dodox/metastable-baselines
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Fixed bug with logging of std for full-cov

Browse Source
This commit is contained in:
Dominik Moritz Roth 2022-07-16 14:58:00 +02:00
parent cb9ee4f302
commit 4854346f2d
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
metastable_baselines/ppo/ppo.py
View File

@ -366,7 +366,7 @@ class PPO(GaussianRolloutCollectorAuxclass, OnPolicyAlgorithm):
"train/std", th.mean(self.policy.chol).mean().item())
else:
self.logger.record(
"train/std", th.mean(th.diagonal(self.policy.chol, dim1=-2, dim2=-1)).mean().item())
"train/std", th.mean(th.sqrt(th.diagonal(self.policy.chol.T @ self.policy.chol, dim1=-2, dim2=-1))).mean().item())
self.logger.record("train/n_updates",
self._n_updates, exclude="tensorboard")