Commit Graph

Select branches

Hide Pull Requests

master

Mono Color

• 4854346f2d Fixed bug with logging of std for full-cov Dominik Roth 2022-07-16 14:58:00 +0200
• cb9ee4f302 Fixed bugs for Hybrid[Diag=>Full] Dominik Roth 2022-07-16 14:57:34 +0200
• ad584d70fd Removed debugging prints Dominik Roth 2022-07-16 13:07:08 +0200
• 72754525cd Allow using newly implemented hybrid method Dominik Roth 2022-07-16 13:06:07 +0200
• fa167b3e5f Hybrid Diag -> Full Implemented; Made spherical_chol more efficient Dominik Roth 2022-07-16 13:05:35 +0200
• f184b88f19 Allow std logging for full and diagonal cov policies Dominik Roth 2022-07-15 18:46:42 +0200
• 74697e8773 Smol bug fixes Dominik Roth 2022-07-15 18:46:17 +0200
• 2e0f46b0f3 Fixing ser/deser bug (cloudpickle cant handle some enums) Dominik Roth 2022-07-15 18:45:38 +0200
• a86d19053d Smashing bugs (dimension mismatch between Normal and Independent/MultivariateNormal) Dominik Roth 2022-07-15 15:46:31 +0200
• ab557a8856 Making MultivariateNormal Policies work (and porting Normal to Independent) Dominik Roth 2022-07-15 15:03:51 +0200
• b1ed9fc2b8 Renamed TRL_PG to PPO Dominik Roth 2022-07-13 19:51:33 +0200
• 1706bea571 Testing SDC Dominik Roth 2022-07-13 19:39:09 +0200
• 3304fd49f6 Working on UniversalGaussianDistribution Dominik Roth 2022-07-13 19:38:57 +0200
• fae19509bc Implemented Policies with Contextual Covariance Dominik Roth 2022-07-13 19:38:20 +0200
• 41e4170b2f Fixes + spherical_chol Dominik Roth 2022-07-11 17:28:08 +0200
• e4440428f8 Working on SDC Dominik Roth 2022-07-11 11:55:23 +0200
• 4c4b12ee0e Allow cloning UniversalGaussianDistribution (new_dist_like) Dominik Roth 2022-07-09 14:45:35 +0200
• c08ea1cb91 Making UniversalGaussianDistribution ready for tanh-squashing-support Dominik Roth 2022-07-09 14:33:07 +0200
• 249754ee89 Wrote a little helper-function to generate all allowed combinations of cov-parameterizations Dominik Roth 2022-07-09 14:03:56 +0200
• e09950b30c Work on Contextual Covariances Dominik Roth 2022-07-09 12:26:39 +0200
• aacacebfc4 Fixed license Dominik Roth 2022-07-06 13:26:33 +0200
• 0911a04e98 Factored out Gaussian Collection for RolloutBuffer Dominik Roth 2022-07-04 21:21:16 +0200
• 1f3eac5398 Cleanup Dominik Roth 2022-07-02 16:42:14 +0200
• 92204c448f Testing kl-projection (it's working!) Dominik Roth 2022-07-02 16:41:25 +0200
• ad7ed0071b Silence! Dominik Roth 2022-07-01 20:02:29 +0200
• 91f64c10d7 Fixed bug with initialization of buffer Dominik Roth 2022-07-01 20:02:09 +0200
• 0dc9edf112 We no longer use venv (breaks cpp_projection...) Dominik Roth 2022-07-01 19:52:22 +0200
• 14100cccc8 Working on SDC-impl. Dominik Roth 2022-07-01 15:14:41 +0200
• 4f2e75b7ae Slimmed 3rd-party-licenses Dominik Roth 2022-07-01 14:03:50 +0200
• 90b3c68a56 Maybe better licensing Dominik Roth 2022-07-01 13:59:07 +0200
• cc51547681 Fixed CppProjection in requirements Dominik Roth 2022-07-01 13:47:04 +0200
• 84d1cda96c Trying to get kl to work Dominik Roth 2022-07-01 13:45:58 +0200
• 9d7ce73a0b README: We also have to install cpp_projection Dominik Roth 2022-07-01 12:30:29 +0200
• 111b1b846d Now we even include a setup.py Dominik Roth 2022-07-01 12:22:27 +0200
• 81ae3e3707 Finalized venv support and added installation-instructions Dominik Roth 2022-07-01 12:19:57 +0200
• f25d7a103b Now ready to pvenv Dominik Roth 2022-07-01 12:03:20 +0200
• 2626ec82a6 Added code-src-note Dominik Roth 2022-07-01 11:52:50 +0200
• ab1b269af9 Allow checking whether a dist is contextual Dominik Roth 2022-07-01 11:52:14 +0200
• a8b9c63965 Making dez covariances contextual Dominik Roth 2022-07-01 11:29:12 +0200
• 155a298e41 Switching to new icon Dominik Roth 2022-06-30 21:02:22 +0200
• 7e7ba65e51 Testing alternative icon Dominik Roth 2022-06-30 21:01:25 +0200
• 2e378d0a7d Rebranding to Metastable Baselines Dominik Roth 2022-06-30 20:40:30 +0200
• 30c9e93967 Fixed replay Dominik Roth 2022-06-29 17:02:40 +0200
• 28561b9bb2 Allow manual early stopping of training (Ctrl+C) Dominik Roth 2022-06-29 12:46:57 +0200
• e8d423f91f Testing the new WassersteinProjectionLayer Dominik Roth 2022-06-29 12:46:37 +0200
• 4e77190d8e Fixed chol not expanding bug and function to shrink chol to diag Dominik Roth 2022-06-29 12:44:13 +0200
• 7c117cfca5 Added possibility to load models and run hem again (currently bugged) Dominik Roth 2022-06-29 12:43:21 +0200
• 416dde202d Factored out frob_sq and perf improvement for spd input Dominik Roth 2022-06-27 13:44:08 +0200
• f4c87c9cdc Better handling of diagonal-covariance as vector and matrix Dominik Roth 2022-06-26 18:14:12 +0200
• bc61a6db32 Refactored some stuff out Dominik Roth 2022-06-26 16:39:37 +0200
• edf00553dd Renamed our RolloutBuffer and testing the FrobeniusProjectionLayer Dominik Roth 2022-06-26 16:39:06 +0200
• 024a9a0265 StillTesting Dominik Roth 2022-06-26 16:38:46 +0200
• 80741776d2 Removed old comments Dominik Roth 2022-06-25 21:56:07 +0200
• b8488c531b Implemented TRLRolloutBuffer Dominik Roth 2022-06-25 21:47:39 +0200
• 60c954c8c1 LunarLanderContinuous-v2 is our new default test-env Dominik Roth 2022-06-25 21:47:21 +0200
• cf5a2e82fc mean and std are now saved to the rollout Dominik Roth 2022-06-25 18:29:55 +0200
• df21e1dc3f Fixed reference to gym.spaces Dominik Roth 2022-06-25 17:49:46 +0200
• 5f7cfd2e10 Note about Code-Src Dominik Roth 2022-06-25 15:37:45 +0200
• b9f66dd95d Using BaseProjectionLayer as Default Dominik Roth 2022-06-25 15:33:43 +0200
• cafc90409f _global_steps ctr added Dominik Roth 2022-06-25 15:05:54 +0200
• 866f863d70 overriding collect_rollouts Dominik Roth 2022-06-25 14:57:27 +0200
• 1a49a412c0 expanding automatic testing Dominik Roth 2022-06-25 14:50:19 +0200
• 25316ec0b8 Incremental progress at implementing trl_pg Dominik Roth 2022-06-25 13:58:58 +0200
• 941b7347f1 Get FPS from env Dominik Roth 2022-06-22 13:12:55 +0200
• 0e17b4c07e Fixed model storage location bug Dominik Roth 2022-06-22 13:00:40 +0200
• 41d4e94dbe Extended .gitignore Dominik Roth 2022-06-22 13:00:28 +0200
• 84b3710850 Testing SACs ability to solve EasierObstacles-v0 Dominik Roth 2022-06-21 15:15:38 +0200
• 13d335f856 models added to .gitignore Dominik Roth 2022-06-21 15:15:22 +0200
• e71735bf79 Trying to converge on simple columbus envs Dominik Roth 2022-06-20 23:12:42 +0200
• b9303416ac Split PPO_SDE into PPO_BASE_SDE and PPO_LATENT_SDE Dominik Roth 2022-06-19 22:47:04 +0200
• c0a5b6650d Added model*.py to .gitignore Dominik Roth 2022-06-19 20:34:33 +0200
• 477a3c48b1 Testing the RayObserver Dominik Roth 2022-06-19 20:34:04 +0200
• 605a81c81c No longer needing update_subtrees.sh Dominik Roth 2022-06-19 16:30:46 +0200
• 7b8f2e7109 I dont like subtrees Dominik Roth 2022-06-19 16:30:32 +0200
• 12e9e09add Updating Columbus - Merge commit '132176985464f6ba2e8f7c88794215644f7f9066' Dominik Roth 2022-06-19 16:15:58 +0200
• 1321769854 Squashed 'subtrees/columbus/' changes from 489a098..6ebd95e Dominik Roth 2022-06-19 16:15:58 +0200
• 26ba8c64c7 Update Columbus - Merge commit 'a49eae378dc65a73e101cd094703ebd80534de77' Dominik Roth 2022-06-19 16:07:12 +0200
• a49eae378d Squashed 'subtrees/columbus/' changes from abad4bd..489a098 Dominik Roth 2022-06-19 16:07:12 +0200
• e2724734cf Updating Columbus - Merge commit 'de5f6e2f810d08b043ea02cdaf59d380fe23288c' Dominik Roth 2022-06-19 16:00:13 +0200
• de5f6e2f81 Squashed 'subtrees/columbus/' changes from 57d8068..abad4bd Dominik Roth 2022-06-19 16:00:13 +0200
• c45e3627ea Trying to get ColumbusEnv to work... Dominik Roth 2022-06-19 15:59:55 +0200
• f950d1fe64 Update Columbus - Merge commit 'c8ec2f71e88386bc822797dbe97af04d8ad4bb8d' Dominik Roth 2022-06-19 15:54:40 +0200
• c8ec2f71e8 Squashed 'subtrees/columbus/' changes from 279b4d9..57d8068 Dominik Roth 2022-06-19 15:54:40 +0200
• 9707ed0149 Update Columbus - Merge commit '00954032000c2229edfd645d4131b27e716da2f9' Dominik Roth 2022-06-19 15:52:56 +0200
• 0095403200 Squashed 'subtrees/columbus/' changes from daf8ec2..279b4d9 Dominik Roth 2022-06-19 15:52:56 +0200
• 9ca6ad9afc Update Columbus - Merge commit '46f742c1ee05a7a81685a330fc5fd0777f281563' Dominik Roth 2022-06-19 15:51:55 +0200
• 46f742c1ee Squashed 'subtrees/columbus/' changes from 12cac4d..daf8ec2 Dominik Roth 2022-06-19 15:51:55 +0200
• 04d74e3d6a Made update_subtrees.sh executable Dominik Roth 2022-06-19 15:51:43 +0200
• 0721aa2a85 Added update_subtrees.sh to automate updating dependencies Dominik Roth 2022-06-19 15:51:09 +0200
• fcc33d7bdc Work on Columbus integration Dominik Roth 2022-06-19 15:50:54 +0200
• 1a21bb9ad4 Merge commit 'fd6edb02f716fa7d40468101797de231adc20c00' as 'subtrees/columbus' Dominik Roth 2022-06-19 15:46:03 +0200
• fd6edb02f7 Squashed 'subtrees/columbus/' content from commit 12cac4d Dominik Roth 2022-06-19 15:46:03 +0200
• 50c83db6e5 No pyc-files Dominik Roth 2022-06-17 15:59:43 +0200
• 6789a41730 Merge branch 'master' of dominik.roth.ml:dodox/sb3_trl Dominik Roth 2022-06-17 15:58:53 +0200
• bb160d2837 changed locations / names for logs Dominik Roth 2022-06-17 13:16:32 +0200
• dd5e3e94b7 changed locations / names for logs Dominik Roth 2022-06-17 13:16:32 +0200
• 2190d68826 pyc in .gitignore Dominik Roth 2022-06-17 12:27:39 +0200
• d8d67468a7 pyc in .gitignore Dominik Roth 2022-06-17 12:27:39 +0200
• e363021ed3 Removed old files (moved into sb3_trl/) Dominik Roth 2022-06-17 11:31:25 +0200
• c90805fdff Removed old files (moved into sb3_trl/) Dominik Roth 2022-06-17 11:31:25 +0200