dodox/metastable-baselines
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
88 Commits 1 Branch 0 Tags
92204c448fe45b13b7525a6dd1046600754617ee
Commit Graph
88 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
dodox 92204c448f Testing kl-projection (it's working!) 2022-07-02 16:41:25 +02:00
dodox ad7ed0071b Silence! 2022-07-01 20:02:29 +02:00
dodox 91f64c10d7 Fixed bug with initialization of buffer 2022-07-01 20:02:09 +02:00
dodox 0dc9edf112 We no longer use venv (breaks cpp_projection...) 2022-07-01 19:52:22 +02:00
dodox 14100cccc8 Working on SDC-impl. 2022-07-01 15:14:41 +02:00
dodox 4f2e75b7ae Slimmed 3rd-party-licenses 2022-07-01 14:03:50 +02:00
dodox 90b3c68a56 Maybe better licensing 2022-07-01 13:59:07 +02:00
dodox cc51547681 Fixed CppProjection in requirements 2022-07-01 13:47:04 +02:00
dodox 84d1cda96c Trying to get kl to work 2022-07-01 13:45:58 +02:00
dodox 9d7ce73a0b README: We also have to install cpp_projection 2022-07-01 12:30:29 +02:00
dodox 111b1b846d Now we even include a setup.py 2022-07-01 12:22:27 +02:00
dodox 81ae3e3707 Finalized venv support and added installation-instructions 2022-07-01 12:19:57 +02:00
dodox f25d7a103b Now ready to pvenv 2022-07-01 12:03:20 +02:00
dodox 2626ec82a6 Added code-src-note 2022-07-01 11:52:50 +02:00
dodox ab1b269af9 Allow checking whether a dist is contextual 2022-07-01 11:52:14 +02:00
dodox a8b9c63965 Making dez covariances contextual 2022-07-01 11:29:12 +02:00
dodox 155a298e41 Switching to new icon 2022-06-30 21:02:22 +02:00
dodox 7e7ba65e51 Testing alternative icon 2022-06-30 21:01:25 +02:00
dodox 2e378d0a7d Rebranding to Metastable Baselines 2022-06-30 20:40:30 +02:00
dodox 30c9e93967 Fixed replay 2022-06-29 17:02:40 +02:00
dodox 28561b9bb2 Allow manual early stopping of training (Ctrl+C) 2022-06-29 12:46:57 +02:00
dodox e8d423f91f Testing the new WassersteinProjectionLayer 2022-06-29 12:46:37 +02:00
dodox 4e77190d8e Fixed chol not expanding bug and function to shrink chol to diag 2022-06-29 12:44:13 +02:00
dodox 7c117cfca5 Added possibility to load models and run hem again (currently bugged) 2022-06-29 12:43:21 +02:00
dodox 416dde202d Factored out frob_sq and perf improvement for spd input 2022-06-27 13:44:08 +02:00
dodox f4c87c9cdc Better handling of diagonal-covariance as vector and matrix 2022-06-26 18:14:12 +02:00
dodox bc61a6db32 Refactored some stuff out 2022-06-26 16:39:37 +02:00
dodox edf00553dd Renamed our RolloutBuffer and testing the FrobeniusProjectionLayer 2022-06-26 16:39:06 +02:00
dodox 024a9a0265 StillTesting 2022-06-26 16:38:46 +02:00
dodox 80741776d2 Removed old comments 2022-06-25 21:56:07 +02:00
dodox b8488c531b Implemented TRLRolloutBuffer 2022-06-25 21:47:39 +02:00
dodox 60c954c8c1 LunarLanderContinuous-v2 is our new default test-env 2022-06-25 21:47:21 +02:00
dodox cf5a2e82fc mean and std are now saved to the rollout 2022-06-25 18:29:55 +02:00
dodox df21e1dc3f Fixed reference to gym.spaces 2022-06-25 17:49:46 +02:00
dodox 5f7cfd2e10 Note about Code-Src 2022-06-25 15:37:45 +02:00
dodox b9f66dd95d Using BaseProjectionLayer as Default 2022-06-25 15:33:43 +02:00
dodox cafc90409f _global_steps ctr added 2022-06-25 15:05:54 +02:00
dodox 866f863d70 overriding collect_rollouts 2022-06-25 14:57:27 +02:00
dodox 1a49a412c0 expanding automatic testing 2022-06-25 14:50:19 +02:00
dodox 25316ec0b8 Incremental progress at implementing trl_pg 2022-06-25 13:58:58 +02:00
dodox 941b7347f1 Get FPS from env 2022-06-22 13:12:55 +02:00
dodox 0e17b4c07e Fixed model storage location bug 2022-06-22 13:00:40 +02:00
dodox 41d4e94dbe Extended .gitignore 2022-06-22 13:00:28 +02:00
dodox 84b3710850 Testing SACs ability to solve EasierObstacles-v0 2022-06-21 15:15:38 +02:00
dodox 13d335f856 models added to .gitignore 2022-06-21 15:15:22 +02:00
dodox e71735bf79 Trying to converge on simple columbus envs 2022-06-20 23:12:42 +02:00
dodox b9303416ac Split PPO_SDE into PPO_BASE_SDE and PPO_LATENT_SDE 2022-06-19 22:47:04 +02:00
dodox c0a5b6650d Added model*.py to .gitignore 2022-06-19 20:34:33 +02:00
dodox 477a3c48b1 Testing the RayObserver 2022-06-19 20:34:04 +02:00
dodox 605a81c81c No longer needing update_subtrees.sh 2022-06-19 16:30:46 +02:00
dodox 7b8f2e7109 I dont like subtrees 2022-06-19 16:30:32 +02:00
dodox 12e9e09add Updating Columbus - Merge commit '132176985464f6ba2e8f7c88794215644f7f9066' 2022-06-19 16:15:58 +02:00
dodox 1321769854 Squashed 'subtrees/columbus/' changes from 489a098..6ebd95e 
6ebd95e Trying to get remote imports to work

git-subtree-dir: subtrees/columbus
git-subtree-split: 6ebd95e74f0a22ba6fbd8d0386d6e625a736926a
 2022-06-19 16:15:58 +02:00
dodox 26ba8c64c7 Update Columbus - Merge commit 'a49eae378dc65a73e101cd094703ebd80534de77' 2022-06-19 16:07:12 +02:00
dodox a49eae378d Squashed 'subtrees/columbus/' changes from abad4bd..489a098 
489a098 smol bug shmashes

git-subtree-dir: subtrees/columbus
git-subtree-split: 489a0988e7d373da8751f484b9e387b8750ed81a
 2022-06-19 16:07:12 +02:00
dodox e2724734cf Updating Columbus - Merge commit 'de5f6e2f810d08b043ea02cdaf59d380fe23288c' 2022-06-19 16:00:13 +02:00
dodox de5f6e2f81 Squashed 'subtrees/columbus/' changes from 57d8068..abad4bd 
abad4bd Added Env 'ColumbusTest3_1'

git-subtree-dir: subtrees/columbus
git-subtree-split: abad4bd6f17aa3e06649639bc338f5d456f03a0f
 2022-06-19 16:00:13 +02:00
dodox c45e3627ea Trying to get ColumbusEnv to work... 2022-06-19 15:59:55 +02:00
dodox c8ec2f71e8 Squashed 'subtrees/columbus/' changes from 279b4d9..57d8068 
57d8068 Fixed imports when imported as external lib

git-subtree-dir: subtrees/columbus
git-subtree-split: 57d8068da755adc6445010e2f86b3d8d80964651
 2022-06-19 15:54:40 +02:00
dodox f950d1fe64 Update Columbus - Merge commit 'c8ec2f71e88386bc822797dbe97af04d8ad4bb8d' 2022-06-19 15:54:40 +02:00
dodox 0095403200 Squashed 'subtrees/columbus/' changes from daf8ec2..279b4d9 
279b4d9 Added a __init__.py

git-subtree-dir: subtrees/columbus
git-subtree-split: 279b4d9f239941a44db68eb171a96610e686c7dc
 2022-06-19 15:52:56 +02:00
dodox 9707ed0149 Update Columbus - Merge commit '00954032000c2229edfd645d4131b27e716da2f9' 2022-06-19 15:52:56 +02:00
dodox 46f742c1ee Squashed 'subtrees/columbus/' changes from 12cac4d..daf8ec2 
daf8ec2 Making strating_pos configurable

git-subtree-dir: subtrees/columbus
git-subtree-split: daf8ec2c4dc75dac8c9a005d882ef681b02df19f
 2022-06-19 15:51:55 +02:00
dodox 9ca6ad9afc Update Columbus - Merge commit '46f742c1ee05a7a81685a330fc5fd0777f281563' 2022-06-19 15:51:55 +02:00
dodox 04d74e3d6a Made update_subtrees.sh executable 2022-06-19 15:51:43 +02:00
dodox 0721aa2a85 Added update_subtrees.sh to automate updating dependencies 2022-06-19 15:51:09 +02:00
dodox fcc33d7bdc Work on Columbus integration 2022-06-19 15:50:54 +02:00
dodox fd6edb02f7 Squashed 'subtrees/columbus/' content from commit 12cac4d 
git-subtree-dir: subtrees/columbus
git-subtree-split: 12cac4db9912238e4daf6fb259666a362329c6a8
 2022-06-19 15:46:03 +02:00
dodox 1a21bb9ad4 Merge commit 'fd6edb02f716fa7d40468101797de231adc20c00' as 'subtrees/columbus' 2022-06-19 15:46:03 +02:00
dodox 50c83db6e5 No pyc-files 2022-06-17 15:59:43 +02:00
dodox 6789a41730 Merge branch 'master' of dominik.roth.ml:dodox/sb3_trl 2022-06-17 15:58:53 +02:00
dodox bb160d2837 changed locations / names for logs 2022-06-17 13:16:32 +02:00
dodox dd5e3e94b7 changed locations / names for logs 2022-06-17 13:16:32 +02:00
dodox 2190d68826 pyc in .gitignore 2022-06-17 12:27:39 +02:00
dodox d8d67468a7 pyc in .gitignore 2022-06-17 12:27:39 +02:00
dodox e363021ed3 Removed old files (moved into sb3_trl/) 2022-06-17 11:31:25 +02:00
dodox c90805fdff Removed old files (moved into sb3_trl/) 2022-06-17 11:31:25 +02:00
dodox 9199536166 Fixed typo in .gitignore 2022-06-17 11:31:06 +02:00
dodox ad5e5756c5 Fixed typo in .gitignore 2022-06-17 11:31:06 +02:00
dodox d9d8e5ea2d Added a .gitignore 2022-06-17 11:30:32 +02:00
dodox 6658ef45e7 Added a .gitignore 2022-06-17 11:30:32 +02:00
dodox d74477e6c2 Added test.py for testing the algos (and tensorboard integration) 2022-06-17 11:29:36 +02:00
dodox 2b725ec58b Added test.py for testing the algos (and tensorboard integration) 2022-06-17 11:29:36 +02:00
dodox f93266c8bd Moved py-files to into subfolder 2022-06-17 11:29:06 +02:00
dodox b3b9bf1a9d Moved py-files to into subfolder 2022-06-17 11:29:06 +02:00
dodox 9d2f8cadc0 projections_orig is stolen from Fabian fro reference; projections is 
begginning of own implementation
 2022-06-16 10:59:26 +02:00
dodox 9a99962176 Split PG/SAC code 2022-06-16 10:30:35 +02:00
dodox 63f755b4e0 initial commit 2022-06-15 18:02:25 +02:00