Commit Graph

Select branches

Hide Pull Requests

master

Mono Color

• 9cd25ee484 Support passing trajectories into predictiion functions (for pca) master Dominik Roth 2023-05-21 20:16:25 +0200
• d4003e1a68 get_past_trajectories will now return a th.Tensor Dominik Roth 2023-05-21 17:29:03 +0200
• ea7634ca42 Revert "typo: trajectory -> traj" Dominik Roth 2023-05-21 17:26:13 +0200
• becb8d36e1 typo: trajectory -> traj Dominik Roth 2023-05-21 17:22:59 +0200
• 69fdd7b103 Fix Bug: Let's let thge pca-lib handle this exception Dominik Roth 2023-05-21 17:19:39 +0200
• c473990fbd Fix smol Bug Dominik Roth 2023-05-21 17:15:46 +0200
• 834b5c9a65 Fixed Bug: Can not get past trajectory from rolloutBuffer Dominik Roth 2023-05-21 17:11:32 +0200
• 6a9d7012c7 Bugs Dominik Roth 2023-05-21 17:03:22 +0200
• 43418a5e53 Tiny Bugfix Dominik Roth 2023-05-21 16:40:13 +0200
• a1df15f7bc Fixed PCA bug Dominik Roth 2023-05-21 16:32:27 +0200
• ea4b9851d8 Fixed: Binding to PCA used old package name Dominik Roth 2023-05-21 16:23:51 +0200
• 8921421732 Fixed Typo Dominik Roth 2023-05-21 16:14:34 +0200
• 2efa6c18fb Experimental Support for PCA Dominik Roth 2023-05-21 14:27:09 +0200
• 76ea3a6326 Implemented prior conditioned annealing (untested) Dominik Roth 2023-04-25 17:05:34 +0200
• 09159774d9 Fix backward pass error for hybrid-method Dominik Roth 2023-03-13 20:44:09 +0100
• 75feefbe5a Fix: Typos for sde/rex hybrid Dominik Roth 2023-02-18 12:42:07 +0100
• c62723bef6 First implementation of hybrid (bewteen sde and rex) Dominik Roth 2023-02-18 12:18:46 +0100
• ae9a95cbfc Fix: Typo in SAC Dominik Roth 2023-02-02 20:00:16 +0100
• 71670782b6 . Dominik Roth 2023-01-28 21:47:19 +0100
• b86498fa9a Now softmax sde latent is actually working... Dominik Roth 2023-01-28 19:48:43 +0100
• e985d892ca New SDE feature: softmax activation of latent Dominik Roth 2023-01-28 19:42:32 +0100
• ffbf2b3fe5 Allow reduced latent sde dim Dominik Roth 2023-01-27 13:34:28 +0100
• f421dc2ab5 Removed hack again... Dominik Roth 2023-01-26 18:18:38 +0100
• f86c6c736f Hack is back Dominik Roth 2023-01-26 18:15:06 +0100
• 20646f07f3 Reverting last two commits (was ugly hack) Dominik Roth 2023-01-26 17:43:57 +0100
• 6f1837bda5 calc episodic infos for some fancy envs Dominik Roth 2023-01-26 17:27:34 +0100
• f37c8caaa4 Force include reward in env infos (for vec env) Dominik Roth 2023-01-26 12:00:18 +0100
• 43cc749809 Fix Noise Reset Bug for SAC Dominik Roth 2023-01-15 13:28:40 +0100
• 844cdb1319 Fixed: Upgrade changing interfaces Dominik Roth 2023-01-06 18:46:38 +0100
• f3e03916c8 Upgrading to SB3 1.7 (probably broke some stuff...) Dominik Roth 2022-12-13 19:14:28 +0100
• c47d5741ca New Version of SB3 Dominik Roth 2022-12-13 18:38:33 +0100
• 9cb7e89b1d MIT License Dominik Roth 2022-11-13 20:07:08 +0100
• 4ec5c65cf2 Tiny fix for other envs Dominik Roth 2022-11-07 13:23:55 +0100
• 302dbf6dde Pruning of README 2nd try Dominik Roth 2022-11-07 12:59:12 +0100
• c5ed794325 Updated requirements Dominik Roth 2022-11-07 12:55:15 +0100
• d89609e276 Merge branch 'master' of dominik-roth.eu:dodox/metastable-baselines Dominik Roth 2022-11-07 12:46:22 +0100
• 479d73ac4b Hotfix for exploding gradients Dominik Roth 2022-11-03 20:13:36 +0100
• 82a174122a Fixed bugs with givens-rotator for eigen Dominik Roth 2022-10-24 10:08:31 +0200
• e31c25135e Fixed Bug with Givens Rotation (Eigen) Dominik Roth 2022-10-09 11:24:06 +0200
• f9a08add40 Action-Loss for SAC Dominik Roth 2022-10-08 18:33:37 +0200
• 3110275d7b Fixed bug with EIGEN (par_type) Dominik Roth 2022-10-07 11:38:34 +0200
• f37d3215a6 Bug Fix for Full Cov Dominik Roth 2022-09-23 23:06:19 +0200
• 00dbc9bdd8 Error when calculating action_loss Dominik Roth 2022-09-12 22:28:57 +0200
• 2c14edd3b0 Fix: Dependency Dominik Roth 2022-09-03 23:41:06 +0200
• d3fa3cc997 Fixed Givens Dependency Dominik Roth 2022-09-03 23:16:54 +0200
• 6e1a7cecd5 Implemented correct clipping (from original SAC) Dominik Roth 2022-09-03 13:46:17 +0200
• ee4a0eed56 Fixed SAC+SDE+SDC bugs Dominik Roth 2022-09-03 13:08:31 +0200
• 4532135812 Finalized factoring out projections Dominik Roth 2022-09-03 11:59:16 +0200
• 0aeea4e2e5 Fixed Bug: Wrong dimensions for action_loss Dominik Roth 2022-09-03 11:44:01 +0200
• 4bb772a251 Factor Projections out into metastable-projections Dominik Roth 2022-09-03 11:37:41 +0200
• 0a037deccc Implemented cov parametrization via eigen-decomp Dominik Roth 2022-09-03 11:16:41 +0200
• e4a8cfc349 Implemented action_loss Dominik Roth 2022-09-03 11:16:29 +0200
• 2f05474091 Fixed a bug with KL-proj Dominik Roth 2022-08-28 20:48:02 +0200
• 4080ad8135 Removed old TODOs Dominik Roth 2022-08-28 12:07:19 +0200
• eb881559d6 Support clip_range None Dominik Roth 2022-08-28 02:07:18 +0200
• 1d3c2fe005 Allow completely disabling some PPO features (for TRPL) Dominik Roth 2022-08-28 00:26:44 +0200
• afec4e709c Fixed bug in RolloutBuffer when using parallel envs Dominik Roth 2022-08-27 16:02:40 +0200
• 02e4ed1510 Added support for parallel envs Dominik Roth 2022-08-27 15:19:00 +0200
• 5c39be5ead Testing Observables Dominik Roth 2022-08-22 15:05:42 +0200
• c6a58b15dd Fixing SDE bug Dominik Roth 2022-08-22 14:19:40 +0200
• 197de7997c Fixed bug with SDE Dominik Roth 2022-08-22 13:36:17 +0200
• a9e3f295b2 Fixed numerical issues with Wasserstein Dominik Roth 2022-08-17 23:25:24 +0200
• 9fffe048af Fixed Spherical_Chol not accepting batches Dominik Roth 2022-08-17 22:55:42 +0200
• 86e6bfb65b Higher epsilon to deal with numerical instabilities Dominik Roth 2022-08-17 19:31:54 +0200
• 64a7d5ec59 Guarante minimum epsilon when ensuring non-zero (CholNet) Dominik Roth 2022-08-16 20:02:33 +0200
• d35c3d8520 Fixed all the bugs in TRPL Dominik Roth 2022-08-15 16:55:17 +0200
• 28d0c609bc Fixed SDE: sampling had dimension mismatches Dominik Roth 2022-08-14 20:09:10 +0200
• e1c59cffd0 Removed debug-print Dominik Roth 2022-08-14 18:45:17 +0200
• 639aae7f42 Testing SDE... Dominik Roth 2022-08-14 18:42:45 +0200
• bb1f9ecf2b Fixed UniversalGaussianDistribution lost SDE when cloning Dominik Roth 2022-08-14 18:42:19 +0200
• 0ee65e789b Fixing sde's bugs Dominik Roth 2022-08-14 16:10:22 +0200
• 0e4eedae5e Fixed gradient throught spherical-chol Dominik Roth 2022-08-10 11:55:08 +0200
• 520dc98eb5 Implemented SDE Dominik Roth 2022-08-10 11:54:52 +0200
• 12e422aec7 Why does KL double free? Dominik Roth 2022-08-07 18:04:40 +0200
• 75d73049b4 Fixing bugs with w2 and sqrt_induced_gaussian Dominik Roth 2022-08-06 21:25:49 +0200
• 802094a50f Enabled w2 (can now get sqrt from dist) Dominik Roth 2022-08-06 14:54:59 +0200
• 508ebf51f0 Implemented sqrt-induced-gaussian for W2-Projection Dominik Roth 2022-08-06 14:46:42 +0200
• fcd9953b37 Testing... Dominik Roth 2022-08-06 14:37:30 +0200
• 54113fd40c Removed unused dependency Dominik Roth 2022-08-06 14:37:06 +0200
• 2c1689fbbc Fixed smol bugs when instanciating based on string-names of enums Dominik Roth 2022-08-06 14:36:35 +0200
• e074294b88 +1 Dominik Roth 2022-08-05 21:07:38 +0200
• 8b82347056 Automatic casting to enums Dominik Roth 2022-08-05 21:06:31 +0200
• 683644f77d Removed weird line... Dominik Roth 2022-08-05 21:06:05 +0200
• a78e81b9e1 Allowing prob squashing Dominik Roth 2022-07-21 09:42:25 +0200
• 199ce0c8cb ProbSquashing implemented (tanh) Dominik Roth 2022-07-20 10:32:19 +0200
• 05dad44b6e Support SAC for testing Dominik Roth 2022-07-19 10:08:47 +0200
• 6384d411a9 Support SAC in replays Dominik Roth 2022-07-19 10:08:34 +0200
• 0162a36824 Renamed TRL_SAC => SAC Dominik Roth 2022-07-19 10:08:14 +0200
• 7b667e9650 SAC is back; with SDC; without Projections Dominik Roth 2022-07-19 10:07:50 +0200
• 5f32435751 Smashing bugs: dont confuse chol with chol_net Dominik Roth 2022-07-19 10:07:20 +0200
• b7de99b1fc EnforcePositiveType makes no sense for Strength.NONE Dominik Roth 2022-07-19 10:06:40 +0200
• 9133ecd61b Show confidence-ellipsoid for supported envs Dominik Roth 2022-07-17 00:48:17 +0200
• 49f9acff3e Fixed: Wrong simplification for Hybrid[SCALAR=>FULL] Dominik Roth 2022-07-17 00:47:47 +0200
• 046fa78206 Fixed: _chol_from_sphe_chol was unable to handle batches Dominik Roth 2022-07-16 17:34:25 +0200
• c141599662 Fixed Bug: _chol_from_sphe_chol dependet on action_dim, not able to use for Hybrid methods Dominik Roth 2022-07-16 15:47:09 +0200
• 3fa6de7e66 Broader sampling of stds for logging with batched full covs Dominik Roth 2022-07-16 15:28:16 +0200
• bc0e188a0d Removed debugging-code Dominik Roth 2022-07-16 15:19:56 +0200
• d2d84d3287 Fixed bug for logging std-estimates when using batched data Dominik Roth 2022-07-16 15:18:24 +0200
• 4a24381f46 Fixed bug when using batches with SPHERICAL_CHOL Dominik Roth 2022-07-16 15:17:48 +0200
• 04529e8261 Removed debug-point Dominik Roth 2022-07-16 14:58:29 +0200