Commit Graph

Select branches

Hide Pull Requests

master

Mono Color

• ecf0b72e88 Port soem fixes / additions learned from implementign itpal_jax master dodox 2025-01-22 14:03:23 +01:00
• 3816adef9a streamline tests, mitigate broken env binding dodox 2025-01-22 13:46:16 +01:00
• 04be117a95 Various fixes dodox 2025-01-22 13:46:00 +01:00
• fe7c7b3db0 better handling of missing cpp_projection dodox 2025-01-22 13:45:34 +01:00
• 90666a695c add .vscode to gitignore dodox 2025-01-22 13:45:05 +01:00
• c1189351cf ensure compat version of gymnasium dodox 2025-01-22 13:44:43 +01:00
• e938018494 trl spec for .reset dodox 2024-11-07 11:41:01 +01:00
• 4f8fc500b7 Simplify operations on spaces (is_discrete, shape) dodox 2024-11-07 11:40:32 +01:00
• 5c44448e53 Use trl space definitions (not gym) dodox 2024-11-07 11:39:45 +01:00
• 8a078fb59e Fix: Issue with env wrapping (ensure batch dim) dodox 2024-11-07 11:39:09 +01:00
• 52b3f3b71e Updated README dodox 2024-11-07 11:38:34 +01:00
• df1ba6fe53 Updated README dodox 2024-10-21 15:25:01 +02:00
• 8eb9b384c7 Pytest as optional dep dodox 2024-10-21 15:24:45 +02:00
• abc8dcbda1 Expand Tests dodox 2024-10-21 15:24:36 +02:00
• e927afcc30 Extend policy impl dodox 2024-10-21 15:24:20 +02:00
• ca1ee980ef Fix: Bug in loss calc for TRPLLoss dodox 2024-10-21 15:23:57 +02:00
• 0c6e58634f Rework algo impls dodox 2024-10-21 15:23:39 +02:00
• 651ef1522f Fixing issues with projections dodox 2024-10-21 15:23:17 +02:00
• 71cb8593d9 Fix: Tried to reference gym space classes even if no gym avaible dodox 2024-08-30 08:05:41 +02:00
• 906240e145 Fix README typo dodox 2024-08-28 12:15:51 +02:00
• af444d85e7 Updated README dodox 2024-08-28 12:15:20 +02:00
• e6d78083aa Fix trpl test using wrong hps dodox 2024-08-28 11:58:58 +02:00
• 54bab221ef Disable vlearn for now... dodox 2024-08-28 11:55:43 +02:00
• 1a02568f3c Rename frob_projection file dodox 2024-08-28 11:55:30 +02:00
• 0464fbabe8 Disable vlearn test for now dodox 2024-08-28 11:55:04 +02:00
• f7d171399f Updated pyproject.toml dodox 2024-08-28 11:46:31 +02:00
• ebff2551cd projections_legacy no longer requierd dodox 2024-08-28 11:34:26 +02:00
• 9c55b6a110 remove old vleasrn objective impl dodox 2024-08-28 11:33:30 +02:00
• 4f58ce0ff2 refactor algo impls dodox 2024-08-28 11:33:20 +02:00
• dd98af9f77 Refactor objective losses dodox 2024-08-28 11:32:51 +02:00
• 25988bab54 Added tmp (untested) vlearn objective impl dodox 2024-08-28 11:32:22 +02:00
• cb48badcff Adapt init dodox 2024-08-28 11:32:07 +02:00
• 5fc4b30ea8 New projection impls dodox 2024-08-28 11:31:42 +02:00
• d29417187f Implemenetd new test suite dodox 2024-08-28 11:30:37 +02:00
• 416c2036a5 vlearn loss draft dodox 2024-07-17 14:53:11 +02:00
• e106d8701f Vlearn draft dodox 2024-07-17 14:52:35 +02:00
• 5f279beccf New proj implementations dodox 2024-07-17 14:51:59 +02:00
• 4240f611ac Updated TODO dodox 2024-06-02 16:37:15 +02:00
• 8d5d44e992 Refactor out some func into general Algo class dodox 2024-06-02 16:36:59 +02:00
• 5f186af9fb Fix class name for TRPL dodox 2024-06-02 16:25:18 +02:00
• 6cb320f432 TODO and WIP warning for README dodox 2024-06-02 16:18:11 +02:00
• 7861821d0d Worked on TRPL module dodox 2024-06-02 14:14:12 +02:00
• 65c6a950aa Use loggers correclty dodox 2024-06-02 14:13:36 +02:00
• 4091df45f5 Implement rudimentary TerminalLogger dodox 2024-06-02 14:12:41 +02:00
• c7f5fcbf0f I hate debugging tensordict weirdness dodox 2024-06-02 13:56:54 +02:00
• a867a74138 Reorder... dodox 2024-06-02 12:09:26 +02:00
• d51bf948d4 Make sure we work without original gym installed dodox 2024-06-02 12:08:48 +02:00
• b4f89c9b7a Added TODO fro module docs dodox 2024-06-02 12:00:19 +02:00
• dd6c6b6165 Why was that h3? dodox 2024-06-02 11:59:26 +02:00
• 78d79cf705 Initial code fro projections dodox 2024-06-02 11:57:19 +02:00
• add8e92b4a Add norms dodox 2024-06-02 11:52:20 +02:00
• c6a12aa27b Started TRPL impl dodox 2024-06-02 11:49:09 +02:00
• 3931f5e31b Started implementation of TRPL loss objective module dodox 2024-06-02 11:48:51 +02:00
• b34224f189 refactor dir structure dodox 2024-06-02 11:13:04 +02:00
• 8a013a4746 Expanded .gitignore dodox 2024-06-02 11:11:35 +02:00
• 0a95ea652a Support for torchrl envs dodox 2024-06-02 11:11:06 +02:00
• 50733bb1a4 Make use of new utils to work with any space dodox 2024-06-02 11:07:57 +02:00
• 59060c7533 refactor dodox 2024-06-02 11:07:46 +02:00
• a3cca71ac9 Add utils to handle all known space types dodox 2024-06-02 11:06:55 +02:00
• 5a6069daf4 Showcase TRPL in README dodox 2024-05-31 18:25:42 +02:00
• 1086c9f6fd Remove all etsts for now (interface changed) dodox 2024-05-31 18:25:17 +02:00
• 015f1e256a Refactor dodox 2024-05-31 18:25:03 +02:00
• 0bf748869a Switch to pyproject.toml dodox 2024-05-31 18:24:47 +02:00
• bd507c37c3 native support for fancy_gym dodox 2024-05-31 13:11:09 +02:00
• 2e7859f068 Fixed README dodox 2024-05-31 13:06:50 +02:00
• 360d2569f0 Updated README dodox 2024-05-31 13:05:11 +02:00
• 0808655136 Update example.py to new func dodox 2024-05-31 13:04:56 +02:00
• 1d8d217ec0 Refactor env handling dodox 2024-05-31 13:04:41 +02:00
• 1d1d9060f9 Switch to using torchrl loggers dodox 2024-05-31 13:04:13 +02:00
• 7ea0bdcec6 Remove utils.py dodox 2024-05-31 13:04:02 +02:00
• dc70d045ab Updated README dodox 2024-05-30 22:26:36 +02:00
• 3082d1bed5 Icon? dodox 2024-05-29 21:41:36 +02:00
• 8946362336 Oh, I could start using git... dodox 2024-05-29 21:21:43 +02:00