dodox/FastTD3
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9 Commits 1 Branch 0 Tags
85cb1c65c7d079f8319c7cf5c4612e0b87909c1b
Commit Graph
4 Commits
Author SHA1 Message Date
Younggyo Seo 85cb1c65c7 Fix replay buffer issues when n_steps > 1 (#7) 
- Fix an issue where the n-step reward is not properly computed for end-of-episode transitions when using n_step > 1.
- Fix an issue where the observation and next_observations are sampled across different episodes when using n_step > 1 and the buffer is full
- Fix an issue where the discount is not properly computed when n_step > 1
 2025-06-07 01:20:48 -04:00
Younggyo Seo c156ba93fb black formatting and update tuned_reward for T1 2025-05-29 08:29:44 +00:00
Younggyo Seo 5725eba3b8 memory optimization for playground 2025-05-29 06:58:28 +00:00
Younggyo Seo 258bfe67dd Initial Public Release 2025-05-29 01:49:23 +00:00