dodox/dppo
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20 Commits 1 Branch 0 Tags
e1ef4ca1cfbff85e5ae6c49f5e57debd70174616
Commit Graph
2 Commits
Author SHA1 Message Date
Allen Z. Ren e1ef4ca1cf More frequent EMA update (#20) 
* move ema update within pretraining epoch

* update pretraining ema configs

* add lift and can epoch 8000 checkpoint url

* add note about EMA issue in pretraining instruction
 2024-11-06 20:42:31 -05:00
allenzren 8293b0936b release 2024-09-03 21:03:27 -04:00