Allen Z. Ren e1ef4ca1cf More frequent EMA update (#20) ... * move ema update within pretraining epoch * update pretraining ema configs * add lift and can epoch 8000 checkpoint url * add note about EMA issue in pretraining instruction		2024-11-06 20:42:31 -05:00
..
avoid_m1	More frequent EMA update (#20)	2024-11-06 20:42:31 -05:00
avoid_m2	More frequent EMA update (#20)	2024-11-06 20:42:31 -05:00
avoid_m3	More frequent EMA update (#20)	2024-11-06 20:42:31 -05:00