More frequent EMA update (#20)
* move ema update within pretraining epoch * update pretraining ema configs * add lift and can epoch 8000 checkpoint url * add note about EMA issue in pretraining instruction
This commit is contained in:
@@ -61,7 +61,7 @@ train:
|
||||
first_cycle_steps: 1000
|
||||
warmup_steps: 10
|
||||
min_lr: 1e-4
|
||||
save_model_freq: 100000
|
||||
save_model_freq: 50000
|
||||
val_freq: 10000
|
||||
render:
|
||||
freq: 10000
|
||||
|
||||
@@ -61,7 +61,7 @@ train:
|
||||
first_cycle_steps: 1000
|
||||
warmup_steps: 10
|
||||
min_lr: 1e-4
|
||||
save_model_freq: 100000
|
||||
save_model_freq: 50000
|
||||
val_freq: 10000
|
||||
render:
|
||||
freq: 10000
|
||||
|
||||
Reference in New Issue
Block a user