More frequent EMA update (#20)
* move ema update within pretraining epoch * update pretraining ema configs * add lift and can epoch 8000 checkpoint url * add note about EMA issue in pretraining instruction
This commit is contained in:
@@ -32,9 +32,9 @@ train:
|
||||
first_cycle_steps: 8000
|
||||
warmup_steps: 1
|
||||
min_lr: 1e-4
|
||||
epoch_start_ema: 10
|
||||
update_ema_freq: 5
|
||||
save_model_freq: 1000
|
||||
epoch_start_ema: 20
|
||||
update_ema_freq: 1
|
||||
save_model_freq: 500
|
||||
|
||||
model:
|
||||
_target_: model.diffusion.diffusion.DiffusionModel
|
||||
|
||||
@@ -31,9 +31,9 @@ train:
|
||||
first_cycle_steps: 5000
|
||||
warmup_steps: 1
|
||||
min_lr: 1e-4
|
||||
epoch_start_ema: 10
|
||||
update_ema_freq: 5
|
||||
save_model_freq: 1000
|
||||
epoch_start_ema: 20
|
||||
update_ema_freq: 1
|
||||
save_model_freq: 500
|
||||
|
||||
model:
|
||||
_target_: model.common.gaussian.GaussianModel
|
||||
|
||||
Reference in New Issue
Block a user