AI/diffusers
1
0
Fork 0
mirror of https://github.com/huggingface/diffusers.git synced 2026-01-29 07:22:12 +03:00
Code Activity

[train_unconditional] fix applying clip_grad_norm_ (#721)

Browse Source 
fix clip_grad_norm_
This commit is contained in:
Suraj Patil
2022-10-04 19:04:05 +02:00
committed by GitHub
parent 6b221920d7
commit 14b9754923
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/unconditional_image_generation/train_unconditional.py
View File

@@ -143,7 +143,8 @@ def main(args):
loss = F.mse_loss(noise_pred, noise)
accelerator.backward(loss)
accelerator.clip_grad_norm_(model.parameters(), 1.0)
if accelerator.sync_gradients:
accelerator.clip_grad_norm_(model.parameters(), 1.0)
optimizer.step()
lr_scheduler.step()
if args.use_ema: