AI/diffusers
1
0
Fork 0
mirror of https://github.com/huggingface/diffusers.git synced 2026-01-27 17:22:53 +03:00
Code Activity

Fix Wrong Text-encoder Grad Setting in Custom_Diffusion Training (#7302)

Browse Source 
fix index in set textencoder grad

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
This commit is contained in:
jnhuang
2024-03-13 22:52:44 +08:00
committed by GitHub
parent 46ab56a468
commit ac07b6dc6a
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/custom_diffusion/train_custom_diffusion.py
View File

@@ -1178,7 +1178,7 @@ def main(args):
grads_text_encoder = text_encoder.get_input_embeddings().weight.grad
# Get the index for tokens that we want to zero the grads for
index_grads_to_zero = torch.arange(len(tokenizer)) != modifier_token_id[0]
for i in range(len(modifier_token_id[1:])):
for i in range(1, len(modifier_token_id)):
index_grads_to_zero = index_grads_to_zero & (
torch.arange(len(tokenizer)) != modifier_token_id[i]
)