Bagheera
8e963d1c2a
7529 do not disable autocast for cuda devices ( #7530 )
...
* 7529 do not disable autocast for cuda devices
* Remove typecasting error check for non-mps platforms, as a correct autocast implementation makes it a non-issue
* add autocast fix to other training examples
* disable native_amp for dreambooth (sdxl)
* disable native_amp for pix2pix (sdxl)
* remove tests from remaining files
* disable native_amp on huggingface accelerator for every training example that uses it
* convert more usages of autocast to nullcontext, make style fixes
* make style fixes
* style.
* Empty-Commit
---------
Co-authored-by: bghira <bghira@users.github.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-02 20:15:06 +05:30
Sayak Paul
76de6a09fb
post-release v0.27.0 ( #7329 )
...
* post-release
* quality
2024-03-18 10:52:20 +05:30
Sayak Paul
4fbd310fd2
[Chore] switch to logger.warning ( #7289 )
...
switch to logger.warning
2024-03-13 06:56:43 +05:30
Linoy Tsaban
8da360aa12
[training scripts] add tags of diffusers-training ( #7206 )
...
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add dora tags for drambooth lora scripts
* style
2024-03-04 22:17:25 +05:30
Sayak Paul
7081a25618
[Examples] Multiple enhancements to the ControlNet training scripts ( #7096 )
...
* log_validation unification for controlnet.
* additional fixes.
* remove print.
* better reuse and loading
* make final inference run conditional.
* Update examples/controlnet/README_sdxl.md
Co-authored-by: Pedro Cuenca <pedro@huggingface.co >
* resize the control image in the snippet.
---------
Co-authored-by: Pedro Cuenca <pedro@huggingface.co >
2024-02-27 09:18:46 +05:30
Sayak Paul
7c8cab313e
post release 0.26.2 ( #6885 )
...
* post release
* style
* Empty-Commit
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-02-09 07:36:38 -10:00
camaro
59c307f1d5
Standardize model card for Controlnet ( #6910 )
...
* controlnet
* style
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-02-09 12:29:08 +05:30
Sayak Paul
159885adc6
correct hub_token exposition behaviour (thanks to @bghira). ( #6918 )
2024-02-08 18:38:27 -10:00
Sayak Paul
30e5e81d58
change to 2024 in the license ( #6902 )
...
change to 2024
2024-02-08 08:19:31 -10:00
Suvaditya Mukherjee
f486d34b04
Make ControlNet SD Training Script torch.compile compatible ( #6525 )
...
* update: make controlnet script torch compile compatible
Signed-off-by: Suvaditya Mukherjee <suvadityamuk@gmail.com >
* update: correct earlier mistakes for compilation
Signed-off-by: Suvaditya Mukherjee <suvadityamuk@gmail.com >
* update: fix code style issues
Signed-off-by: Suvaditya Mukherjee <suvadityamuk@gmail.com >
---------
Signed-off-by: Suvaditya Mukherjee <suvadityamuk@gmail.com >
2024-01-12 09:27:26 +05:30
Sayak Paul
9d945b2b90
0.25.0 post release ( #6358 )
...
* post release
* style
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-01-05 16:13:27 +05:30
Patrick von Platen
dadd55fb36
Post Release: v0.24.0 ( #5985 )
...
* Post Release: v0.24.0
* post pone deprecation
* post pone deprecation
* Add model_index.json
2023-12-01 18:43:44 +01:00
Patrick von Platen
6d2e19f746
[Examples] Allow downloading variant model files ( #5531 )
...
* add variant
* add variant
* Apply suggestions from code review
* reformat
* fix: textual_inversion.py
* fix: variant in model_info
---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
2023-11-27 10:43:20 +05:30
Sayak Paul
1477865e48
post release v0.23.0 ( #5730 )
...
* post release
* fix: variant test
* up
* fix: test
2023-11-10 16:35:44 +05:30
Sayak Paul
64603389da
post release (v0.22.0) ( #5658 )
...
post release
2023-11-06 16:23:38 +01:00
Patrick von Platen
342c5c02c0
[Release 0.21] Bump version ( #5018 )
...
* [Release 0.21] Bump version
* fix & remove
* fix more
* fix all, upload
2023-09-14 18:28:57 +02:00
Will Berman
d73e6ad050
guard save model hooks to only execute on main process ( #4929 )
2023-09-08 10:30:06 -07:00
Sayak Paul
d0c30cfd37
make post-release ( #4650 )
2023-08-17 14:16:25 +05:30
Patrick von Platen
20e92586c1
0.20.0dev0 ( #4299 )
...
* 0.20.0dev0
* make style
2023-07-26 23:06:18 +02:00
Ruoxi
ece55227ff
Multiply lr scheduler steps by num_processes. ( #3983 )
...
* Multiply lr scheduler steps by `num_processes`.
* Stop multiplying steps by gradient accumulation.
2023-07-13 17:50:25 +05:30
Patrick von Platen
b9feed8795
move to 0.19.0dev ( #4048 )
2023-07-11 22:49:12 +02:00
Will Berman
d49e2dd54c
manual check for checkpoints_total_limit instead of using accelerate ( #3681 )
...
* manual check for checkpoints_total_limit instead of using accelerate
* remove controlnet_conditioning_embedding_out_channels
2023-06-15 15:38:54 -07:00
Patrick von Platen
c42f6ee43e
Post 0.17.0 release ( #3721 )
...
* Post release
* Post release
2023-06-08 18:08:49 +02:00
Zachary Mueller
79fa94ea8b
Apply deprecations from Accelerate ( #3714 )
...
Apply deprecations
2023-06-08 16:44:22 +02:00
Will Berman
67cd460154
do not scale the initial global step by gradient accumulation steps when loading from checkpoint ( #3506 )
2023-05-22 15:19:56 -07:00
Pedro Cuenca
70ef774fa0
Remove required from tracker_project_name ( #3260 )
...
Remove required from tracker_project_name.
As observed by https://github.com/off99555 in https://github.com/huggingface/diffusers/issues/2695#issuecomment-1470755050 , it already has a default value.
2023-04-27 16:59:18 +05:30
Pedro Cuenca
e0a2bd15f9
Write model card in controlnet training script ( #3229 )
...
Write model card in controlnet training script.
2023-04-26 21:22:27 +02:00
Patrick von Platen
f842396367
Post release for 0.16.0 ( #3244 )
...
* Post release
* fix more
2023-04-26 17:43:09 +01:00
Patrick von Platen
6ba0efb9a1
Release: v0.16.0
2023-04-26 13:35:01 +02:00
Will Berman
7e6886f5e9
controlnet training resize inputs to multiple of 8 ( #3135 )
...
controlnet training center crop input images to multiple of 8
The pipeline code resizes inputs to multiples of 8.
Not doing this resizing in the training script is causing
the encoded image to have different height/width dimensions
than the encoded conditioning image (which uses a separate
encoder that's part of the controlnet model).
We resize and center crop the inputs to make sure they're the
same size (as well as all other images in the batch). We also
check that the initial resolution is a multiple of 8.
2023-04-19 10:46:51 -07:00
Patrick von Platen
0a73b4d3cd
[Post release] v0.16.0dev ( #3072 )
2023-04-12 17:18:30 +01:00
Patrick von Platen
e7534542a2
Release: v0.15.0
2023-04-12 15:15:31 +00:00
Sayak Paul
e607a582cf
[Examples] Fix type-casting issue in the ControlNet training script ( #2994 )
...
* fix: norm group test for UNet3D.
* fix: type-casting issue in controlnet training.
2023-04-12 06:35:06 +05:30
Chanchana Sornsoontorn
52c4d32d41
Fix typo and format BasicTransformerBlock attributes ( #2953 )
...
* ⚙️ chore(train_controlnet) fix typo in logger message
* ⚙️ chore(models) refactor modules order; make them the same as calling order
When printing the BasicTransformerBlock to stdout, I think it's crucial that the attributes order are shown in proper order. And also previously the "3. Feed Forward" comment was not making sense. It should have been close to self.ff but it's instead next to self.norm3
* correct many tests
* remove bogus file
* make style
* correct more tests
* finish tests
* fix one more
* make style
* make unclip deterministic
* ⚙️ chore(models/attention) reorganize comments in BasicTransformerBlock class
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-04-12 00:31:05 +02:00
YiYi Xu
0c63c3839a
allow use custom local dataset for controlnet training scripts ( #2928 )
...
use custom local datset
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-04-04 10:37:47 -07:00
Lucain
a87e88b783
Use upload_folder in training scripts ( #2934 )
...
use upload folder in training scripts
Co-authored-by: testbot <lucainp@hf.co >
2023-04-04 16:19:12 +01:00
Patrick von Platen
a0263b2e5b
make style
2023-04-04 15:18:39 +02:00
Ernie Chu
62c01d267a
Ensure validation image RGB not RGBA ( #2945 )
...
* ensure validation image RGB not RGBA
* ensure validation image RGB not RGBA
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-04-04 14:17:59 +01:00
Henrik Forstén
79eb3d07d0
Controlnet training ( #2545 )
...
* Controlnet training code initial commit
Works with circle dataset: https://github.com/lllyasviel/ControlNet/blob/main/docs/train.md
* Script for adding a controlnet to existing model
* Fix control image transform
Control image should be in 0..1 range.
* Add license header and remove more unused configs
* controlnet training readme
* Allow nonlocal model in add_controlnet.py
* Formatting
* Remove unused code
* Code quality
* Initialize controlnet in training script
* Formatting
* Address review comments
* doc style
* explicit constructor args and submodule names
* hub dataset
NOTE - not tested
* empty prompts
* add conditioning image
* rename
* remove instance data dir
* image_transforms -> -1,1 . conditioning_image_transformers -> 0, 1
* nits
* remove local rank config
I think this isn't necessary in any of our training scripts
* validation images
* proportion_empty_prompts typo
* weight copying to controlnet bug
* call log validation fix
* fix
* gitignore wandb
* fix progress bar and resume from checkpoint iteration
* initial step fix
* log multiple images
* fix
* fixes
* tracker project name configurable
* misc
* add controlnet requirements.txt
* update docs
* image labels
* small fixes
* log validation using existing models for pipeline
* fix for deepspeed saving
* memory usage docs
* Update examples/controlnet/train_controlnet.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/train_controlnet.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update examples/controlnet/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* remove extra is main process check
* link to dataset in intro paragraph
* remove unnecessary paragraph
* note on deepspeed
* Update examples/controlnet/README.md
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* assert -> value error
* weights and biases note
* move images out of git
* remove .gitignore
---------
Co-authored-by: William Berman <WLBberman@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-03-14 20:16:30 -07:00