Christopher Beckham
8e46d97cd8
Add missing restore() EMA call in train SDXL script ( #7599 )
...
* Restore unet params back to normal from EMA when validation call is finished
* empty commit
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-09 18:07:55 +05:30
Bagheera
8e963d1c2a
7529 do not disable autocast for cuda devices ( #7530 )
...
* 7529 do not disable autocast for cuda devices
* Remove typecasting error check for non-mps platforms, as a correct autocast implementation makes it a non-issue
* add autocast fix to other training examples
* disable native_amp for dreambooth (sdxl)
* disable native_amp for pix2pix (sdxl)
* remove tests from remaining files
* disable native_amp on huggingface accelerator for every training example that uses it
* convert more usages of autocast to nullcontext, make style fixes
* make style fixes
* style.
* Empty-Commit
---------
Co-authored-by: bghira <bghira@users.github.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-02 20:15:06 +05:30
Álvaro Somoza
73ba81090e
[Community pipeline] SDXL Differential Diffusion Img2Img Pipeline ( #7550 )
...
* initial-commit pipeline created
* updated README.md
2024-04-01 18:15:30 -10:00
YiYi Xu
7956c36aaa
add a from_pipe method to DiffusionPipeline ( #7241 )
...
* add from_pipe
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-04-01 13:02:00 -10:00
haikmanukyan
5266ab7935
add HD-Painter pipeline ( #7520 )
...
* add HD-Painter pipeline
* style fixing
* refactor, change doc, fix ruff
* fix docs
* used correct ruff version
---------
Co-authored-by: Hayk Manukyan <youremail@yourdomain.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-01 15:10:44 +05:30
Bingxin Ke
c2e87869be
[Community pipeline] Marigold depth estimation update -- align with marigold v0.1.5 ( #7524 )
...
* add resample option; check denoise_step; update ckpt path
* Add seeding in pipeline to increase reproducibility
* fix typo
* fix typo
2024-03-30 07:09:02 -10:00
Hyoungwon Cho
9d20ed37a2
Perturbed-Attention Guidance ( #7512 )
...
* pag_initial
* pag_docs
* edit_docs
* custom
* typo
* delete_docs
* whitespace
* make style
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-30 10:52:51 +05:30
Linoy Tsaban
bda1d4faf8
add Instant id sdxl image2image pipeline ( #7507 )
...
* initial commit - instantid img2img
* adapting to img2img
* change add_time_ids
* change add_time_ids
* WIP changes
* add strength to timesteps
* check insightface import
* style
* check insightface import changed to warning
* check insightface import changed to warning
* style
---------
Co-authored-by: apolinário <joaopaulo.passos@gmail.com >
2024-03-30 10:25:21 +05:30
Bagheera
d78acdedc1
apple mps: training support for SDXL (ControlNet, LoRA, Dreambooth, T2I) ( #7447 )
...
* apple mps: training support for SDXL LoRA
* sdxl: support training lora, dreambooth, t2i, pix2pix, and controlnet on apple mps
---------
Co-authored-by: bghira <bghira@users.github.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-28 14:26:18 +05:30
Thomas Liang
0cc5630945
[Chore] Fix Colab notebook links in README.md ( #7495 )
2024-03-27 12:36:36 -10:00
Long(Tony) Lian
5199ee4f7b
Fix missing raise statements in check_inputs ( #7473 )
...
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-26 13:34:28 -10:00
Sayak Paul
288632adf6
[Training utils] add kohya conversion dict. ( #7435 )
...
* add kohya conversion dict.
* update readme
* typo
* add filename
2024-03-26 17:31:22 +05:30
Ernie Chu
5ce79cbded
Update train_dreambooth_lora_sd15_advanced.py ( #7433 )
...
you cannot specify `type="bool"` and `action="store_true"` at the same time.
remove excessive and buggy `type=bool`.
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2024-03-26 12:53:02 +02:00
Marçal Comajoan Cara
d52f3e30f8
Fix broken link ( #7472 )
...
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-26 10:29:08 +05:30
estelleafl
0dd0528851
Small ldm3d fix ( #7464 )
...
* fixed typo
* updated doc to be consistent in naming
* make style/quality
* preprocessing for 4 channels and not 6
* make style
* test for 4c
* make style/quality
* fixed test on cpu
* fixed doc typo
* changed default ckpt to 4c
* Update pipeline_stable_diffusion_ldm3d.py
* fix bug
---------
Co-authored-by: Aflalo <estellea@isl-iam1.rr.intel.com >
Co-authored-by: Aflalo <estellea@isl-gpu33.rr.intel.com >
Co-authored-by: Aflalo <estellea@isl-gpu38.rr.intel.com >
2024-03-25 15:33:43 -10:00
M. Tolga Cangöz
a51b6cc86a
[Docs] Fix typos ( #7451 )
...
* Fix typos
* Fix typos
* Fix typos
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-25 11:48:02 -07:00
Sayak Paul
e29f16cfaa
[Research Projects] ORPO diffusion for alignment ( #7423 )
...
* barebones orpo
* remove reference model.
* full implementation
* change default of beta_orpo
* add a training command.
* fix: dataloading issues.
* interpreting the formulation.
* revert styling
* add: wds full blown version
* fix: per_gpu_batch_siz
* start debuggin
* debugging
* remove print
* fix
* remove filter keys.
* turn on non-blocking calls.
* device_placement
* let's see.
* add bigger training run command
* reinitialize generator for fair repro
* add: detailed readme and requirements
---------
Co-authored-by: Sayak Paul <sayakpaul@Sayaks-MacBook-Pro-2.local >
2024-03-25 08:37:41 +05:30
YiYi Xu
e4356d6488
add a "Community Scripts" section ( #7358 )
...
* add
* add tiling
* fix
* fix
* fix
* give community script its own readme
* Update examples/community/README_community_scripts.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update examples/community/README_community_scripts.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update examples/community/README_community_scripts.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update examples/community/README_community_scripts.md
---------
Co-authored-by: Alexis Rolland <alexis.rolland@ubisoft.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-03-21 10:05:07 -10:00
M. Tolga Cangöz
3028089e5e
Fix typos ( #7411 )
...
* Fix typos
* Fix typo in SVD.md
2024-03-20 18:46:47 -07:00
Sayak Paul
e25e525fde
[LoRA test suite] refactor the test suite and cleanse it ( #7316 )
...
* cleanse and refactor lora testing suite.
* more cleanup.
* make check_if_lora_correctly_set a utility function
* fix: typo
* retrigger ci
* style
2024-03-20 17:13:52 +05:30
M. Tolga Cangöz
e97a633b63
Update access of configuration attributes ( #7343 )
...
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-18 08:53:29 -10:00
M. Tolga Cangöz
6a05b274cc
Fix Typos ( #7325 )
...
* Fix PyTorch's convention for inplace functions
* Fix import structure in __init__.py and update config loading logic in test_config.py
* Update configuration access
* Fix typos
* Trim trailing white spaces
* Fix typo in logger name
* Revert "Fix PyTorch's convention for inplace functions"
This reverts commit f65dc4afcb8d44e870b82ad5e8bca2
2024-03-18 09:48:40 -07:00
Anatoly Belikov
98d46a3f08
delete vae and text encoders after use in SDXL training script ( #6693 )
...
delete vae and text encoders after use
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-18 20:03:53 +05:30
Sayak Paul
76de6a09fb
post-release v0.27.0 ( #7329 )
...
* post-release
* quality
2024-03-18 10:52:20 +05:30
M. Tolga Cangöz
5d848ec07c
[Tests] Update a deprecated parameter in test files and fix several typos ( #7277 )
...
* Add properties and `IPAdapterTesterMixin` tests for `StableDiffusionPanoramaPipeline`
* Fix variable name typo and update comments
* Update deprecated `output_type="numpy"` to "np" in test files
* Discard changes to src/diffusers/pipelines/stable_diffusion_panorama/pipeline_stable_diffusion_panorama.py
* Update test_stable_diffusion_panorama.py
* Update numbers in README.md
* Update get_guidance_scale_embedding method to use timesteps instead of w
* Update number of checkpoints in README.md
* Add type hints and fix var name
* Fix PyTorch's convention for inplace functions
* Fix a typo
* Revert "Fix PyTorch's convention for inplace functions"
This reverts commit 74350cf65b
2024-03-14 12:17:35 -07:00
Linoy Tsaban
83062fb872
[Advanced DreamBooth LoRA SDXL] Support EDM-style training (follow up of #7126 ) ( #7182 )
...
* add edm style training
* style
* finish adding edm training feature
* import fix
* fix latents mean
* minor adjustments
* add edm to readme
* style
* fix autocast and scheduler config issues when using edm
* style
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-14 18:40:14 +05:30
Anatoly Belikov
53e9aacc10
log loss per image ( #7278 )
...
* log loss per image
* add commandline param for per image loss logging
* style
* debug-loss -> debug_loss
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-14 11:41:43 +05:30
Beinsezii
d3986f18be
Change step_offset scheduler docstrings ( #7128 )
...
* Change step_offset scheduler docstrings
* Mention it may be needed by some models
* More docstrings
These ones failed literal S&R because I performed it case-sensitive
which is fun.
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-13 15:12:00 -10:00
jnhuang
ac07b6dc6a
Fix Wrong Text-encoder Grad Setting in Custom_Diffusion Training ( #7302 )
...
fix index in set textencoder grad
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-13 20:22:44 +05:30
Sayak Paul
4fbd310fd2
[Chore] switch to logger.warning ( #7289 )
...
switch to logger.warning
2024-03-13 06:56:43 +05:30
pravdomil
165af7edd3
Inline InputPadder ( #6582 )
...
inline InputPadder
2024-03-09 11:24:07 -10:00
pravdomil
e64fdcf2ce
Fix gmflow_dir ( #6583 )
...
* remove sys.path
* update readme
2024-03-09 08:53:17 -10:00
Aryan
cd6e1f1171
[docs/nits] Fix return values based on return_dict and minor doc updates ( #7105 )
...
* fix returns and docs
* handle latent output_type correctly
* revert to old tensor2vid impl
* make fix-copies
* fix return in community animatediff pipes
* fix return docstring
* fix return docs
* add missing quote
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-03-08 18:47:24 -10:00
qqii
e5ee05da76
[Community Pipeline] Skip Marigold depth_colored with color_map=None ( #7170 )
...
[Community Pipeline] Skip Marigold depth_colored generation by passing color_map=None
2024-03-08 17:51:11 -10:00
Sayak Paul
9d9744075e
[Easy] fix: save_model_card utility of the DreamBooth SDXL LoRA script ( #7258 )
...
* fix: save_model_card utility.
* fix a little more to make it more lenient.
* remove lower()
2024-03-08 15:22:23 +05:30
pravdomil
b24f78349c
use self.device ( #6595 )
...
* use self.device
* use device
* fix
* fix
2024-03-07 12:46:23 -10:00
Sayak Paul
0d4dfbbd0a
[Examples] fix: prior preservation setting in DreamBooth LoRA SDXL script. ( #7242 )
...
fix: prior preservation setting in DreamBooth LoRA SDXL script.
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2024-03-07 15:19:58 +05:30
Linoy Tsaban
b5814c5555
add DoRA training feature to sdxl dreambooth lora script ( #7235 )
...
* dora in canonical script
* add mention of DoRA to readme
2024-03-07 11:43:37 +05:30
Paakhhi
9940573618
Refactor Prompt2Prompt: Inherit from DiffusionPipeline ( #7211 )
...
refactor: inherit from DiffusionPipeline instead of StableDiffusionPipeline
2024-03-06 19:34:40 -10:00
Nate Landman
534f5d54fa
Update train_dreambooth_lora_sdxl_advanced.py ( #7227 )
...
adding the type gives you
```
TypeError: _StoreTrueAction.__init__() got an unexpected keyword argument 'type'
```
2024-03-06 12:41:48 +01:00
bram-w
eb942b866a
SDXL Turbo support and example launch ( #6473 )
...
* support and example launch for sdxl turbo
* White space fixes
* Trailing whitespace character
* ruff format
* fix guidance_scale and steps for turbo mode
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Radames Ajna <radamajna@gmail.com >
2024-03-06 11:51:01 +05:30
iczaw
6246c70d21
[Community] PromptDiffusion Pipeline ( #6752 )
...
* Create promptdiffusioncontrolnet.py
* Update __init__.py
Added PromptDiffusionControlNetModel
* Update __init__.py
Added PromptDiffusionControlNetModel
* Update promptdiffusioncontrolnet.py
* Create pipeline_prompt_diffusion.py
Added Prompt Diffusion pipeline.
* Create convert_original_promptdiffusion_to_diffusers.py
* Update convert_from_ckpt.py
Added download_promptdiffusion_from_original_ckpt, convert_promptdiffusion_checkpoint
* Update promptdiffusioncontrolnet.py
* Update pipeline_prompt_diffusion.py
* Update README.md
* Update pipeline_prompt_diffusion.py
* Delete src/diffusers/models/promptdiffusioncontrolnet.py
* Update __init__.py
* Update __init__.py
* Delete scripts/convert_original_promptdiffusion_to_diffusers.py
* Update convert_from_ckpt.py
* Update README.md
* Delete examples/community/pipeline_prompt_diffusion.py
* Create README.md
* Create promptdiffusioncontrolnet.py
* Create convert_original_promptdiffusion_to_diffusers.py
* Create pipeline_prompt_diffusion.py
* Update README.md
* Update pipeline_prompt_diffusion.py
* Update README.md
* Update pipeline_prompt_diffusion.py
* Update convert_original_promptdiffusion_to_diffusers.py
* Update promptdiffusioncontrolnet.py
* Update README.md
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-05 09:06:02 +05:30
M. Tolga Cangöz
f4977abcd8
Fix typos ( #7181 )
...
* Fix typos
* Fix typos
* Fix typos and update documentation in lora.md
2024-03-04 10:28:23 -08:00
Linoy Tsaban
8da360aa12
[training scripts] add tags of diffusers-training ( #7206 )
...
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add tags for diffusers training
* add dora tags for drambooth lora scripts
* style
2024-03-04 22:17:25 +05:30
Linoy Tsaban
01ee0978cc
[advanced dreambooth lora sdxl] add DoRA training feature ( #7072 )
...
* add is_dora arg
* style
* add dora training feature to sd 1.5 script
* added notes about DoRA training
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-04 11:07:54 +01:00
Sayak Paul
56b68459f5
Update requirements.txt to remove huggingface-cli ( #7202 )
...
Internal message: https://huggingface.slack.com/archives/C03Q18WK18T/p1709529892062479
2024-03-04 11:29:01 +05:30
Sayak Paul
ccb93dcad1
Support EDM-style training in DreamBooth LoRA SDXL script ( #7126 )
...
* add: dreambooth lora script for Playground v2.5
* fix: kwarg
* address suraj's comments.
* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com >
* apply suraj's suggestion
* incorporate changes in the canonical script./
* tracker naming
* fix: schedule determination
* add: two simple tests
* remove playground script
* note about edm-style training
* address pedro's comments.
* address part of Suraj's comments.
* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com >
* remove guidance_scale.
* use mse_loss.
* add comments for preconditioning.
* quality
* Update examples/dreambooth/train_dreambooth_lora_sdxl.py
Co-authored-by: Suraj Patil <surajp815@gmail.com >
* tackle v-pred.
* Empty-Commit
* support edm for sdxl too.
* address suraj's comments.
* Empty-Commit
---------
Co-authored-by: Suraj Patil <surajp815@gmail.com >
2024-03-03 09:28:57 +05:30
Oleh
9a2600ede9
Map speedup ( #6745 )
...
* Speed up dataset mapping
* Fix missing columns
* Remove cache files cleanup
* Update examples/text_to_image/train_text_to_image_sdxl.py
* make style
* Fix code style
* style
* Empty-Commit
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Quentin Lhoest <42851186+lhoestq@users.noreply.github.com >
Co-authored-by: Quentin Lhoest <lhoest.q@gmail.com >
2024-03-01 21:38:21 +05:30
Sayak Paul
5f150c4cef
fix: loading problem for sdxl lora dreambooth ( #7166 )
2024-03-01 19:30:48 +05:30
Quentin Lhoest
66f8bd6869
Fix vae_encodings_fn hash in train_text_to_image_sdxl.py ( #7171 )
...
Update train_text_to_image_sdxl.py
2024-03-01 16:56:54 +05:30
