M. Tolga Cangöz
6a05b274cc
Fix Typos ( #7325 )
...
* Fix PyTorch's convention for inplace functions
* Fix import structure in __init__.py and update config loading logic in test_config.py
* Update configuration access
* Fix typos
* Trim trailing white spaces
* Fix typo in logger name
* Revert "Fix PyTorch's convention for inplace functions"
This reverts commit f65dc4afcb8d44e870b82ad5e8bca2
2024-03-18 09:48:40 -07:00
Dhruv Nair
4330a747d4
[Tests] Fix ControlNet Single File tests ( #7315 )
...
* update
* update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-18 11:28:59 +05:30
M. Tolga Cangöz
5d848ec07c
[Tests] Update a deprecated parameter in test files and fix several typos ( #7277 )
...
* Add properties and `IPAdapterTesterMixin` tests for `StableDiffusionPanoramaPipeline`
* Fix variable name typo and update comments
* Update deprecated `output_type="numpy"` to "np" in test files
* Discard changes to src/diffusers/pipelines/stable_diffusion_panorama/pipeline_stable_diffusion_panorama.py
* Update test_stable_diffusion_panorama.py
* Update numbers in README.md
* Update get_guidance_scale_embedding method to use timesteps instead of w
* Update number of checkpoints in README.md
* Add type hints and fix var name
* Fix PyTorch's convention for inplace functions
* Fix a typo
* Revert "Fix PyTorch's convention for inplace functions"
This reverts commit 74350cf65b
2024-03-14 12:17:35 -07:00
Dhruv Nair
4974b84564
Update Cascade Tests ( #7324 )
...
* update
* update
* update
2024-03-14 20:51:22 +05:30
Dhruv Nair
41424466e3
[Tests] Fix incorrect constant in VAE scaling test. ( #7301 )
...
update
2024-03-14 10:24:01 +05:30
Manuel Brack
00eca4b887
[Pipeline] Add LEDITS++ pipelines ( #6074 )
...
* Setup LEdits++ file structure
* Fix import
* LEditsPP Stable Diffusion pipeline
* Include variable image aspect ratios
* Implement LEDITS++ for SDXL
* clean up LEditsPPPipelineStableDiffusion
* Adjust inversion output
* Added docu, more cleanup for LEditsPPPipelineStableDiffusion
* clean up LEditsPPPipelineStableDiffusionXL
* Update documentation
* Fix documentation import
* Add skeleton IF implementation
* Fix documentation typo
* Add LEDTIS docu to toctree
* Add missing title
* Finalize SD documentation
* Finalize SD-XL documentation
* Fix code style and quality
* Fix typo
* Fix return types
* added LEditsPPPipelineIF; minor changes for LEditsPPPipelineStableDiffusion and LEditsPPPipelineStableDiffusionXL
* Fix copy reference
* add documentation for IF
* Add first tests
* Fix batching for SD-XL
* Fix text encoding and perfect reconstruction for SD-XL
* Add tests for SD-XL, minor changes
* move user_mask to correct device, use cross_attention_kwargs also for inversion
* Example docstring
* Fix attention resolution for non-square images
* Refactoring for PR review
* Safely remove ledits_utils.py
* Style fixes
* Replace assertions with ValueError
* Remove LEditsPPPipelineIF
* Remove unecessary input checks
* Refactoring of CrossAttnProcessor
* Revert unecessary changes to scheduler
* Remove first progress-bar in inversion
* Refactor scheduler usage and reset
* Use imageprocessor instead of custom logic
* Fix scheduler init warning
* Fix error when running the pipeline in fp16
* Update documentation wrt perfect inversion
* Update tests
* Fix code quality and copy consistency
* Update LEditsPP import
* Remove enable/disable methods that are now in StableDiffusionMixin
* Change import in docs
* Revert import structure change
* Fix ledits imports
---------
Co-authored-by: Katharina Kornmeier <katharina.kornmeier@stud.tu-darmstadt.de >
2024-03-13 12:43:47 +02:00
Dhruv Nair
299c16d0f5
Fix loading Img2Img refiner components in from_single_file ( #7282 )
...
* update
* update
* update
* update
2024-03-13 09:25:53 +05:30
Dhruv Nair
69f49195ac
Fix passing pooled prompt embeds to Cascade Decoder and Combined Pipeline ( #7287 )
...
* update
* update
* update
* update
2024-03-13 09:21:41 +05:30
Dhruv Nair
ed224f94ba
Add single file support for Stable Cascade ( #7274 )
...
* update
* update
* update
* update
* update
* update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-13 08:37:31 +05:30
Sayak Paul
531e719163
[LoRA] use the PyTorch classes wherever needed and start depcrecation cycles ( #7204 )
...
* fix PyTorch classes and start deprecsation cycles.
* remove args crafting for accommodating scale.
* remove scale check in feedforward.
* assert against nn.Linear and not CompatibleLinear.
* remove conv_cls and lineaR_cls.
* remove scale
* 👋 scale.
* fix: unet2dcondition
* fix attention.py
* fix: attention.py again
* fix: unet_2d_blocks.
* fix-copies.
* more fixes.
* fix: resnet.py
* more fixes
* fix i2vgenxl unet.
* depcrecate scale gently.
* fix-copies
* Apply suggestions from code review
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* quality
* throw warning when scale is passed to the the BasicTransformerBlock class.
* remove scale from signature.
* cross_attention_kwargs, very nice catch by Yiyi
* fix: logger.warn
* make deprecation message clearer.
* address final comments.
* maintain same depcrecation message and also add it to activations.
* address yiyi
* fix copies
* Apply suggestions from code review
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* more depcrecation
* fix-copies
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-03-13 07:56:19 +05:30
UmerHA
3f9c746fb2
Adds denoising_end parameter to ControlNetPipeline for SDXL ( #6175 )
...
* Initial commit
* Removed copy hints, as in original SDXLControlNetPipeline
Removed copy hints, as in original SDXLControlNetPipeline, as the `make fix-copies` seems to have issues with the @property decorator.
* Reverted changes to ControlNetXS
* Addendum to: Removed changes to ControlNetXS
* Added test+docs for mixture of denoiser
* Update docs/source/en/using-diffusers/controlnet.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/using-diffusers/controlnet.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-03-08 16:42:02 -10:00
Sayak Paul
b4226bd6a7
[Tests] fix config checking tests ( #7247 )
...
* debig
* cast tuples to lists.
* debug
* handle upcast attention
* handle downblock types for vae.
* remove print.
* address Dhruv's comments.
* fix: upblock types.
* upcast attention
* debug
* debug
* debug
* better guarding.
* style
2024-03-08 18:53:07 +05:30
Sayak Paul
f7e5954d5e
[Tests] fix: VAE tiling tests when setting the right device ( #7246 )
...
* debug
* checking
* fix more
* remove device.
* fix-copies
2024-03-08 10:01:25 +05:30
Kashif Rasul
40aa47b998
[Pipiline] Wuerstchen v3 aka Stable Cascasde pipeline ( #6487 )
...
* initial diffNext v3
* move to v3 folder
* imports
* dry up the unets
* no switch_level
* fix init
* add switch_level tp config
* Fixed some things
* Added pooled text embeddings
* Initial work on adding image encoder
* changes from @dome272
* Stuff for the image encoder processing and variable naming in decoder
* fix arg name
* inference fixes
* inference fixes
* default TimestepBlock without conds
* c_skip=0 by default
* fix bfloat16 to cpu
* use config
* undo temp change
* fix gen_c_embeddings args
* change text encoding
* text encoding
* undo print
* undo .gitignore change
* Allow WuerstchenV3PriorPipeline to use the base DDPM & DDIM schedulers
* use WuerstchenV3Unet in both pipelines
* fix imports
* initial failing tests
* cleanup
* use scheduler.timesterps
* some fixes to the tests, still not fully working
* fix tests
* fix prior tests
* add dropout to the model_kwargs
* more tests passing
* update expected_slice
* initial rename
* rename tests
* rename class names
* make fix-copies
* initial docs
* autodocs
* typos
* fix arg docs
* add text_encoder info
* combined pipeline has optional image arg
* fix documentation
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* use self.config
* Update src/diffusers/pipelines/stable_cascade/modeling_stable_cascade_common.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* c_in -> in_channels
* removed kwargs from unet's forward
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* remove older callback api
* removed kwargs and fixed decoder guidance > 1
* decoder takes emeds
* check and use image_embeds
* fixed all but one decoder test
* fix decoder tests
* update callback api
* fix some more combined tests
* push combined pipeline
* initial docs
* fix doc_string
* update combined api
* no test_callback_inputs test for combined pipeline
* add optional components
* fix ordering of components
* fix combined tests
* update convert script
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/stable_cascade/pipeline_stable_cascade_prior.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* fix imports
* move effnet out of deniosing loop
* prompt_embeds_pooled only when doing guidance
* Fix repeat shape
* move StableCascadeUnet to models/unets/
* more descriptive names
* converted when numpy()
* StableCascadePriorPipelineOutput docs
* rename StableCascadeUNet
* add slow tests
* fix slow tests
* update
* update
* updated model_path
* add args for weights
* set push_to_hub to false
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
---------
Co-authored-by: Dominic Rampas <d6582533@gmail.com >
Co-authored-by: Pablo Pernias <pablo@pernias.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: 99991 <99991@users.noreply.github.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-03-06 15:07:25 +05:30
Jinay Jain
1bc0d37ffe
[bug] Fix float/int guidance scale not working in StableVideoDiffusionPipeline ( #7143 )
...
* [bug] Fix float/int guidance scale not working in `StableVideoDiffusionPipeline`
* Add test to disable CFG on SVD
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-06 14:05:07 +05:30
Michael
687bc27727
add TCD Scheduler ( #7174 )
...
* add: support TCD scheduler
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-03-04 19:43:34 -10:00
YiYi Xu
06b01ea87e
[ip-adapter] refactor prepare_ip_adapter_image_embeds and skip load image_encoder ( #7016 )
...
* add
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-02-29 15:38:49 -10:00
elucida
fa633ed6de
refactor: move model helper function in pipeline to a mixin class ( #6571 )
...
* move model helper function in pipeline to EfficiencyMixin
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-02-28 09:26:39 -10:00
Beinsezii
2e31a759b5
DPMSolverMultistep add rescale_betas_zero_snr ( #7097 )
...
* DPMMultistep rescale_betas_zero_snr
* DPM upcast samples in step()
* DPM rescale_betas_zero_snr UT
* DPMSolverMulti move sample upcast after model convert
Avoids having to re-use the dtype.
* Add a newline for Ruff
2024-02-27 11:37:34 -10:00
Suraj Patil
8492db2332
add DPM scheduler with EDM formulation ( #7120 )
...
* add DPM scheduler with EDM formulation
* set sigmas in init
* add _compute_sigmas
* Apply suggestions from code review
Co-authored-by: Pedro Cuenca <pedro@huggingface.co >
* address some review comments
* up,
* add tests
---------
Co-authored-by: Pedro Cuenca <pedro@huggingface.co >
2024-02-27 23:39:38 +05:30
Suraj Patil
f57e7bd92c
Add EDMEulerScheduler ( #7109 )
...
* Add EDMEulerScheduler
* address review comments
* fix import
* fix test
* add tests
* add co-author
Co-authored-by: @dg845 dgu8957@gmail.com
2024-02-27 17:51:19 +05:30
Dhruv Nair
ac49f97a75
Add tests to check configs when using single file loading ( #7099 )
...
* update
* update
* update
* update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-02-27 15:47:23 +05:30
Younes Belkada
8a692739c0
FIX [PEFT / Core] Copy the state dict when passing it to load_lora_weights ( #7058 )
...
* copy the state dict in load lora weights
* fixup
2024-02-27 02:42:23 +01:00
jinghuan-Chen
88aa7f6ebf
Make LoRACompatibleConv padding_mode work. ( #6031 )
...
* Make LoRACompatibleConv padding_mode work.
* Format code style.
* add fast test
* Update src/diffusers/models/lora.py
Simplify the code by patrickvonplaten.
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* code refactor
* apply patrickvonplaten suggestion to simplify the code.
* rm test_lora_layers_old_backend.py and add test case in test_lora_layers_peft.py
* update test case.
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-02-26 14:05:13 -10:00
Aryan
bb1b76d3bf
IPAdapterTesterMixin ( #6862 )
...
* begin IPAdapterTesterMixin
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-02-22 14:25:33 -10:00
Dhruv Nair
af13a90ebd
Remove disable_full_determinism from StableVideoDiffusion xformers test. ( #7039 )
...
* update
* update
2024-02-20 21:43:23 +05:30
Dhruv Nair
6bceaea3fe
Update ControlNet Inpaint single file test ( #7022 )
...
update
2024-02-20 10:58:30 +05:30
Dhruv Nair
d2fc5ebb95
[Refactor] FreeInit for AnimateDiff based pipelines ( #6874 )
...
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
2024-02-19 11:11:42 +05:30
Dhruv Nair
d5b8d1ca04
Fix Pixart Slow Tests ( #6962 )
...
* update
* update
2024-02-19 09:50:18 +05:30
Fabio Rigano
eba7e7a6d7
IP-Adapter attention masking ( #6847 )
...
* Add attention masking to attn processors
* Update tensor conversion
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-02-18 18:06:14 -10:00
YiYi Xu
2e387dad5f
fix IPAdapter unload_ip_adapter test ( #6972 )
...
add
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-02-14 20:42:40 -10:00
Dhruv Nair
40dd9cb2bd
Move SDXL T2I Adapter lora test into PEFT workflow ( #6965 )
...
update
2024-02-13 17:08:53 +05:30
Dhruv Nair
30bcda7de6
Fix flaky IP Adapter test ( #6960 )
...
update
2024-02-13 17:07:39 +05:30
Dhruv Nair
84905ca728
Update PixArt Alpha test module to match src module ( #6943 )
...
update
2024-02-12 11:01:33 +05:30
dg845
35fd84be27
Replace hardcoded values in SchedulerCommonTest with properties ( #5479 )
...
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-02-10 21:34:20 -10:00
YiYi Xu
f2756253e6
Fix a bug in AutoPipeline.from_pipe when switching pipeline with optional components ( #6820 )
...
* fix
* add tests
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-02-09 21:56:52 -10:00
Sayak Paul
ca9ed5e8d1
[LoRA] deprecate certain lora methods from the old backend. ( #6889 )
...
* deprecate certain lora methods from the old backend.
* uncomment necessary things.
* safe remove old lora backend 👋
2024-02-09 17:14:32 +01:00
Sayak Paul
30e5e81d58
change to 2024 in the license ( #6902 )
...
change to 2024
2024-02-08 08:19:31 -10:00
Sayak Paul
491a933a1b
[I2VGenXL] attention_head_dim in the UNet ( #6872 )
...
* attention_head_dim
* debug
* print more info
* correct num_attention_heads behaviour
* down_block_num_attention_heads -> num_attention_heads.
* correct the image link in doc.
* add: deprecation for num_attention_head
* fix: test argument to use attention_head_dim
* more fixes.
* quality
* address comments.
* remove depcrecation.
2024-02-08 12:30:14 +05:30
Sayak Paul
1835510524
Remove torch_dtype in to() to end deprecation ( #6886 )
...
* remove torch_dtype from to()
* remove torch_dtype from usage scripts.
* remove old lora backend
* Revert "remove old lora backend"
This reverts commit adcddf6ba4
2024-02-08 09:38:57 +05:30
Dhruv Nair
994360f7a5
Fix last IP Adapter test ( #6875 )
...
update
2024-02-06 08:53:40 -10:00
Dhruv Nair
e6a48db633
Refactor Deepfloyd IF tests. ( #6855 )
...
* update
* update
* update
2024-02-06 16:43:17 +05:30
Dhruv Nair
bb99623d09
Update IP Adapter tests to use cosine similarity distance ( #6806 )
...
* update
* update
2024-02-05 16:22:59 +05:30
Sayak Paul
ec9840a5db
[Refactor] harmonize the module structure for models in tests ( #6738 )
...
* harmonize the module structure for models in tests
* make the folders modules.
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-02-01 14:23:39 +05:30
Sayak Paul
04cd6adf8c
[Feat] add I2VGenXL for image-to-video generation ( #6665 )
...
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-01-31 10:38:51 -10:00
YiYi Xu
2e8d18e699
[IP-Adapter] Support multiple IP-Adapters ( #6573 )
...
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Alvaro Somoza <somoza.alvaro@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2024-01-31 07:11:15 -10:00
Dhruv Nair
56bea6b4a1
Add PIA Model/Pipeline ( #6698 )
...
* update
* update
* updaet
* add tests and docs
* clean up
* add to toctree
* fix copies
* pr review feedback
* fix copies
* fix tests
* update docs
* update
* update
* update docs
* update
* update
* update
* update
2024-01-31 18:00:17 +02:00
Sayak Paul
0fc62d1702
[Kandinsky tests] add is_flaky to test_model_cpu_offload_forward_pass ( #6762 )
...
* add is_flaky to test_model_cpu_offload_forward_pass
* style
* update
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-01-31 14:51:12 +05:30
YiYi Xu
b09b90e24c
udpate ip-adapter slow tests ( #6760 )
...
* udpate slices
* up
* hopefully last one
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-01-29 17:55:41 -10:00
Sayak Paul
09b7bfce91
[Core] move transformer scripts to transformers modules ( #6747 )
...
* move transformer scripts to transformers modules
* move transformer model test
* move prior transformer test to directory
* fix doc path
* correct doc path
* add: __init__.py
2024-01-29 22:28:28 +05:30
