Álvaro Somoza
23e091564f
Fix for "no lora weight found module" with some loras ( #7875 )
...
* return layer weight if not found
* better system and test
* key example and typo
2024-05-07 13:54:57 +02:00
Steven Liu
0d23645bd1
[docs] Distilled inference ( #7834 )
...
* combine
* edits
2024-05-06 15:07:25 -07:00
Guillaume LEGENDRE
7fa3e5b0f6
Ci - change cache folder ( #7867 )
2024-05-06 17:55:24 +05:30
Steven Liu
49b959b540
[docs] LCM ( #7829 )
...
* lcm
* lcm lora
* fix
* fix hfoption
* edits
2024-05-03 16:08:27 -07:00
HelloWorldBeginner
58237364b1
Add Ascend NPU support for SDXL fine-tuning and fix the model saving bug when using DeepSpeed. ( #7816 )
...
* Add Ascend NPU support for SDXL fine-tuning and fix the model saving bug when using DeepSpeed.
* fix check code quality
* Decouple the NPU flash attention and make it an independent module.
* add doc and unit tests for npu flash attention.
---------
Co-authored-by: mhh001 <mahonghao1@huawei.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-05-03 08:14:34 -10:00
Dhruv Nair
3e35628873
Remove installing python again in container ( #7852 )
...
update
2024-05-03 15:09:15 +05:30
Lucain
6a479588db
Respect resume_download deprecation ( #7843 )
...
* Deprecate resume_download
* align docstring with transformers
* style
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-05-03 08:42:57 +02:00
Aritra Roy Gosthipaty
fa489eaed6
[Tests] reduce the model size in the blipdiffusion fast test ( #7849 )
...
reducing model size
2024-05-03 07:46:48 +05:30
Dhruv Nair
0d7c479023
Update deps for pipe test fetcher ( #7838 )
...
update
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-05-02 20:36:47 +05:30
Guillaume LEGENDRE
ce97d7e19b
Change GPU Runners ( #7840 )
...
* Move to new GPU Runners for slow tests
* Move to new GPU Runners for nightly tests
2024-05-02 18:48:46 +05:30
Guillaume LEGENDRE
44ba90caff
move to new runners ( #7839 )
2024-05-02 14:53:38 +02:00
Dhruv Nair
3c85a57297
Update CI cache ( #7832 )
...
update
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-05-02 14:03:35 +05:30
Dhruv Nair
03ca11318e
Update download diff format tests ( #7831 )
...
update
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-05-02 13:15:38 +05:30
Dhruv Nair
3ffa7b46e5
Fix hanging pipeline fetching ( #7837 )
...
update
2024-05-02 13:08:57 +05:30
yunseong Cho
c1b2a89e34
Fix key error for dictionary with randomized order in convert_ldm_unet_checkpoint ( #7680 )
...
fix key error for different order
Co-authored-by: yunseong <yunseong.cho@superlabs.us >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-05-02 10:29:55 +05:30
Aritra Roy Gosthipaty
435d37ce5a
[Tests] reduce the model size in the audioldm fast test ( #7833 )
...
chore: initial size reduction of models
2024-05-02 06:03:52 +05:30
YiYi Xu
5915c2985d
[ip-adapter] fix ip-adapter for StableDiffusionInstructPix2PixPipeline ( #7820 )
...
update prepare_ip_adapter_ for pix2pix
2024-05-01 06:27:43 -10:00
YiYi Xu
21a7ff12a7
update the logic of is_sequential_cpu_offload ( #7788 )
...
* up
* add comment to the tests + fix dit
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-05-01 06:25:57 -10:00
Sayak Paul
8909ab4b19
[Tests] fix: device map tests for models ( #7825 )
...
* fix: device module tests
* remove patch file
* Empty-Commit
2024-05-01 18:45:47 +05:30
Dhruv Nair
c1edb03c37
Fix for pipeline slow test fetcher ( #7824 )
...
* update
* update
2024-05-01 17:36:54 +05:30
Steven Liu
0d08370263
[docs] Community pipelines ( #7819 )
...
* community pipelines
* feedback
* consolidate
2024-04-30 14:10:14 -07:00
Tolga Cangöz
b8ccb46259
Fix CPU offload in docstring ( #7827 )
...
Fix cpu offload
2024-04-30 10:53:27 -07:00
Dhruv Nair
725ead2f5e
SSH Runner Workflow Update ( #7822 )
...
* add debug workflow
* update
2024-04-30 20:14:18 +05:30
Linoy Tsaban
26a7851e1e
Add B-Lora training option to the advanced dreambooth lora script ( #7741 )
...
* add blora
* add blora
* add blora
* add blora
* little changes
* little changes
* remove redundancies
* fixes
* add B LoRA to readme
* style
* inference
* defaults + path to loras+ generation
* minor changes
* style
* minor changes
* minor changes
* blora arg
* added --lora_unet_blocks
* style
* Update examples/advanced_diffusion_training/README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* add commit hash to B-LoRA repo cloneing
* change inference, remove cloning
* change inference, remove cloning
add section about configureable unet blocks
* change inference, remove cloning
add section about configureable unet blocks
* Apply suggestions from code review
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-30 09:46:30 +05:30
Sayak Paul
3fd31eef51
[Core] introduce _no_split_modules to ModelMixin ( #6396 )
...
* introduce _no_split_modules.
* unnecessary spaces.
* remove unnecessary kwargs and style
* fix: accelerate imports.
* change to _determine_device_map
* add the blocks that have residual connections.
* add: CrossAttnUpBlock2D
* add: testin
* style
* line-spaces
* quality
* add disk offload test without safetensors.
* checking disk offloading percentages.
* change model split
* add: utility for checking multi-gpu requirement.
* model parallelism test
* splits.
* splits.
* splits
* splits.
* splits.
* splits.
* offload folder to test_disk_offload_with_safetensors
* add _no_split_modules
* fix-copies
2024-04-30 08:46:51 +05:30
Aritra Roy Gosthipaty
b02e2113ff
[Tests] reduce the model size in the amused fast test ( #7804 )
...
* chore: reducing model sizes
* chore: shrinks further
* chore: shrinks further
* chore: shrinking model for img2img pipeline
* chore: reducing size of model for inpaint pipeline
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-30 08:11:26 +05:30
Aritra Roy Gosthipaty
21f023ec1a
[Tests] reduce the model size in the ddpm fast test ( #7797 )
...
* chore: reducing unet size for faster tests
* review suggestions
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-30 08:11:03 +05:30
Aritra Roy Gosthipaty
31d9f9ea77
[Tests] reduce the model size in the ddim fast test ( #7803 )
...
chore: reducing model size for ddim fast pipeline
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-30 07:54:38 +05:30
Clint Adams
f53352f750
Set main_input_name in StableDiffusionSafetyChecker to "clip_input" ( #7500 )
...
FlaxStableDiffusionSafetyChecker sets main_input_name to "clip_input".
This makes StableDiffusionSafetyChecker consistent.
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-04-29 11:39:59 -10:00
RuiningLi
83ae24ce2d
Added get_velocity function to EulerDiscreteScheduler. ( #7733 )
...
* Added get_velocity function to EulerDiscreteScheduler.
* Fix white space on blank lines
* Added copied from statement
* back to the original.
---------
Co-authored-by: Ruining Li <ruining@robots.ox.ac.uk >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-29 10:32:13 -10:00
jschoormans
8af793b2d4
Adding TextualInversionLoaderMixin for the controlnet_inpaint_sd_xl pipeline ( #7288 )
...
* added TextualInversionMixIn to controlnet_inpaint_sd_xl pipeline
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-04-29 09:00:53 -10:00
Dhruv Nair
eb96ff0d59
Safetensor loading in AnimateDiff conversion scripts ( #7764 )
...
* update
* update
2024-04-29 17:36:50 +05:30
Yushu
a38dd79512
[Pipeline] Fix error of SVD pipeline when num_videos_per_prompt > 1 ( #7786 )
...
swap the order for do_classifier_free_guidance concat with repeat
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-04-29 16:24:16 +05:30
Dhruv Nair
b1c5817a89
Add debugging workflow ( #7778 )
...
add debug workflow
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-29 13:44:39 +05:30
Nilesh
235d34cf56
Check for latents, before calling prepare_latents - sdxlImg2Img ( #7582 )
...
* Check for latents, before calling prepare_latents - sdxlImg2Img
* Added latents check for all the img2img pipeline
* Fixed silly mistake while checking latents as None
2024-04-28 14:53:29 -10:00
Jenyuan-Huang
5029673987
Update InstantStyle usage in IP-Adapter documentation ( #7806 )
...
* enable control ip-adapter per-transformer block on-the-fly
---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
Co-authored-by: ResearcherXman <xhs.research@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2024-04-28 10:34:57 -10:00
Sayak Paul
56bd7e67c2
[Scheduler] introduce sigma schedule. ( #7649 )
...
* introduce sigma schedule.
Co-authored-by: Suraj Patil <surajp815@gmail.com >
* address yiyi
* update docstrings.
* implement the schedule for EDMDPMSolverMultistepScheduler
---------
Co-authored-by: Suraj Patil <surajp815@gmail.com >
2024-04-27 07:40:35 +05:30
39th president of the United States, probably
9d16daaf64
Add DREAM training ( #6381 )
...
A new function compute_dream_and_update_latents has been added to the
training utilities that allows you to do DREAM rectified training in line
with the paper https://arxiv.org/abs/2312.00210 . The method can be used
with an extra argument in the train_text_to_image.py script.
Co-authored-by: Jimmy <39@🇺🇸 .com>
2024-04-27 07:19:15 +05:30
Fabio Rigano
8e4ca1b6b2
[Docs] Update image masking and face id example ( #7780 )
...
* [Docs] Update image masking and face id example
* Update docs
* Fix docs
2024-04-26 12:51:11 -10:00
Beinsezii
0d2d424fbe
Add PixArtSigmaPipeline to AutoPipeline mapping ( #7783 )
2024-04-26 09:10:20 -10:00
Steven Liu
e24e54fdfa
[docs] Fix AutoPipeline docstring ( #7779 )
...
fix
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-26 10:09:36 -07:00
btlorch
ebc99a77aa
Convert RGB to BGR for the SDXL watermark encoder ( #7013 )
...
* Convert channel order to BGR for the watermark encoder. Convert the watermarked BGR images back to RGB. Fixes #6292
* Revert channel order before stacking images to overcome limitations that negative strides are currently not supported
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-04-25 14:44:53 -10:00
Steven Liu
fa750a15bd
[docs] Refactor image quality docs ( #7758 )
...
* refactor
* code snippets
* fix path
* fix path in guide
* code outputs
* align toctree title
* title
* fix title
2024-04-25 16:55:35 -07:00
Steven Liu
181688012a
[docs] Reproducible pipelines ( #7769 )
...
* reproducibility
* feedback
* feedback
* fix path
* github link
2024-04-25 16:15:12 -07:00
Sayak Paul
142f353e1c
Fix lora device test ( #7738 )
...
* fix lora device test
* fix more.
* fix more/
* quality
* empty
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2024-04-25 18:05:27 +05:30
Sayak Paul
b833d0fc80
[Tests] mark UNetControlNetXSModelTests::test_forward_no_control to be flaky ( #7771 )
...
decorate UNetControlNetXSModelTests::test_forward_no_control with is_flaky
2024-04-25 07:29:04 +05:30
Sayak Paul
e963621649
[PixArt] fix small nits in pixart sigma ( #7767 )
...
fix small nits in pixart sigma
2024-04-25 06:37:35 +05:30
Junsong Chen
39215aa30e
PixArt-Sigma Implementation ( #7654 )
...
* support PixArt-DMD
---------
Co-authored-by: jschen <chenjunsong4@h-partners.com >
Co-authored-by: badayvedat <badayvedat@gmail.com >
Co-authored-by: Vedat Baday <54285744+badayvedat@users.noreply.github.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2024-04-23 22:33:08 -10:00
Dhruv Nair
9ef43f38d4
Fix test for consistency decoder. ( #7746 )
...
update
2024-04-24 12:28:11 +05:30
Dhruv Nair
88018fcf20
Fix failing VAE tiling test ( #7747 )
...
update
2024-04-24 12:27:45 +05:30