Dhruv Nair
c86b766d6b
clean up
2023-12-18 13:21:22 +00:00
Dhruv Nair
fef19188ee
clean up toctree
2023-12-18 13:15:36 +00:00
Dhruv Nair
3892ce9453
clean up
2023-12-18 13:04:29 +00:00
Dhruv Nair
76bed110b4
Merge branch 'deprecate-pipe' of https://github.com/huggingface/diffusers into deprecate-pipe
2023-12-18 12:29:57 +00:00
Dhruv Nair
6bfdf13125
clean up
2023-12-18 12:19:45 +00:00
Patrick von Platen
321e37adab
clean
2023-12-18 11:33:26 +01:00
Patrick von Platen
95b8a96630
clean
2023-12-18 11:31:18 +01:00
Patrick von Platen
c687648842
clean
2023-12-18 11:29:09 +01:00
Dhruv Nair
e66b520fd0
clean up
2023-12-18 07:38:07 +00:00
Dhruv Nair
851c6f1c82
Merge branch 'main' into deprecate-pipe
2023-12-18 07:22:04 +00:00
Dhruv Nair
a4a1404366
fix copies
2023-12-18 07:16:35 +00:00
Dhruv Nair
da12b1c4b1
make style
2023-12-18 07:13:31 +00:00
Sayak Paul
56b3b21693
[Refactor autoencoders] feat: introduce autoencoders module ( #6129 )
...
* feat: introduce autoencoders module
* more changes for styling and copy fixing
* path changes in the docs.
* fix: import structure in init.
* fix controlnetxs import
2023-12-18 12:42:15 +05:30
Dhruv Nair
23fe7ecaf2
remove deprecation message
2023-12-18 07:11:44 +00:00
Sayak Paul
9cef07da5a
[Benchmarks] fix: lcm benchmarking reporting ( #6198 )
...
* fix: lcm benchmarking reporting
* fix generate_csv_dict call.
2023-12-17 15:32:11 +05:30
Sayak Paul
2d94c7838e
[Core] feat: enable fused attention projections for other SD and SDXL pipelines ( #6179 )
...
* feat: enable fused attention projections for other SD and SDXL pipelines
* add: test for SD fused projections.
2023-12-16 08:45:54 +05:30
Sayak Paul
a81334e3f0
[LoRA] add an error message when dealing with _best_guess_weight_name ofline ( #6184 )
...
* add an error message when dealing with _best_guess_weight_name ofline
* simplify condition
2023-12-16 08:36:08 +05:30
Dhruv Nair
d704a730cd
Compile test fix ( #6104 )
...
* update
* update
2023-12-15 18:34:46 +05:30
dg845
49db233b35
Clean Up Comments in LCM(-LoRA) Distillation Scripts. ( #6145 )
...
* Clean up comments in LCM(-LoRA) distillation scripts.
* Calculate predicted source noise noise_pred correctly for all prediction_types.
* make style
* apply suggestions from review
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-15 18:18:16 +05:30
Dhruv Nair
93ea26f272
Add PEFT to training deps ( #6148 )
...
add peft to training deps
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-15 08:39:59 +05:30
Dhruv Nair
f5dfe2a8b0
LoRA test fixes ( #6163 )
...
* update
* update
* update
* update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-15 08:39:41 +05:30
Patrick von Platen
4836cfad98
[Sigmas] Keep sigmas on CPU ( #6173 )
...
* correct
* Apply suggestions from code review
* make style
2023-12-15 07:43:18 +05:30
Kuba
1ccbfbb663
[docs] Add missing \ in lora.md ( #6174 )
2023-12-14 16:55:43 -08:00
Linoy Tsaban
29dfe22a8e
[advanced dreambooth lora sdxl training script] load pipeline for inference only if validation prompt is used ( #6171 )
...
* load pipeline for inference only if validation prompt is used
* move things outside
* load pipeline for inference only if validation prompt is used
* fix readme when validation prompt is used
---------
Co-authored-by: linoytsaban <linoy@huggingface.co >
Co-authored-by: apolinário <joaopaulo.passos@gmail.com >
2023-12-14 11:45:33 -06:00
Aryan V S
56806cdbfd
Add missing subclass docs, Fix broken example in SD_safe ( #6116 )
...
* fix broken example in pipeline_stable_diffusion_safe
* fix typo in pipeline_stable_diffusion_pix2pix_zero
* add missing docs
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-14 09:20:30 -08:00
Steven Liu
8ccc76ab37
[docs] IP-Adapter API doc ( #6140 )
...
add ip-adapter
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-14 09:19:37 -08:00
Monohydroxides
c46711e895
[Community] Add SDE Drag pipeline ( #6105 )
...
* Add community pipeline: sde_drag.py
* Update README.md
* Update README.md
Update example code and visual example
* Update sde_drag.py
Update code example.
2023-12-14 20:47:20 +05:30
Dhruv Nair
f13665e8f4
remove tests for deprecated pipelines
2023-12-14 08:52:26 +00:00
Dhruv Nair
4a92f3412a
format
2023-12-14 08:46:32 +00:00
Dhruv Nair
237bf591f2
add deprecation message
2023-12-14 08:33:07 +00:00
Dhruv Nair
8edd9f27f9
update
2023-12-14 08:05:02 +00:00
Dhruv Nair
f11217c02d
make style
2023-12-14 07:58:15 +00:00
Dhruv Nair
13d08aab57
deprecate pipe
2023-12-14 07:55:16 +00:00
Sayak Paul
1d686bac81
[feat: Benchmarking Workflow] add stuff for a benchmarking workflow ( #5839 )
...
* add poc for benchmarking workflow.
* import
* fix argument
* fix: argument
* fix: path
* fix
* fix
* path
* output csv files.
* workflow cleanup
* append token
* add utility to push to hf dataset
* fix: kw arg
* better reporting
* fix: headers
* better formatting of the numbers.
* better type annotation
* fix: formatting
* moentarily disable check
* push results.
* remove disable check
* introduce base classes.
* img2img class
* add inpainting pipeline
* intoduce base benchmark class.
* add img2img and inpainting
* feat: utility to compare changes
* fix
* fix import
* add args
* basepath
* better exception handling
* better path handling
* fix
* fix
* remove
* ifx
* fix
* add: support for controlnet.
* image_url -> url
* move images to huggingface hub
* correct urls.
* root_ckpt
* flush before benchmarking
* don't install accelerate from source
* add runner
* simplify Diffusers Benchmarking step
* change runner
* fix: subprocess call.
* filter percentage values
* fix controlnet benchmark
* add t2i adapters.
* fix filter columns
* fix t2i adapter benchmark
* fix init.
* fix
* remove safetensors flag
* fix args print
* fix
* feat: run_command
* add adapter resolution mapping
* benchmark t2i adapter fix.
* fix adapter input
* fix
* convert to L.
* add flush() add appropriate places
* better filtering
* okay
* get env for torch
* convert to float
* fix
* filter out nans.
* better coment
* sdxl
* sdxl for other benchmarks.
* fix: condition
* fix: condition for inpainting
* fix: mapping for resolution
* fix
* include kandinsky and wuerstchen
* fix: Wuerstchen
* Empty-Commit
* [Community] AnimateDiff + Controlnet Pipeline (#5928 )
* begin work on animatediff + controlnet pipeline
* complete todos, uncomment multicontrolnet, input checks
Co-Authored-By: EdoardoBotta <botta.edoardo@gmail.com >
* update
Co-Authored-By: EdoardoBotta <botta.edoardo@gmail.com >
* add example
* update community README
* Update examples/community/README.md
---------
Co-authored-by: EdoardoBotta <botta.edoardo@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* EulerDiscreteScheduler add `rescale_betas_zero_snr` (#6024 )
* EulerDiscreteScheduler add `rescale_betas_zero_snr`
* Revert "[Community] AnimateDiff + Controlnet Pipeline (#5928 )"
This reverts commit 821726d7c0#6024 )"
This reverts commit 3dc2362b5apatrick.v.platen@gmail.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: Aryan V S <contact.aryanvs@gmail.com >
Co-authored-by: EdoardoBotta <botta.edoardo@gmail.com >
Co-authored-by: Beinsezii <39478211+Beinsezii@users.noreply.github.com >
2023-12-12 11:03:34 +05:30
M. Tolga Cangöz
0a401b95b7
[Docs] Fix typos ( #6122 )
...
Fix typos and trim trailing whitespaces
2023-12-11 10:55:28 -08:00
Edward Li
664e931bcb
Correct type annotation for VaeImageProcessor.numpy_to_pil ( #6111 )
...
From `(np.ndarray) -> PIL.Image.Image` to `(np.ndarray) -> List[PIL.Image.Image]`.
2023-12-11 15:22:04 +05:30
Aryan V S
88bdd97ccd
IP adapter support for most pipelines ( #5900 )
...
* support ip-adapter in src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_upscale.py
* support ip-adapter in src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_attend_and_excite.py
* support ip-adapter in src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_instruct_pix2pix.py
* update tests
* support ip-adapter in src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_panorama.py
* support ip-adapter in src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_sag.py
* support ip-adapter in src/diffusers/pipelines/stable_diffusion_safe/pipeline_stable_diffusion_safe.py
* support ip-adapter in src/diffusers/pipelines/latent_consistency_models/pipeline_latent_consistency_text2img.py
* support ip-adapter in src/diffusers/pipelines/latent_consistency_models/pipeline_latent_consistency_img2img.py
* support ip-adapter in src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion_ldm3d.py
* revert changes to sd_attend_and_excite and sd_upscale
* make style
* fix broken tests
* update ip-adapter implementation to latest
* apply suggestions from review
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-10 21:19:14 +05:30
Charchit Sharma
08b453e382
IP-Adapter for StableDiffusionControlNetImg2ImgPipeline ( #5901 )
...
* adapter for StableDiffusionControlNetImg2ImgPipeline
* fix-copies
* fix-copies
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-09 11:02:55 +05:30
apolinário
2a111bc9fe
[Advanced Training Script] Fix pipe example ( #6106 )
2023-12-08 15:56:35 +01:00
apolinário
16e6997f0d
[Advanced Diffusion Script] Add Widget default text ( #6100 )
...
add widget
2023-12-08 12:45:27 +01:00
YiYi Xu
3b9b98656e
Fix a bug in add_noise function ( #6085 )
...
* fix
* copies
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-12-07 11:35:28 -10:00
Fabio Rigano
b65928b556
Add support for IPAdapterFull ( #5911 )
...
* Add support for IPAdapterFull
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-12-07 06:40:39 -10:00
Beinsezii
6bf1ca2c79
EulerDiscreteScheduler add rescale_betas_zero_snr ( #6024 )
...
* EulerDiscreteScheduler add `rescale_betas_zero_snr`
2023-12-06 21:51:04 -10:00
Aryan V S
978dec9014
[Community] AnimateDiff + Controlnet Pipeline ( #5928 )
...
* begin work on animatediff + controlnet pipeline
* complete todos, uncomment multicontrolnet, input checks
Co-Authored-By: EdoardoBotta <botta.edoardo@gmail.com >
* update
Co-Authored-By: EdoardoBotta <botta.edoardo@gmail.com >
* add example
* update community README
* Update examples/community/README.md
---------
Co-authored-by: EdoardoBotta <botta.edoardo@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-12-06 21:01:41 -10:00
Dhruv Nair
79a7ab92d1
Fix clearing backend cache from device agnostic testing ( #6075 )
...
update
2023-12-07 11:18:31 +05:30
Younes Belkada
c2717317f0
[PEFT] Adapt example scripts to use PEFT ( #5388 )
...
* adapt example scripts to use PEFT
* Update examples/text_to_image/train_text_to_image_lora.py
* fix
* add for SDXL
* oops
* make sure to install peft
* fix
* fix
* fix dreambooth and lora
* more fixes
* add peft to requirements.txt
* fix
* final fix
* add peft version in requirements
* remove comment
* change variable names
* add few lines in readme
* add to reqs
* style
* fix issues
* fix lora dreambooth xl tests
* init_lora_weights to gaussian and add out proj where missing
* ammend requirements.
* ammend requirements.txt
* add correct peft versions
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-07 09:39:29 +05:30
Ian
bf7f9b49a2
Fix typing inconsistency in Euler discrete scheduler ( #6052 )
2023-12-06 23:45:16 +01:00
UmerHA
e192ae08d3
Add ControlNet-XS support ( #5827 )
...
* Check in 23-10-05
* check-in 23-10-06
* check-in 23-10-07 2pm
* check-in 23-10-08
* check-in 231009T1200
* check-in 230109
* checkin 231010
* init + forward run
* checkin
* checkin
* ControlNetXSModel is now saveable+loadable
* Forward works
* checkin
* Pipeline works with `no_control=True`
* checkin
* debug: save intermediate outputs of resnet
* checkin
* Understood time error + fixed connection error
* checkin
* checkin 231106T1600
* turned off detailled debug prints
* time debug logs
* small fix
* Separated control_scale for connections/time
* simplified debug logging
* Full denoising works with control scale = 0
* aligned logs
* Added control_attention_head_dim param
* Passing n_heads instead of dim_head into ctrl unet
* Fixed ctrl midblock bug
* Cleanup
* Fixed time dtype bug
* checkin
* 1. from_unet, 2. base passed, 3. all unet params
* checkin
* Finished docstrings
* cleanup
* make style
* checkin
* more tests pass
* Fixed tests
* removed debug logs
* make style + quality
* make fix-copies
* fixed documentation
* added cnxs to doc toc
* added control start/end param
* Update controlnetxs_sdxl.md
* tried to fix copies..
* Fixed norm_num_groups in from_unet
* added sdxl-depth test
* created SD2.1 controlnet-xs pipeline
* re-added debug logs
* Adjusting group norm ; readded logs
* Added debug log statements
* removed debug logs ; started tests for sd2.1
* updated sd21 tests
* fixed tests
* fixed tests
* slightly increased error tolerance for 1 test
* make style & quality
* Added docs for CNXS-SD
* make fix-copies
* Fixed sd compile test ; fixed gradient ckpointing
* vae downs = cnxs conditioning downs; removed guess
* make style & quality
* Fixed tests
* fixed test
* Incorporated review feedback
* simplified control model surgery
* fixed tests & make style / quality
* Updated docs; deleted pip & cursor files
* Rolled back minimal change to resnet
* Update resnet.py
* Update resnet.py
* Update src/diffusers/models/controlnetxs.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/models/controlnetxs.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Incorporated review feedback
* Update docs/source/en/api/pipelines/controlnetxs_sdxl.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/controlnetxs.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/controlnetxs.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/controlnetxs.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/models/controlnetxs.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/models/controlnetxs.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/pipelines/controlnet_xs/pipeline_controlnet_xs.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/controlnetxs.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/pipelines/controlnet_xs/pipeline_controlnet_xs_sd_xl.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Incorporated doc feedback
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2023-12-06 23:33:47 +01:00
Steven Liu
87a09d66f3
[docs] SDXL Turbo ( #6065 )
...
api docs
2023-12-06 14:33:14 -08:00
Lucain
75ada25048
Harmonize HF environment variables + deprecate use_auth_token ( #6066 )
...
* Harmonize HF environment variables + deprecate use_auth_token
* fix import
* fix
2023-12-06 22:22:31 +01:00
