Charchit Sharma
08b453e382
IP-Adapter for StableDiffusionControlNetImg2ImgPipeline ( #5901 )
...
* adapter for StableDiffusionControlNetImg2ImgPipeline
* fix-copies
* fix-copies
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-12-09 11:02:55 +05:30
Fabio Rigano
b65928b556
Add support for IPAdapterFull ( #5911 )
...
* Add support for IPAdapterFull
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-12-07 06:40:39 -10:00
Beinsezii
6bf1ca2c79
EulerDiscreteScheduler add rescale_betas_zero_snr ( #6024 )
...
* EulerDiscreteScheduler add `rescale_betas_zero_snr`
2023-12-06 21:51:04 -10:00
Dhruv Nair
79a7ab92d1
Fix clearing backend cache from device agnostic testing ( #6075 )
...
update
2023-12-07 11:18:31 +05:30
UmerHA
e192ae08d3
Add ControlNet-XS support ( #5827 )
...
* Check in 23-10-05
* check-in 23-10-06
* check-in 23-10-07 2pm
* check-in 23-10-08
* check-in 231009T1200
* check-in 230109
* checkin 231010
* init + forward run
* checkin
* checkin
* ControlNetXSModel is now saveable+loadable
* Forward works
* checkin
* Pipeline works with `no_control=True`
* checkin
* debug: save intermediate outputs of resnet
* checkin
* Understood time error + fixed connection error
* checkin
* checkin 231106T1600
* turned off detailled debug prints
* time debug logs
* small fix
* Separated control_scale for connections/time
* simplified debug logging
* Full denoising works with control scale = 0
* aligned logs
* Added control_attention_head_dim param
* Passing n_heads instead of dim_head into ctrl unet
* Fixed ctrl midblock bug
* Cleanup
* Fixed time dtype bug
* checkin
* 1. from_unet, 2. base passed, 3. all unet params
* checkin
* Finished docstrings
* cleanup
* make style
* checkin
* more tests pass
* Fixed tests
* removed debug logs
* make style + quality
* make fix-copies
* fixed documentation
* added cnxs to doc toc
* added control start/end param
* Update controlnetxs_sdxl.md
* tried to fix copies..
* Fixed norm_num_groups in from_unet
* added sdxl-depth test
* created SD2.1 controlnet-xs pipeline
* re-added debug logs
* Adjusting group norm ; readded logs
* Added debug log statements
* removed debug logs ; started tests for sd2.1
* updated sd21 tests
* fixed tests
* fixed tests
* slightly increased error tolerance for 1 test
* make style & quality
* Added docs for CNXS-SD
* make fix-copies
* Fixed sd compile test ; fixed gradient ckpointing
* vae downs = cnxs conditioning downs; removed guess
* make style & quality
* Fixed tests
* fixed test
* Incorporated review feedback
* simplified control model surgery
* fixed tests & make style / quality
* Updated docs; deleted pip & cursor files
* Rolled back minimal change to resnet
* Update resnet.py
* Update resnet.py
* Update src/diffusers/models/controlnetxs.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/models/controlnetxs.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Incorporated review feedback
* Update docs/source/en/api/pipelines/controlnetxs_sdxl.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/controlnetxs.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/controlnetxs.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/controlnetxs.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/models/controlnetxs.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/models/controlnetxs.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/pipelines/controlnet_xs/pipeline_controlnet_xs.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/controlnetxs.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/pipelines/controlnet_xs/pipeline_controlnet_xs_sd_xl.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Incorporated doc feedback
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2023-12-06 23:33:47 +01:00
Sayak Paul
a2bc2e14b9
[feat] allow SDXL pipeline to run with fused QKV projections ( #6030 )
...
* debug
* from step
* print
* turn sigma a list
* make str
* init_noise_sigma
* comment
* remove prints
* feat: introduce fused projections
* change to a better name
* no grad
* device.
* device
* dtype
* okay
* print
* more print
* fix: unbind -> split
* fix: qkv >-> k
* enable disable
* apply attention processor within the method
* attn processors
* _enable_fused_qkv_projections
* remove print
* add fused projection to vae
* add todos.
* add: documentation and cleanups.
* add: test for qkv projection fusion.
* relax assertions.
* relax further
* fix: docs
* fix-copies
* correct error message.
* Empty-Commit
* better conditioning on disable_fused_qkv_projections
* check
* check processor
* bfloat16 computation.
* check latent dtype
* style
* remove copy temporarily
* cast latent to bfloat16
* fix: vae -> self.vae
* remove print.
* add _change_to_group_norm_32
* comment out stuff that didn't work
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* reflect patrick's suggestions.
* fix imports
* fix: disable call.
* fix more
* fix device and dtype
* fix conditions.
* fix more
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-12-06 07:33:26 +05:30
Arsalan
f427345ab1
Device agnostic testing ( #5612 )
...
* utils and test modifications to enable device agnostic testing
* device for manual seed in unet1d
* fix generator condition in vae test
* consistency changes to testing
* make style
* add device agnostic testing changes to source and one model test
* make dtype check fns private, log cuda fp16 case
* remove dtype checks from import utils, move to testing_utils
* adding tests for most model classes and one pipeline
* fix vae import
2023-12-05 19:04:13 +05:30
Dhruv Nair
f948778322
Move kandinsky convert script ( #6047 )
...
move kandinsky convert script
2023-12-05 15:12:37 +05:30
takuoko
0a08d41961
[Feature] Support IP-Adapter Plus ( #5915 )
...
* Support IP-Adapter Plus
* fix format
* restore before black format
* restore before black format
* generic
* Refactor PerceiverAttention
* format
* fix test and refactor PerceiverAttention
* generic encode_image
* keep attention implementation
* merge tests
* encode_image backward compatible
* code quality
* fix controlnet inpaint pipeline
* refactor FFN
* refactor FFN
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2023-12-04 12:43:34 +01:00
Sayak Paul
3351270627
[PixArt Tests] remove fast tests from slow suite ( #5945 )
...
remove fast tests from slow suite
2023-12-02 20:58:27 +05:30
YiYi Xu
b41f809a4e
[Kandinsky 3.0] Follow-up TODOs ( #5944 )
...
clean-up kendinsky 3.0
2023-12-01 07:14:22 -10:00
Suraj Patil
63f767ef15
Add SVD ( #5895 )
...
* begin model
* finish blocks
* add_embedding
* addition_time_embed_dim
* use TimestepEmbedding
* fix temporal res block
* fix time_pos_embed
* fix add_embedding
* add conversion script
* fix model
* up
* add new resnet blocks
* make forward work
* return sample in original shape
* fix temb shape in TemporalResnetBlock
* add spatio temporal transformers
* add vae blocks
* fix blocks
* update
* update
* fix shapes in Alphablender and add time activation in res blcok
* use new blocks
* style
* fix temb shape
* fix SpatioTemporalResBlock
* reuse TemporalBasicTransformerBlock
* fix TemporalBasicTransformerBlock
* use TransformerSpatioTemporalModel
* fix TransformerSpatioTemporalModel
* fix time_context dim
* clean up
* make temb optional
* add blocks
* rename model
* update conversion script
* remove UNetMidBlockSpatioTemporal
* add in init
* remove unused arg
* remove unused arg
* remove more unsed args
* up
* up
* check for None
* update vae
* update up/mid blocks for decoder
* begin pipeline
* adapt scheduler
* add guidance scalings
* fix norm eps in temporal transformers
* add temporal autoencoder
* make pipeline run
* fix frame decodig
* decode in float32
* decode n frames at a time
* pass decoding_t to decode_latents
* fix decode_latents
* vae encode/decode in fp32
* fix dtype in TransformerSpatioTemporalModel
* type image_latents same as image_embeddings
* allow using differnt eps in temporal block for video decoder
* fix default values in vae
* pass num frames in decode
* switch spatial to temporal for mixing in VAE
* fix num frames during split decoding
* cast alpha to sample dtype
* fix attention in MidBlockTemporalDecoder
* fix typo
* fix guidance_scales dtype
* fix missing activation in TemporalDecoder
* skip_post_quant_conv
* add vae conversion
* style
* take guidance scale as input
* up
* allow passing PIL to export_video
* accept fps as arg
* add pipeline and vae in init
* remove hack
* use AutoencoderKLTemporalDecoder
* don't scale image latents
* add unet tests
* clean up unet
* clean TransformerSpatioTemporalModel
* add slow svd test
* clean up
* make temb optional in Decoder mid block
* fix norm eps in TransformerSpatioTemporalModel
* clean up temp decoder
* clean up
* clean up
* use c_noise values for timesteps
* use math for log
* update
* fix copies
* doc
* upcast vae
* update forward pass for gradient checkpointing
* make added_time_ids is tensor
* up
* fix upcasting
* remove post quant conv
* add _resize_with_antialiasing
* fix _compute_padding
* cleanup model
* more cleanup
* more cleanup
* more cleanup
* remove freeu
* remove attn slice
* small clean
* up
* up
* remove extra step kwargs
* remove eta
* remove dropout
* remove callback
* remove merge factor args
* clean
* clean up
* move to dedicated folder
* remove attention_head_dim
* docstr and small fix
* update unet doc strings
* rename decoding_t
* correct linting
* store c_skip and c_out
* cleanup
* clean TemporalResnetBlock
* more cleanup
* clean up vae
* clean up
* begin doc
* more cleanup
* up
* up
* doc
* Improve
* better naming
* better naming
* better naming
* better naming
* better naming
* better naming
* better naming
* better naming
* Apply suggestions from code review
* Default chunk size to None
* add example
* Better
* Apply suggestions from code review
* update doc
* Update src/diffusers/pipelines/stable_diffusion_video/pipeline_stable_diffusion_video.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* style
* Get torch compile working
* up
* rename
* fix doc
* add chunking
* torch compile
* torch compile
* add modelling outputs
* torch compile
* Improve chunking
* Apply suggestions from code review
* Update docs/source/en/using-diffusers/svd.md
* Close diff tag
* remove slicing
* resnet docstr
* add docstr in resnet
* rename
* Apply suggestions from code review
* update tests
* Fix output type latents
* fix more
* fix more
* Update docs/source/en/using-diffusers/svd.md
* fix more
* add pipeline tests
* remove unused arg
* clean up
* make sure get_scaling receives tensors
* fix euler scheduler
* fix get_scalings
* simply euler for now
* remove old test file
* use randn_tensor to create noise
* fix device for rand tensor
* increase expected_max_difference
* fix test_inference_batch_single_identical
* actually fix test_inference_batch_single_identical
* disable test_save_load_float16
* skip test_float16_inference
* skip test_inference_batch_single_identical
* fix test_xformers_attention_forwardGenerator_pass
* Apply suggestions from code review
* update StableVideoDiffusionPipelineSlowTests
* update image
* add diffusers example
* fix more
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: apolinário <joaopaulo.passos@gmail.com >
2023-11-29 19:13:36 +01:00
vahramtadevosyan
d63a498c3b
[Pipeline] Add TextToVideoZeroSDXLPipeline ( #4695 )
...
* integrated sdxl for the text2video-zero pipeline
* make fix-copies
* fixed CI issues
* make fix-copies
* added docs and `copied from` statements
* added fast tests
* made a small change in docs
* quality+style check fix
* updated docs. added controlnet inference with sdxl
* added device compatibility for fast tests
* fixed docstrings
* changing vae upcasting
* remove torch.empty_cache to speed up inference
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* made fast tests to run on dummy models only, fixed copied from statements
* fixed testing utils imports
* Added bullet points for SDXL support
* fixed formatting & quality
* Update tests/pipelines/text_to_video/test_text_to_video_zero_sdxl.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update tests/pipelines/text_to_video/test_text_to_video_zero_sdxl.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* fixed minor error for merging
* fixed updates of sdxl
* made fast tests inherit from `PipelineTesterMixin` and run in 3-4secs on CPU
* make style && make quality
* reimplemented fast tests w/o default attn processor
* make style & make quality
* make fix-copies
* make fix-copies
* fixed docs
* make style & make quality & make fix-copies
* bug fix in cross attention
* make style && make quality
* make fix-copies
* fix gpu issues
* make fix-copies
* updated pipeline signature
---------
Co-authored-by: Vahram <vahram.tadevosyan@lambda-loginnode02.cm.cluster >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2023-11-29 16:10:43 +01:00
Marko Kostiv
6a4aad43dc
Controlnet ssd 1b support ( #5779 )
...
* Add SSD-1B support for controlnet model
* Add conditioning_channels into ControlNet init from unet
* Fix black formatting
* Isort fixes
* Adds SSD-1B controlnet pipeline test with UNetMidBlock2D as mid block
* Overrides failing ssd-1b tests
* Fixes tests after main branch update
* Fixes code quality checks
---------
Co-authored-by: Marko Kostiv <marko@linearity.io >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-11-29 16:10:01 +01:00
JuanCarlosPi
9f7b2cf2dc
Support of ip-adapter to the StableDiffusionControlNetInpaintPipeline ( #5887 )
...
* Change pipeline_controlnet_inpaint.py to add ip-adapter support. Changes are similar to those in pipeline_controlnet
* Change tests for the StableDiffusionControlNetInpaintPipeline by adding image_encoder: None
* Update src/diffusers/pipelines/controlnet/pipeline_controlnet_inpaint.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2023-11-29 16:00:24 +01:00
YiYi Xu
d9075be494
[load_textual_inversion]: allow multiple tokens ( #5837 )
...
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-11-27 06:52:36 -10:00
Patrick von Platen
e550163b9f
[Vae] Make sure all vae's work with latent diffusion models ( #5880 )
...
* add comments to explain the code better
* add comments to explain the code better
* add comments to explain the code better
* add comments to explain the code better
* add comments to explain the code better
* fix more
* fix more
* fix more
* fix more
* fix more
* fix more
2023-11-27 14:17:47 +01:00
dg845
67d070749a
Add Custom Timesteps Support to LCMScheduler and Supported Pipelines ( #5874 )
...
* Add custom timesteps support to LCMScheduler.
* Add custom timesteps support to StableDiffusionPipeline.
* Add custom timesteps support to StableDiffusionXLPipeline.
* Add custom timesteps support to remaining Stable Diffusion pipelines which support LCMScheduler (img2img, inpaint).
* Add custom timesteps support to remaining Stable Diffusion XL pipelines which support LCMScheduler (img2img, inpaint).
* Add custom timesteps support to StableDiffusionControlNetPipeline.
* Add custom timesteps support to T21 Stable Diffusion (XL) Adapters.
* Clean up Stable Diffusion inpaint tests.
* Manually add support for custom timesteps to AltDiffusion pipelines since make fix-copies doesn't appear to work correctly (it deletes the whole pipeline).
* make style
* Refactor pipeline timestep handling into the retrieve_timesteps function.
2023-11-27 12:39:14 +01:00
Aryan V S
9c357bda3f
Deprecate KarrasVeScheduler and ScoreSdeVpScheduler ( #5269 )
...
* deprecated: KarrasVeScheduler, ScoreSdeVpScheduler
* delete tests relevant to deprecated schedulers
* chore: run make style
* fix: import error caused due to incorrect _import_structure after deprecation
* fix: ScoreSdeVpScheduler was not importable from diffusers
* remove import added by assumption
* Update src/diffusers/schedulers/__init__.py as suggested by @patrickvonplaten
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* make it a part deprecated
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Fix
* fix
* fix doc
* fix doc....again.......
* remove karras_ve test folder
Co-Authored-By: YiYi Xu <yixu310@gmail.com >
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-11-27 12:33:02 +01:00
Junsong Chen
7d6f30e89b
[Fix: pixart-alpha] random 512px resolution bug ( #5842 )
...
* [Fix: pixart-alpha]
add ASPECT_RATIO_512_BIN in use_resolution_binning for random 512px image generation.
* add slow test file for 512px generation without resolution binning
* fix: slow tests for resolution binning.
---------
Co-authored-by: jschen <chenjunsong4@h-partners.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-11-27 13:35:35 +05:30
Patrick von Platen
b978334d71
[@cene555][Kandinsky 3.0] Add Kandinsky 3.0 ( #5913 )
...
* finalize
* finalize
* finalize
* add slow test
* add slow test
* add slow test
* Fix more
* add slow test
* fix more
* fix more
* fix more
* fix more
* fix more
* fix more
* fix more
* fix more
* fix more
* Better
* Fix more
* Fix more
* add slow test
* Add auto pipelines
* add slow test
* Add all
* add slow test
* add slow test
* add slow test
* add slow test
* add slow test
* Apply suggestions from code review
* add slow test
* add slow test
2023-11-24 17:46:00 +01:00
YiYi Xu
ba352aea29
[feat] IP Adapters (author @okotaku ) ( #5713 )
...
* add ip-adapter
---------
Co-authored-by: okotaku <to78314910@gmail.com >
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2023-11-21 07:34:30 -10:00
dg845
dc21498b43
Update LCMScheduler Inference Timesteps to be More Evenly Spaced ( #5836 )
...
* Change LCMScheduler.set_timesteps to pick more evenly spaced inference timesteps.
* Change inference_indices implementation to better match previous behavior.
* Add num_inference_steps=26 test case to test_inference_steps.
* run CI
---------
Co-authored-by: patil-suraj <surajp815@gmail.com >
2023-11-20 15:46:10 +01:00
Kashif Rasul
6b04d61cf6
[Styling] stylify using ruff ( #5841 )
...
* ruff format
* not need to use doc-builder's black styling as the doc is styled in ruff
* make fix-copies
* comment
* use run_ruff
2023-11-20 11:48:34 +01:00
Will Berman
2a84e8bb5a
fix memory consistency decoder test ( #5828 )
...
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2023-11-17 09:31:01 -08:00
Suraj Patil
64cbd8e27a
Support LCM in ControlNet and Adapter pipelines. ( #5822 )
...
* support lcm
* fix tests
* fix tests
2023-11-16 14:59:50 +01:00
Dhruv Nair
cdadb023a2
Make Video Tests faster ( #5787 )
...
* update test
* update
2023-11-15 10:56:01 +05:30
Sayak Paul
ded93f798c
[Refactor] refactor loaders.py to make it cleaner and leaner. ( #5771 )
...
* refactor loaders.py to make it cleaner and leaner.
* refactor loaders init
* inits.
* textual inversion to the init.
* inits.
* remove certain modules from the main init.
* AttnProcsLayers
* fix imports
* avoid circular import.
* fix circular import pt 2.
* address PR comments
* imports
* fix: imports.
* remove from main init for avoiding circular deps.
* remove spurious deps.
* fix-copies.
* fix imports.
* more debug
* more debug
* Apply suggestions from code review
* Apply suggestions from code review
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-11-14 12:54:28 +01:00
Sayak Paul
a5720e9e31
[PixArt-Alpha] Fix PixArt-Alpha pipeline when number of images to generate is more than 1 ( #5752 )
...
* does this fix things?
* attention mask use
* attention mask order
* better masking.
* add: tesrt
* remove mask_featur
* test
* debug
* fix: tests
* deprecate mask_feature
* add deprecation test
* add slow test
* add print statements to retrieve the assertion values.
* fix for the 1024 fast tes
* fix tesy
* fix the remaining
* Apply suggestions from code review
* more debug
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-11-14 12:45:35 +01:00
Sourab Mangrulkar
9c8eca702c
add lora delete feature ( #5738 )
...
* add lora delete feature
* added tests and changed condition
* deal with corner cases
* more corner cases
* rename to `delete_adapter_layers` for consistency
---------
Co-authored-by: younesbelkada <younesbelkada@gmail.com >
2023-11-14 10:51:13 +01:00
Sayak Paul
ed759f0aee
[PixArt-Alpha] Introduce resolution binning ( #5739 )
...
* feat: add resolution binning
Co-authored-by: lawrence-cj <jschen@mail.dlut.edu.cn >
* rename
* debug
* add :test
* remove unused variable
* set resolution_binning to False.
---------
Co-authored-by: lawrence-cj <jschen@mail.dlut.edu.cn >
2023-11-14 08:34:59 +05:30
Kashif Rasul
c9f847a70f
[Wuerstchen] fix for when USE_PEFT_BACKEND is True ( #5704 )
...
* fix for when USE_PEFT_BACKEND is True
* Update modeling_wuerstchen_prior.py
* revert change
* add lora tests
2023-11-13 18:37:55 +01:00
Sayak Paul
1477865e48
post release v0.23.0 ( #5730 )
...
* post release
* fix: variant test
* up
* fix: test
2023-11-10 16:35:44 +05:30
Patrick von Platen
3d7eaf83d7
LCM Add Tests ( #5707 )
...
* lcm add tests
* uP
* Fix all
* uP
* Add
* all
* uP
* uP
* uP
* uP
* uP
* uP
* uP
2023-11-09 15:45:11 +01:00
Patrick von Platen
bf406ea886
Correct consist dec ( #5722 )
...
* uP
* Update src/diffusers/models/consistency_decoder_vae.py
* uP
* uP
2023-11-09 13:10:24 +01:00
Will Berman
2fd46405cd
consistency decoder ( #5694 )
...
* consistency decoder
* rename
* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update src/diffusers/pipelines/consistency_models/pipeline_consistency_models.py
* uP
* Apply suggestions from code review
* uP
* uP
* uP
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-11-09 12:21:41 +01:00
Dhruv Nair
65ef7a0c5c
Fix prompt bug in AnimateDiff ( #5702 )
...
* fix prompt bug
* add test
2023-11-08 21:49:09 +01:00
Sayak Paul
78be400761
[PixArt-Alpha] fix mask feature condition. ( #5695 )
...
* fix mask feature condition.
* debug
* remove identical test
* set correct
* Empty-Commit
2023-11-08 17:42:46 +05:30
Patrick von Platen
c803a8f8c0
[LCM] Fix img2img ( #5698 )
...
* [LCM] Fix img2img
* make fix-copies
* make fix-copies
* make fix-copies
* up
2023-11-08 11:51:46 +01:00
YiYi Xu
69996938cf
speed up Shap-E fast test ( #5686 )
...
skip rendering
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-11-08 11:43:20 +01:00
dg845
aab6de22c3
Improve LCMScheduler ( #5681 )
...
* Refactor LCMScheduler.step such that prev_sample == denoised at the last timestep in the schedule.
* Make timestep scaling when calculating boundary conditions configurable.
* Reparameterize timestep_scaling to be a multiplicative rather than division scaling.
* make style
* fix dtype conversion
* make style
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-11-07 18:48:18 +01:00
Sayak Paul
1dc231d14a
[PixArt-Alpha] Support non-square images ( #5672 )
...
* debug
* support non-square images
* add: test
* fix: test
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-11-07 18:21:33 +01:00
Sayak Paul
a8523bffa8
[PixArt-Alpha] fix mask_feature so that precomputed embeddings work with a batch size > 1 ( #5677 )
...
* fix embeds
* remove todo
* add: test
* better name
2023-11-07 17:12:47 +01:00
Dhruv Nair
71f56c771a
Model tests xformers fixes ( #5679 )
...
* fix model xformers test
* update
2023-11-07 20:50:41 +05:30
Sayak Paul
d61889fc17
[Feat] PixArt-Alpha ( #5642 )
...
* init pixart alpha pipeline
* fix: import
* script
* script
* script
* add: vae to the pipeline
* add: vae_scale_factor
* add: checkpoint_path
* clean conversion script a bit.
* size embeddings.
* fix: size embedding
* update scrip
* support for interpolation of position embedding.
* support for conditioning.
* ..
* ..
* ..
* final layer
* final layer
* align if encode_prompt
* support for caption embedding
* refactor
* refactor
* refactor
* start cross attention
* start cross attention
* cross_attention_dim
* cross
* cross
* support for resolution and aspect_ratio
* support for caption projection
* refactor patch embeddings
* batch_size
* up
* commit
* commit
* commit.
* squeeze
* squeeze
* squeeze
* squeeze
* squeeze
* squeeze
* squeeze
* squeeze
* squeeze
* squeeze
* squeeze
* squeeze.
* squeeze.
* fix final block./
* fix final block./
* fix final block./
* clean
* fix: interpolation scale.
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging'
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* make --checkpoint_path non-required.
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* remove num_tokens
* timesteps -> timestep
* timesteps -> timestep
* timesteps -> timestep
* timesteps -> timestep
* timesteps -> timestep
* timesteps -> timestep
* debug
* debug
* update conversion script.
* update conversion script.
* update conversion script.
* debug
* debug
* debug
* clean
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* deug
* debug
* debug
* debug
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* clean
* fix
* fix
* boom
* boom
* some changes
* boom
* save
* up
* remove i
* fix more tests
* DPMSolverMultistepScheduler
* fix
* offloading
* fix conversion script
* fix conversion script
* remove print
* remove support for negative prompt embeds.
* typo.
* remove extra kwargs
* bring conversion script to where it was
* fix
* trying mu luck
* trying my luck again
* again
* again
* again
* clean up
* up
* up
* update example
* support for 512
* remove spacing
* finalize docs.
* test debug
* fix: assertion values.
* debug
* debug
* debug
* fix: repeat
* remove prints.
* Apply suggestions from code review
* Apply suggestions from code review
* Correct more
* Apply suggestions from code review
* Change all
* Clean more
* fix more
* Fix more
* Fix more
* Correct more
* address patrick's comments.
* remove unneeded args
* clean up pipeline.
* sty;e
* make the use of additional conditions better conditioned.
* None better
* dtype
* height and width validation
* add a note about size brackets.
* fix
* spit out slow test outputs.
* fix?
* fix optional test
* fix more
* remove unneeded comment
* debug
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-11-06 08:40:04 +01:00
YiYi Xu
2b23ec82e8
add callbacks to denoising step ( #5427 )
...
* draft1
* update
* style
* move to the end of loop
* update
* update callbak_on_step_end_inputs
* Revert "update"
This reverts commit 5f9b15318344889f4dabpatrick.v.platen@gmail.com >
* fix
* apply feedbacks on img2img + inpaint: keep only important pipeline attributes
* depth
* pix2pix
* make _callback_tensor_inputs an class variable so that we can use it for testing
* add a basic tst for callback
* add a read-only tensor input timesteps + fix tests
* add second test for callback cfg
* sdxl
* sdxl img2img
* sdxl inpaint
* kandinsky prior
* kandinsky decoder
* kandinsky img2img + combined
* kandinsky inpaint
* fix copies
* fix
* consistent default inputs
* fix copies
* wuerstchen_prior prior
* test_wuerstchen_decoder + fix test for prior
* wuerstchen_combined pipeline + skip tests
* skip test for kandinsky combined
* lcm
* remove timesteps etc
* add doc string
* copies
* Update src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* Update src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* make style and improve tests
* up
* up
* fix more
* fix cfg test
* tests for callbacks
* fix for real
* update
* lcm img2img
* add doc
* add doc page to index
---------
Co-authored-by: yiyixuxu <yixu310@gmail,com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2023-11-05 20:00:41 +01:00
Sayak Paul
dd9a5caf61
[Core] support for tiny autoencoder in img2img ( #5636 )
...
* support for tiny autoencoder in img2img
Co-authored-by: slep0v <37597789+slep0v@users.noreply.github.com >
* copy fix
* line space
* line space
* clean up
* spit out expected value
* spit out expected value
* assertion values.
* assertion values.
---------
Co-authored-by: slep0v <37597789+slep0v@users.noreply.github.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-11-03 15:31:53 +01:00
dg845
beb8f216ed
Clean up LCM Pipeline and Test Code. ( #5641 )
...
* Clean up LCM pipeline and pipeline test code.
* Add comment for LCM img2img sampling loop.
2023-11-03 13:50:48 +01:00
YiYi Xu
d122206466
fix a bug in AutoPipeline.from_pipe() when creating a controlnet pipeline from an existing controlnet ( #5638 )
...
fix
Co-authored-by: yiyixuxu <yixu310@gmail,com>
2023-11-03 12:14:19 +01:00
Patrick von Platen
072e00897a
[LCM] Make sure img2img works ( #5632 )
...
* [LCM] Clean up implementations
* Add all
* correct more
* correct more
* finish
* up
2023-11-02 19:50:47 +01:00
