Patrick von Platen
f5942649f5
Release: v.0.21.4-patch
2023-09-29 15:39:55 +00:00
Patrick von Platen
edea57749e
[Lora] fix lora fuse unfuse ( #5003 )
...
* fix lora fuse unfuse
* add same changes to loaders.py
* add test
---------
Co-authored-by: multimodalart <joaopaulo.passos+multimodal@gmail.com >
2023-09-29 15:30:16 +00:00
Sayak Paul
c37c840b1b
update
2023-09-27 22:13:19 +05:30
Sayak Paul
9858053bfe
Release: v0.21.3
2023-09-27 22:10:50 +05:30
Patrick von Platen
6a3301fe34
resolve conflicts.
2023-09-27 22:09:04 +05:30
Patrick von Platen
813a1b2ee0
Fix one more
2023-09-19 00:09:30 +02:00
Patrick von Platen
a43b8574a9
Patch release: v0.21.2
2023-09-19 00:06:16 +02:00
Sayak Paul
a2f0db52e3
[LoRA] don't break offloading for incompatible lora ckpts. ( #5085 )
...
* don't break offloading for incompatible lora ckpts.
* debugging
* better condition.
* fix
* fix
* fix
* fix
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-09-19 00:05:34 +02:00
Will Berman
92f6693b37
remove unused adapter weights in constructor ( #5088 )
...
remove adapter weights in MultiAdapter constructor
2023-09-19 00:05:28 +02:00
Will Berman
932897afa8
t2i Adapter community member fix ( #5090 )
...
* convert tensorrt controlnet
* Fix code quality
* Fix code quality
* Fix code quality
* Fix code quality
* Fix code quality
* Fix code quality
* Fix number controlnet condition
* Add convert SD XL to onnx
* Add convert SD XL to tensorrt
* Add convert SD XL to tensorrt
* Add examples in comments
* Add examples in comments
* Add test onnx controlnet
* Add tensorrt test
* Remove copied
* Move file test to examples/community
* Remove script
* Remove script
* Remove text
* Fix import
* Fix T2I MultiAdapter
* fix tests
---------
Co-authored-by: dotieuthien <thien.do@mservice.com.vn >
Co-authored-by: dotieuthien <dotieuthien9997@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: dotieuthien <hades@cinnamon.is >
2023-09-19 00:05:20 +02:00
Patrick von Platen
c2940434d0
[Textual inversion] Refactor textual inversion to make it cleaner ( #5076 )
...
* [Textual inversion] Clean loading
* [Textual inversion] Clean loading
* [Textual inversion] Clean up
* [Textual inversion] Clean up
* [Textual inversion] Clean up
* [Textual inversion] Clean up
2023-09-19 00:04:53 +02:00
Patrick von Platen
60ab8fad16
Patch release: v0.21.1
2023-09-14 13:06:57 +02:00
Patrick von Platen
d17240457f
[Import] Add missing settings / Correct some dummy imports ( #5036 )
...
* [Import] Add missing settings
* up
* up
* up
2023-09-14 12:47:55 +02:00
Vladimir Mandic
7512fc4df5
allow loading of sd models from safetensors without online lookups using local config files ( #5019 )
...
finish config_files implementation
2023-09-14 12:47:41 +02:00
Patrick von Platen
0c2f1ccc97
[Import] Don't force transformers to be installed ( #5035 )
...
* [Import] Don't force transformers to be installed
* make style
2023-09-14 12:47:34 +02:00
Dhruv Nair
47f2d2c7be
Fix model offload bug when key isn't present ( #5030 )
...
* fix model offload bug when key isn't present
* make style
2023-09-14 12:47:25 +02:00
Patrick von Platen
af85591593
Patch release: v0.21.1
2023-09-14 12:46:39 +02:00
Patrick von Platen
29f15673ed
Release: v0.21.0
2023-09-13 15:58:24 +02:00
Patrick von Platen
1037287e2b
examples fix t2i training ( #5001 )
...
* examples fix t2i training
* make style
2023-09-12 23:52:41 +02:00
Steven Liu
6ea95b7a90
Fix PR template ( #4984 )
...
fix template
2023-09-12 19:36:38 +02:00
Patrick von Platen
0e0db625d0
Fix safety checker seq offload ( #4998 )
...
* fix safety checker
* fix safety checker
* fix safety checker
2023-09-12 18:56:35 +02:00
dg845
1f948109b8
[docs] Fix DiffusionPipeline.enable_sequential_cpu_offload docstring ( #4952 )
...
* Fix an unmatched backtick and make description more general for DiffusionPipeline.enable_sequential_cpu_offload.
* make style
* _exclude_from_cpu_offload -> self._exclude_from_cpu_offload
* make style
* apply suggestions from review
* make style
2023-09-12 08:58:47 -07:00
Patrick von Platen
37cb819df5
[Lora] Speed up lora loading ( #4994 )
...
* speed up lora loading
* Apply suggestions from code review
* up
* up
* Fix more
* Correct more
* Apply suggestions from code review
* up
* Fix more
* Fix more -
* up
* up
2023-09-12 17:51:15 +02:00
Dhruv Nair
f64d52dbca
fix custom diffusion tests ( #4996 )
2023-09-12 17:50:47 +02:00
Dhruv Nair
4d897aaff5
fix image variation slow test ( #4995 )
...
fix image variation tests
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-09-12 17:45:47 +02:00
Patrick von Platen
b1105269b7
make style
2023-09-12 14:55:27 +00:00
Kashif Rasul
5d28d2217f
[Wuerstchen] fix combined pipeline's num_images_per_prompt ( #4989 )
...
* fix encode_prompt
* added prompt_embeds and negative_prompt_embeds
* prompt_embeds for the prior only
2023-09-12 16:55:13 +02:00
Kashif Rasul
73bf620dec
fix E721 Do not compare types, use isinstance() ( #4992 )
2023-09-12 16:52:25 +02:00
Dhruv Nair
c806f2fad6
remove extra gligen in import ( #4987 )
2023-09-12 18:35:29 +05:30
Patrick von Platen
18b7264bd0
[Utils] Correct custom init sort ( #4967 )
...
* [Utils] Correct custom init sort
* [Utils] Correct custom init sort
* [Utils] Correct custom init sort
* add type checking
* fix custom init sort
* fix test
* fix tests
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2023-09-12 11:05:53 +02:00
zhiqiang
d82157b3ce
[Bug Fix] Should pass the dtype instead of torch_dtype ( #4917 )
...
.
2023-09-11 19:45:58 +02:00
Patrick von Platen
93579650f8
Refactor model offload ( #4514 )
...
* [Draft] Refactor model offload
* [Draft] Refactor model offload
* Apply suggestions from code review
* cpu offlaod updates
* remove model cpu offload from individual pipelines
* add hook to offload models to cpu
* clean up
* model offload
* add model cpu offload string
* make style
* clean up
* fixes for offload issues
* fix tests issues
* resolve merge conflicts
* update src/diffusers/pipelines/pipeline_utils.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* make style
* Update src/diffusers/pipelines/latent_diffusion/pipeline_latent_diffusion.py
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2023-09-11 19:39:26 +02:00
Kashif Rasul
16a056a7b5
Wuerstchen fixes ( #4942 )
...
* fix arguments and make example code work
* change arguments in combined test
* Add default timesteps
* style
* fixed test
* fix broken test
* formatting
* fix docstrings
* fix num_images_per_prompt
* fix doc styles
* please dont change this
* fix tests
* rename to DEFAULT_STAGE_C_TIMESTEPS
---------
Co-authored-by: Dominic Rampas <d6582533@gmail.com >
2023-09-11 15:47:53 +02:00
Patrick von Platen
6c6a246461
Update README.md ( #4973 )
...
Add monthly pip installs
2023-09-11 15:45:19 +02:00
Patrick von Platen
6bbee1048b
Make sure Flax pipelines can be loaded into PyTorch ( #4971 )
...
* Make sure Flax pipelines can be loaded into PyTorch
* add test
* Update src/diffusers/pipelines/pipeline_utils.py
2023-09-11 12:03:49 +02:00
Patrick von Platen
2c60f7d14e
[Core] Remove TF import checks ( #4968 )
...
[TF] Remove tf
2023-09-11 11:22:40 +02:00
Dhruv Nair
b6e0b016ce
Lazy Import for Diffusers ( #4829 )
...
* initial commit
* move modules to import struct
* add dummy objects and _LazyModule
* add lazy import to schedulers
* clean up unused imports
* lazy import on models module
* lazy import for schedulers module
* add lazy import to pipelines module
* lazy import altdiffusion
* lazy import audio diffusion
* lazy import audioldm
* lazy import consistency model
* lazy import controlnet
* lazy import dance diffusion ddim ddpm
* lazy import deepfloyd
* lazy import kandinksy
* lazy imports
* lazy import semantic diffusion
* lazy imports
* lazy import stable diffusion
* move sd output to its own module
* clean up
* lazy import t2iadapter
* lazy import unclip
* lazy import versatile and vq diffsuion
* lazy import vq diffusion
* helper to fetch objects from modules
* lazy import sdxl
* lazy import txt2vid
* lazy import stochastic karras
* fix model imports
* fix bug
* lazy import
* clean up
* clean up
* fixes for tests
* fixes for tests
* clean up
* remove import of torch_utils from utils module
* clean up
* clean up
* fix mistake import statement
* dedicated modules for exporting and loading
* remove testing utils from utils module
* fixes from merge conflicts
* Update src/diffusers/pipelines/kandinsky2_2/__init__.py
* fix docs
* fix alt diffusion copied from
* fix check dummies
* fix more docs
* remove accelerate import from utils module
* add type checking
* make style
* fix check dummies
* remove torch import from xformers check
* clean up error message
* fixes after upstream merges
* dummy objects fix
* fix tests
* remove unused module import
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-09-11 09:56:22 +02:00
Sayak Paul
88735249da
[Docs] fix: minor formatting in the Würstchen docs ( #4965 )
...
fix: minor formatting in the docs
2023-09-11 09:12:53 +02:00
Will Berman
4191ddee11
Revert revert and install accelerate main ( #4963 )
...
* Revert "Temp Revert "[Core] better support offloading when side loading is enabled… (#4927 )"
This reverts commit 2ab170499e
2023-09-11 08:49:46 +02:00
Will Berman
2ab170499e
Temp Revert "[Core] better support offloading when side loading is enabled… ( #4927 )
...
Revert "[Core] better support offloading when side loading is enabled. (#4855 )"
This reverts commit e4b8e7928b
2023-09-08 19:54:59 -07:00
Sayak Paul
914c513ee0
[Docs] add t2i adapter entry to overview of training scripts. ( #4946 )
...
add t2i adapter entry to overview of training scripts.
2023-09-09 06:52:11 +05:30
Will Berman
d73e6ad050
guard save model hooks to only execute on main process ( #4929 )
2023-09-08 10:30:06 -07:00
Sayak Paul
d0cf681a1f
[Tests] add: tests for t2i adapter training. ( #4947 )
...
add: tests for t2i adapter training.
2023-09-08 19:45:39 +05:30
Suraj Patil
dfec61f4b3
[examples] T2IAdapter training script ( #4934 )
...
* add t2i_example script
* remove in channels logic
* remove comments
* remove use_euler arg
* add requirements
* only use canny example
* use datasets
* comments
* make log_validation consistent with other scripts
* add readme
* fix title in readme
* update check_min_version
* change a few minor things.
* add doc entry
* add: test for t2i adapter training
* remove use_auth_token
* fix: logged info.
* remove tests for now.
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-09-08 10:03:02 +05:30
Suraj Patil
0ec7a02b6a
[StableDiffusionXLAdapterPipeline] allow negative micro conds ( #4941 )
...
* allow negative micro conds in t2i pipeline
* Empty-Commit
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-09-08 07:59:42 +05:30
Suraj Patil
626284f8d1
[StableDiffusionXLAdapterPipeline] add adapter_conditioning_factor ( #4937 )
...
add adapter_conditioning_factor
2023-09-07 19:05:28 +02:00
Sayak Paul
9800cc5ece
[InstructPix2Pix] Fix pipeline implementation and add docs ( #4844 )
...
* initial evident fixes.
* instructpix2pix fixes.
* add: entry to doc.
* address PR feedback.
* make fix-copies
2023-09-07 15:34:19 +05:30
Kashif Rasul
541bb6ee63
Würstchen model ( #3849 )
...
* initial
* initial
* added initial convert script for paella vqmodel
* initial wuerstchen pipeline
* add LayerNorm2d
* added modules
* fix typo
* use model_v2
* embed clip caption amd negative_caption
* fixed name of var
* initial modules in one place
* WuerstchenPriorPipeline
* inital shape
* initial denoising prior loop
* fix output
* add WuerstchenPriorPipeline to __init__.py
* use the noise ratio in the Prior
* try to save pipeline
* save_pretrained working
* Few additions
* add _execution_device
* shape is int
* fix batch size
* fix shape of ratio
* fix shape of ratio
* fix output dataclass
* tests folder
* fix formatting
* fix float16 + started with generator
* Update pipeline_wuerstchen.py
* removed vqgan code
* add WuerstchenGeneratorPipeline
* fix WuerstchenGeneratorPipeline
* fix docstrings
* fix imports
* convert generator pipeline
* fix convert
* Work on Generator Pipeline. WIP
* Pipeline works with our diffuzz code
* apply scale factor
* removed vqgan.py
* use cosine schedule
* redo the denoising loop
* Update src/diffusers/models/resnet.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* use torch.lerp
* use warp-diffusion org
* clip_sample=False,
* some refactoring
* use model_v3_stage_c
* c_cond size
* use clip-bigG
* allow stage b clip to be None
* add dummy
* würstchen scheduler
* minor changes
* set clip=None in the pipeline
* fix attention mask
* add attention_masks to text_encoder
* make fix-copies
* add back clip
* add text_encoder
* gen_text_encoder and tokenizer
* fix import
* updated pipeline test
* undo changes to pipeline test
* nip
* fix typo
* fix output name
* set guidance_scale=0 and remove diffuze
* fix doc strings
* make style
* nip
* removed unused
* initial docs
* rename
* toc
* cleanup
* remvoe test script
* fix-copies
* fix multi images
* remove dup
* remove unused modules
* undo changes for debugging
* no new line
* remove dup conversion script
* fix doc string
* cleanup
* pass default args
* dup permute
* fix some tests
* fix prepare_latents
* move Prior class to modules
* offload only the text encoder and vqgan
* fix resolution calculation for prior
* nip
* removed testing script
* fix shape
* fix argument to set_timesteps
* do not change .gitignore
* fix resolution calculations + readme
* resolution calculation fix + readme
* small fixes
* Add combined pipeline
* rename generator -> decoder
* Update .gitignore
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* removed efficient_net
* create combined WuerstchenPipeline
* make arguments consistent with VQ model
* fix var names
* no need to return text_encoder_hidden_states
* add latent_dim_scale to config
* split model into its own file
* add WuerschenPipeline to docs
* remove unused latent_size
* register latent_dim_scale
* update script
* update docstring
* use Attention preprocessor
* concat with normed input
* fix-copies
* add docs
* fix test
* fix style
* add to cpu_offloaded_model
* updated type
* remove 1-line func
* updated type
* initial decoder test
* formatting
* formatting
* fix autodoc link
* num_inference_steps is int
* remove comments
* fix example in docs
* Update src/diffusers/pipelines/wuerstchen/diffnext.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* rename layernorm to WuerstchenLayerNorm
* rename DiffNext to WuerstchenDiffNeXt
* added comment about MixingResidualBlock
* move paella vq-vae to pipelines' folder
* initial decoder test
* increased test_float16_inference expected diff
* self_attn is always true
* more passing decoder tests
* batch image_embeds
* fix failing tests
* set the correct dtype
* relax inference test
* update prior
* added combined pipeline test
* faster test
* faster test
* Update src/diffusers/pipelines/wuerstchen/pipeline_wuerstchen_combined.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* fix issues from review
* update wuerstchen.md + change generator name
* resolve issues
* fix copied from usage and add back batch_size
* fix API
* fix arguments
* fix combined test
* Added timesteps argument + fixes
* Update tests/pipelines/test_pipelines_common.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update tests/pipelines/wuerstchen/test_wuerstchen_prior.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/wuerstchen/pipeline_wuerstchen_combined.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/wuerstchen/pipeline_wuerstchen_combined.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/wuerstchen/pipeline_wuerstchen_combined.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update src/diffusers/pipelines/wuerstchen/pipeline_wuerstchen_combined.py
* up
* Fix more
* failing tests
* up
* up
* correct naming
* correct docs
* correct docs
* fix test params
* correct docs
* fix classifier free guidance
* fix classifier free guidance
* fix more
* fix all
* make tests faster
---------
Co-authored-by: Dominic Rampas <d6582533@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Dominic Rampas <61938694+dome272@users.noreply.github.com >
2023-09-06 16:15:51 +02:00
dg845
b76274cb53
[docs] Fix typo in Inpainting force unmasked area unchanged example ( #4910 )
...
Fix typo by replacing init_image_arr and repainted_image_arr with init_image and repainted_image, respectively.
2023-09-06 10:49:01 +02:00
Patrick von Platen
dc3e0ca59b
[Textual inversion] Relax loading textual inversion ( #4903 )
...
* [Textual inversion] Relax loading textual inversion
* up
2023-09-06 10:39:44 +02:00
