Patrick von Platen
2c04e5855c
Multi Vector Textual Inversion ( #3144 )
...
* Multi Vector
* Improve
* fix multi token
* improve test
* make style
* Update examples/test_examples.py
* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com >
* update
* Finish
* Apply suggestions from code review
---------
Co-authored-by: Suraj Patil <surajp815@gmail.com >
2023-04-21 19:06:19 +01:00
Steven Liu
391cfcd7d7
[docs] Clarify training args ( #3146 )
...
* clarify training arg
* apply feedback
2023-04-21 11:03:44 -07:00
Sayak Paul
e573ae06e2
Update custom_diffusion.mdx to credit the author ( #3163 )
...
* Update custom_diffusion.mdx
* fix: unnecessary list comprehension.
2023-04-21 18:44:08 +01:00
Steven Liu
2f6351b001
[docs] Deterministic algorithms ( #3172 )
...
deterministic algos
2023-04-21 10:38:34 -07:00
regisss
9bce375f77
Update Habana Gaudi documentation ( #3169 )
...
* Update Habana Gaudi doc
* Fix tables
2023-04-21 17:24:43 +01:00
Sayak Paul
3045fb2763
[DreamBooth] add text encoder LoRA support in the DreamBooth training script ( #3130 )
...
* add: LoRA text encoder support for DreamBooth example.
* fix initialization.
* fix: modification call.
* add: entry in the readme.
* use dog dataset from hub.
* fix: params to clip.
* add entry to the LoRA doc.
* add: tests for lora.
* remove unnecessary list comprehension./
2023-04-20 17:25:17 +05:30
Mishig
a121e05feb
Update custom_diffusion.mdx ( #3165 )
...
Add missing newlines for rendering the links correctly
2023-04-20 11:04:06 +02:00
nupurkmr9
3979aac996
adding custom diffusion training to diffusers examples ( #3031 )
...
* diffusers==0.14.0 update
* custom diffusion update
* custom diffusion update
* custom diffusion update
* custom diffusion update
* custom diffusion update
* custom diffusion update
* custom diffusion
* custom diffusion
* custom diffusion
* custom diffusion
* custom diffusion
* apply formatting and get rid of bare except.
* refactor readme and other minor changes.
* misc refactor.
* fix: repo_id issue and loaders logging bug.
* fix: save_model_card.
* fix: save_model_card.
* fix: save_model_card.
* add: doc entry.
* refactor doc,.
* custom diffusion
* custom diffusion
* custom diffusion
* apply style.
* remove tralining whitespace.
* fix: toctree entry.
* remove unnecessary print.
* custom diffusion
* custom diffusion
* custom diffusion test
* custom diffusion xformer update
* custom diffusion xformer update
* custom diffusion xformer update
---------
Co-authored-by: Nupur Kumari <nupurkumari@Nupurs-MacBook-Pro.local >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Nupur Kumari <nupurkumari@nupurs-mbp.wifi.local.cmu.edu >
2023-04-20 09:31:42 +02:00
1lint
86ecd4b795
add from_ckpt method as Mixin ( #2318 )
...
* add mixin class for pipeline from original sd ckpt
* Improve
* make style
* merge main into
* Improve more
* fix more
* up
* Apply suggestions from code review
* finish docs
* rename
* make style
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-04-19 17:07:36 +01:00
Sayak Paul
3b641eabe9
feat: verfication of multi-gpu support for select examples. ( #3126 )
...
* feat: verfication of multi-gpu support for select examples.
* add: multi-gpu training sections to the relvant doc pages.
2023-04-18 08:36:13 +05:30
Takuma Mori
5c9dd0af95
Add to support Guess Mode for StableDiffusionControlnetPipleline ( #2998 )
...
* add guess mode (WIP)
* fix uncond/cond order
* support guidance_scale=1.0 and batch != 1
* remove magic coeff
* add docstring
* add intergration test
* add document to controlnet.mdx
* made the comments a bit more explanatory
* fix table
2023-04-14 08:37:34 +05:30
Steven Liu
d0f258206d
[docs] Update community pipeline docs ( #2989 )
...
* update community pipeline docs
* fix formatting
* explain sharing workflows
2023-04-13 13:46:28 -07:00
Sayak Paul
fa736e321d
[Docs] refactor text-to-video zero ( #3049 )
...
* fix: norm group test for UNet3D.
* refactor text-to-video zero docs.
2023-04-12 14:15:26 +01:00
Patrick von Platen
a4b233e5b5
Finish docs textual inversion ( #3068 )
...
* Finish docs textual inversion
* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Pedro Cuenca <pedro@huggingface.co >
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Pedro Cuenca <pedro@huggingface.co >
2023-04-12 13:35:58 +01:00
Susung Hong
0df47efee2
[Docs] update Self-Attention Guidance docs ( #2952 )
...
* Update index.mdx
* Edit docs & add HF space link
* Only change equation numbers in comments
2023-04-12 10:14:32 +01:00
Sayak Paul
a89a14fa7a
[LoRA] Enabling limited LoRA support for text encoder ( #2918 )
...
* add: first draft for a better LoRA enabler.
* make fix-copies.
* feat: backward compatibility.
* add: entry to the docs.
* add: tests.
* fix: docs.
* fix: norm group test for UNet3D.
* feat: add support for flat dicts.
* add depcrcation message instead of warning.
2023-04-12 08:29:04 +05:30
Steven Liu
cb9d77af23
[docs] Reusing components ( #3000 )
...
* reuse-components
* format
2023-04-11 15:34:34 +01:00
Patrick von Platen
8b451eb63b
Fix config prints and save, load of pipelines ( #2849 )
...
* [Config] Fix config prints and save, load
* Only use potential nn.Modules for dtype and device
* Correct vae image processor
* make sure in_channels is not accessed directly
* make sure in channels is only accessed via config
* Make sure schedulers only access config attributes
* Make sure to access config in SAG
* Fix vae processor and make style
* add tests
* uP
* make style
* Fix more naming issues
* Final fix with vae config
* change more
2023-04-11 13:35:42 +02:00
Mishig
4f48476dd6
Update contribution.mdx ( #3054 )
...
* Update contribution.mdx
hotfix for doc-builder parsing quote in heading bug
* quoteation replace
2023-04-11 09:23:58 +02:00
Andranik Movsisyan
ba49272db8
[Pipeline] Add TextToVideoZeroPipeline ( #2954 )
...
* add TextToVideoZeroPipeline and CrossFrameAttnProcessor
* add docs for text-to-video zero
* add teaser image for text-to-video zero docs
* Fix review changes. Add Documentation. Add test
* clean up the codes in pipeline_text_to_video.py. Add descriptive comments and docstrings
* make style && make quality
* make fix-copies
* make requested changes to docs. use huggingface server links for resources, delete res folder
* make style && make quality && make fix-copies
* make style && make quality
* Apply suggestions from code review
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-04-10 22:09:53 +02:00
Pedro Cuenca
983a7fbfd8
Initial draft of Core ML docs ( #2987 )
...
* Initial draft of Core ML docs.
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Fix Core ML spelling
* Apply the rest of suggestions.
* Attempt to fix hyperlink inside Tip.
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Apply suggestions from code review
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2023-04-10 21:09:04 +02:00
Guspan Tanadi
ce144d6dd0
docs: Link Navigation Path API Pipelines ( #2976 )
...
* docs: link navigation Safe Stable Diffusion
Link navigation API pipelines text2img and using diffusers Conditional Image Generation.
* docs: link navigation Versatile Diffusion
Removing exceeding path Stable Diffusion Overview.
* docs: Python extension Spectrogram Diffusion
Link navigation Spectrogram Diffusion Pipeline source code
* docs: Link navigation AltDiffusion Pipelines
Stable Diffusion Overview and Using Diffusers path.
2023-04-07 14:07:42 -07:00
Sayak Paul
24947317a6
[Examples] Add support for Min-SNR weighting strategy for better convergence ( #2899 )
...
* improve stable unclip doc.
* feat: support for applying min-snr weighting for faster convergence.
* add: support for validation logging with wandb
* make not a required arg.
* fix: arg name.
* fix: cli args.
* fix: tracker config.
* fix: loss calculation.
* fix: validation logging.
* fix: unwrap call.
* fix: validation logging.
* fix: internval.
* fix: checkpointing push to hub.
* fix: c8a2856c6d \#commitcomment-106913193
* fix: norm group test for UNet3D.
* address PR comments.
* remove unneeded code.
* add: entry in the readme and docs.
* Apply suggestions from code review
Co-authored-by: Suraj Patil <surajp815@gmail.com >
---------
Co-authored-by: Suraj Patil <surajp815@gmail.com >
2023-04-06 19:08:40 +05:30
Steven Liu
0d0fa2a3e1
[docs] Simplify loading guide ( #2694 )
...
* simplify loading guide
* apply feedbacks
* clarify variants
* clarify torch_dtype and variant
* remove conceptual pipeline doc
2023-04-04 14:08:21 -07:00
Guspan Tanadi
f3e72e9e57
Removing explicit markdown extension ( #2944 )
...
Trigger from previous PR. Build the page once again.
2023-04-04 14:15:19 +01:00
M. Tolga Cangöz
4fd7e97f33
Update ddpm.mdx ( #2929 )
2023-04-04 14:02:30 +01:00
M. Tolga Cangöz
4a1eae07c7
Update ddim.mdx ( #2926 )
2023-04-04 14:01:55 +01:00
M. Tolga Cangöz
e329edff7e
Update score_sde_vp.mdx ( #2938 )
2023-04-04 14:00:43 +01:00
M. Tolga Cangöz
3e2d1af867
Update score_sde_ve.mdx ( #2937 )
2023-04-04 14:00:15 +01:00
M. Tolga Cangöz
715c25d344
Update unipc.mdx ( #2936 )
2023-04-04 13:59:53 +01:00
M. Tolga Cangöz
4274a3a915
Update euler_ancestral.mdx ( #2932 )
2023-04-04 13:58:58 +01:00
M. Tolga Cangöz
c43356267b
Update controlnet.mdx ( #2912 )
...
.
2023-03-31 14:32:36 +01:00
M. Tolga Cangöz
89b23d9869
Update image_variation.mdx ( #2911 )
...
.
2023-03-31 14:31:43 +01:00
Guspan Tanadi
419660c99b
Have fix current pipeline link ( #2910 )
...
Also capitalization notebook provider name
2023-03-31 14:31:14 +01:00
YiYi Xu
51d970d60d
[docs] add the Stable diffusion with Jax/Flax Guide into the docs ( #2487 )
...
* add stable diffusion jax guide
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-03-30 16:22:40 -10:00
Sayak Paul
b2021273eb
[Docs] add an example use for StableUnCLIPPipeline in the pipeline docs ( #2897 )
...
* improve stable unclip doc.
* add: entry of StableUnCLIPPipeline to the docs
* Apply suggestions from code review
Co-authored-by: apolinario <joaopaulo.passos@gmail.com >
---------
Co-authored-by: apolinario <joaopaulo.passos@gmail.com >
2023-03-30 17:14:04 +05:30
Steven Liu
e47459c80f
[docs] Performance tutorial ( #2773 )
...
* update performance tutorial
* fix divs
* oops forgot to close tag
* apply feedback
* apply feedback
* apply feedback
* align doc title
2023-03-29 12:48:14 -07:00
Patrick von Platen
40a7b8629e
[Docs] Correct phrasing ( #2873 )
2023-03-28 17:32:18 +01:00
M. Tolga Cangöz
628fefb232
Update stable_diffusion_safe.mdx ( #2870 )
...
Fix typos
2023-03-28 17:23:54 +01:00
M. Tolga Cangöz
03fe36f183
Update paint_by_example.mdx ( #2869 )
...
.
2023-03-28 17:23:39 +01:00
M. Tolga Cangöz
ef4c2fa4f1
Update alt_diffusion.mdx ( #2865 )
...
Fix typos
2023-03-28 17:17:53 +01:00
M. Tolga Cangöz
3980858ad4
Update overview.mdx ( #2864 )
...
Fix typos
2023-03-28 17:17:33 +01:00
M. Tolga Cangöz
37c82480bb
Update evaluation.mdx ( #2862 )
...
Fix typos
2023-03-28 17:15:37 +01:00
dg845
663c654577
[WIP][Docs] Use DiffusionPipeline Instead of Child Classes when Loading Pipeline ( #2809 )
...
* Change the docs to use the parent DiffusionPipeline class when loading a checkpoint using from_pretrained() instead of a child class (e.g. StableDiffusionPipeline) where possible.
* Run make style to fix style issues.
* Change more docs to use DiffusionPipeline rather than a subclass.
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-03-28 16:44:34 +01:00
John HU
920a15cf70
Fix link to LoRA training guide in DreamBooth training guide ( #2836 )
...
Fix link to LoRA training guide
2023-03-28 16:35:41 +01:00
Sandeep
b76d9fde8d
Remove suggestion to use cuDNN benchmark in docs ( #2793 )
...
* Remove suggestion to use cuDNN benchmark in docs
* removing the wrong line
2023-03-28 16:01:30 +01:00
Sayak Paul
fab4f3d6e4
improve stable unclip doc. ( #2823 )
2023-03-28 08:18:29 +05:30
Sayak Paul
5883d8d4d1
[Docs] update docs (Stable unCLIP) to reflect the updated ckpts. ( #2815 )
...
* update docs to reflect the updated ckpts.
* update: point about prompt.
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* emove image resizing.
* Apply suggestions from code review
* Apply suggestions from code review
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-03-24 17:24:19 +01:00
Bahjat Kawar
37a44bb283
Add ModelEditing pipeline ( #2721 )
...
* TIME first commit
* styling.
* styling 2.
* fixes; tests
* apply styling and doc fix.
* remove sups.
* fixes
* remove temp file
* move augmentations to const
* added doc entry
* code quality
* customize augmentations
* quality
* quality
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2023-03-24 13:01:39 +05:30
Sanchit Gandhi
b94880e536
Add AudioLDM ( #2232 )
...
* Add AudioLDM
* up
* add vocoder
* start unet
* unconditional unet
* clap, vocoder and vae
* clean-up: conversion scripts
* fix: conversion script token_type_ids
* clean-up: pipeline docstring
* tests: from SD
* clean-up: cpu offload vocoder instead of safety checker
* feat: adapt tests to audioldm
* feat: add docs
* clean-up: amend pipeline docstrings
* clean-up: make style
* clean-up: make fix-copies
* fix: add doc path to toctree
* clean-up: args for conversion script
* clean-up: paths to checkpoints
* fix: use conditional unet
* clean-up: make style
* fix: type hints for UNet
* clean-up: docstring for UNet
* clean-up: make style
* clean-up: remove duplicate in docstring
* clean-up: make style
* clean-up: make fix-copies
* clean-up: move imports to start in code snippet
* fix: pass cross_attention_dim as a list/tuple to unet
* clean-up: make fix-copies
* fix: update checkpoint path
* fix: unet cross_attention_dim in tests
* film embeddings -> class embeddings
* Apply suggestions from code review
Co-authored-by: Will Berman <wlbberman@gmail.com >
* fix: unet film embed to use existing args
* fix: unet tests to use existing args
* fix: make style
* fix: transformers import and version in init
* clean-up: make style
* Revert "clean-up: make style"
This reverts commit 5d6d1f8b32 .
* clean-up: make style
* clean-up: use pipeline tester mixin tests where poss
* clean-up: skip attn slicing test
* fix: add torch dtype to docs
* fix: remove conversion script out of src
* fix: remove .detach from 1d waveform
* fix: reduce default num inf steps
* fix: swap height/width -> audio_length_in_s
* clean-up: make style
* fix: remove nightly tests
* fix: imports in conversion script
* clean-up: slim-down to two slow tests
* clean-up: slim-down fast tests
* fix: batch consistent tests
* clean-up: make style
* clean-up: remove vae slicing fast test
* clean-up: propagate changes to doc
* fix: increase test tol to 1e-2
* clean-up: finish docs
* clean-up: make style
* feat: vocoder / VAE compatibility check
* feat: possibly expand / cut audio waveform
* fix: pipeline call signature test
* fix: slow tests output len
* clean-up: make style
* make style
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: William Berman <WLBberman@gmail.com >
2023-03-23 19:00:21 +01:00