M. Tolga Cangöz
f4977abcd8
Fix typos ( #7181 )
...
* Fix typos
* Fix typos
* Fix typos and update documentation in lora.md
2024-03-04 10:28:23 -08:00
Steven Liu
3dd4168d4c
[docs] Minor updates ( #7063 )
...
* updates
* feedback
2024-02-25 09:38:02 -08:00
Sayak Paul
30e5e81d58
change to 2024 in the license ( #6902 )
...
change to 2024
2024-02-08 08:19:31 -10:00
xhedit
7f58a76f48
Update lora.md with a more accurate description of rank ( #6724 )
...
* Update lora.md with a more accurate description of rank
* Update docs/source/en/training/lora.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-01-29 09:41:51 -08:00
Kuba
1ccbfbb663
[docs] Add missing \ in lora.md ( #6174 )
2023-12-14 16:55:43 -08:00
Steven Liu
bae14c8bcb
[docs] Update training docs ( #5512 )
...
* first draft
* try hfoption syntax
* fix hfoption id
* add text2image
* fix tag
* feedback
* feedbacks
* add textual inversion
* DreamBooth
* lora
* controlnet
* instructpix2pix
* custom diffusion
* t2i
* separate training methods and models
* sdxl
* kandinsky
* wuerstchen
* light edits
2023-11-14 10:29:56 -08:00
Garry Dolley
1328aeb274
[Docs] Clarify that these are two separate examples ( #5734 )
...
* [Docs] Running the pipeline twice does not appear to be the intention of these examples
One is with `cross_attention_kwargs` and the other (next line) removes it
* [Docs] Clarify that these are two separate examples
One using `scale` and the other without it
2023-11-09 14:26:14 -08:00
Susheel Thapa
324d18fba2
Chore: Typo fixed in multiple files ( #5422 )
2023-10-17 08:17:03 -07:00
Sayak Paul
bfc606301f
add doc around fusing multiple loras. ( #5056 )
...
* add doc around fusing multiple loras.
* Apply suggestions from code review
Co-authored-by: apolinário <joaopaulo.passos@gmail.com >
* address poli's comments.
---------
Co-authored-by: apolinário <joaopaulo.passos@gmail.com >
2023-09-18 12:42:58 +01:00
Sayak Paul
8009272f48
[Tests and Docs] Add a test on serializing pipelines with components containing fused LoRA modules ( #4962 )
...
* add: test to ensure pipelines can be saved with fused lora modules.
* add docs about serialization with fused lora.
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Empty-Commit
* Update docs/source/en/training/lora.md
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-09-13 10:01:37 +01:00
Sayak Paul
6c314ad0ce
[Docs] add doc entry to explain lora fusion and use of different scales. ( #4893 )
...
* add doc entry to explain lora fusion and use of different scales.
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2023-09-06 07:38:13 +05:30
Sayak Paul
19f3161d94
[Docs] improve the LoRA doc. ( #4838 )
...
* improve the LoRA doc.
* include fuse_lora and unfuse_lora
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2023-08-31 00:13:15 +05:30
Steven Liu
cd7071e750
[docs] Add safetensors flag ( #4245 )
...
* add safetensors flag
* apply review
2023-08-10 12:37:23 -07:00
Sayak Paul
b2456717e6
Update lora.md to clarify SDXL support ( #4503 )
...
* Update lora.md
* Update lora.md
2023-08-07 11:06:30 +05:30
takuoko
9c29bc2df8
[Examples] Support train_text_to_image_lora_sdxl.py ( #4365 )
...
* add train_text_to_image_lora_sdxl.py
* add train_text_to_image_lora_sdxl.py
* add test and minor fix
* Update examples/text_to_image/README_sdxl.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* fix unwrap_model rule
* add invisible-watermark in requirements
* del invisible-watermark
* Update examples/text_to_image/README_sdxl.md
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update examples/text_to_image/README_sdxl.md
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* Update examples/text_to_image/train_text_to_image_lora_sdxl.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
* del comment & update readme
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-08-06 13:47:20 +05:30
Sayak Paul
816ca0048f
[LoRA] Fix SDXL text encoder LoRAs ( #4371 )
...
* temporarily disable text encoder loras.
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debbuging.
* modify doc.
* rename tests.
* print slices.
* fix: assertions
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-08-02 17:00:56 +05:30
Sayak Paul
4a4cdd6b07
[Feat] Support SDXL Kohya-style LoRA ( #4287 )
...
* sdxl lora changes.
* better name replacement.
* better replacement.
* debugging
* debugging
* debugging
* debugging
* debugging
* remove print.
* print state dict keys.
* print
* distingisuih better
* debuggable.
* fxi: tyests
* fix: arg from training script.
* access from class.
* run style
* debug
* save intermediate
* some simplifications for SDXL LoRA
* styling
* unet config is not needed in diffusers format.
* fix: dynamic SGM block mapping for SDXL kohya loras (#4322 )
* Use lora compatible layers for linear proj_in/proj_out (#4323 )
* improve condition for using the sgm_diffusers mapping
* informative comment.
* load compatible keys and embedding layer maaping.
* Get SDXL 1.0 example lora to load
* simplify
* specif ranks and hidden sizes.
* better handling of k rank and hidden
* debug
* debug
* debug
* debug
* debug
* fix: alpha keys
* add check for handling LoRAAttnAddedKVProcessor
* sanity comment
* modifications for text encoder SDXL
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* denugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* up
* up
* up
* up
* up
* up
* unneeded comments.
* unneeded comments.
* kwargs for the other attention processors.
* kwargs for the other attention processors.
* debugging
* debugging
* debugging
* debugging
* improve
* debugging
* debugging
* more print
* Fix alphas
* debugging
* debugging
* debugging
* debugging
* debugging
* debugging
* clean up
* clean up.
* debugging
* fix: text
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
Co-authored-by: Batuhan Taskaya <batuhan@python.org >
2023-07-28 19:49:49 +02:00
camenduru
c6ae9b7df6
Where did this 'x' come from, Elon? ( #4277 )
...
* why mdx?
* why mdx?
* why mdx?
* no x for kandinksy either
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-07-26 18:18:14 +02:00
