Sayak Paul
5e181eddfe
Deprecate slicing and tiling methods from DiffusionPipeline ( #12271 )
...
* deprecate slicing from flux pipeline.
* propagate.
* tiling
* up
* up
2025-09-11 10:04:35 +05:30
Leo Jiang
c222570a9b
DeepSpeed adaption for flux-kontext ( #12240 )
...
Co-authored-by: J石页 <jiangshuo9@h-partners.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-09-09 12:58:08 +05:30
co63oc
764b62473a
fix some typos ( #12265 )
...
Signed-off-by: co63oc <co63oc@users.noreply.github.com >
2025-09-03 21:28:24 +05:30
Linoy Tsaban
006d092751
[Flux LoRA] fix for prior preservation and mixed precision sampling, follow up on #11873 ( #12264 )
...
* propagate fixes from https://github.com/huggingface/diffusers/pull/11873/ to flux script
* propagate fixes from https://github.com/huggingface/diffusers/pull/11873/ to flux script
* propagate fixes from https://github.com/huggingface/diffusers/pull/11873/ to flux script
* Apply style fixes
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-02 11:30:33 +03:00
Bulat Akhmatov
0ff1aa910c
[fix] fix for prior preservation and mixed precision sampling ( #11873 )
...
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-09-01 14:12:14 +03:00
Dhruv Nair
7aa6af1138
[Refactor] Move testing utils out of src ( #12238 )
...
* update
* update
* update
* update
* update
* merge main
* Revert "merge main"
This reverts commit 65efbcead5 .
2025-08-28 19:53:02 +05:30
Parag Ekbote
513dbdb2f3
Fix Table Rendering in ReadME ( #12245 )
...
fix table rendering readme issue in readme.
2025-08-27 10:44:49 -07:00
Leo Jiang
0fd7ee79ea
NPU attention refactor for FLUX ( #12209 )
...
* NPU attention refactor for FLUX transformer
* Apply style fixes
---------
Co-authored-by: J石页 <jiangshuo9@h-partners.com >
Co-authored-by: Aryan <aryan@huggingface.co >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-26 12:53:55 +05:30
sqt
0d1c5b0c3e
Fix typo: 'will ge generated' -> 'will be generated' ( #12231 )
2025-08-25 12:47:52 -07:00
Meta
0e46c55931
Update README.md ( #12193 )
2025-08-25 11:35:56 -07:00
Sayak Paul
7a2b78bf0f
post release v0.35.0 ( #12184 )
...
* post release v0.35.0
* quality
2025-08-19 22:10:08 +05:30
Taechai
3c50f0cdad
Update README.md ( #12182 )
...
* Update README.md
Specify the full dir
* Update examples/dreambooth/README.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-08-18 13:02:49 -07:00
Leo Jiang
03be15e890
[Docs] typo error in qwen image ( #12144 )
...
typo error in qwen image
Co-authored-by: J石页 <jiangshuo9@h-partners.com >
Co-authored-by: Aryan <aryan@huggingface.co >
2025-08-18 11:55:42 +05:30
Sayak Paul
c9c8217306
[chore] complete the licensing statement. ( #12001 )
...
complete the licensing statement.
2025-08-11 22:15:15 +05:30
Sayak Paul
5937e11d85
[docs] small corrections to the example in the Qwen docs ( #12068 )
...
* up
* up
2025-08-05 09:47:21 +05:30
Sayak Paul
9c1d4e3be1
[wip] feat: support lora in qwen image and training script ( #12056 )
...
* feat: support lora in qwen image and training script
* up
* up
* up
* up
* up
* up
* add lora tests
* fix
* add tests
* fix
* reviewer feedback
* up[
* Apply suggestions from code review
Co-authored-by: Aryan <aryan@huggingface.co >
---------
Co-authored-by: Aryan <aryan@huggingface.co >
2025-08-05 07:06:02 +05:30
Sayak Paul
20e0740b88
[training-scripts] Make pytorch examples UV-compatible ( #12000 )
...
* add uv dependencies on top of scripts.
* add uv deps.
2025-07-31 22:09:52 +05:30
Álvaro Somoza
edcbe8038b
Fix huggingface-hub failing tests ( #11994 )
...
* login
* more logins
* uploads
* missed login
* another missed login
* downloads
* examples and more logins
* fix
* setup
* Apply style fixes
* fix
* Apply style fixes
2025-07-29 02:34:58 -04:00
YiYi Xu
ef1e628729
fix style ( #11975 )
...
up
2025-07-22 10:25:40 -10:00
Sam Gao
173e1b147d
[Examples] Uniform notations in train_flux_lora ( #10011 )
...
[Examples] uniform naming notations
since the in parameter `size` represents `args.resolution`, I thus replace the `args.resolution` inside DreamBoothData with `size`. And revise some notations such as `center_crop`.
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2025-07-22 09:14:00 -10:00
Chengxi Guo
cde02b061b
Fix kontext finetune issue when batch size >1 ( #11921 )
...
set drop_last to True
Signed-off-by: mymusise <mymusise1@gmail.com >
2025-07-18 19:38:58 -04:00
Sayak Paul
9c13f86579
[training] add an offload utility that can be used as a context manager. ( #11775 )
...
* add an offload utility that can be used as a context manager.
* update
---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2025-07-16 09:09:13 +01:00
dependabot[bot]
48a551251d
Bump aiohttp from 3.10.10 to 3.12.14 in /examples/server ( #11924 )
...
Bumps [aiohttp](https://github.com/aio-libs/aiohttp ) from 3.10.10 to 3.12.14.
- [Release notes](https://github.com/aio-libs/aiohttp/releases )
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst )
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.10.10...v3.12.14 )
---
updated-dependencies:
- dependency-name: aiohttp
dependency-version: 3.12.14
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-07-15 09:15:57 +05:30
Hengyue-Bi
6398fbc391
Fix: Align VAE processing in ControlNet SD3 training with inference ( #11909 )
...
Fix: Apply vae_shift_factor in ControlNet SD3 training
2025-07-14 14:54:38 -04:00
dependabot[bot]
9f4d997d8f
Bump torch from 2.4.1 to 2.7.0 in /examples/server ( #11429 )
...
Bumps [torch](https://github.com/pytorch/pytorch ) from 2.4.1 to 2.7.0.
- [Release notes](https://github.com/pytorch/pytorch/releases )
- [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md )
- [Commits](https://github.com/pytorch/pytorch/compare/v2.4.1...v2.7.0 )
---
updated-dependencies:
- dependency-name: torch
dependency-version: 2.7.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2025-07-10 09:24:10 +05:30
Sébastien Iooss
db715e2c8c
feat: add multiple input image support in Flux Kontext ( #11880 )
...
* feat: add multiple input image support in Flux Kontext
* move model to community
* fix linter
2025-07-09 11:09:59 -04:00
Sayak Paul
01240fecb0
[training ] add Kontext i2i training ( #11858 )
...
* feat: enable i2i fine-tuning in Kontext script.
* readme
* more checks.
* Apply suggestions from code review
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
* fixes
* fix
* add proj_mlp to the mix
* Update README_flux.md
add note on installing from commit `05e7a854d0a5661f5b433f6dd5954c224b104f0b`
* fix
* fix
---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2025-07-08 21:04:16 +05:30
Luo Yihang
5ef74fd5f6
fix norm not training in train_control_lora_flux.py ( #11832 )
2025-07-01 17:37:54 -10:00
Sayak Paul
00f95b9755
Kontext training ( #11813 )
...
* support flux kontext
* make fix-copies
* add example
* add tests
* update docs
* update
* add note on integrity checker
* initial commit
* initial commit
* add readme section and fixes in the training script.
* add test
* rectify ckpt_id
* fix ckpt
* fixes
* change id
* update
* Update examples/dreambooth/train_dreambooth_lora_flux_kontext.py
Co-authored-by: Aryan <aryan@huggingface.co >
* Update examples/dreambooth/README_flux.md
---------
Co-authored-by: Aryan <aryan@huggingface.co >
Co-authored-by: linoytsaban <linoy@huggingface.co >
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2025-06-26 19:31:42 +03:00
Sayak Paul
10c36e0b78
[chore] post release v0.34.0 ( #11800 )
...
* post release v0.34.0
* code quality
---------
Co-authored-by: YiYi Xu <yixu310@gmail.com >
2025-06-26 06:56:46 +05:30
imbr92
6760300202
Add --lora_alpha and metadata handling to train_dreambooth_lora_sana.py ( #11744 )
...
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2025-06-23 15:46:44 +03:00
dependabot[bot]
7251bb4fd0
Bump urllib3 from 2.2.3 to 2.5.0 in /examples/server ( #11748 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 2.2.3 to 2.5.0.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/2.2.3...2.5.0 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-version: 2.5.0
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-19 11:09:33 +05:30
Aryan
a4df8dbc40
Update more licenses to 2025 ( #11746 )
...
update
2025-06-19 07:46:01 +05:30
Sayak Paul
62cce3045d
[chore] change to 2025 licensing for remaining ( #11741 )
...
change to 2025 licensing for remaining
2025-06-18 20:56:00 +05:30
Leo Jiang
d72184eba3
[training] add ds support to lora hidream ( #11737 )
...
* [training] add ds support to lora hidream
* Apply style fixes
---------
Co-authored-by: J石页 <jiangshuo9@h-partners.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-06-18 09:26:02 +05:30
Linoy Tsaban
1bc6f3dc0f
[LoRA training] update metadata use for lora alpha + README ( #11723 )
...
* lora alpha
* Apply style fixes
* Update examples/advanced_diffusion_training/README_flux.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* fix readme format
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-06-17 12:19:27 +03:00
Sayak Paul
f0dba33d82
[training] show how metadata stuff should be incorporated in training scripts. ( #11707 )
...
* show how metadata stuff should be incorporated in training scripts.
* typing
* fix
---------
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2025-06-16 16:42:34 +05:30
Sayak Paul
368958df6f
[LoRA] parse metadata from LoRA and save metadata ( #11324 )
...
* feat: parse metadata from lora state dicts.
* tests
* fix tests
* key renaming
* fix
* smol update
* smol updates
* load metadata.
* automatically save metadata in save_lora_adapter.
* propagate changes.
* changes
* add test to models too.
* tigher tests.
* updates
* fixes
* rename tests.
* sorted.
* Update src/diffusers/loaders/lora_base.py
Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com >
* review suggestions.
* removeprefix.
* propagate changes.
* fix-copies
* sd
* docs.
* fixes
* get review ready.
* one more test to catch error.
* change to a different approach.
* fix-copies.
* todo
* sd3
* update
* revert changes in get_peft_kwargs.
* update
* fixes
* fixes
* simplify _load_sft_state_dict_metadata
* update
* style fix
* uipdate
* update
* update
* empty commit
* _pack_dict_with_prefix
* update
* TODO 1.
* todo: 2.
* todo: 3.
* update
* update
* Apply suggestions from code review
Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com >
* reraise.
* move argument.
---------
Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com >
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2025-06-13 14:37:49 +05:30
Philip Brown
6c7fad7ec8
Add community class StableDiffusionXL_T5Pipeline ( #11626 )
...
* Add community class StableDiffusionXL_T5Pipeline
Will be used with base model opendiffusionai/stablediffusionxl_t5
* Changed pooled_embeds to use projection instead of slice
* "make style" tweaks
* Added comments to top of code
* Apply style fixes
2025-06-09 15:57:51 -04:00
Markus Pobitzer
745199a869
[examples] flux-control: use num_training_steps_for_scheduler ( #11662 )
...
[examples] flux-control: use num_training_steps_for_scheduler in get_scheduler instead of args.max_train_steps * accelerator.num_processes
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-06-05 14:56:25 +05:30
co63oc
8183d0f16e
Fix typos in strings and comments ( #11476 )
...
* Fix typos in strings and comments
Signed-off-by: co63oc <co63oc@users.noreply.github.com >
* Update src/diffusers/hooks/hooks.py
Co-authored-by: Aryan <contact.aryanvs@gmail.com >
* Update src/diffusers/hooks/hooks.py
Co-authored-by: Aryan <contact.aryanvs@gmail.com >
* Update layerwise_casting.py
* Apply style fixes
* update
---------
Signed-off-by: co63oc <co63oc@users.noreply.github.com >
Co-authored-by: Aryan <contact.aryanvs@gmail.com >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-05-30 18:49:00 +05:30
Justin Ruan
df55f05358
Fix wrong indent for examples of controlnet script ( #11632 )
...
fix wrong indent for training controlnet
2025-05-29 15:26:39 -07:00
Yuanzhou Cai
89ddb6c0a4
[textual_inversion_sdxl.py] fix lr scheduler steps count ( #11557 )
...
fix lr scheduler steps count
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
2025-05-29 15:25:45 +03:00
Linoy Tsaban
cc59505e26
[training docs] smol update to README files ( #11616 )
...
add comment to install prodigy
2025-05-27 06:26:54 -07:00
Sai Shreyas Bhavanasi
ba8dc7dc49
RegionalPrompting: Inherit from Stable Diffusion ( #11525 )
...
* Refactoring Regional Prompting pipeline to use Diffusion Pipeline instead of Stable Diffusion Pipeline
* Apply style fixes
2025-05-20 15:03:16 -04:00
Quentin Gallouédec
c8bb1ff53e
Use HF Papers ( #11567 )
...
* Use HF Papers
* Apply style fixes
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-05-19 06:22:33 -10:00
Kenneth Gerald Hamilton
07dd6f8c0e
[train_dreambooth.py] Fix the LR Schedulers when num_train_epochs is passed in a distributed training env ( #11239 )
...
Co-authored-by: Linoy Tsaban <57615435+linoytsaban@users.noreply.github.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-05-13 07:34:01 +05:30
Abdellah Oumida
ddd0cfb497
Fix typo in train_diffusion_orpo_sdxl_lora_wds.py ( #11541 )
2025-05-12 15:28:29 -10:00
scxue
784db0eaab
Add cross attention type for Sana-Sprint training in diffusers. ( #11514 )
...
* test permission
* Add cross attention type for Sana-Sprint.
* Add Sana-Sprint training script in diffusers.
* make style && make quality;
* modify the attention processor with `set_attn_processor` and change `SanaAttnProcessor3_0` to `SanaVanillaAttnProcessor`
* Add import for SanaVanillaAttnProcessor
* Add README file.
* Apply suggestions from code review
* style
* Update examples/research_projects/sana/README.md
---------
Co-authored-by: lawrence-cj <cjs1020440147@icloud.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-05-08 18:55:29 +05:30
Linoy Tsaban
66e50d4e24
[LoRA] make lora alpha and dropout configurable ( #11467 )
...
* add lora_alpha and lora_dropout
* Apply style fixes
* add lora_alpha and lora_dropout
* Apply style fixes
* revert lora_alpha until #11324 is merged
* Apply style fixes
* empty commit
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-05-08 11:54:50 +03:00