Dhruv Nair
ad24f55ea5
Merge branch 'main' into custom-blocks-guide
2025-11-07 07:51:54 +01:00
Dhruv Nair
a65e0a60df
update
2025-11-07 07:34:14 +01:00
Junsong Chen
b3e9dfced7
[SANA-Video] Adding 5s pre-trained 480p SANA-Video inference ( #12584 )
...
* 1. add `SanaVideoTransformer3DModel` in transformer_sana_video.py
2. add `SanaVideoPipeline` in pipeline_sana_video.py
3. add all code we need for import `SanaVideoPipeline`
* add a sample about how to use sana-video;
* code update;
* update hf model path;
* update code;
* sana-video can run now;
* 1. add aspect ratio in sana-video-pipeline;
2. add reshape function in sana-video-processor;
3. fix convert pth to safetensor bugs;
* default to use `use_resolution_binning`;
* make style;
* remove unused code;
* Update src/diffusers/models/transformers/transformer_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/models/transformers/transformer_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/models/transformers/transformer_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/pipelines/sana/pipeline_sana_video.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/models/transformers/transformer_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/models/transformers/transformer_sana_video.py
* Update src/diffusers/pipelines/sana/pipeline_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/models/transformers/transformer_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/pipelines/sana/pipeline_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* support `dispatch_attention_fn`
* 1. add sana-video markdown;
2. fix typos;
* add two test case for sana-video (need check)
* fix text-encoder in test-sana-video;
* Update tests/pipelines/sana/test_sana_video.py
* Update tests/pipelines/sana/test_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update tests/pipelines/sana/test_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update tests/pipelines/sana/test_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update tests/pipelines/sana/test_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update tests/pipelines/sana/test_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/pipelines/sana/pipeline_sana_video.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/video_processor.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* make style
make quality
make fix-copies
* toctree yaml update;
* add sana-video-transformer3d markdown;
* Apply style fixes
---------
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-05 21:08:47 -08:00
Sayak Paul
ac5a1e28fc
[docs] sort doc ( #12586 )
...
sort doc
2025-11-04 10:26:07 +05:30
Lev Novitskiy
325a95051b
Kandinsky 5.0 Docs fixes ( #12582 )
...
* add transformer pipeline first version
* updates
* fix 5sec generation
* rewrite Kandinsky5T2VPipeline to diffusers style
* add multiprompt support
* remove prints in pipeline
* add nabla attention
* Wrap Transformer in Diffusers style
* fix license
* fix prompt type
* add gradient checkpointing and peft support
* add usage example
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* remove unused imports
* add 10 second models support
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* remove no_grad and simplified prompt paddings
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* moved template to __init__
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* moved sdps inside processor
* remove oneline function
* remove reset_dtype methods
* Transformer: move all methods to forward
* separated prompt encoding
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* refactoring
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* refactoring acording to acabbc0033yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* fixed
* style +copies
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: Charles <charles@huggingface.co >
* more
* Apply suggestions from code review
* add lora loader doc
* add compiled Nabla Attention
* all needed changes for 10 sec models are added!
* add docs
* Apply style fixes
* update docs
* add kandinsky5 to toctree
* add tests
* fix tests
* Apply style fixes
* update tests
* minor docs refactoring
* refactor Kandinsky 5.0 Vide docs
* Update docs/source/en/_toctree.yml
---------
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Charles <charles@huggingface.co >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-03 14:38:07 -10:00
galbria
84e16575e4
Bria fibo ( #12545 )
...
* Bria FIBO pipeline
* style fixs
* fix CR
* Refactor BriaFibo classes and update pipeline parameters
- Updated BriaFiboAttnProcessor and BriaFiboAttention classes to reflect changes from Flux equivalents.
- Modified the _unpack_latents method in BriaFiboPipeline to improve clarity.
- Increased the default max_sequence_length to 3000 and added a new optional parameter do_patching.
- Cleaned up test_pipeline_bria_fibo.py by removing unused imports and skipping unsupported tests.
* edit the docs of FIBO
* Remove unused BriaFibo imports and update CPU offload method in BriaFiboPipeline
* Refactor FIBO classes to BriaFibo naming convention
- Updated class names from FIBO to BriaFibo for consistency across the module.
- Modified instances of FIBOEmbedND, FIBOTimesteps, TextProjection, and TimestepProjEmbeddings to reflect the new naming.
- Ensured all references in the BriaFiboTransformer2DModel are updated accordingly.
* Add BriaFiboTransformer2DModel import to transformers module
* Remove unused BriaFibo imports from modular pipelines and add BriaFiboTransformer2DModel and BriaFiboPipeline classes to dummy objects for enhanced compatibility with torch and transformers.
* Update BriaFibo classes with copied documentation and fix import typo in pipeline module
- Added documentation comments indicating the source of copied code in BriaFiboTransformerBlock and _pack_latents methods.
- Corrected the import statement for BriaFiboPipeline in the pipelines module.
* Remove unused BriaFibo imports from __init__.py to streamline modular pipelines.
* Refactor documentation comments in BriaFibo classes to indicate inspiration from existing implementations
- Updated comments in BriaFiboAttnProcessor, BriaFiboAttention, and BriaFiboPipeline to reflect that the code is inspired by other modules rather than copied.
- Enhanced clarity on the origins of the methods to maintain proper attribution.
* change Inspired by to Based on
* add reference link and fix trailing whitespace
* Add BriaFiboTransformer2DModel documentation and update comments in BriaFibo classes
- Introduced a new documentation file for BriaFiboTransformer2DModel.
- Updated comments in BriaFiboAttnProcessor, BriaFiboAttention, and BriaFiboPipeline to clarify the origins of the code, indicating copied sources for better attribution.
---------
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
2025-10-28 16:27:48 +05:30
Meatfucker
40528e9ae7
Fix typos in kandinsky5 docs ( #12552 )
...
Update kandinsky5.md
Fix typos
2025-10-28 02:54:24 -03:00
Lev Novitskiy
5afbcce176
Kandinsky 5 10 sec (NABLA suport) ( #12520 )
...
* add transformer pipeline first version
* updates
* fix 5sec generation
* rewrite Kandinsky5T2VPipeline to diffusers style
* add multiprompt support
* remove prints in pipeline
* add nabla attention
* Wrap Transformer in Diffusers style
* fix license
* fix prompt type
* add gradient checkpointing and peft support
* add usage example
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
* remove unused imports
* add 10 second models support
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* remove no_grad and simplified prompt paddings
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* moved template to __init__
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* moved sdps inside processor
* remove oneline function
* remove reset_dtype methods
* Transformer: move all methods to forward
* separated prompt encoding
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* refactoring
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* refactoring acording to acabbc0033yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/pipelines/kandinsky5/pipeline_kandinsky.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* fixed
* style +copies
* Update src/diffusers/models/transformers/transformer_kandinsky.py
Co-authored-by: Charles <charles@huggingface.co >
* more
* Apply suggestions from code review
* add lora loader doc
* add compiled Nabla Attention
* all needed changes for 10 sec models are added!
* add docs
* Apply style fixes
* update docs
* add kandinsky5 to toctree
* add tests
* fix tests
* Apply style fixes
* update tests
---------
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Charles <charles@huggingface.co >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-28 07:47:18 +05:30
Mikko Lauri
250f5cb53d
Add AITER attention backend ( #12549 )
...
* add aiter attention backend
* Apply style fixes
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-10-27 20:25:02 +05:30
josephrocca
dc6bd1511a
Fix Chroma attention padding order and update docs to use lodestones/Chroma1-HD ( #12508 )
...
* [Fix] Move attention mask padding after T5 embedding
* [Fix] Move attention mask padding after T5 embedding
* Clean up whitespace in pipeline_chroma.py
Removed unnecessary blank lines for cleaner code.
* Fix
* Fix
* Update model to final Chroma1-HD checkpoint
* Update to Chroma1-HD
* Update model to Chroma1-HD
* Update model to Chroma1-HD
* Update Chroma model links to Chroma1-HD
* Add comment about padding/masking
* Fix checkpoint/repo references
* Apply style fixes
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2025-10-27 16:25:20 +05:30
YiYi Xu
a138d71ec1
HunyuanImage21 ( #12333 )
...
* add hunyuanimage2.1
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-10-23 22:31:12 -10:00
David Bertoin
dd07b19e27
Prx ( #12525 )
...
* rename photon to prx
* rename photon into prx
* Revert .gitignore to state before commit b7fb0fe9d6b7fb0fe9d6
2025-10-21 17:09:22 -07:00
David Bertoin
cefc2cf82d
Add Photon model and pipeline support ( #12456 )
...
* Add Photon model and pipeline support
This commit adds support for the Photon image generation model:
- PhotonTransformer2DModel: Core transformer architecture
- PhotonPipeline: Text-to-image generation pipeline
- Attention processor updates for Photon-specific attention mechanism
- Conversion script for loading Photon checkpoints
- Documentation and tests
* just store the T5Gemma encoder
* enhance_vae_properties if vae is provided only
* remove autocast for text encoder forwad
* BF16 example
* conditioned CFG
* remove enhance vae and use vae.config directly when possible
* move PhotonAttnProcessor2_0 in transformer_photon
* remove einops dependency and now inherits from AttentionMixin
* unify the structure of the forward block
* update doc
* update doc
* fix T5Gemma loading from hub
* fix timestep shift
* remove lora support from doc
* Rename EmbedND for PhotoEmbedND
* remove modulation dataclass
* put _attn_forward and _ffn_forward logic in PhotonBlock's forward
* renam LastLayer for FinalLayer
* remove lora related code
* rename vae_spatial_compression_ratio for vae_scale_factor
* support prompt_embeds in call
* move xattention conditionning out computation out of the denoising loop
* add negative prompts
* Use _import_structure for lazy loading
* make quality + style
* add pipeline test + corresponding fixes
* utility function that determines the default resolution given the VAE
* Refactor PhotonAttention to match Flux pattern
* built-in RMSNorm
* Revert accidental .gitignore change
* parameter names match the standard diffusers conventions
* renaming and remove unecessary attributes setting
* Update docs/source/en/api/pipelines/photon.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* quantization example
* added doc to toctree
* Update docs/source/en/api/pipelines/photon.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/photon.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/api/pipelines/photon.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* use dispatch_attention_fn for multiple attention backend support
* naming changes
* make fix copy
* Update docs/source/en/api/pipelines/photon.md
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Add PhotonTransformer2DModel to TYPE_CHECKING imports
* make fix-copies
* Use Tuple instead of tuple
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* restrict the version of transformers
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update tests/pipelines/photon/test_pipeline_photon.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update tests/pipelines/photon/test_pipeline_photon.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* change | for Optional
* fix nits.
* use typing Dict
---------
Co-authored-by: davidb <davidb@worker-10.soperator-worker-svc.soperator.svc.cluster.local >
Co-authored-by: David Briand <david@photoroom.com >
Co-authored-by: davidb <davidb@worker-8.soperator-worker-svc.soperator.svc.cluster.local >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
2025-10-21 20:55:55 +05:30
Sayak Paul
b3e56e71fb
styling issues. ( #12522 )
2025-10-21 20:04:54 +05:30
Steven Liu
5b5fa49a89
[docs] Organize toctree by modality ( #12514 )
...
* reorganize
* fix
---------
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
2025-10-21 10:18:54 +05:30
Lev Novitskiy
23ebbb4bc8
Kandinsky 5 is finally in Diffusers! ( #12478 )
...
* add kandinsky5 transformer pipeline first version
---------
Co-authored-by: Álvaro Somoza <asomoza@users.noreply.github.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: Charles <charles@huggingface.co >
2025-10-17 18:34:30 -10:00
Ali Imran
1b456bd5d5
docs: cleanup of runway model ( #12503 )
...
* cleanup of runway model
* quality fixes
2025-10-17 14:10:50 -07:00
Steven Liu
26475082cb
[docs] Attention checks ( #12486 )
...
* checks
* feedback
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-10-16 09:19:30 -07:00
YiYi Xu
f072c64bf2
ltx0.9.8 (without IC lora, autoregressive sampling) ( #12493 )
...
update
Co-authored-by: Aryan <aryan@huggingface.co >
2025-10-15 07:41:17 -10:00
Steven Liu
b4e6dc3037
[docs] Fix broken links ( #12487 )
...
fix broken links
2025-10-15 06:42:10 +05:30
Steven Liu
3eb40786ca
[docs] Prompting ( #12312 )
...
* init
* fix
* batch inf
* feedback
* update
2025-10-14 13:53:56 -07:00
Meatfucker
a4bc845478
Fix missing load_video documentation and load_video import in WanVideoToVideoPipeline example code ( #12472 )
...
* Update utilities.md
Update missing load_video documentation
* Update pipeline_wan_video2video.py
Fix missing load_video import in example code
2025-10-14 10:43:21 -07:00
Manith Ratnayake
fa468c5d57
docs: api-pipelines-qwenimage typo fix ( #12461 )
2025-10-13 08:57:46 -07:00
Steven Liu
8abc7aeb71
[docs] Fix syntax ( #12464 )
...
* fix syntax
* fix
* style
* fix
2025-10-11 08:13:30 +05:30
Dhruv Nair
331a7a1356
Apply suggestion from @stevhliu
...
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-10-08 14:26:46 +05:30
Dhruv Nair
28d3856a0e
Apply suggestion from @stevhliu
...
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-10-08 14:26:40 +05:30
DN6
c918079f8b
update
2025-10-08 14:21:37 +05:30
DN6
a4815ab1c8
update
2025-10-08 13:53:59 +05:30
DN6
c194bf11a0
update
2025-10-08 13:53:59 +05:30
Dhruv Nair
df67d521ee
Apply suggestion from @stevhliu
...
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-10-08 13:51:07 +05:30
Dhruv Nair
ddaf986eb4
Apply suggestion from @stevhliu
...
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-10-08 13:49:38 +05:30
Changseop Yeom
0974b4c606
[i18n-KO] Fix typo and update translation in ethical_guidelines.md ( #12435 )
2025-10-06 14:24:05 -07:00
Steven Liu
cc5b31ffc9
[docs] Migrate syntax ( #12390 )
...
* change syntax
* make style
2025-09-30 10:11:19 -07:00
Steven Liu
d7a1a0363f
[docs] CP ( #12331 )
...
* init
* feedback
* feedback
* feedback
* feedback
* feedback
* feedback
2025-09-30 09:33:41 -07:00
Steven Liu
c07fcf780a
[docs] Model formats ( #12256 )
...
* init
* config
* lora metadata
* feedback
* fix
* cache allocator warmup for from_single_file
* feedback
* feedback
2025-09-29 11:36:14 -07:00
Steven Liu
ccedeca96e
[docs] Distributed inference ( #12285 )
...
* init
* feedback
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2025-09-29 11:24:26 -07:00
Sayak Paul
64a5187d96
[quantization] feat: support aobaseconfig classes in TorchAOConfig ( #12275 )
...
* feat: support aobaseconfig classes.
* [docs] AOBaseConfig (#12302 )
init
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* up
* replace with is_torchao_version
* up
* up
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-09-29 18:04:18 +05:30
Sayak Paul
9c0944581a
[docs] slight edits to the attention backends docs. ( #12394 )
...
* slight edits to the attention backends docs.
* Update docs/source/en/optimization/attention_backends.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-09-26 21:50:16 +05:30
DefTruth
310fdaf556
Introduce cache-dit to community optimization ( #12366 )
...
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* misc: update examples link
* misc: update examples link
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* docs: introduce cache-dit to diffusers
* Refine documentation for CacheDiT features
Updated the wording for clarity and consistency in the documentation. Adjusted sections on cache acceleration, automatic block adapter, patch functor, and hybrid cache configuration.
2025-09-24 10:50:57 -07:00
Aryan
dcb6dd9b7a
Context Parallel w/ Ring & Ulysses & Unified Attention ( #11941 )
...
* update
* update
* add coauthor
Co-Authored-By: Dhruv Nair <dhruv.nair@gmail.com >
* improve test
* handle ip adapter params correctly
* fix chroma qkv fusion test
* fix fastercache implementation
* fix more tests
* fight more tests
* add back set_attention_backend
* update
* update
* make style
* make fix-copies
* make ip adapter processor compatible with attention dispatcher
* refactor chroma as well
* remove rmsnorm assert
* minify and deprecate npu/xla processors
* update
* refactor
* refactor; support flash attention 2 with cp
* fix
* support sage attention with cp
* make torch compile compatible
* update
* refactor
* update
* refactor
* refactor
* add ulysses backward
* try to make dreambooth script work; accelerator backward not playing well
* Revert "try to make dreambooth script work; accelerator backward not playing well"
This reverts commit 768d0ea6fadhruv.nair@gmail.com >
* apply review suggestions
* update docs
* add explanation
* make fix-copies
* add docstrings
* support passing parallel_config to from_pretrained
* apply review suggestions
* make style
* update
* Update docs/source/en/api/parallel.md
Co-authored-by: Aryan <aryan@huggingface.co >
* up
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
Co-authored-by: sayakpaul <spsayakpaul@gmail.com >
2025-09-24 19:03:25 +05:30
Steven Liu
a72bc0c4bb
[docs] Attention backends ( #12320 )
...
* init
* feedback
* update
* feedback
* fixes
2025-09-23 10:59:46 -07:00
Steven Liu
76810eca2b
[docs] Schedulers ( #12246 )
...
* init
* toctree
* scheduler suggestions
* toctree
2025-09-23 10:29:16 -07:00
Sayak Paul
5796735015
add test and doc for QwenImageEdit Plus ( #12363 )
...
* up
* xfail some tests
* up
* up
2025-09-22 21:57:30 +05:30
Dhruv Nair
e78aa54b82
Update docs/source/en/modular_diffusers/custom_blocks.md
...
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-09-17 08:41:51 +05:30
Dhruv Nair
180c9eaed1
Update docs/source/en/_toctree.yml
...
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-09-17 08:41:19 +05:30
Dhruv Nair
830603e323
Update docs/source/en/modular_diffusers/custom_blocks.md
...
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-09-17 08:41:10 +05:30
Dhruv Nair
ed3f88528a
Update docs/source/en/modular_diffusers/custom_blocks.md
...
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-09-17 08:41:02 +05:30
DN6
c67dda4bdd
update
2025-09-16 18:11:20 +05:30
DN6
e3f111a095
update
2025-09-15 23:16:43 +05:30
Sayak Paul
eb7ef26736
[quant] allow components_to_quantize to be a non-list for single components ( #12234 )
...
* allow non list components_to_quantize.
* up
* Apply suggestions from code review
* Apply suggestions from code review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* [docs] components_to_quantize (#12287 )
init
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2025-09-10 09:47:08 -10:00
