Shenghai Yuan
ae5881ba77
Fix Helios paper link in documentation ( #13213 )
...
* Fix Helios paper link in documentation
Updated the link to the Helios paper for accuracy.
* Fix reference link in HeliosTransformer3DModel documentation
Updated the reference link for the Helios Transformer model paper.
* Update Helios research paper link in documentation
* Update Helios research paper link in documentation
2026-03-05 18:58:13 +05:30
dg845
33f785b444
Add Helios-14B Video Generation Pipelines ( #13208 )
...
* [1/N] add helios
* fix test
* make fix-copies
* change script path
* fix cus script
* update docs
* fix documented check
* update links for docs and examples
* change default config
* small refactor
* add test
* Update src/diffusers/models/transformers/transformer_helios.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* remove register_buffer for _scale_cache
* fix non-cuda devices error
* remove "handle the case when timestep is 2D"
* refactor HeliosMultiTermMemoryPatch and process_input_hidden_states
* Update src/diffusers/pipelines/helios/pipeline_helios.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/models/transformers/transformer_helios.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/pipelines/helios/pipeline_helios.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* fix calculate_shift
* Update src/diffusers/pipelines/helios/pipeline_helios.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* rewritten `einops` in pure `torch`
* fix: pass patch_size to apply_schedule_shift instead of hardcoding
* remove the logics of 'vae_decode_type'
* move some validation into check_inputs()
* rename helios scheduler & merge all into one step()
* add some details to doc
* move dmd step() logics from pipeline to scheduler
* change to Python 3.9+ style type
* fix NoneType error
* refactor DMD scheduler's set_timestep
* change rope related vars name
* fix stage2 sample
* fix dmd sample
* Update src/diffusers/models/transformers/transformer_helios.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_helios.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* remove redundant & refactor norm_out
* Update src/diffusers/pipelines/helios/pipeline_helios.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* change "is_keep_x0" to "keep_first_frame"
* use a more intuitive name
* refactor dynamic_time_shifting
* remove use_dynamic_shifting args
* remove usage of UniPCMultistepScheduler
* separate stage2 sample to HeliosPyramidPipeline
* Update src/diffusers/models/transformers/transformer_helios.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_helios.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_helios.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* Update src/diffusers/models/transformers/transformer_helios.py
Co-authored-by: YiYi Xu <yixu310@gmail.com >
* fix transformer
* use a more intuitive name
* update example script
* fix requirements
* remove redudant attention mask
* fix
* optimize pipelines
* make style .
* update TYPE_CHECKING
* change to use torch.split
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* derive memory patch sizes from patch_size multiples
* remove some hardcoding
* move some checks into check_inputs
* refactor sample_block_noise
* optimize encoding chunks logits for v2v
* use num_history_latent_frames = sum(history_sizes)
* Update src/diffusers/pipelines/helios/pipeline_helios.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* remove redudant optimized_scale
* Update src/diffusers/pipelines/helios/pipeline_helios_pyramid.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* use more descriptive name
* optimize history_latents
* remove not used "num_inference_steps"
* removed redudant "pyramid_num_stages"
* add "is_cfg_zero_star" and "is_distilled" to HeliosPyramidPipeline
* remove redudant
* change example scripts name
* change example scripts name
* correct docs
* update example
* update docs
* Update tests/models/transformers/test_models_transformer_helios.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update tests/models/transformers/test_models_transformer_helios.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* separate HeliosDMDScheduler
* fix numerical stability issue:
* Update src/diffusers/schedulers/scheduling_helios_dmd.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/schedulers/scheduling_helios_dmd.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/schedulers/scheduling_helios_dmd.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/schedulers/scheduling_helios_dmd.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* Update src/diffusers/schedulers/scheduling_helios_dmd.py
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com >
* remove redudant
* small refactor
* remove use_interpolate_prompt logits
* simplified model test
* fallbackt to BaseModelTesterConfig
* remove _maybe_expand_t2v_lora_for_i2v
* fix HeliosLoraLoaderMixin
* update docs
* use randn_tensor for test
* fix doc typo
* optimize code
* mark torch.compile xfail
* change paper name
* Make get_dummy_inputs deterministic using self.generator
* Set less strict threshold for test_save_load_float16 test for Helios pipeline
* make style and make quality
* Preparation for merging
* add torch.Generator
* Fix HeliosPipelineOutput doc path
* Fix Helios related (optimize docs & remove redudant) (#13210 )
* fix docs
* remove redudant
* remove redudant
* fix group offload
* Removed fixes for group offload
---------
Co-authored-by: yuanshenghai <yuanshenghai@bytedance.com >
Co-authored-by: Shenghai Yuan <140951558+SHYuanBest@users.noreply.github.com >
Co-authored-by: YiYi Xu <yixu310@gmail.com >
Co-authored-by: SHYuanBest <shyuan-cs@hotmail.com >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2026-03-04 21:31:43 +05:30
YiYi Xu
c919ec0611
[Modular] add explicit workflow support ( #13028 )
...
* up
* up up
* update outputs
* style
* add modular_auto_docstring!
* more auto docstring
* style
* up up up
* more more
* up
* address feedbacks
* add TODO in the description for empty docstring
* refactor based on dhruv's feedback: remove the class method
* add template method
* up
* up up up
* apply auto docstring
* make style
* rmove space in make docstring
* Apply suggestions from code review
* revert change in z
* fix
* Apply style fixes
* include auto-docstring check in the modular ci. (#13004 )
* initial support: workflow
* up up
* treeat loop sequential pipeline blocks as leaf
* update qwen image docstring note
* add workflow support for sdxl
* add a test suit
* add test for qwen-image
* refactor flux a bit, seperate modular_blocks into modular_blocks_flux and modular_blocks_flux_kontext + support workflow
* refactor flux2: seperate blocks for klein_base + workflow
* qwen: remove import support for stuff other than the default blocks
* add workflow support for wan
* sdxl: remove some imports:
* refactor z
* update flux2 auto core denoise
* add workflow test for z and flux2
* Apply suggestions from code review
* Apply suggestions from code review
* add test for flux
* add workflow test for flux
* add test for flux-klein
* sdxl: modular_blocks.py -> modular_blocks_stable_diffusion_xl.py
* style
* up
* add auto docstring
* workflow_names -> available_workflows
* fix workflow test for klein base
* Apply suggestions from code review
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
* fix workflow tests
* qwen: edit -> image_conditioned to be consistent with flux kontext/2 such
* remove Optional
* update type hints
* update guider update_components
* fix more
* update docstring auto again
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
Co-authored-by: yiyi@huggingface.co <yiyi@ip-26-0-160-103.ec2.internal >
Co-authored-by: yiyi@huggingface.co <yiyi@ip-26-0-161-123.ec2.internal >
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com >
2026-02-14 16:18:48 -10:00
Dhruv Nair
b010a8ce0c
[Modular] Add single file support to Modular ( #12383 )
...
* update
* update
* update
* update
* Apply style fixes
* update
* update
* update
* update
* update
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-28 22:23:04 +05:30
Ali Imran
1b456bd5d5
docs: cleanup of runway model ( #12503 )
...
* cleanup of runway model
* quality fixes
2025-10-17 14:10:50 -07:00
Steven Liu
cc5b31ffc9
[docs] Migrate syntax ( #12390 )
...
* change syntax
* make style
2025-09-30 10:11:19 -07:00
Ziheng Zhang
9e4a75b142
[docs] Fix VAE scale factor calculation in distributed inference docs ( #12259 )
...
docs: Fix VAE scale factor calculation
2025-09-01 16:34:16 -10:00
Dhruv Nair
ba0e732eb0
[Modular] Consolidate load_default_components into load_components ( #12217 )
...
* update
* Apply style fixes
* update
* update
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-28 19:55:02 +05:30
Sam Yuan
91a151b5c6
continue translate document to zh ( #12194 )
...
Signed-off-by: SamYuan1990 <yy19902439@126.com >
2025-08-20 08:49:19 -07:00
Sam Yuan
f868d4b58b
translate document to zh ( #12179 )
...
Signed-off-by: SamYuan1990 <yy19902439@126.com >
2025-08-19 08:43:33 -07:00
Sam Yuan
bc2762cce9
try to use deepseek with an agent to auto i18n to zh ( #12032 )
...
* try to use deepseek with an agent to auto i18n to zh
Signed-off-by: SamYuan1990 <yy19902439@126.com >
* add two more docs
Signed-off-by: SamYuan1990 <yy19902439@126.com >
* fix, updated some prompt for better translation
Signed-off-by: SamYuan1990 <yy19902439@126.com >
* Try to passs CI check
Signed-off-by: SamYuan1990 <yy19902439@126.com >
* fix up for human review process
Signed-off-by: SamYuan1990 <yy19902439@126.com >
* fix up
Signed-off-by: SamYuan1990 <yy19902439@126.com >
* fix review comments
Signed-off-by: SamYuan1990 <yy19902439@126.com >
---------
Signed-off-by: SamYuan1990 <yy19902439@126.com >
2025-08-13 08:26:24 -07:00
Aryan
a4df8dbc40
Update more licenses to 2025 ( #11746 )
...
update
2025-06-19 07:46:01 +05:30
Quentin Gallouédec
c8bb1ff53e
Use HF Papers ( #11567 )
...
* Use HF Papers
* Apply style fixes
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-05-19 06:22:33 -10:00
Shenghai Yuan
23b467c79c
[core] ConsisID ( #10140 )
...
* Update __init__.py
* add consisid
* update consisid
* update consisid
* make style
* make_style
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: hlky <hlky@hlky.ac >
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: hlky <hlky@hlky.ac >
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: hlky <hlky@hlky.ac >
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: hlky <hlky@hlky.ac >
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: hlky <hlky@hlky.ac >
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: hlky <hlky@hlky.ac >
* add doc
* make style
* Rename consisid .md to consisid.md
* Update geodiff_molecule_conformation.ipynb
* Update geodiff_molecule_conformation.ipynb
* Update geodiff_molecule_conformation.ipynb
* Update demo.ipynb
* Update pipeline_consisid.py
* make fix-copies
* Update docs/source/en/using-diffusers/consisid.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/using-diffusers/consisid.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Update docs/source/en/using-diffusers/consisid.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* update doc & pipeline code
* fix typo
* make style
* update example
* Update docs/source/en/using-diffusers/consisid.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* update example
* update example
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: hlky <hlky@hlky.ac >
* Update src/diffusers/pipelines/consisid/pipeline_consisid.py
Co-authored-by: hlky <hlky@hlky.ac >
* update
* add test and update
* remove some changes from docs
* refactor
* fix
* undo changes to examples
* remove save/load and fuse methods
* update
* link hf-doc-img & make test extremely small
* update
* add lora
* fix test
* update
* update
* change expected_diff_max to 0.4
* fix typo
* fix link
* fix typo
* update docs
* update
* remove consisid lora tests
---------
Co-authored-by: hlky <hlky@hlky.ac >
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
Co-authored-by: Aryan <aryan@huggingface.co >
2025-01-19 13:10:08 +05:30
suzukimain
b52119ae92
[docs] Replace runwayml/stable-diffusion-v1-5 with Lykon/dreamshaper-8 ( #9428 )
...
* [docs] Replace runwayml/stable-diffusion-v1-5 with Lykon/dreamshaper-8
Updated documentation as runwayml/stable-diffusion-v1-5 has been removed from Huggingface.
* Update docs/source/en/using-diffusers/inpaint.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
* Replace with stable-diffusion-v1-5/stable-diffusion-v1-5
* Update inpaint.md
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2024-09-16 10:18:45 -07:00
Tolga Cangöz
468ae09ed8
Errata - Trim trailing white space in the whole repo ( #8575 )
...
* Trim all the trailing white space in the whole repo
* Remove unnecessary empty places
* make style && make quality
* Trim trailing white space
* trim
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-06-24 18:39:15 +05:30
Tolga Cangöz
98730c5dd7
Errata ( #8322 )
...
* Fix typos
* Trim trailing whitespaces
* Remove a trailing whitespace
* chore: Update MarigoldDepthPipeline checkpoint to prs-eth/marigold-lcm-v1-0
* Revert "chore: Update MarigoldDepthPipeline checkpoint to prs-eth/marigold-lcm-v1-0"
This reverts commit fd742b30b4
2024-06-05 13:59:09 -07:00
Sayak Paul
6695635696
upgrade to python 3.10 in the Dockerfiles ( #7893 )
...
* upgrade to python 3.10
* fix
* try https://askubuntu.com/questions/1459694/can-not-find-python3-10-after-apt-get-installation
* fix
* up
* yes
* okay
* up
* up
* up
* up
* up
* check
* okay
* up
* i[
* fix
2024-05-10 14:29:08 +02:00
Steven Liu
181688012a
[docs] Reproducible pipelines ( #7769 )
...
* reproducibility
* feedback
* feedback
* fix path
* github link
2024-04-25 16:15:12 -07:00
Sayak Paul
30e5e81d58
change to 2024 in the license ( #6902 )
...
change to 2024
2024-02-08 08:19:31 -10:00
1toTree
e46ec5f88f
Zh doc ( #4807 )
...
* Update _toctree.yml
* Add files via upload
* Update docs/source/zh/stable_diffusion.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
---------
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com >
2023-10-04 08:54:13 -07:00
Younes Belkada
914586f5b6
[core] Use python 3.8 in workflow and setup file ( #5122 )
...
* use python 3.7 instead
* Update setup.py
2023-09-20 20:57:06 +02:00
camenduru
c6ae9b7df6
Where did this 'x' come from, Elon? ( #4277 )
...
* why mdx?
* why mdx?
* why mdx?
* no x for kandinksy either
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2023-07-26 18:18:14 +02:00
Patrick von Platen
abbfe4b5b7
fix zh
2023-06-10 17:54:55 +02:00
NimenDavid
0614fd2038
[Docs]zh translated docs update ( #3245 )
...
* zh translated docs update
* update _toctree
2023-04-28 10:23:02 +01:00
Sian
4aa68291a9
add translated docs ( #2587 )
...
* add translated docs
* improve translated content
* improve translated content
* Modify the translation content
2023-03-10 13:55:12 +01:00
