mirror of
https://github.com/huggingface/diffusers.git
synced 2026-10-24 20:59:27 +03:00
* feat: add torchtpu * feat:draft TorchTPU support * fix: wan overflow issue + compile mode error on sdxl * doc: enhance with TorchTPU doc * doc: enhance with TorchTPU doc * style: remove unused imports flagged by ruff Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * docs: remove Debug Eager and Fused Eager sections from tpu.md Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * feat: add TP for TPU * style: fix import sorting in TPU test scripts Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * style: ruff format TPU test scripts Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> * fix: style * fix: test for native 4 devices * fix: propagate TPU device fixes to Flux/Flux2/Wan-family copies; register tpu.md; drop redundant execution_device check - Propagate the text_encoder.device-based fix (introduced for TPU CPU-offload support) from FluxPipeline/Flux2KleinPipeline/WanPipeline into their `# Copied from` copies (flux/*, flux2_klein_inpaint, visualcloze, anyflow, chronoedit, lucy_edit, skyreels_v2/*). SDXL-family copies of StableDiffusionXLPipeline.encode_prompt are intentionally left untouched; they'll be handled in a follow-up PR that fixes device placement for every pipeline component (not just text encoders). - Register docs/source/en/optimization/tpu.md in _toctree.yml (was breaking the docs build: "not present in the table of contents"). - Remove the redundant "prefer non-CPU, non-meta component" loop from DiffusionPipeline._execution_device: PR #14383 already fixed this in DiffusionPipeline.device, which _execution_device falls back to. Verified on TPU hardware that _execution_device still resolves correctly for a split-placement pipeline after the removal. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> * tests: cleanup * fix: fix compile mode * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * test: remove flux2 e2e test * doc: apply suggestions * doc: apply suggestions * review: remove monkey patch * review: revert neuron-specific changes in the tests * review: apply suggestions * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * doc: add tpu to tp doc * review: remove unnecessary for tpu * test: assert every _tp_plan parameter is sharded after a TP load Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * removal: delete redundant tp shard helpers * removal: drop TPU workarounds no longer needed after recent main changes * doc: keep the FLUX.2-dev text encoder off a single TPU chip in the TP example * doc: encode the prompt on CPU in the TPU TP example so it runs end to end * test: tighten TPU TP tolerance and simplify the TPU TP worker * doc: use enable_model_cpu_offload() in the TPU eager example * doc: shard both FLUX.2-dev text encoder and transformer in the TPU TP example * doc: run the text encoders on TPU in the compiled example * test: drop the redundant TPU sync in the TP worker * test: trim comments in the TPU TP tests * test: run the TPU TP test with mp.spawn like the CUDA one * test: pin the TPU TP test to 4 chips * Update docs/source/en/optimization/tpu.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * doc: use DistributedConfig and dtype, and drop the torch_tpu import in the TPU examples * test: skip the TPU TP test for models without a _tp_plan * doc: correct the warning of recompilation * fix: clone the SD3 timestep so torch.compile doesn't recompile every step, thus we can use it for the tpu.md compile mode snippet * doc: update advice for compile mode when one chip doesn't fit * test: pass the TPU TP tolerances as test arguments * review: apply suggestions to the doc * review: view compilation patch for tpu-only --------- Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by: JingyaHuang <huang_jingya@outlok.com> Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
855 lines
29 KiB
YAML
855 lines
29 KiB
YAML
- sections:
|
||
- local: index
|
||
title: Diffusers
|
||
- local: installation
|
||
title: Installation
|
||
- local: quicktour
|
||
title: Quickstart
|
||
- local: using-diffusers/cli
|
||
title: Command line interface
|
||
title: Get started
|
||
- isExpanded: true
|
||
sections:
|
||
- isExpanded: false
|
||
sections:
|
||
- local: using-diffusers/loading
|
||
title: DiffusionPipeline
|
||
- local: tutorials/autopipeline
|
||
title: AutoPipeline
|
||
- local: using-diffusers/automodel
|
||
title: AutoModel
|
||
- local: using-diffusers/other-formats
|
||
title: Model formats
|
||
- local: using-diffusers/schedulers
|
||
title: Schedulers
|
||
- local: using-diffusers/weighted_prompts
|
||
title: Prompting
|
||
- local: using-diffusers/image_quality
|
||
title: FreeU
|
||
- local: using-diffusers/reusing_seeds
|
||
title: Reproducibility
|
||
- local: using-diffusers/callback
|
||
title: Pipeline callbacks
|
||
- local: using-diffusers/custom_pipeline_overview
|
||
title: Community pipelines and components
|
||
- local: using-diffusers/push_to_hub
|
||
title: Sharing pipelines and models
|
||
- local: using-diffusers/legacy_checkpoints
|
||
title: Legacy checkpoints
|
||
title: Using diffusion pipelines
|
||
- isExpanded: false
|
||
sections:
|
||
- local: tutorials/using_peft_for_inference
|
||
title: LoRA
|
||
- local: using-diffusers/ip_adapter
|
||
title: IP-Adapter
|
||
- local: using-diffusers/controlnet
|
||
title: ControlNet
|
||
- local: using-diffusers/dreambooth
|
||
title: DreamBooth
|
||
- local: using-diffusers/legacy_adapters
|
||
title: Legacy adapters
|
||
title: Adapters and personalization
|
||
title: Inference
|
||
- isExpanded: true
|
||
sections:
|
||
- local: stable_diffusion
|
||
title: Basic performance
|
||
- isExpanded: false
|
||
sections:
|
||
- local: optimization/fp16
|
||
title: Accelerate inference
|
||
- local: optimization/cache
|
||
title: Caching
|
||
- local: optimization/attention_backends
|
||
title: Attention backends
|
||
- local: optimization/memory
|
||
title: Reduce memory usage
|
||
- local: optimization/speed-memory-optims
|
||
title: Compiling and offloading quantized models
|
||
title: Inference
|
||
- isExpanded: false
|
||
sections:
|
||
- local: optimization/cache_dit
|
||
title: CacheDiT
|
||
- local: optimization/para_attn
|
||
title: ParaAttention
|
||
- local: optimization/pruna
|
||
title: Pruna
|
||
- local: optimization/xdit
|
||
title: xDiT
|
||
title: Community methods
|
||
- isExpanded: false
|
||
sections:
|
||
- local: quantization/overview
|
||
title: Getting started
|
||
- local: quantization/bitsandbytes
|
||
title: bitsandbytes
|
||
- local: quantization/gguf
|
||
title: gguf
|
||
- local: quantization/nunchaku
|
||
title: Nunchaku Lite
|
||
- local: quantization/torchao
|
||
title: torchao
|
||
- local: quantization/quanto
|
||
title: quanto
|
||
- local: quantization/modelopt
|
||
title: NVIDIA ModelOpt
|
||
- local: quantization/autoround
|
||
title: AutoRound
|
||
- local: quantization/sdnq
|
||
title: SDNQ
|
||
title: Quantization
|
||
- isExpanded: false
|
||
sections:
|
||
- local: optimization/onnx
|
||
title: ONNX
|
||
- local: optimization/open_vino
|
||
title: OpenVINO
|
||
- local: optimization/coreml
|
||
title: Core ML
|
||
- local: optimization/mps
|
||
title: Metal Performance Shaders (MPS)
|
||
- local: optimization/habana
|
||
title: Intel Gaudi
|
||
- local: optimization/neuron
|
||
title: AWS Neuron
|
||
- local: optimization/tpu
|
||
title: TPU
|
||
title: Hardware-specific acceleration
|
||
- isExpanded: false
|
||
sections:
|
||
- local: using-diffusers/create_a_server
|
||
title: Create a server
|
||
- local: using-diffusers/batched_inference
|
||
title: Batch inference
|
||
- local: training/distributed_inference
|
||
title: Distributed inference
|
||
- local: hybrid_inference/overview
|
||
title: Remote inference
|
||
title: Serving and scaling
|
||
title: Optimize and scale
|
||
- isExpanded: false
|
||
sections:
|
||
- local: modular_diffusers/overview
|
||
title: Overview
|
||
- local: modular_diffusers/quickstart
|
||
title: Quickstart
|
||
- local: modular_diffusers/modular_diffusers_states
|
||
title: States
|
||
- local: modular_diffusers/pipeline_block
|
||
title: ModularPipelineBlocks
|
||
- local: modular_diffusers/sequential_pipeline_blocks
|
||
title: SequentialPipelineBlocks
|
||
- local: modular_diffusers/loop_sequential_pipeline_blocks
|
||
title: LoopSequentialPipelineBlocks
|
||
- local: modular_diffusers/auto_pipeline_blocks
|
||
title: AutoPipelineBlocks
|
||
- local: modular_diffusers/modular_pipeline
|
||
title: ModularPipeline
|
||
- local: using-diffusers/guiders
|
||
title: Guiders
|
||
- local: modular_diffusers/components_manager
|
||
title: ComponentsManager
|
||
- local: modular_diffusers/auto_docstring
|
||
title: Auto docstring and parameter templates
|
||
- local: modular_diffusers/custom_blocks
|
||
title: Building Custom Blocks
|
||
- local: modular_diffusers/mellon
|
||
title: Using Custom Blocks with Mellon
|
||
title: Modular Diffusers
|
||
- isExpanded: false
|
||
sections:
|
||
- local: training/overview
|
||
title: Overview
|
||
- local: training/create_dataset
|
||
title: Create a dataset for training
|
||
- local: training/adapt_a_model
|
||
title: Adapt a model to a new task
|
||
- local: tutorials/basic_training
|
||
title: Train a diffusion model
|
||
- isExpanded: false
|
||
sections:
|
||
- local: training/unconditional_training
|
||
title: Unconditional image generation
|
||
- local: training/text2image
|
||
title: Text-to-image
|
||
- local: training/sdxl
|
||
title: Stable Diffusion XL
|
||
- local: training/kandinsky
|
||
title: Kandinsky 2.2
|
||
- local: training/controlnet
|
||
title: ControlNet
|
||
- local: training/t2i_adapters
|
||
title: T2I-Adapters
|
||
- local: training/instructpix2pix
|
||
title: InstructPix2Pix
|
||
- local: training/cogvideox
|
||
title: CogVideoX
|
||
title: Model recipes
|
||
- isExpanded: false
|
||
sections:
|
||
- local: training/text_inversion
|
||
title: Textual Inversion
|
||
- local: training/dreambooth
|
||
title: DreamBooth
|
||
- local: training/lora
|
||
title: LoRA
|
||
- local: training/custom_diffusion
|
||
title: Custom Diffusion
|
||
- local: training/lcm_distill
|
||
title: Latent Consistency Distillation
|
||
- local: training/ddpo
|
||
title: Reinforcement learning training with DDPO
|
||
title: Training methods
|
||
- local: training/nemo_automodel
|
||
title: NeMo Automodel
|
||
- local: training/jobs
|
||
title: Hugging Face Jobs
|
||
title: Train and fine-tune
|
||
- isExpanded: false
|
||
sections:
|
||
- isExpanded: false
|
||
sections:
|
||
- local: using-diffusers/unconditional_image_generation
|
||
title: Unconditional image generation
|
||
- local: using-diffusers/conditional_image_generation
|
||
title: Text-to-image
|
||
- local: using-diffusers/img2img
|
||
title: Image-to-image
|
||
- local: using-diffusers/inpaint
|
||
title: Inpainting
|
||
- local: advanced_inference/outpaint
|
||
title: Outpainting
|
||
- local: using-diffusers/text-img2vid
|
||
title: Video generation
|
||
- local: using-diffusers/depth2img
|
||
title: Depth-to-image
|
||
title: Recipes
|
||
- isExpanded: false
|
||
sections:
|
||
- local: conceptual/philosophy
|
||
title: Diffusers philosophy
|
||
- local: using-diffusers/write_own_pipeline
|
||
title: Understanding pipelines, models and schedulers
|
||
- local: using-diffusers/controlling_generation
|
||
title: Controlled generation
|
||
title: Concepts and background
|
||
- local: community_projects
|
||
title: Projects built with Diffusers
|
||
title: Resources
|
||
- isExpanded: false
|
||
sections:
|
||
- local: conceptual/contribution
|
||
title: How to contribute
|
||
- local: conceptual/ethical_guidelines
|
||
title: Diffusers' Ethical Guidelines
|
||
title: Contribute
|
||
- isExpanded: false
|
||
sections:
|
||
- sections:
|
||
- local: api/configuration
|
||
title: Configuration
|
||
- local: api/logging
|
||
title: Logging
|
||
- local: api/outputs
|
||
title: Outputs
|
||
- local: api/quantization
|
||
title: Quantization
|
||
- local: hybrid_inference/api_reference
|
||
title: Remote inference
|
||
- local: api/parallel
|
||
title: Parallel inference
|
||
title: Main Classes
|
||
- sections:
|
||
- local: api/modular_diffusers/pipeline
|
||
title: Pipeline
|
||
- local: api/modular_diffusers/pipeline_blocks
|
||
title: Blocks
|
||
- local: api/modular_diffusers/pipeline_states
|
||
title: States
|
||
- local: api/modular_diffusers/pipeline_components
|
||
title: Components and configs
|
||
- local: api/modular_diffusers/guiders
|
||
title: Guiders
|
||
title: Modular
|
||
- sections:
|
||
- local: api/loaders/ip_adapter
|
||
title: IP-Adapter
|
||
- local: api/loaders/lora
|
||
title: LoRA
|
||
- local: api/loaders/single_file
|
||
title: Single files
|
||
- local: api/loaders/textual_inversion
|
||
title: Textual Inversion
|
||
- local: api/loaders/unet
|
||
title: UNet
|
||
- local: api/loaders/transformer_sd3
|
||
title: SD3Transformer2D
|
||
- local: api/loaders/peft
|
||
title: PEFT
|
||
title: Loaders
|
||
- sections:
|
||
- local: api/models/overview
|
||
title: Overview
|
||
- local: api/models/auto_model
|
||
title: AutoModel
|
||
- sections:
|
||
- local: api/models/controlnet
|
||
title: ControlNetModel
|
||
- local: api/models/controlnet_union
|
||
title: ControlNetUnionModel
|
||
- local: api/models/controlnet_flux
|
||
title: FluxControlNetModel
|
||
- local: api/models/controlnet_hunyuandit
|
||
title: HunyuanDiT2DControlNetModel
|
||
- local: api/models/controlnet_sana
|
||
title: SanaControlNetModel
|
||
- local: api/models/controlnet_sd3
|
||
title: SD3ControlNetModel
|
||
- local: api/models/controlnet_sparsectrl
|
||
title: SparseControlNetModel
|
||
title: ControlNets
|
||
- sections:
|
||
- local: api/models/ace_step_transformer
|
||
title: AceStepTransformer1DModel
|
||
- local: api/models/allegro_transformer3d
|
||
title: AllegroTransformer3DModel
|
||
- local: api/models/anyflow_far_transformer3d
|
||
title: AnyFlowFARTransformer3DModel
|
||
- local: api/models/anyflow_transformer3d
|
||
title: AnyFlowTransformer3DModel
|
||
- local: api/models/aura_flow_transformer2d
|
||
title: AuraFlowTransformer2DModel
|
||
- local: api/models/transformer_bria_fibo
|
||
title: BriaFiboTransformer2DModel
|
||
- local: api/models/bria_transformer
|
||
title: BriaTransformer2DModel
|
||
- local: api/models/chroma_transformer
|
||
title: ChromaTransformer2DModel
|
||
- local: api/models/chronoedit_transformer_3d
|
||
title: ChronoEditTransformer3DModel
|
||
- local: api/models/cogvideox_transformer3d
|
||
title: CogVideoXTransformer3DModel
|
||
- local: api/models/cogview3plus_transformer2d
|
||
title: CogView3PlusTransformer2DModel
|
||
- local: api/models/cogview4_transformer2d
|
||
title: CogView4Transformer2DModel
|
||
- local: api/models/consisid_transformer3d
|
||
title: ConsisIDTransformer3DModel
|
||
- local: api/models/cosmos3_omni_transformer
|
||
title: Cosmos3OmniTransformer
|
||
- local: api/models/cosmos_transformer3d
|
||
title: CosmosTransformer3DModel
|
||
- local: api/models/dit_transformer2d
|
||
title: DiTTransformer2DModel
|
||
- local: api/models/easyanimate_transformer3d
|
||
title: EasyAnimateTransformer3DModel
|
||
- local: api/models/ernie_image_transformer2d
|
||
title: ErnieImageTransformer2DModel
|
||
- local: api/models/flux2_transformer
|
||
title: Flux2Transformer2DModel
|
||
- local: api/models/flux_transformer
|
||
title: FluxTransformer2DModel
|
||
- local: api/models/glm_image_transformer2d
|
||
title: GlmImageTransformer2DModel
|
||
- local: api/models/helios_transformer3d
|
||
title: HeliosTransformer3DModel
|
||
- local: api/models/hidream_image_transformer
|
||
title: HiDreamImageTransformer2DModel
|
||
- local: api/models/hunyuan_transformer2d
|
||
title: HunyuanDiT2DModel
|
||
- local: api/models/hunyuanimage_transformer_2d
|
||
title: HunyuanImageTransformer2DModel
|
||
- local: api/models/hunyuan_video15_transformer_3d
|
||
title: HunyuanVideo15Transformer3DModel
|
||
- local: api/models/hunyuan_video_transformer_3d
|
||
title: HunyuanVideoTransformer3DModel
|
||
- local: api/models/ideogram4_transformer2d
|
||
title: Ideogram4Transformer2DModel
|
||
- local: api/models/transformer_joyimage_edit_plus
|
||
title: JoyImageEditPlusTransformer3DModel
|
||
- local: api/models/transformer_joyimage
|
||
title: JoyImageEditTransformer3DModel
|
||
- local: api/models/kandinsky6_transformer
|
||
title: Kandinsky 6 Transformers
|
||
- local: api/models/krea2_transformer2d
|
||
title: Krea2Transformer2DModel
|
||
- local: api/models/latte_transformer3d
|
||
title: LatteTransformer3DModel
|
||
- local: api/models/longcat_image_transformer2d
|
||
title: LongCatImageTransformer2DModel
|
||
- local: api/models/ltx2_video_transformer3d
|
||
title: LTX2VideoTransformer3DModel
|
||
- local: api/models/ltx_video_transformer3d
|
||
title: LTXVideoTransformer3DModel
|
||
- local: api/models/lumina2_transformer2d
|
||
title: Lumina2Transformer2DModel
|
||
- local: api/models/lumina_nextdit2d
|
||
title: LuminaNextDiT2DModel
|
||
- local: api/models/minimax_h3_transformer3d
|
||
title: MiniMaxH3Transformer3DModel
|
||
- local: api/models/minimax_music3_transformer
|
||
title: MiniMaxMusic3Transformer1DModel
|
||
- local: api/models/mochi_transformer3d
|
||
title: MochiTransformer3DModel
|
||
- local: api/models/motif_video_transformer_3d
|
||
title: MotifVideoTransformer3DModel
|
||
- local: api/models/omnigen_transformer
|
||
title: OmniGenTransformer2DModel
|
||
- local: api/models/ovisimage_transformer2d
|
||
title: OvisImageTransformer2DModel
|
||
- local: api/models/pixart_transformer2d
|
||
title: PixArtTransformer2DModel
|
||
- local: api/models/prior_transformer
|
||
title: PriorTransformer
|
||
- local: api/models/qwenimage21_transformer2d
|
||
title: QwenImage21Transformer2DModel
|
||
- local: api/models/qwenimage_transformer2d
|
||
title: QwenImageTransformer2DModel
|
||
- local: api/models/sana_transformer2d
|
||
title: SanaTransformer2DModel
|
||
- local: api/models/sana_video_transformer3d
|
||
title: SanaVideoTransformer3DModel
|
||
- local: api/models/sd3_transformer2d
|
||
title: SD3Transformer2DModel
|
||
- local: api/models/skyreels_v2_transformer_3d
|
||
title: SkyReelsV2Transformer3DModel
|
||
- local: api/models/stable_audio_3_transformer
|
||
title: StableAudio3DiTModel
|
||
- local: api/models/stable_audio_transformer
|
||
title: StableAudioDiTModel
|
||
- local: api/models/transformer2d
|
||
title: Transformer2DModel
|
||
- local: api/models/transformer_temporal
|
||
title: TransformerTemporalModel
|
||
- local: api/models/wan_animate_2_transformer_3d
|
||
title: WanAnimate2Transformer3DModel
|
||
- local: api/models/wan_animate_transformer_3d
|
||
title: WanAnimateTransformer3DModel
|
||
- local: api/models/wan_transformer_3d
|
||
title: WanTransformer3DModel
|
||
- local: api/models/z_image_transformer2d
|
||
title: ZImageTransformer2DModel
|
||
title: Transformers
|
||
- sections:
|
||
- local: api/models/stable_cascade_unet
|
||
title: StableCascadeUNet
|
||
- local: api/models/unet
|
||
title: UNet1DModel
|
||
- local: api/models/unet2d-cond
|
||
title: UNet2DConditionModel
|
||
- local: api/models/unet2d
|
||
title: UNet2DModel
|
||
- local: api/models/unet3d-cond
|
||
title: UNet3DConditionModel
|
||
- local: api/models/unet-motion
|
||
title: UNetMotionModel
|
||
- local: api/models/uvit2d
|
||
title: UViT2DModel
|
||
title: UNets
|
||
- sections:
|
||
- local: api/models/asymmetricautoencoderkl
|
||
title: AsymmetricAutoencoderKL
|
||
- local: api/models/autoencoder_dc
|
||
title: AutoencoderDC
|
||
- local: api/models/autoencoderkl
|
||
title: AutoencoderKL
|
||
- local: api/models/autoencoderkl_allegro
|
||
title: AutoencoderKLAllegro
|
||
- local: api/models/autoencoderkl_cogvideox
|
||
title: AutoencoderKLCogVideoX
|
||
- local: api/models/autoencoderkl_cosmos
|
||
title: AutoencoderKLCosmos
|
||
- local: api/models/autoencoder_kl_hunyuanimage
|
||
title: AutoencoderKLHunyuanImage
|
||
- local: api/models/autoencoder_kl_hunyuanimage_refiner
|
||
title: AutoencoderKLHunyuanImageRefiner
|
||
- local: api/models/autoencoder_kl_hunyuan_video
|
||
title: AutoencoderKLHunyuanVideo
|
||
- local: api/models/autoencoder_kl_hunyuan_video15
|
||
title: AutoencoderKLHunyuanVideo15
|
||
- local: api/models/autoencoder_kl_kvae
|
||
title: AutoencoderKLKVAE
|
||
- local: api/models/autoencoder_kl_kvae_video
|
||
title: AutoencoderKLKVAEVideo
|
||
- local: api/models/autoencoderkl_audio_ltx_2
|
||
title: AutoencoderKLLTX2Audio
|
||
- local: api/models/autoencoderkl_ltx_2
|
||
title: AutoencoderKLLTX2Video
|
||
- local: api/models/autoencoderkl_ltx_video
|
||
title: AutoencoderKLLTXVideo
|
||
- local: api/models/autoencoderkl_magvit
|
||
title: AutoencoderKLMagvit
|
||
- local: api/models/autoencoderkl_minimax_h3
|
||
title: AutoencoderKLMiniMaxH3
|
||
- local: api/models/autoencoderkl_minimax_h3_audio
|
||
title: AutoencoderKLMiniMaxH3Audio
|
||
- local: api/models/autoencoderkl_mochi
|
||
title: AutoencoderKLMochi
|
||
- local: api/models/autoencoderkl_qwenimage
|
||
title: AutoencoderKLQwenImage
|
||
- local: api/models/autoencoderkl_qwenimage21
|
||
title: AutoencoderKLQwenImage21
|
||
- local: api/models/autoencoder_kl_wan
|
||
title: AutoencoderKLWan
|
||
- local: api/models/autoencoder_rae
|
||
title: AutoencoderRAE
|
||
- local: api/models/autoencoder_same
|
||
title: AutoencoderSAME
|
||
- local: api/models/consistency_decoder_vae
|
||
title: ConsistencyDecoderVAE
|
||
- local: api/models/kandinsky6_vae
|
||
title: Kandinsky 6 VAEs
|
||
- local: api/models/ltx2_diffusion_decoder
|
||
title: LTX2VideoDiffusionDecoderModel
|
||
- local: api/models/autoencoder_oobleck
|
||
title: Oobleck AutoEncoder
|
||
- local: api/models/autoencoder_tiny
|
||
title: Tiny AutoEncoder
|
||
- local: api/models/vq
|
||
title: VQModel
|
||
title: VAEs
|
||
title: Models
|
||
- sections:
|
||
- local: api/pipelines/overview
|
||
title: Overview
|
||
- local: api/pipelines/auto_pipeline
|
||
title: AutoPipeline
|
||
- sections:
|
||
- local: api/pipelines/ace_step
|
||
title: ACE-Step
|
||
- local: api/pipelines/audioldm2
|
||
title: AudioLDM 2
|
||
- local: api/pipelines/longcat_audio_dit
|
||
title: LongCat-AudioDiT
|
||
- local: api/pipelines/stable_audio
|
||
title: Stable Audio
|
||
- local: api/pipelines/stable_audio_3
|
||
title: Stable Audio 3
|
||
title: Audio
|
||
- sections:
|
||
- local: api/pipelines/anima
|
||
title: Anima
|
||
- local: api/pipelines/animatediff
|
||
title: AnimateDiff
|
||
- local: api/pipelines/aura_flow
|
||
title: AuraFlow
|
||
- local: api/pipelines/bria_3_2
|
||
title: Bria 3.2
|
||
- local: api/pipelines/bria_fibo
|
||
title: Bria Fibo
|
||
- local: api/pipelines/bria_fibo_edit
|
||
title: Bria Fibo Edit
|
||
- local: api/pipelines/chroma
|
||
title: Chroma
|
||
- local: api/pipelines/cogview3
|
||
title: CogView3
|
||
- local: api/pipelines/cogview4
|
||
title: CogView4
|
||
- local: api/pipelines/consistency_models
|
||
title: Consistency Models
|
||
- local: api/pipelines/controlnet
|
||
title: ControlNet
|
||
- local: api/pipelines/controlnet_flux
|
||
title: ControlNet with Flux.1
|
||
- local: api/pipelines/controlnet_hunyuandit
|
||
title: ControlNet with Hunyuan-DiT
|
||
- local: api/pipelines/controlnet_sd3
|
||
title: ControlNet with Stable Diffusion 3
|
||
- local: api/pipelines/controlnet_sdxl
|
||
title: ControlNet with Stable Diffusion XL
|
||
- local: api/pipelines/controlnet_sana
|
||
title: ControlNet-Sana
|
||
- local: api/pipelines/controlnet_union
|
||
title: ControlNetUnion
|
||
- local: api/pipelines/ddim
|
||
title: DDIM
|
||
- local: api/pipelines/ddpm
|
||
title: DDPM
|
||
- local: api/pipelines/deepfloyd_if
|
||
title: DeepFloyd IF
|
||
- local: api/pipelines/dit
|
||
title: DiT
|
||
- local: api/pipelines/dreamlite
|
||
title: DreamLite
|
||
- local: api/pipelines/easyanimate
|
||
title: EasyAnimate
|
||
- local: api/pipelines/echo
|
||
title: Echo
|
||
- local: api/pipelines/ernie_image
|
||
title: ERNIE-Image
|
||
- local: api/pipelines/flux
|
||
title: Flux
|
||
- local: api/pipelines/flux2
|
||
title: Flux2
|
||
- local: api/pipelines/control_flux_inpaint
|
||
title: FluxControlInpaint
|
||
- local: api/pipelines/glm_image
|
||
title: GLM-Image
|
||
- local: api/pipelines/hidream
|
||
title: HiDream-I1
|
||
- local: api/pipelines/hunyuandit
|
||
title: Hunyuan-DiT
|
||
- local: api/pipelines/hunyuanimage21
|
||
title: HunyuanImage2.1
|
||
- local: api/pipelines/ideogram4
|
||
title: Ideogram 4
|
||
- local: api/pipelines/pix2pix
|
||
title: InstructPix2Pix
|
||
- local: api/pipelines/joyimage_edit
|
||
title: JoyImage Edit
|
||
- local: api/pipelines/joyimage_edit_plus
|
||
title: JoyImage Edit Plus
|
||
- local: api/pipelines/kandinsky
|
||
title: Kandinsky 2.1
|
||
- local: api/pipelines/kandinsky_v22
|
||
title: Kandinsky 2.2
|
||
- local: api/pipelines/kandinsky3
|
||
title: Kandinsky 3
|
||
- local: api/pipelines/kandinsky5_image
|
||
title: Kandinsky 5.0 Image
|
||
- local: api/pipelines/kolors
|
||
title: Kolors
|
||
- local: api/pipelines/krea2
|
||
title: Krea 2
|
||
- local: api/pipelines/latent_consistency_models
|
||
title: Latent Consistency Models
|
||
- local: api/pipelines/latent_diffusion
|
||
title: Latent Diffusion
|
||
- local: api/pipelines/ledits_pp
|
||
title: LEDITS++
|
||
- local: api/pipelines/longcat_image
|
||
title: LongCat-Image
|
||
- local: api/pipelines/lumina2
|
||
title: Lumina 2.0
|
||
- local: api/pipelines/lumina
|
||
title: Lumina-T2X
|
||
- local: api/pipelines/marigold
|
||
title: Marigold
|
||
- local: api/pipelines/nucleusmoe_image
|
||
title: NucleusMoE-Image
|
||
- local: api/pipelines/omnigen
|
||
title: OmniGen
|
||
- local: api/pipelines/ovis_image
|
||
title: Ovis-Image
|
||
- local: api/pipelines/pag
|
||
title: PAG
|
||
- local: api/pipelines/pixart
|
||
title: PixArt-α
|
||
- local: api/pipelines/pixart_sigma
|
||
title: PixArt-Σ
|
||
- local: api/pipelines/prx
|
||
title: PRX
|
||
- local: api/pipelines/prx_pixel
|
||
title: PRX Pixel
|
||
- local: api/pipelines/qwenimage21
|
||
title: Qwen-Image 2.1
|
||
- local: api/pipelines/qwenimage
|
||
title: QwenImage
|
||
- local: api/pipelines/sana
|
||
title: Sana
|
||
- local: api/pipelines/sana_sprint
|
||
title: Sana Sprint
|
||
- local: api/pipelines/sana_video
|
||
title: Sana Video
|
||
- local: api/pipelines/shap_e
|
||
title: Shap-E
|
||
- local: api/pipelines/stable_cascade
|
||
title: Stable Cascade
|
||
- sections:
|
||
- local: api/pipelines/stable_diffusion/overview
|
||
title: Overview
|
||
- local: api/pipelines/stable_diffusion/depth2img
|
||
title: Depth-to-image
|
||
- local: api/pipelines/stable_diffusion/image_variation
|
||
title: Image variation
|
||
- local: api/pipelines/stable_diffusion/img2img
|
||
title: Image-to-image
|
||
- local: api/pipelines/stable_diffusion/inpaint
|
||
title: Inpainting
|
||
- local: api/pipelines/stable_diffusion/latent_upscale
|
||
title: Latent upscaler
|
||
- local: api/pipelines/stable_diffusion/sdxl_turbo
|
||
title: SDXL Turbo
|
||
- local: api/pipelines/stable_diffusion/stable_diffusion_2
|
||
title: Stable Diffusion 2
|
||
- local: api/pipelines/stable_diffusion/stable_diffusion_3
|
||
title: Stable Diffusion 3
|
||
- local: api/pipelines/stable_diffusion/stable_diffusion_xl
|
||
title: Stable Diffusion XL
|
||
- local: api/pipelines/stable_diffusion/upscale
|
||
title: Super-resolution
|
||
- local: api/pipelines/stable_diffusion/adapter
|
||
title: T2I-Adapter
|
||
- local: api/pipelines/stable_diffusion/text2img
|
||
title: Text-to-image
|
||
title: Stable Diffusion
|
||
- local: api/pipelines/stable_unclip
|
||
title: Stable unCLIP
|
||
- local: api/pipelines/value_guided_sampling
|
||
title: Value-guided sampling
|
||
- local: api/pipelines/visualcloze
|
||
title: VisualCloze
|
||
- local: api/pipelines/z_image
|
||
title: Z-Image
|
||
title: Image
|
||
- sections:
|
||
- local: api/pipelines/diffusion_gemma
|
||
title: DiffusionGemma
|
||
- local: api/pipelines/llada2
|
||
title: LLaDA2
|
||
title: Text
|
||
- sections:
|
||
- local: api/pipelines/allegro
|
||
title: Allegro
|
||
- local: api/pipelines/anyflow
|
||
title: AnyFlow
|
||
- local: api/pipelines/chronoedit
|
||
title: ChronoEdit
|
||
- local: api/pipelines/cogvideox
|
||
title: CogVideoX
|
||
- local: api/pipelines/consisid
|
||
title: ConsisID
|
||
- local: api/pipelines/cosmos
|
||
title: Cosmos
|
||
- local: api/pipelines/cosmos3
|
||
title: Cosmos3
|
||
- local: api/pipelines/framepack
|
||
title: Framepack
|
||
- local: api/pipelines/helios
|
||
title: Helios
|
||
- local: api/pipelines/hunyuan_video
|
||
title: HunyuanVideo
|
||
- local: api/pipelines/hunyuan_video15
|
||
title: HunyuanVideo1.5
|
||
- local: api/pipelines/kandinsky5_video
|
||
title: Kandinsky 5.0 Video
|
||
- local: api/pipelines/kandinsky6
|
||
title: Kandinsky 6
|
||
- local: api/pipelines/latte
|
||
title: Latte
|
||
- local: api/pipelines/ltx2
|
||
title: LTX-2
|
||
- local: api/pipelines/ltx_video
|
||
title: LTXVideo
|
||
- local: api/pipelines/minimax_music3
|
||
title: MiniMax Music 3
|
||
- local: api/pipelines/minimax_h3
|
||
title: MiniMax-H3
|
||
- local: api/pipelines/mochi
|
||
title: Mochi
|
||
- local: api/pipelines/motif_video
|
||
title: Motif-Video
|
||
- local: api/pipelines/skyreels_v2
|
||
title: SkyReels-V2
|
||
- local: api/pipelines/stable_diffusion/svd
|
||
title: Stable Video Diffusion
|
||
- local: api/pipelines/wan
|
||
title: Wan
|
||
- local: api/pipelines/wan_animate_2
|
||
title: Wan-Animate-2
|
||
title: Video
|
||
title: Pipelines
|
||
- sections:
|
||
- local: api/schedulers/overview
|
||
title: Overview
|
||
- local: api/schedulers/block_refinement
|
||
title: BlockRefinementScheduler
|
||
- local: api/schedulers/cm_stochastic_iterative
|
||
title: CMStochasticIterativeScheduler
|
||
- local: api/schedulers/ddim_cogvideox
|
||
title: CogVideoXDDIMScheduler
|
||
- local: api/schedulers/multistep_dpm_solver_cogvideox
|
||
title: CogVideoXDPMScheduler
|
||
- local: api/schedulers/consistency_decoder
|
||
title: ConsistencyDecoderScheduler
|
||
- local: api/schedulers/cosine_dpm
|
||
title: CosineDPMSolverMultistepScheduler
|
||
- local: api/schedulers/ddim_inverse
|
||
title: DDIMInverseScheduler
|
||
- local: api/schedulers/ddim
|
||
title: DDIMScheduler
|
||
- local: api/schedulers/ddpm
|
||
title: DDPMScheduler
|
||
- local: api/schedulers/deis
|
||
title: DEISMultistepScheduler
|
||
- local: api/schedulers/discrete_ddim
|
||
title: DiscreteDDIMScheduler
|
||
- local: api/schedulers/multistep_dpm_solver_inverse
|
||
title: DPMSolverMultistepInverse
|
||
- local: api/schedulers/multistep_dpm_solver
|
||
title: DPMSolverMultistepScheduler
|
||
- local: api/schedulers/dpm_sde
|
||
title: DPMSolverSDEScheduler
|
||
- local: api/schedulers/singlestep_dpm_solver
|
||
title: DPMSolverSinglestepScheduler
|
||
- local: api/schedulers/edm_multistep_dpm_solver
|
||
title: EDMDPMSolverMultistepScheduler
|
||
- local: api/schedulers/edm_euler
|
||
title: EDMEulerScheduler
|
||
- local: api/schedulers/entropy_bound
|
||
title: EntropyBoundScheduler
|
||
- local: api/schedulers/euler_ancestral
|
||
title: EulerAncestralDiscreteScheduler
|
||
- local: api/schedulers/euler
|
||
title: EulerDiscreteScheduler
|
||
- local: api/schedulers/flow_map_euler_discrete
|
||
title: FlowMapEulerDiscreteScheduler
|
||
- local: api/schedulers/flow_match_euler_discrete
|
||
title: FlowMatchEulerDiscreteScheduler
|
||
- local: api/schedulers/flow_match_heun_discrete
|
||
title: FlowMatchHeunDiscreteScheduler
|
||
- local: api/schedulers/helios_dmd
|
||
title: HeliosDMDScheduler
|
||
- local: api/schedulers/helios
|
||
title: HeliosScheduler
|
||
- local: api/schedulers/heun
|
||
title: HeunDiscreteScheduler
|
||
- local: api/schedulers/ipndm
|
||
title: IPNDMScheduler
|
||
- local: api/schedulers/dpm_discrete_ancestral
|
||
title: KDPM2AncestralDiscreteScheduler
|
||
- local: api/schedulers/dpm_discrete
|
||
title: KDPM2DiscreteScheduler
|
||
- local: api/schedulers/lcm
|
||
title: LCMScheduler
|
||
- local: api/schedulers/lms_discrete
|
||
title: LMSDiscreteScheduler
|
||
- local: api/schedulers/minimax_h3
|
||
title: MiniMaxH3Scheduler
|
||
- local: api/schedulers/piflow
|
||
title: PiflowScheduler
|
||
- local: api/schedulers/pndm
|
||
title: PNDMScheduler
|
||
- local: api/schedulers/repaint
|
||
title: RePaintScheduler
|
||
- local: api/schedulers/score_sde_ve
|
||
title: ScoreSdeVeScheduler
|
||
- local: api/schedulers/tcd
|
||
title: TCDScheduler
|
||
- local: api/schedulers/unipc
|
||
title: UniPCMultistepScheduler
|
||
- local: api/schedulers/vq_diffusion
|
||
title: VQDiffusionScheduler
|
||
title: Schedulers
|
||
- sections:
|
||
- local: api/internal_classes_overview
|
||
title: Overview
|
||
- local: api/attnprocessor
|
||
title: Attention Processor
|
||
- local: api/activations
|
||
title: Custom activation functions
|
||
- local: api/cache
|
||
title: Caching methods
|
||
- local: api/normalization
|
||
title: Custom normalization layers
|
||
- local: api/utilities
|
||
title: Utilities
|
||
- local: api/image_processor
|
||
title: VAE Image Processor
|
||
- local: api/video_processor
|
||
title: Video Processor
|
||
title: Internal classes
|
||
title: API
|