Sanchit Gandhi 7a24977ce3 Add AudioLDM 2 (#4549) ...

* from audioldm

* unet down + mid

* vae, clap, flan-t5

* start sequence audio mae

* iterate on audioldm encoder

* finish encoder

* finish weight conversion

* text pre-processing

* gpt2 pre-processing

* fix projection model

* working

* unet equivalence

* finish in base

* add unet cond

* finish unet

* finish custom unet

* start clean-up

* revert base unet changes

* refactor pre-processing

* tests: from audioldm

* fix some tests

* more fixes

* iterate on tests

* make fix copies

* harden fast tests

* slow integration tests

* finish tests

* update checkpoint

* update copyright

* docs

* remove outdated method

* add docstring

* make style

* remove decode latents

* enable cpu offload

* (text_encoder_1, tokenizer_1) -> (text_encoder, tokenizer)

* more clean up

* more refactor

* build pr docs

* Update docs/source/en/api/pipelines/audioldm2.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* small clean

* tidy conversion

* update for large checkpoint

* generate -> generate_language_model

* full clap model

* shrink clap-audio in tests

* fix large integration test

* fix fast tests

* use generation config

* make style

* update docs

* finish docs

* finish doc

* update tests

* fix last test

* syntax

* finalise tests

* refactor projection model in prep for TTS

* fix fast tests

* style

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

2023-08-21 12:34:21 +01:00

..

__init__.py

Fix conversion script

2022-07-15 17:00:41 +00:00

change_naming_configs_and_checkpoints.py

[Copyright] 2023 (#2524)

2023-03-01 10:31:00 +01:00

conversion_ldm_uncond.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00

convert_asymmetric_vqgan_to_diffusers.py

Asymmetric vqgan (#3956)

2023-07-20 17:51:06 +02:00

convert_consistency_to_diffusers.py

Add Consistency Models Pipeline (#3492)

2023-07-05 19:33:58 +02:00

convert_dance_diffusion_to_diffusers.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00

convert_ddpm_original_checkpoint_to_diffusers.py

Ruff: apply same rules as in transformers (#2827)

2023-03-27 16:18:57 +02:00

convert_diffusers_to_original_stable_diffusion.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00

convert_dit_to_diffusers.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00

convert_if.py

add model (#3230)

2023-04-25 14:20:43 -07:00

convert_k_upscaler_to_diffusers.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00

convert_kakao_brain_unclip_to_diffusers.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00

convert_kandinsky_to_diffusers.py

update conversion script for Kandinsky unet (#3766)

2023-06-14 06:57:53 -10:00

convert_ldm_original_checkpoint_to_diffusers.py

[Copyright] 2023 (#2524)

2023-03-01 10:31:00 +01:00

convert_lora_safetensor_to_diffusers.py

make style

2023-03-06 10:51:03 +00:00

convert_models_diffuser_to_diffusers.py

Ruff: apply same rules as in transformers (#2827)

2023-03-27 16:18:57 +02:00

convert_ms_text_to_video_to_diffusers.py

[MS Text To Video] Add first text to video (#2738)

2023-03-22 18:39:33 +01:00

convert_music_spectrogram_to_diffusers.py

Music Spectrogram diffusion pipeline (#1044)

2023-03-23 14:06:17 +01:00

convert_ncsnpp_original_checkpoint_to_diffusers.py

[Copyright] 2023 (#2524)

2023-03-01 10:31:00 +01:00

convert_original_audioldm2_to_diffusers.py

Add AudioLDM 2 (#4549)

2023-08-21 12:34:21 +01:00

convert_original_audioldm_to_diffusers.py

Remove code snippets containing is_safetensors_available() (#4521)

2023-08-11 11:05:22 +05:30

convert_original_controlnet_to_diffusers.py

fix some typo error (#4546)

2023-08-10 06:49:25 +05:30

convert_original_stable_diffusion_to_diffusers.py

Fixed invalid pipeline_class_name parameter. (#4590)

2023-08-14 17:21:17 +05:30

convert_original_t2i_adapter.py

t2i pipeline (#3932)

2023-07-17 12:55:44 -07:00

convert_shap_e_to_diffusers.py

Shap-E: add support for mesh output (#4062)

2023-07-20 18:05:13 +02:00

convert_stable_diffusion_checkpoint_to_onnx.py

[Copyright] 2023 (#2524)

2023-03-01 10:31:00 +01:00

convert_stable_diffusion_controlnet_to_onnx.py

Convert Stable Diffusion ControlNet to TensorRT (#4465)

2023-08-11 08:12:26 +05:30

convert_stable_diffusion_controlnet_to_tensorrt.py

Convert Stable Diffusion ControlNet to TensorRT (#4465)

2023-08-11 08:12:26 +05:30

convert_tiny_autoencoder_to_diffusers.py

Remove code snippets containing is_safetensors_available() (#4521)

2023-08-11 11:05:22 +05:30

convert_unclip_txt2img_to_image_variation.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00

convert_unidiffuser_to_diffusers.py

[WIP] Add UniDiffuser model and pipeline (#2963)

2023-05-26 17:27:30 +05:30

convert_vae_diff_to_onnx.py

make style

2023-03-06 10:40:18 +00:00

convert_vae_pt_to_diffusers.py

[Conversion] Small fixes (#3848)

2023-06-22 13:52:59 +02:00

convert_versatile_diffusion_to_diffusers.py

Ruff: apply same rules as in transformers (#2827)

2023-03-27 16:18:57 +02:00

convert_vq_diffusion_to_diffusers.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00

convert_zero123_to_diffusers.py

[Pipelines] Add community pipeline for Zero123 (#4295)

2023-08-02 19:36:49 +02:00

generate_logits.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00