Aryan 3f329a426a [core] Mochi T2V (#9769) ...

* update

* udpate

* update transformer

* make style

* fix

* add conversion script

* update

* fix

* update

* fix

* update

* fixes

* make style

* update

* update

* update

* init

* update

* update

* add

* up

* up

* up

* update

* mochi transformer

* remove original implementation

* make style

* update inits

* update conversion script

* docs

* Update src/diffusers/pipelines/mochi/pipeline_mochi.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* Update src/diffusers/pipelines/mochi/pipeline_mochi.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* fix docs

* pipeline fixes

* make style

* invert sigmas in scheduler; fix pipeline

* fix pipeline num_frames

* flip proj and gate in swiglu

* make style

* fix

* make style

* fix tests

* latent mean and std fix

* update

* cherry-pick 1069d210e1

* remove additional sigma already handled by flow match scheduler

* fix

* remove hardcoded value

* replace conv1x1 with linear

* Update src/diffusers/pipelines/mochi/pipeline_mochi.py

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>

* framewise decoding and conv_cache

* make style

* Apply suggestions from code review

* mochi vae encoder changes

* rebase correctly

* Update scripts/convert_mochi_to_diffusers.py

* fix tests

* fixes

* make style

* update

* make style

* update

* add framewise and tiled encoding

* make style

* make original vae implementation behaviour the default; note: framewise encoding does not work

* remove framewise encoding implementation due to presence of attn layers

* fight test 1

* fight test 2

---------

Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
Co-authored-by: yiyixuxu <yixu310@gmail.com>

2024-11-05 20:33:41 +05:30

..

autoencoders

[Tests] clean up and refactor gradient checkpointing tests (#9494)

2024-10-31 18:24:19 +05:30

transformers

[core] Mochi T2V (#9769)

2024-11-05 20:33:41 +05:30

unets

[Tests] clean up and refactor gradient checkpointing tests (#9494)

2024-10-31 18:24:19 +05:30

__init__.py

[Tests] Improve unet / vae tests (#1018)

2022-10-28 13:43:26 +02:00

test_activations.py

move activation dispatches into helper function (#3656)

2023-06-05 12:30:48 -07:00

test_attention_processor.py

adding back test_conversion_when_using_device_map (#7704)

2024-04-18 19:21:32 -10:00

test_layers_utils.py

Support bfloat16 for Upsample2D (#9480)

2024-10-01 16:08:12 -10:00

test_modeling_common_flax.py

[Tests] parallelize (#3078)

2023-04-13 13:32:57 +01:00

test_modeling_common.py

[Tests] clean up and refactor gradient checkpointing tests (#9494)

2024-10-31 18:24:19 +05:30