Kashif Rasul cf4227cd1e T5Attention support for cross-attention (#2654) ...

* fix AttnProcessor2_0

Fix use of AttnProcessor2_0 for cross attention with mask

* added scale_qk and out_bias flags

* fixed for xformers

* check if it has scale argument

* Update cross_attention.py

* check torch version

* fix sliced attn

* style

* set scale

* fix test

* fixed addedKV processor

* revert back AttnProcessor2_0

* if missing if

* fix inner_dim

---------

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

2023-03-15 18:04:05 +01:00

..

__init__.py

[Tests] Improve unet / vae tests (#1018)

2022-10-28 13:43:26 +02:00

test_models_unet_1d.py

[Copyright] 2023 (#2524)

2023-03-01 10:31:00 +01:00

test_models_unet_2d_condition.py

T5Attention support for cross-attention (#2654)

2023-03-15 18:04:05 +01:00

test_models_unet_2d_flax.py

Replace flake8 with ruff and update black (#2279)

2023-02-07 23:46:23 +01:00

test_models_unet_2d.py

[Copyright] 2023 (#2524)

2023-03-01 10:31:00 +01:00

test_models_vae_flax.py

[Tests] Improve unet / vae tests (#1018)

2022-10-28 13:43:26 +02:00

test_models_vae.py

[Copyright] 2023 (#2524)

2023-03-01 10:31:00 +01:00

test_models_vq.py

[Copyright] 2023 (#2524)

2023-03-01 10:31:00 +01:00