* tests: fix cuda model tests.
* up
* up
* up
* add to docstrings.
* restore previous beehaviour.
---------
Co-authored-by: dg845 <58458699+dg845@users.noreply.github.com>
* add attention backend tests.
* remove existing tests/others/test_attention_backends.py file
* modify generate_model_tests.py
* remove native.
* account for _keep_in_fp32_modules
* don't skip when exception is raised.
* use is_kernels_available()
* mark with compile.
* move rtol and atol to methods as defaults.
* Apply suggestions from code review
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
* up
* up
* add mask support for flash backend
* fix test case
* refactor test
* add protection
* fix comment
* update according to suggestion
* revert change
* fix according to claude review
* add test converage for QwenImage
* add SP support and fix non-contiguous mask for flash_varlen kernel
* revert change
* Update tests/models/testing_utils/parallelism.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
* Update tests/models/testing_utils/parallelism.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
* drop `_padded_to_unpad`
* follow `if _parallel_config is None` pattern
* rename `attn_mask_2d`
* move check to the top
* make comment clear
* move non-contiguous-attention-mask as default dummy data
* revert and update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
* tests: add cp backend and attention backend tests.
* up
* up
* up
* fix ring for flash and flash_3
* generate.
* Apply suggestions from code review
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
* up
* up
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
