* add mask support for flash backend
* fix test case
* refactor test
* add protection
* fix comment
* update according to suggestion
* revert change
* fix according to claude review
* add test converage for QwenImage
* add SP support and fix non-contiguous mask for flash_varlen kernel
* revert change
* Update tests/models/testing_utils/parallelism.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
* Update tests/models/testing_utils/parallelism.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
* drop `_padded_to_unpad`
* follow `if _parallel_config is None` pattern
* rename `attn_mask_2d`
* move check to the top
* make comment clear
* move non-contiguous-attention-mask as default dummy data
* revert and update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
* tests: add cp backend and attention backend tests.
* up
* up
* up
* fix ring for flash and flash_3
* generate.
* Apply suggestions from code review
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
* up
* up
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
* fix mask in SP
* change the modification to qwen specific
* drop xfail since qwen-image mask is fixed
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
* UT expands to batch inputs
* update according to suggestion
* update according to suggestion 2
* fix CI
* update according to suggestion 3
* clean line
