Skip to content

flash-attn2: no build variant for torch 2.13 #1082

Description

@qgallouedec

kernels-community/flash-attn2 ships variants for torch 2.7–2.12. With torch 2.13 installed, get_kernel fails:

Cannot find a build variant for this system in kernels-community/flash-attn2
torch212-cxx11-cu126-x86_64-linux: Torch version (2.12) does not match environment Torch version (2.13)

Could torch 2.13 builds be added?

Hit in TRL CI (huggingface/trl#6741), where attn_implementation="kernels-community/flash-attn2" tests are now xfailed.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions