[Bug] FlashInfer + MTP speculative decoding crashes on SM121 (DGX Spark) with GQA=16 model

March 21, 2026 · #37754
View on GitHub
Python Difficulty: Easy

Parent Repository

vllm-project/vllm

Python repository

75,721 15,332
All Issues Back to vllm

Sign in required

Authenticate to use favourites & bookmarks

5