[Bug]: GPTQ INT4 quantized Qwen3-vl-30b-a3b can not deploy by vllm with tensor-parallel-size=2
April 8, 2026 · #2582
Python
Difficulty: Medium
Labels
bug
Parent Repository
vllm-project/llm-compressor
Python repository
2,996 474