[Bug]: NVFP4 MoE produces garbage output on SM120 (RTX 5080) with CPU Weight Offloading — Nemotron-Cascade-2-30B-A3B
April 1, 2026 · #38718
Python
Difficulty: Medium
Parent Repository
vllm-project/vllm
Python repository
75,721 15,332