[Performance]: llmcompressor W8A8 Inference: decoding stage speed is lower than FP16

April 1, 2026 · #38697
View on GitHub
Python Difficulty: Medium

Labels

performance

Parent Repository

vllm-project/vllm

Python repository

75,721 15,332
All Issues Back to vllm

Sign in required

Authenticate to use favourites & bookmarks

5