[Feature] Expose Accurate Prefill Throughput Metric and Non-Blocking Load Query API for PD Disaggregation Scheduling
April 10, 2026 · #22494
Python
Difficulty: Medium
Parent Repository
sgl-project/sglang
Python repository
25,689 5,301