Add llama.cpp as a CPU-optimized ServingRuntime for LLM inference

April 2, 2026 · #5334
View on GitHub
Go Difficulty: Medium

Parent Repository

kserve/kserve

Go repository

5,285 1,423
All Issues Back to kserve

Sign in required

Authenticate to use favourites & bookmarks

5