latestOpenAPI 3.1.02026-08-204612588.9 KB
a3f7357cc8ac
Metrics
Get endpoint vLLM KV cache usage [READ]
post/v2/endpoint/{namespace}/{name}/metrics/vllm/kv-cache
Path parameters
namespacestring required
User or organization name
namestring required
Endpoint name
Request body
Response
Endpoint metric returned successfully