Sign in

v1

latestOpenAPI 3.1.02026-07-134612587.0 KB
Metrics

Get endpoint vLLM prefix cache hit ratio [READ]

post/v2/endpoint/{namespace}/{name}/metrics/vllm/prefix-cache

Path parameters

namespacestring required

User or organization name

namestring required

Endpoint name

Request body

replicaIdstring nullable

Optionally filter by replica ID

startstring date-time required

RFC 3339 Date Format. Ex: 2021-01-01T00:00:00Z

stopstring date-time required

RFC 3339 Date Format. Ex: 2021-01-01T00:00:00Z

Response

Endpoint metric returned successfully