Metrics

Get system and model inference metrics

Returns a unified snapshot of live system resource metrics (CPU, memory) and per-model moving averages for all pipeline stages (last 100 requests).

get/v1/metrics

Response

Success

modelsobject required

Map of model ID to its moving-average inference metrics. Empty object if no requests have been processed yet.