v1

latestSwagger 2.02026-07-17184180523.4 KB
monitor

Get runtime metrics for models and channels

Returns runtime rpm/tpm/error metrics sourced from reqlimit and monitor

get/api/monitor/runtime_metrics

Response

OK

messagestring
successboolean