Sign in

v1

latestOpenAPI 3.1.02026-07-26157321426.3 KB

Gets the metrics for a model deployment

Gets the metrics for a model deployment in the given time range.

get/v1/models/{model_id}/deployments/{deployment_id}/metrics

Query parameters

mode'CURRENT' | 'SUMMARY' | 'SERIES'

How metric values are aggregated over the request.

'CURRENT': a single instantaneous snapshot at now; start/end must be omitted. 'SUMMARY': a single value set aggregating the whole window. 'SERIES': evenly-spaced value sets across the window, with the step derived from the window duration.

start_epoch_millisinteger nullable

Epoch millis timestamp to start fetching metrics. Defaults to one hour before the end.

end_epoch_millisinteger nullable

Epoch millis timestamp to end fetching metrics. Defaults to the current time. The window between start and end must not exceed 7 days.

metricsstring[]

Names of the metrics to return; see https://docs.baseten.co/observability/export-metrics/supported-metrics for the available names. When omitted, a default set is returned: baseten_replicas_active, baseten_inference_requests_total, and baseten_end_to_end_response_time_seconds. Unknown names are rejected; valid names that do not apply are omitted from the response.

Response

start_epoch_millisinteger required

Start of the returned window.

end_epoch_millisinteger required

End of the returned window.

mode'CURRENT' | 'SUMMARY' | 'SERIES' required

How metric values are aggregated over the request.

step_secondsinteger nullable required

Seconds per step; populated only in SERIES mode, null otherwise.