v1

latestOpenAPI 3.1.02026-07-13897404.3 KB
Serverless

update endpoint

Updates the specified endpoint group with the provided parameters.

CLI Usage: vastai update endpoint <id> [options]

put/api/v0/endptjobs/{id}/

Path parameters

idinteger required
Example:4242

ID of the endpoint group to update

Request body

min_loadnumber

Minimum floor load in perf units/s (token/s for LLMs)

target_utilnumber

Target capacity utilization (fraction, max 1.0)

cold_multnumber

Cold/stopped instance capacity target as multiple of hot capacity target

cold_workersinteger

Min number of workers to keep 'cold' when you have no load

max_workersinteger

Max number of workers your endpoint group can have

endpoint_namestring

Deployment endpoint name

Example request

{
  "target_util": 0.9,
  "cold_mult": 2.5,
  "cold_workers": 5,
  "max_workers": 20,
  "endpoint_name": "my_endpoint"
}

Response

Success response

successboolean

Example response

{
  "success": true
}