---
title: "Deploy Update"
method: PUT
path: "/deploy/{deploy_id}"
tags: ["Dedicated Models"]
---

# Deploy Update

`PUT /deploy/{deploy_id}`

## Path parameters

- `deploy_id` string, required

## Headers

- `xi-api-key` string, nullable
- `x-api-key` string, nullable

## Request body

- DeployLLMUpdateIn
  - `settings` ScaleSettings
    - `min_instances` integer — Minimum number of model instances to run
    - `max_instances` integer — Maximum number of model instances to run
  - `standard_args` StandardArgs — The standard-argument allowlist. Construct from a raw ``dict[str, str]`` via :meth:`from_raw`; render to engine flags via :func:`standard_parts`.
    - `max_context_size` integer, nullable — Maximum total sequence length (prompt + generation).
    - `max_concurrent_requests` integer, nullable — Max number of requests served concurrently.
    - `gpu_memory_fraction` number, nullable — Fraction of GPU memory the engine may use for weights + KV cache.
    - `max_prefill_tokens` integer, nullable — Max tokens processed per prefill/engine step (chunked prefill size).
    - `kv_cache_dtype` 'auto' | 'fp8', nullable — KV cache precision. fp8 ~doubles KV capacity at <1% accuracy loss.
    - `enable_prefix_caching` boolean, nullable — Reuse KV cache for shared prompt prefixes.
    - `quantization` 'fp8' | 'awq' | 'gptq' | 'awq_marlin' | 'gptq_marlin' | 'compressed-tensors' | 'bitsandbytes', nullable — On-the-fly weight quantization method.
  - `extra_args` string[], nullable — Extra engine-specific command-line args (custom-weight deploys only). Replaces the whole list; omitted args are cleared.

## Response `200`

Successful Response

- DeployStatusOut
  - `deploy_id` string, required — Deploy Id

## Other responses

- `400` — Bad Request
- `401` — Unauthorized
- `404` — Not Found
- `409` — Conflict
- `422` — Validation Error

---

[API](https://skmtc.net/deepinfra/apis/deepinfra-api.md) · [All operations](https://skmtc.net/deepinfra/apis/deepinfra-api/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/deepinfra/deepinfra-api/versions/51b817b3f80f/schema)