Sign in

v1

latestOpenAPI 3.1.02026-07-26106201349.6 KB
Gateway

Prepare Model for different precisions

post/v1/accounts/{account_id}/models/{model_id}:prepare

Path parameters

account_idstring required

The Account Id

model_idstring required

The Model Id

Request body

precision'PRECISION_UNSPECIFIED' | 'FP16' | 'FP8' | 'FP8_MM' | 'FP8_AR' | 'FP8_MM_KV_ATTN' | 'FP8_KV' | 'FP8_MM_V2' | 'FP8_V2' | 'FP8_MM_KV_ATTN_V2' | 'NF4' | 'FP4' | 'BF16' | 'FP4_BLOCKSCALED_MM' | 'FP4_MX_MOE'
readMaskstring
acceleratorCountinteger

Number of accelerators (GPUs) to use for quantization. Defaults to 8 if unset.

abortboolean

If true, abort an active prepare job and clear prepare tracking state. No new prepare job is launched in this request.

Response

A successful response.

object required