v1

latestOpenAPI 3.0.32026-07-237020.2 KB
async.chat

Queue a new asynchronous chat completion task for background processing and later retrieval.

post/async/chat/create

Request body

model'Llama-3.1 8B' | 'Llama-3.3 70B' required
reasoning_effort'low' | 'medium' | 'high'
metadataobject
frequency_penaltynumber
max_completion_tokensnumber
n1
modalitiesstring[]
presence_penaltynumber
seednumber
service_tier'auto' | 'default'
stopstring[]
streamboolean
temperaturenumber
top_pnumber
parallel_tool_callsboolean

Response

Returns a unique ID for the asynchronous chat task, used to retrieve the generated result once processing is complete.

idstring required