v34

latestOpenAPI 3.1.0Apache-2.0raw.githubusercontent.com2026-08-0332109227.7 KB

inference

`/v1/responses` — OpenAI Responses API (MVP, stateless single-turn).

OpenAI Responses API (MVP). Strict allow-list parser: unknown top-level fields reject with 400 unsupported_field. input is either a string prompt OR an array of {role, content} messages. Known-rejected fields: tools, tool_choice, previous_response_id, reasoning, background, metadata, instructions — each rejects with 400 unsupported_field. stream: true is rejected (Responses SSE is deferred). Multimodal image content parts reject with 400 unsupported_field on the array form.

post/v1/responses

Request body

max_output_tokensinteger nullable

Defaults to 16 (mirroring completions) when absent. Positive integer.

modelstring required

seedinteger nullable

Optional signed 64-bit per-request sampling seed. Reproducibility is best effort, not guaranteed, and depends on the active generation backend and deployment configuration. Non-integer or out-of-range values reject with 400 invalid_request.

streamfalse | null nullable

Accepted only as false (or absent). true rejects with 400 unsupported_field because Responses SSE is not supported yet.

temperaturenumber float nullable

Sampling temperature. Finite number >= 0.

top_pnumber float nullable

Nucleus sampling. Finite number in (0, 1].

Response

Response object