v29

latestOpenAPI 3.1.0raw.githubusercontent.com2026-02-0286184235.0 KB

Inference

Inference Post

OpenAI-compatible APIs.

post/inference/v1{path}

Path parameters

pathstring required

Request body

modelstring required

temperaturenumber nullable

top_pnumber nullable

ninteger nullable

max_completion_tokensinteger nullable

max_tokensinteger nullable

presence_penaltynumber nullable

frequency_penaltynumber nullable

streamboolean nullable

logit_biasobject nullable

userstring nullable

seedinteger nullable

logprobsboolean nullable

top_logprobsinteger nullable

parallel_tool_callsboolean nullable

extra_headersobject nullable

function_callstring nullable

api_versionstring nullable

promptstring nullable

Reference to a Weave Prompt object (e.g., 'weave:///entity/project/object/prompt_name:version'). If provided, the messages from this prompt will be prepended to the messages in this request. Template variables in the prompt messages can be substituted using the template_vars parameter.

template_varsobject nullable

Dictionary of template variables to substitute in prompt messages. Variables in messages like '{variable_name}' will be replaced with the corresponding values. Applied to both prompt messages (if prompt is provided) and regular messages.

Response

Successful Response

{"stackTrail":"paths:/inference/v1{path}:post:responses:200:content:application/json:schema","oasType":"schema","type":"unknown"}