Create response
Creates a model response for the given input. Returns a response object or a stream of server-sent events.
Request body
If true, the response runs asynchronously in the background.
Penalize new tokens based on their frequency in the text so far. Between -2.0 and 2.0.
System prompt / instructions for the model.
Integration ID used to resolve provider credentials for this request.
Maximum number of tokens in the response output.
Maximum number of tool call rounds in the agentic loop.
Developer-defined key-value pairs attached to the response (OpenAI spec: Map<string, string>). Non-string values are rejected with a 400.
The model to use in provider/model format (e.g. openai/gpt-4o). Use agent/<key> to invoke a pre-configured agent from the orq.ai platform.
Whether to allow parallel tool calls.
Penalize new tokens based on their presence in the text so far. Between -2.0 and 2.0.
The ID of a previous response to continue from. Requires store to be true (default) on the original response.
Key for prompt caching across requests.
Safety identifier for content filtering.
Processing mode for the request. Fast uses premium low-latency processing; priority remains a backward-compatible alias.
Custom text sequences that cause the model to stop generating. Forwarded to providers that support it (e.g. Anthropic); ignored otherwise.
Whether to persist the response (default: true). When false, the response cannot be retrieved later and previous_response_id will not work for follow-up requests.
If true, returns a stream of server-sent events.
Tags attached to the request trace.
Sampling temperature between 0 and 2.
Template engine for variable substitution in instructions. Defaults to the agent manifest's engine when invoking an agent, otherwise text.
Only sample from the top K options for each subsequent token. Forwarded to providers that support it (e.g. Anthropic); ignored otherwise.
Number of most likely tokens to return at each position.
Nucleus sampling parameter.
Template variables for prompt substitution. Plain values fill {{variable}} placeholders in instructions. For secrets, use {"secret": true, "value": "sensitive-data"} — secrets are automatically passed to platform tools (Python, HTTP, MCP) and redacted from traces.
Response
Returns a response object or a stream of events.
Developer-defined key-value pairs attached to the response (OpenAI spec: Map<string, string>).
Always "response"
Only sample from the top K options for each subsequent token. Present only when set on the request.