v4

latestOpenAPI 3.0.3PostgreSQL Licenseraw.githubusercontent.com2026-08-01192952.2 KB
LLM Proxy

Send a chat request to an LLM

Proxies a chat completion request to the specified LLM provider and model. Supports tool definitions for function calling.

post/api/llm/v1/chat

Request body

max_tokensinteger
modelstring

Override default model

providerstring

Override default provider

stop_sequencesstring[]
system_promptstring
temperaturenumber

Response

LLM chat completion response.

stop_reason'end_turn' | 'max_tokens' | 'stop_sequence' | 'tool_use' | 'content_filter' | 'error' required