v4

latestOpenAPI 3.0.3PostgreSQL Licenseraw.githubusercontent.com2026-08-01192952.2 KB
LLM Proxy

Streaming chat (SSE) via the LLM proxy

Returns Server-Sent Events conforming to pgedge-go-llm-lib's SSE wire format. See https://github.com/pgEdge/pgedge-go-llm-lib for the full chunk/event schema.

post/api/llm/v1/chat/stream

Request body

max_tokensinteger
modelstring

Override default model

providerstring

Override default provider

stop_sequencesstring[]
system_promptstring
temperaturenumber

Response

SSE stream of chat chunks. Each data line is a JSON-encoded llm.StreamChunk; a terminator 'event: done' or 'event: error' precedes connection close.