v1

latestOpenAPI 3.1.0Apache 2.02026-07-1714117164.2 KB
batched_prompts

Batch Chat Completion

Predict on a batch of prompts

post/batch/chat/completions

Request body

modelstring required
adaptorstring nullable
api_keystring nullable
temperaturenumber
max_tokensinteger
top_pnumber
batch_sizeinteger
inference_urlstring

Response

Successful Response

{"stackTrail":"paths:/batch/chat/completions:post:responses:200:content:application/json:schema","oasType":"schema","type":"unknown"}