Sign in

v1

latestOpenAPI 3.1.02026-07-1766222595.7 KB

Create Completion Sync Task

Runs a sync prompt completion on an LLM.

post/v1/llm/completions-sync

Query parameters

model_endpoint_namestring required

Request body

promptstring required
max_new_tokensinteger required
temperaturenumber required
stop_sequencesstring[] nullable
return_token_log_probsboolean nullable
presence_penaltynumber nullable
frequency_penaltynumber nullable
top_kinteger nullable
top_pnumber nullable
include_stop_str_in_outputboolean nullable
guided_jsonobject nullable
guided_regexstring nullable
guided_choicestring[] nullable
guided_grammarstring nullable
skip_special_tokensboolean nullable

Response

Successful Response

request_idstring nullable