v1

latestOpenAPI 3.1.02026-07-17114426.0 KB

Chat Completions

OpenAI-compatible chat completions endpoint.

Supports any HuggingFace causal language model.

post/v1/chat/completions

modelstring required

temperaturenumber nullable

top_pnumber nullable

max_tokensinteger nullable

streamboolean nullable

logprobsboolean nullable

top_logprobsinteger nullable

presence_penaltynumber nullable

frequency_penaltynumber nullable

userstring nullable

n_ctxinteger nullable

n_batchinteger nullable

n_gpu_layersinteger nullable

n_threadsinteger nullable

flash_attnboolean nullable

use_mmapboolean nullable

use_mlockboolean nullable

cache_type_kstring nullable

cache_type_vstring nullable

extra_bodyobject nullable

thinkboolean nullable

thinking_budgetinteger nullable

cache_keystring nullable

return_cache_keyboolean nullable

auto_truncateboolean nullable

truncation_strategystring nullable

Successful Response

{"stackTrail":"paths:/v1/chat/completions:post:responses:200:content:application/json:schema","oasType":"schema","type":"unknown"}