latestOpenAPI 3.1.02026-08-15156216302.6 KB

1ff37a4f6190

Tokenizer

Tokenize

post/v1/tokenize

xi-api-keystring nullable

x-api-keystring nullable

modelstring required

model name

promptstring nullable

text to tokenize (completion form)

messagesobject[] nullable

chat messages to tokenize (chat form)

return_token_strsboolean nullable

also return the per-token strings (vLLM)

{
  "model": "my-org/my-dedicated-llm"
}

Successful Response

countinteger required

number of tokens

max_model_leninteger required

the model's maximum context length

tokensinteger[] required

token ids

token_strsstring[] nullable

per-token strings, if requested (vLLM)