v1

latestOpenAPI 3.1.0Apache 2.02026-07-264001921002.3 KB

LiteLLM Integration

Chat with model (LiteLLM - Cohere format)

Sends a chat request using Cohere-compatible format via LiteLLM.

post/litellm/cohere/v2/chat

modelstring required

Model to use for chat completion

tool_choice'AUTO' | 'NONE' | 'REQUIRED'

Tool choice mode - AUTO lets the model decide, NONE disables tools, REQUIRED forces tool use

temperaturenumber

pnumber

Top-p sampling

kinteger

Top-k sampling

max_tokensinteger

stop_sequencesstring[]

frequency_penaltynumber

presence_penaltynumber

streamboolean

safety_mode'CONTEXTUAL' | 'STRICT' | 'NONE'

log_probsboolean

strict_tool_choiceboolean

{
  "model": "command-r-plus"
}

Successful response

idstring