Create a conversation model
Create a Conversation Model
Request body
An explicit id for the model, otherwise the API will return a response with an auto-generated conversation model id.
Name of the LLM model offered by OpenAI, Cloudflare or vLLM
The LLM service's API Key
Typesense collection that stores the historical conversations
LLM service's account ID (only applicable for Cloudflare)
The system prompt that contains special instructions to the LLM
Time interval in seconds after which the messages would be deleted. Default: 86400 (24 hours)
The maximum number of bytes to send to the LLM in every API call. Consult the LLM's documentation on the number of bytes supported in the context window.
URL of vLLM service
Response
Created Conversation Model
An explicit id for the model, otherwise the API will return a response with an auto-generated conversation model id.
Name of the LLM model offered by OpenAI, Cloudflare or vLLM
The LLM service's API Key
Typesense collection that stores the historical conversations
LLM service's account ID (only applicable for Cloudflare)
The system prompt that contains special instructions to the LLM
Time interval in seconds after which the messages would be deleted. Default: 86400 (24 hours)
The maximum number of bytes to send to the LLM in every API call. Consult the LLM's documentation on the number of bytes supported in the context window.
URL of vLLM service