An explicit id for the model, otherwise the API will return a response with an auto-generated conversation model id.
model_namestring required
Name of the LLM model offered by OpenAI, Cloudflare or vLLM
api_keystring
The LLM service's API Key
history_collectionstring required
Typesense collection that stores the historical conversations
account_idstring
LLM service's account ID (only applicable for Cloudflare)
system_promptstring
The system prompt that contains special instructions to the LLM
ttlinteger
Time interval in seconds after which the messages would be deleted. Default: 86400 (24 hours)
max_bytesinteger required
The maximum number of bytes to send to the LLM in every API call. Consult the LLM's documentation on the number of bytes supported in the context window.