LoRAX
OpenAI Chat Completions v1 compatible endpoint
OpenAI Chat Completions v1 compatible endpoint
post/v1/chat/completions
Request body
Example request
{
"model": "alignment-handbook/zephyr-7b-dpo-lora",
"messages": [
{
"role": "user",
"content": "What is deep learning?"
}
],
"temperature": 0.5,
"top_p": 0.95,
"n": 3,
"stop": [
"photographer"
]
}Response
Generated Text