LoRAX
OpenAI Completions v1 compatible endpoint
OpenAI Completions v1 compatible endpoint
post/v1/completions
Request body
Example request
{
"model": "alignment-handbook/zephyr-7b-dpo-lora",
"prompt": "What is deep learning?",
"temperature": 0.5,
"top_p": 0.95,
"n": 3,
"stop": [
"photographer"
]
}Response
Generated Text