v1

latestOpenAPI 3.0.3Apache 2.02026-07-1782738.8 KB
LoRAX

OpenAI Chat Completions v1 compatible endpoint

OpenAI Chat Completions v1 compatible endpoint

post/v1/chat/completions

Request body

modelstring
temperaturenumber float nullable
top_pnumber float nullable
ninteger nullable
max_tokensinteger
stopstring[]
streamboolean
adapter_sourcestring nullable
api_tokenstring nullable

Example request

{
  "model": "alignment-handbook/zephyr-7b-dpo-lora",
  "messages": [
    {
      "role": "user",
      "content": "What is deep learning?"
    }
  ],
  "temperature": 0.5,
  "top_p": 0.95,
  "n": 3,
  "stop": [
    "photographer"
  ]
}

Response

Generated Text

idstring
objectstring
createdinteger
modelstring