---
title: "Generate tokens"
method: POST
path: "/generate"
tags: ["LoRAX"]
---

# Generate tokens

`POST /generate`

Generate tokens

## Request body

- GenerateRequest
  - `inputs` string, required
  - `parameters` GenerateParameters
    - `best_of` integer, nullable
    - `decoder_input_details` boolean
    - `details` boolean
    - `do_sample` boolean
    - `max_new_tokens` integer, nullable
    - `ignore_eos_token` boolean
    - `repetition_penalty` number, float, nullable
    - `return_full_text` boolean, nullable
    - `seed` integer, nullable
    - `stop` string[]
    - `temperature` number, float, nullable
    - `top_k` integer, nullable
    - `top_p` number, float, nullable
    - `truncate` integer, nullable
    - `typical_p` number, float, nullable
    - `watermark` boolean
    - `schema` string, nullable
    - `adapter_id` string, nullable
    - `adapter_source` string, nullable
    - `merged_adapters` AdapterParameters
      - `ids` string[]
      - `weights` number[]
      - `merge_strategy` 'linear' | 'ties' | 'dare_linear' | 'dare_ties'
      - `density` number, float
      - `majority_sign_method` 'total' | 'frequency'
    - `api_token` string, nullable
    - `apply_chat_template` boolean

## Response `200`

Generated Text

- GenerateResponse
  - `details` Details
    - `best_of_sequences` BestOfSequence[], nullable
      - `finish_reason` 'length' | 'eos_token' | 'stop_sequence', required
      - `generated_text` string, required
      - `generated_tokens` integer, required
      - `prefill` PrefillToken[], required
        - `id` integer, required
        - `logprob` number, float, nullable, required
        - `text` string, required
      - `seed` integer, nullable
      - `tokens` Token[], required
        - `id` integer, required
        - `logprob` number, float, nullable, required
        - `special` boolean, required
        - `text` string, required
    - `finish_reason` 'length' | 'eos_token' | 'stop_sequence', required
    - `prompt_tokens` integer, required
    - `generated_tokens` integer, required
    - `prefill` PrefillToken[], required
      - `id` integer, required
      - `logprob` number, float, nullable, required
      - `text` string, required
    - `seed` integer, nullable
    - `tokens` Token[], required
      - `id` integer, required
      - `logprob` number, float, nullable, required
      - `special` boolean, required
      - `text` string, required
  - `generated_text` string, required

## Other responses

- `422` — Input validation error
- `424` — Generation Error
- `429` — Model is overloaded
- `500` — Incomplete generation

---

[API](https://skmtc.net/predibase/apis/lorax.md) · [All operations](https://skmtc.net/predibase/apis/lorax/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/predibase/lorax/versions/d56749eaa5c4/schema)