---
title: "LLM"
method: POST
path: "/api/generate/llm"
tags: ["generate"]
---

# LLM

`POST /api/generate/llm`

Generate text using a language model.

## Request body

- LLMRequest
  - `messages` LLMMessage[], required
    - `role` string, required
    - `content` string, required
  - `model` string
  - `temperature` number
  - `max_tokens` integer
  - `top_p` number
  - `top_k` integer
  - `stream` boolean

## Response `200`

Successful Response

- LLMResponse
  - `id` string, required
  - `model` string, required
  - `created` integer, required
  - `usage` LLMTokenUsage, required
    - `prompt_tokens` integer, required
    - `completion_tokens` integer, required
    - `total_tokens` integer, required
  - `choices` LLMChoice[], required
    - `index` integer, required
    - `finish_reason` string
    - `delta` LLMMessage
      - `role` string, required
      - `content` string, required
    - `message` LLMMessage
      - `role` string, required
      - `content` string, required

## Other responses

- `400` — Bad Request
- `401` — Unauthorized
- `422` — Validation Error
- `500` — Internal Server Error
- `default` — Error

---

[API](https://skmtc.net/livepeer/apis/untitled-api.md) · [All operations](https://skmtc.net/livepeer/apis/untitled-api/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/livepeer/untitled-api/versions/dfc937fc0d2c/schema)