v2

OpenAPI 3.0.02026-08-051996591.2 MB

Large Language Models

List LLMs

Lists LLMs that you can use with query and chat endpoints. A query does not specify the LLM directly. Instead, it uses a generation_preset_name. The generation_preset_name in generation parameters corresponds to the name property of the generation presets that /v2/generation_presets lists.

get/v2/llms

Query parameters

filterstring

A regular expression to match names and descriptions of the LLMs.

limitinteger

The maximum number of results to return in the list.

page_keystring

The opaque cursor returned in metadata.page_key of the previous response. Omit it to fetch the first page.

Headers

Request-Timeoutinteger

The platform makes a best effort to complete the request in the specified seconds, or it times out.

Request-Timeout-Millisinteger

The platform makes a best effort to complete the request in the specified milliseconds, or it times out.

Response

List of LLMs.

Example response

{
  "llms": [
    {
      "id": "llm_1021844",
      "name": "Claude 3.7 Sonnet",
      "description": "The Anthropic Claude 3.7 Sonnet model.",
      "ownership": "platform",
      "idle_timeout_seconds": 300,
      "auth": {
        "type": "bearer",
        "token": "abcdef......"
      }
    }
  ],
  "metadata": {
    "page_key": "eyJvZmZzZXQiOjF9"
  }
}