v1

latestOpenAPI 3.0.02026-07-141,4077,1665.2 MB

LLM Observability

Update annotation queue label schema

Create or replace the label schema for a given annotation queue. The label schema defines the labels annotators can apply to interactions in the queue. Label names must be unique within the queue and match the pattern ^[a-zA-Z0-9_-]+$. Each label must have a valid type: score, categorical, boolean, or text.

put/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema

Path parameters

queue_idstring required

The ID of the LLM Observability annotation queue.

Request body

Example request

{
  "data": {
    "attributes": {
      "annotation_schema": {
        "label_schemas": [
          {
            "description": "Rating of the response quality.",
            "id": "abc-123",
            "is_required": true,
            "max": 5,
            "name": "quality",
            "type": "score",
            "values": [
              "good",
              "bad",
              "neutral"
            ]
          }
        ]
      }
    },
    "type": "queues"
  }
}

Response

Example response

{
  "data": {
    "attributes": {
      "annotation_schema": {
        "label_schemas": [
          {
            "description": "Rating of the response quality.",
            "id": "abc-123",
            "is_required": true,
            "max": 5,
            "name": "quality",
            "type": "score",
            "values": [
              "good",
              "bad",
              "neutral"
            ]
          }
        ]
      }
    },
    "id": "00000000-0000-0000-0000-000000000001",
    "type": "queues"
  }
}