---
title: "Eval Sets Create"
method: POST
path: "/evaluations/eval-sets/{id}/"
tags: ["evaluations"]
---

# Eval Sets Create

`POST /evaluations/eval-sets/{id}/`

POST handler with superadmin-only field protection.

Strips superadmin-only fields from non-superadmin requests before
delegating to OrganizationInjectionMixin.post() for org injection.

## Path parameters

- `id` string, required

## Headers

- `Authorization` string, required

## Request body

- DatasetDetailRequest
  - `initial_log_filters` FilterParamDictPydantic — Pydantic model for FilterParamDict. A dictionary that maps metric names to their filter parameters. Each key is a metric name (str), and each value can be: - A single MetricFilterParamPydantic (one condition) - A List[MetricFilterParamPydantic] (multiple conditions for same metric) - A FilterBundlePydantic (nested filter bundle with connector) Note: Uses extra="allow" for dynamic metric name fields. The __pydantic_extra__ annotation tells Pydantic what types to expect for extra fields, and generates typed additionalProperties in JSON Schema.
  - `project` string, nullable
  - `name` string, required
  - `type` 'llm' | 'human' | 'dataset' | 'sampling' | 'reference' — * `llm` - Llm * `human` - Human * `dataset` - Dataset * `sampling` - Sampling * `reference` - Reference
  - `description` string
  - `running_progress` number, double
  - `running_status` 'draft' | 'pending' | 'paused' | 'running' | 'waiting_for_annotations' | 'completed' | 'failed' — * `draft` - Draft * `pending` - Pending * `paused` - Paused * `running` - Running * `waiting_for_annotations` - Waiting For Annotations * `completed` - Completed * `failed` - Failed
  - `running_at` string, date-time, nullable
  - `unique_organization_ids` string[]
  - `timestamps` string[]
  - `ingest_workflow_id` string, nullable
  - `starred` boolean
  - `organization` integer, required
  - `evaluator` string, nullable

## Response `200`

- DatasetDetail
  - `id` string, required
  - `completed_annotation_count` integer, required
  - `updated_by` Editor, required
    - `id` integer, required
    - `email` string, required
    - `name` string, required
    - `username` string
    - `first_name` string
    - `last_name` string
  - `initial_log_filters` FilterParamDictPydantic — Pydantic model for FilterParamDict. A dictionary that maps metric names to their filter parameters. Each key is a metric name (str), and each value can be: - A single MetricFilterParamPydantic (one condition) - A List[MetricFilterParamPydantic] (multiple conditions for same metric) - A FilterBundlePydantic (nested filter bundle with connector) Note: Uses extra="allow" for dynamic metric name fields. The __pydantic_extra__ annotation tells Pydantic what types to expect for extra fields, and generates typed additionalProperties in JSON Schema.
  - `tags` GenericTagDisplay[], required
    - `id` string, required
    - `name` string, required
    - `color` string, required
    - `created_at` string, date-time, required
    - `updated_at` string, date-time, required
  - `project` string, nullable
  - `name` string, required
  - `type` 'llm' | 'human' | 'dataset' | 'sampling' | 'reference' — * `llm` - Llm * `human` - Human * `dataset` - Dataset * `sampling` - Sampling * `reference` - Reference
  - `granularity` 'logs' | 'traces' | 'threads', required — * `logs` - Logs * `traces` - Traces * `threads` - Threads
  - `description` string
  - `created_at` string, date-time, required
  - `running_progress` number, double
  - `running_status` 'draft' | 'pending' | 'paused' | 'running' | 'waiting_for_annotations' | 'completed' | 'failed' — * `draft` - Draft * `pending` - Pending * `paused` - Paused * `running` - Running * `waiting_for_annotations` - Waiting For Annotations * `completed` - Completed * `failed` - Failed
  - `running_at` string, date-time, nullable
  - `updated_at` string, date-time, required
  - `unique_organization_ids` string[]
  - `timestamps` string[]
  - `log_count` integer, required
  - `ingest_workflow_id` string, nullable
  - `status` 'initializing' | 'ready' | 'failed' | 'loading', required — * `initializing` - Initializing * `ready` - Ready * `failed` - Failed * `loading` - Loading
  - `starred` boolean
  - `organization` integer, required
  - `evaluator` string, nullable

---

[API](https://skmtc.net/keywordsai/apis/api-reference.md) · [All operations](https://skmtc.net/keywordsai/apis/api-reference/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/keywordsai/api-reference/versions/c26d550029f8/schema)