---
title: "Api Datasets List"
method: GET
path: "/api/datasets/"
tags: ["datasets"]
---

# Api Datasets List

`GET /api/datasets/`

Create or duplicate datasets

Endpoint:
    POST /api/datasets/     - Create a dataset (from logs, empty, or by duplicating an existing one)

Args (POST):
    - name (string, required)
    - description (string, optional)
    - start_time (string, required, ISO 8601) — ignored if is_empty=true or source_dataset_id set
    - end_time (string, required, ISO 8601) — ignored if is_empty=true or source_dataset_id set
    - sampling (integer, optional, default 100) — percent of logs to add
    - initial_log_filters (object, optional, default {})
    - is_empty (boolean, optional, default false) — create empty dataset without adding logs
    - source_dataset_id (string, optional) — duplicate an existing dataset. Copies all logs
      asynchronously. When set, start_time/end_time/sampling/initial_log_filters are ignored.
      Name defaults to "{source_name} (copy)" if not provided.

Returns (POST 201):
    {
      "id": "dataset_id",
      "name": "...",
      "type": "sampling",
      "status": "initializing",
      ...
    }

Notes:
    - Server sets organization and updated_by; type defaults to "sampling".
    - If selected logs exceed plan limits, returns 400 with error message.
    - Duplication fires `dataset_processing_complete` WS event when done (same as import).

## Query parameters

- `page` integer
- `page_size` integer

## Headers

- `Authorization` string, required

## Response `200`

- PaginatedDatasetListList
  - `count` integer, required
  - `next` string, uri, nullable
  - `previous` string, uri, nullable
  - `total_count` integer
  - `current_filters` FilterParamDictPydantic — Pydantic model for FilterParamDict. A dictionary that maps metric names to their filter parameters. Each key is a metric name (str), and each value can be: - A single MetricFilterParamPydantic (one condition) - A List[MetricFilterParamPydantic] (multiple conditions for same metric) - A FilterBundlePydantic (nested filter bundle with connector) Note: Uses extra="allow" for dynamic metric name fields. The __pydantic_extra__ annotation tells Pydantic what types to expect for extra fields, and generates typed additionalProperties in JSON Schema.
  - `filters_data` PaginatedDatasetListListFiltersData
  - `results` DatasetList[], required
    - `id` string
    - `organization_id` integer, required
    - `updated_by` Editor, required
      - `id` integer, required
      - `email` string, required
      - `name` string, required
      - `username` string
      - `first_name` string
      - `last_name` string
    - `log_count` integer
    - `name` string, required
    - `log_ids` string[]
    - `description` string
    - `type` 'llm' | 'human' | 'dataset' | 'sampling' | 'reference' — * `llm` - Llm * `human` - Human * `dataset` - Dataset * `sampling` - Sampling * `reference` - Reference
    - `status` 'initializing' | 'ready' | 'failed' | 'loading' — * `initializing` - Initializing * `ready` - Ready * `failed` - Failed * `loading` - Loading
    - `created_at` string, date-time, required
    - `updated_at` string, date-time, required
    - `completed_annotation_count` integer, required
    - `running_status` 'draft' | 'pending' | 'paused' | 'running' | 'waiting_for_annotations' | 'completed' | 'failed' — * `draft` - Draft * `pending` - Pending * `paused` - Paused * `running` - Running * `waiting_for_annotations` - Waiting For Annotations * `completed` - Completed * `failed` - Failed
    - `running_progress` number, double
    - `starred` boolean
    - `tags` GenericTagDisplay[], required
      - `id` string, required
      - `name` string, required
      - `color` string, required
      - `created_at` string, date-time, required
      - `updated_at` string, date-time, required
    - `granularity` 'logs' | 'traces' | 'threads', required — * `logs` - Logs * `traces` - Traces * `threads` - Threads

---

[API](https://skmtc.net/keywordsai/apis/api-reference.md) · [All operations](https://skmtc.net/keywordsai/apis/api-reference/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/keywordsai/api-reference/versions/c26d550029f8/schema)