v3

latestOpenAPI 3.1.02026-07-311,4541,5202.3 MB

datasets

Api Datasets Eval Reports Create List

View for creating new dataset evaluation tasks.

Args: dataset_id: str, The ID of the dataset to run evaluation on evaluator_ids: str[], The IDs of the evaluators to run (preferred) evaluator_slugs: str[], Deprecated alias for evaluator_ids (backward compat)

Returns: GET: A list of created tasks POST: The created eval task if successful, otherwise a dictionary of errors

get/api/datasets/{dataset_id}/eval-reports/create/

Path parameters

dataset_idstring required

Query parameters

pageinteger

A page number within the paginated result set.

page_sizeinteger

Number of results to return per page.

Headers

Authorizationstring required

JWT access token or Respan API key

Response

countinteger required

nextstring uri nullable

previousstring uri nullable

total_countinteger

current_filtersFilterParamDictPydantic

Pydantic model for FilterParamDict. A dictionary that maps metric names to their filter parameters.

Each key is a metric name (str), and each value can be:

A single MetricFilterParamPydantic (one condition)
A List[MetricFilterParamPydantic] (multiple conditions for same metric)
A FilterBundlePydantic (nested filter bundle with connector)

Note: Uses extra="allow" for dynamic metric name fields. The pydantic_extra annotation tells Pydantic what types to expect for extra fields, and generates typed additionalProperties in JSON Schema.

filters_dataPaginatedDatasetTaskTrackerRunEvalListListFiltersData