v3

latestOpenAPI 3.1.02026-07-311,4541,5202.3 MB
evaluations

Dataset Evaluation Tasks Create

Create a new dataset evaluation task.

Accepts both evaluator_ids (preferred) and evaluator_slugs (deprecated alias).

Optional: If experiment_id is provided, the experiment's evaluator_slugs will be updated to include the new evaluators, making them appear as columns in the experiment UI.

post/evaluations/dataset-evaluation-tasks/

Headers

Authorizationstring required

JWT access token or Respan API key

Request body

dataset_idstring required
evaluator_slugstring required
unique_organization_idstring required
experiment_idstring

Response

dataset_idstring required
evaluator_slugstring required
unique_organization_idstring required
experiment_idstring