v3

latestOpenAPI 3.1.02026-07-311,4541,5202.3 MB
datasets

Run Eval On Dataset

Create a new dataset evaluation task.

Accepts both evaluator_ids (preferred) and evaluator_slugs (deprecated alias).

Optional: If experiment_id is provided, the experiment's evaluator_slugs will be updated to include the new evaluators, making them appear as columns in the experiment UI.

post/api/datasets/{dataset_id}/eval-reports/create/

Path parameters

dataset_idstring required

Headers

Authorizationstring required

Use your Respan API key for Respan API authentication. Enter only the Respan API key value; clients send Authorization: Bearer <RESPAN_API_KEY>. For /api/responses, provider credentials such as Perplexity, OpenAI, or Azure OpenAI go in Settings -> Providers or respan_params.credential_override in the request body, not in this authentication field.

Request body

dataset_idstring required
evaluator_slugstring required
unique_organization_idstring required
experiment_idstring

Response

dataset_idstring required
evaluator_slugstring required
unique_organization_idstring required
experiment_idstring