v20

latestOpenAPI 3.1.0raw.githubusercontent.com2026-08-035471202.8 KB
Eval runs

Create an eval run (async)

Creates a suite run from an existing suiteId (rerun) and/or inline tests, then detaches execution and responds 202 immediately with the runId. Validation and quota errors surface on this request; poll GET /eval-runs/{runId} for progress. The run appears live in the hosted UI Runs tab, tagged source: "api".

A bare suiteId with no inline tests reruns the suite as configured. Per-organization concurrency is capped (default 2 concurrent runs); exceeding it returns 429 with details.reason: "CONCURRENT_RUN_LIMIT".

post/projects/{projectId}/eval-runs

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

Request body

OR
OR

Response

Run created; execution continues in the background.

runIdstring required
suiteIdstring required
status'running' required