Sign in

v5

latestOpenAPI 3.1.02026-08-081,0211,3082.1 MB
EVALS

Run Batch Evaluation

Run evaluations for multiple test cases with all selected agents and criteria.

Each test case is evaluated with ALL selected agents available for use. This is the main evaluation endpoint that accepts:

  • List of agents with full configuration (all agents are available for each test case)
  • List of test case IDs (reference to pool)
  • List of criteria with complete data

Returns a job ID and status information.

post/evals/evaluate

Query parameters

navigationSourcestring nullable

Request body

test_case_idsstring[] required
run_namestring nullable
session_idstring nullable

Response

Successful Response

job_idstring required
messagestring required
total_evaluationsinteger required
agents_countinteger required
test_cases_countinteger required
criteria_countinteger required
statusstring