v1

latestOpenAPI 3.1.0Apache-2.02026-07-226091175.5 KB

Evaluation

Get experiment

Fetch one experiment batch with its run summaries and evaluator results grouped by run id.

get/api/v1/automations/{id}/experiments/{experimentId}

idstring required

Automation id or typed alias.

experimentIdstring required

Experiment batch id.

Experiment detail with runs and results.

idstring required

Experiment batch id. Some CLI commands historically call this a batch id.

automationIdstring required

Automation this experiment belongs to.

automationType'workflow' | 'agent' required

status'queued' | 'running' | 'completed' required

Experiment batch status.

runCountinteger required

Total runs in the experiment.

completedCountinteger required

Runs that have completed.

passedCountinteger required

Runs whose evaluator scores passed.

failedCountinteger required

Runs whose evaluator scores failed.

avgScorenumber nullable required

Average automated evaluator score.

versionstring nullable required

resultsByRunobject required

Evaluator results keyed by run id.