Sign in

v1

latestOpenAPI 3.1.02026-07-22152755.8 KB
test_framework

Retrieve a test result

success indicates whether the run passed its quality evaluation. A run with success=false either failed to connect (check error_message) or failed an evaluation check (check evaluation). success_rate is the percentage of runs with success=true.

The runs field is a dict keyed by run ID string (e.g. {"86368": {...}, "86367": {...}}), not an array — unlike the list endpoint. Each run also has a call_id STRING field (the provider's call identifier) — that is a data field, NOT an endpoint ID; do not pass it where run_id is expected.

get/test_framework/v2/results/{id}/

Path parameters

idinteger required

A unique integer value identifying this result.

Response

idinteger
namestring

Name of the result Example: "Test Result 1"

agentinteger
agent_namestring

Name of the agent associated with this result

agent_versionstring

The agent version (history record) this result ran against, or null.

status'running' | 'completed' | 'failed' | 'pending' | 'in_progress' | 'evaluating' | 'in_queue' | 'timeout' | 'cancelled' | 'scaling_up'

Current status of the result

  • running - Running
  • completed - Completed
  • failed - Failed
  • pending - Pending
  • in_progress - In Progress
  • evaluating - Evaluating
  • in_queue - In Queue
  • timeout - Timeout
  • cancelled - Cancelled
  • scaling_up - Scaling Up
met_expected_outcome_countstring

Number of runs that fully met their expected outcomes with a score of 100

total_expected_outcome_countstring

Total number of runs that had expected outcomes defined

success_ratenumber double

Success rate of the test runs

run_as_textboolean

Whether this test was run in text mode instead of voice mode Example: true or false

is_cronjobstring

Whether this result was created by a scheduled cronjob

runsobject

Run objects keyed by run ID string (e.g. {"12345": {...}}). The list endpoint returns runs as an array of summaries instead.

{"stackTrail":"components:schemas:ResultDetailV2:properties:overall_evaluation:oneOf","oasType":"schema","type":"unknown","description":"\nOverall evaluation of the test runs\nExample:\n","nullable":true}