--- title: "Retrieve Simulation Results" method: GET path: "/v1/retrieve-simulation-results/{simulation_run_id}" tags: ["Retrieve Simulation Results"] --- # Retrieve Simulation Results `GET /v1/retrieve-simulation-results/{simulation_run_id}` Retrieve the results of a simulation run. Returns the simulation run details and associated test cases. ## Path parameters - `simulation_run_id` string, required ## Headers - `X-API-Key` string, required ## Response `200` Successful Response - SimulationResultsResponse - `simulation_run` SimulationRunResultResponse, required - `id` string, required — ID of the simulation run - `simulation_id` string, required — ID of the simulation associated with the run - `summary` string, nullable — Summary of the simulation run - `status` 'RUNNING' | 'COMPLETED' — Enum representing the possible states of a simulation run. The taxonomy is intentionally minimal: a sim_run is either in-flight (RUNNING) or terminal (COMPLETED). The pass/fail/cancel distinction lives entirely on child test_result counters and statuses, not on sim_run. See livekit_agent/docs/test_result_status_redesign.md §2.2 for the full taxonomy. - `total_tests` integer, nullable — Total number of tests in the simulation run - `tests_passed` integer, nullable — Number of tests that passed in the simulation run - `tests_failed` integer, nullable — Number of tests that failed in the simulation run - `tests_completed` integer, nullable — Number of tests that were completed in the simulation run - `created_at` string, date-time, required — When the simulation run was created - `simulation_results` SimulationResultResponse[], nullable — List of results from the simulation run - `id` integer, required — ID of the simulation result - `digital_human_id` integer, nullable — ID of the digital human associated with the simulation result - `result` object, nullable — Result of the simulation run - `duration` integer, nullable — Duration of the simulation run in milliseconds - `start_time` string, date-time, nullable — Start time of the simulation run - `end_time` string, date-time, nullable — End time of the simulation run - `custom_metrics` union — Custom metrics associated with the simulation result - object - unknown[] - unknown - `status` string, nullable — Current status of the simulation result - `latency` union — Average latency of the simulation run - object - unknown[] - unknown - `events` Event[], nullable — Events of the simulation run - `title` string, required — Title of the event - `start_offset_ms` integer, required — Start offset of the event in milliseconds - `description` string, nullable — Description of the event - `end_offset_ms` integer, nullable — End offset of the event in milliseconds - `tags` string[], nullable — List of tags associated with the event - `metadata` object, nullable — Additional metadata associated with the event - `transcript_url` string, nullable — URL to the transcript file of the simulation run - `audio_url` string, nullable — URL to the audio file of the simulation run - `evaluations` Evaluation[], nullable — Evaluations of the simulation result - `id` string — Unique identifier for the evaluation result - `created_at` string, date-time — When this evaluation result was created (defaults to now in UTC) - `hallucination` boolean, nullable — Whether the agent exhibited hallucination during the call - `hallucination_reasoning` string, nullable — Reasoning behind the hallucination, if applicable - `redundancy` boolean, nullable — Whether the agent exhibited redundancy during the call - `redundancy_reasoning` string, nullable — Reasoning behind the redundancy, if applicable - `agent_speak_percentage` number, nullable, required — Percentage of the call where the agent was speaking - `avg_agent_latency` number, nullable, required — Average latency of the agent's responses during the call - `latency` Latency - `avg_agent_latency` number, nullable — Average latency - `max_agent_latency` number, nullable — Maximum latency - `p50_agent_latency` number, nullable — 50th percentile latency - `p90_agent_latency` number, nullable — 90th percentile latency - `p95_agent_latency` number, nullable — 95th percentile latency - `p99_agent_latency` number, nullable — 99th percentile latency - `filler_ignored_latency` FillerIgnoredLatency - `avg_filler_ignored_latency` number, nullable — Average filler ignored latency - `p50_filler_ignored_latency` number, nullable — 50th percentile filler ignored latency - `p90_filler_ignored_latency` number, nullable — 90th percentile filler ignored latency - `p95_filler_ignored_latency` number, nullable — 95th percentile filler ignored latency - `p99_filler_ignored_latency` number, nullable — 99th percentile filler ignored latency - `num_turns` integer, nullable — Total number of turns taken by the agent during the call - `call_summary` string, nullable — Summary of the call, if applicable - `custom_evals` union — List of custom evaluations performed during the call - unknown[] - unknown - object - `custom_evals_success_rate` number, nullable — Success rate of the custom evaluations performed during the call - `goal_success` boolean, nullable — Whether the goal was successfully achieved during the call - `goal_reasoning` string, nullable — Reasoning behind the goal success, if applicable - `pronunciation_score` number, nullable — Pronunciation score of the agent during the call - `pronunciation_reasoning` string, nullable — Reasoning behind the pronunciation score, if applicable - `sentiment_label` string, nullable — Overall sentiment label for customer utterances - `sentiment_score` number, nullable — Overall sentiment score for customer utterances - `sentiment_scores` object, nullable — Per-label sentiment scores for customer utterances - `custom_metrics` CustomMetric[], nullable — Custom metrics associated with the evaluation - `name` string, required — The name of the custom metric - `description` string, required — The description of the custom metric - `response_type` string, required — The response type of the custom metric - `response_value` string, required — The response value of the custom metric - `reasoning` string, nullable — The reasoning of the custom metric - `min_value` number, nullable — The minimum value of the custom metric - `max_value` number, nullable — The maximum value of the custom metric - `category` string, nullable — The category of the custom metric - `tags` string[], nullable — The tags of the custom metric - `scoring_guidance` string, nullable — The scoring guidance of the custom metric - `enum_options` string[], nullable — The enum options of the custom metric - `human_edited` boolean, nullable — Whether this metric result was manually overridden by a human - `human_response_value` string, nullable — Human-overridden response_value; null when no override applied - `human_reasoning` string, nullable — Human-overridden reasoning; null when no override applied - `override_reason_code` string, nullable — Structured reason for the latest human override. One of: ai_hallucination, overly_strict_success_criteria, overly_strict_system_prompt, other. - `override_notes` string, nullable — Freeform notes from the human reviewer accompanying the latest override - `last_edited_by` string, nullable — User id of the most recent human reviewer - `last_edited_at` string, date-time, nullable — Timestamp of the most recent human override - `human_edited` boolean, nullable — Whether any result in this evaluation was manually overridden by a human - `human_goal_success` boolean, nullable — Human-overridden goal_success; null when no override applied - `human_goal_reasoning` string, nullable — Human-overridden goal_reasoning; null when no override applied - `human_hallucination` boolean, nullable — Human-overridden hallucination verdict; null when no override applied - `human_hallucination_reasoning` string, nullable — Human-overridden hallucination reasoning; null when no override applied - `human_redundancy` boolean, nullable — Human-overridden redundancy verdict; null when no override applied - `human_redundancy_reasoning` string, nullable — Human-overridden redundancy reasoning; null when no override applied - `human_pronunciation_score` number, nullable — Human-overridden pronunciation score; null when no override applied - `human_pronunciation_reasoning` string, nullable — Human-overridden pronunciation reasoning; null when no override applied - `override_goal_reason_code` string, nullable — Reason for the human override of goal_success. - `override_goal_notes` string, nullable — Freeform notes from the reviewer for the goal override. - `override_hallucination_reason_code` string, nullable — Reason for the human override of hallucination. - `override_hallucination_notes` string, nullable — Freeform notes from the reviewer for the hallucination override. - `override_redundancy_reason_code` string, nullable — Reason for the human override of redundancy. - `override_redundancy_notes` string, nullable — Freeform notes from the reviewer for the redundancy override. - `override_pronunciation_reason_code` string, nullable — Reason for the human override of pronunciation_score. - `override_pronunciation_notes` string, nullable — Freeform notes from the reviewer for the pronunciation override. - `last_edited_by` string, nullable — User id of the most recent human reviewer - `last_edited_at` string, date-time, nullable — Timestamp of the most recent human override - `agent_audio_clarity` number, nullable — Agent audio: audio clarity score 0-100 (higher better) - `user_audio_clarity` number, nullable — User audio: audio clarity score 0-100 (higher better) - `tool_calls` ToolCallComparisonGroup[], nullable — Expected vs actual tool calls grouped by tool name - `name` string, required — Tool name - `expected` ExpectedToolCallDetail[] — Expected invocations of this tool - `parameters` object, nullable — Expected parameters - `output` unknown - `actual` ActualToolCallDetail[] — Actual invocations of this tool during the simulation - `parameters` object, nullable — Parameters passed to the tool - `output` unknown - `start_offset_ms` integer, nullable — When the tool was called relative to conversation start, in milliseconds - `trace_ids` string[], nullable — Trace IDs associated with this simulation result - `status` string — Status of the response ## Other responses - `422` — Validation Error --- [API](https://skmtc.net/getbluejay/apis/bluejay-api.md) · [All operations](https://skmtc.net/getbluejay/apis/bluejay-api/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/getbluejay/bluejay-api/revisions/f48cef80963f/schema)