v5

latestOpenAPI 3.1.02026-08-025631,1012.8 MB

Retriever Evaluations

Get evaluation results

Retrieve evaluation results with all calculated metrics

get/v1/retrievers/{retriever_id}/evaluations/{evaluation_id}

retriever_idstring required

evaluation_idstring required

Successful Response

evaluation_idstring required

Unique evaluation identifier

retriever_idstring required

ID of retriever being evaluated

dataset_idstring required

ID of dataset used for evaluation

dataset_namestring required

Name of dataset

status'pending' | 'in_progress' | 'completed' | 'failed' required

Status of an evaluation run.

created_atstring date-time required

When evaluation was created

updated_atstring date-time required

Last update timestamp

completed_atstring date-time nullable

When evaluation completed

namespace_idstring required

Namespace ID

internal_idstring required

Internal organization ID

query_countinteger required

Number of queries evaluated

overall_metricsobject nullable

Aggregated metrics across all queries

metrics_by_kobject nullable

Metrics broken down by K value (keys are string K values like '5', '10', '20')

total_queriesinteger nullable

Total queries in the dataset for this run (= evaluated_queries + skipped_queries).

evaluated_queriesinteger nullable

Number of queries that produced metrics. May be < total_queries when some queries were skipped (skip-and-continue on empty/failing input).

skipped_queriesinteger nullable

Number of queries skipped during evaluation (empty query_input or a per-query execution failure) — these did not fail the whole eval.

error_messagestring nullable

Error message if failed