OpenAPI 3.1.02026-08-155691,1162.8 MB

40af5e67ba94

Retriever Evaluations

Score predictions vs ground truth (stateless)

Compute quality metrics (Precision@K, Recall@K, F1@K, F2@K) for precomputed predictions vs ground truth, with NO retriever, namespace, or persistence. Each item's predicted and ground_truth are treated as SETS. Send a single pair (predicted + ground_truth) or an items batch. Returns per-item scores and the macro-average across items. Auth only (no X-Namespace). This is the stateless counterpart to the retriever-scoped evaluation runs — use it to dogfood F1/F2 on extraction/generation benchmarks.

post/v1/evaluations/score

Request body

predictedstring[] nullable

Single-pair form: predicted terms/ids. Pair with ground_truth.

ground_truthstring[] nullable

Single-pair form: ground-truth terms/ids. Pair with predicted.

metricsstring[]

Metrics to compute. Allowed: precision, recall, f1, f2.

kinteger nullable

Cutoff: score only the first k predicted items. Default: all.

Response

Successful Response

metricsstring[] required

Metrics computed, in request order.

kinteger nullable

Cutoff applied, if any.

countinteger required

Number of items scored.

per_itemobject[] required

Each item's {metric: value} in [0.0, 1.0].

aggregateobject required

Macro-average (mean over items) of each metric.