v1

latestOpenAPI 3.0.42026-08-04342835917.6 KB
Benchmark

Returns a page of the requested confidence zone of an A-vs-B matchup — the prompts A clearly wins, the coin flips, or the prompts B clearly wins.

Each vote is weighted by the annotator's reliability; a prompt is placed by the Wilson score interval on A's win share and, within the requested zone, ordered most-confident first (coin flips by effective sample size). The same vote-level filters as the matrix query apply. Benchmarks without granular votes return an empty page.

get/benchmark/{benchmarkId}/matchup-breakdown

Path parameters

benchmarkIdstring required

The id of the benchmark.

Query parameters

participantAstring required

The id of participant A (the reference side of the split).

participantBstring required

The id of participant B.

{"stackTrail":"components:schemas:MatchupZone","oasType":"schema","type":"unknown"}

Which confidence zone of the matchup to page through.

pageinteger

The 1-based page index.

page_sizeinteger

The number of items per page.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by country.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by language.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by gender.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by age_bucket.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by occupation.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by tags.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by participant_id.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by leaderboard_id.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by run_id.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by prompt_identifier.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by voted_at.

logic'and' | 'or'

How to combine the field filters: "and" (default) requires every filter to match, "or" requires any of them to match.

Response

OK

totalinteger required
pageinteger required
pageSizeinteger required
totalPagesinteger