d779de93a5ee

latestOpenAPI 3.0.42026-08-13351856967.1 KB
Benchmark

Queries the per-image ratings of a benchmark — a page of prompts, each with its ranked images and the pairwise win matrix over them, in the same pandas-split shape as the standings matrix.

Filters apply to the underlying votes and use the same field set as the standings query. Ordering (extremeness by default) selects which prompts a page fits; a rating is an image's standing against all images on its prompt, so a participant filter narrows the rows but does not refit. Matrix axes are the image labels — a participant's name, suffixed -{n} when it has several images on the prompt. A prompt with no matching votes yields no rows.

get/benchmark/{benchmarkId}/images/query

Path parameters

benchmarkIdstring required

The id of the benchmark.

Query parameters

useWeightedScoringboolean

Whether to weight ratings by annotator reliability.

pageinteger

The 1-based page index.

page_sizeinteger

The number of items per page.

sortstring[]

Sort fields. Prefix with - for descending order (e.g. -created_at).

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by country.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by language.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by gender.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by age_bucket.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by occupation.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by tags.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by participant_id.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by leaderboard_id.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by run_id.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by prompt_identifier.

eqstring
neqstring
gtstring
gtestring
ltstring
ltestring
containsstring
starts_withstring
ends_withstring
instring[]
not_containsstring

Filter by voted_at.

logic'and' | 'or'

How to combine the field filters: "and" (default) requires every filter to match, "or" requires any of them to match.

Response

OK

totalResponsesinteger required

Total raw human responses behind the corpus under the current filter.

distinctMatchupsinteger required

Distinct compared image pairs in the corpus under the current filter.

totalPromptsinteger required

The number of prompts the filter leaves rankable — the paging total.

pageinteger required

The 1-based page index.

pageSizeinteger required

The page size in prompts.