v1

latestOpenAPI 3.1.02026-07-26151126273.9 KB
collections

Start Batch Run

Start a batch evaluation run on all files in the collection.

post/api/v1/eval_batch_runs

Cookies

wos-sessionstring
datalab_active_teamstring

Request body

collection_idinteger required

ID of the collection to run against

eval_rubric_idinteger nullable

ID of the eval rubric to use. Required for standard pipelines, optional for custom pipelines (falls back to pipeline's eval_definition).

pipeline_type'convert' | 'extract' | 'segment'

One of: convert, extract, segment

pipeline_idstring nullable

Optional custom pipeline ID

page_schemastring nullable

Required when pipeline_type=extract

segmentation_schemastring nullable

Required when pipeline_type=segment

output_formatstring nullable

Comma-separated output formats (e.g. 'markdown,json,html')

run_evalsboolean

Set false to process the collection through a pipeline WITHOUT scoring (e.g. S3 output writeback) — no rubric is required and none runs. Requires pipeline_id; incompatible with eval_rubric_id.

Response

Successful Response

idinteger required
collection_idinteger required
eval_rubric_idinteger nullable required
pipeline_idstring nullable required
pipeline_typestring required
statusstring required
started_atstring date-time nullable required
completed_atstring date-time nullable required
total_filesinteger required
completed_filesinteger required
avg_scorenumber nullable required
createdstring date-time nullable required
eval_rubric_versioninteger nullable
eval_definition_snapshotobject nullable
pipeline_versioninteger nullable