v1

latestOpenAPI 3.1.0raw.githubusercontent.com2026-06-304917042.1 MB

evals

Create an evaluator

post/v1/evaluators

namestring required

descriptionstring nullable

ownerstring nullable

status'active' | 'inactive' | 'archived'

configobject

promptstring nullable

thresholdnumber nullable

severity'info' | 'low' | 'medium' | 'high' | 'critical'

judge_model_overridestring nullable

kind'model_judge' | 'deterministic'

format'boolean' | 'enum' | 'numeric' | 'score'

tagsstring[]

Successful Response

idstring uuid required

organization_idstring uuid required

namestring required

kindstring required

formatstring required

descriptionstring nullable required

ownerstring nullable required

statusstring required

configobject

promptstring nullable required

thresholdnumber nullable required

severitystring required

judge_model_overridestring nullable required

tagsstring[]

created_bystring uuid nullable

created_atstring date-time required

updated_atstring date-time required