latestOpenAPI 3.1.02026-08-08127304355.9 KB

69c553220183

Evaluation Criteria

Create Evaluation Criteria

Create a new evaluation criteria in a project. Use to set up criteria for evaluating LLM outputs in test runs or online evaluations.

post/api/v2/projects/{project_id}/evaluation-criteria

Path parameters

project_idstring required

Request body

namestring required
target_type'prompt' | 'agent' required
target_idstring uuid required
type'1-5' | '1-3' | '1-100' | 'yes-no' | 'multi-select' | 'text' | 'auto-categorization' | 'code-bool' | 'code-float' required
llm_eval_enabledboolean required
idstring uuid nullable

Response

CreateEvaluationCriteriaResponse(id: uuid.UUID)

idstring uuid required