Sign in
latestOpenAPI 3.1.02026-08-08127304355.9 KB

69c553220183

Evaluation Criteria

Create Code Evaluation Criteria

Create a new code evaluation criteria with an initial auto-deployed version.

post/api/v2/projects/{project_id}/evaluation-criteria/code

Path parameters

project_idstring required

Request body

namestring required
descriptionstring required
target_type'prompt' | 'agent' required
target_idstring uuid required
eval_codestring required
criteria_type'1-5' | '1-3' | '1-100' | 'yes-no' | 'multi-select' | 'text' | 'auto-categorization' | 'code-bool' | 'code-float' required
sample_ratenumber
generate_insightsboolean
language'python' | 'typescript'

Response

CreateCodeEvalResponse(id: uuid.UUID, name: str, description: Optional[str], target_type: shared.common.TargetType, target_id: uuid.UUID, criteria_type: shared.sqlalchemy.models.AutoEvalCriteriaType, sample_rate: Optional[float], is_enabled: bool, generate_insights: bool, deployed_version: server.api_routes.code_eval_criteria_api_v2.CodeEvalVersionSummary, latest_version: server.api_routes.code_eval_criteria_api_v2.CodeEvalVersionSummary)

idstring uuid required
namestring required
descriptionstring nullable required
target_type'prompt' | 'agent' required
target_idstring uuid required
criteria_type'1-5' | '1-3' | '1-100' | 'yes-no' | 'multi-select' | 'text' | 'auto-categorization' | 'code-bool' | 'code-float' required
sample_ratenumber nullable required
is_enabledboolean required
generate_insightsboolean required