Sign in

v3

latestOpenAPI 3.1.02026-07-311,4541,5202.3 MB
evaluations

Api Evaluators Create 2

POST handler with superadmin-only field protection.

Strips superadmin-only fields from non-superadmin requests before delegating to OrganizationInjectionMixin.post() for org injection.

post/api/evaluators/{evaluator_id}/

Path parameters

evaluator_idstring required

Headers

Authorizationstring required

JWT access token or Respan API key

Request body

version_idstring
configurationsobject
categorical_choicesobject[]
score_configobject
passing_conditionsobject nullable
llm_configobject nullable
code_configobject nullable
projectstring nullable
eval_classstring
idstring
versioninteger
is_read_onlyboolean
version_descriptionstring
evaluator_slugstring
namestring required
unique_organization_idstring nullable
descriptionstring
type'llm' | 'code' | 'human' | 'function' | 'human_numerical' | 'human_categorical' | 'human_boolean' | 'human_text' | 'custom'
  • llm - Llm
  • code - Code
  • human - Human
  • function - Function
  • human_numerical - Human Numerical
  • human_categorical - Human Categorical
  • human_boolean - Human Boolean
  • human_text - Human Text
  • custom - Custom
score_value_type'numerical' | 'boolean' | 'percentage' | 'single_select' | 'multi_select' | 'text' | 'json' | 'comment' | 'categorical'
  • numerical - Numerical
  • boolean - Boolean
  • percentage - Percentage
  • single_select - Single Select
  • multi_select - Multi Select
  • text - Text
  • json - Json
  • comment - Comment
  • categorical - Categorical
custom_required_fieldsstring[]
starredboolean
organizationinteger nullable

Response

version_idstring
configurationsobject
categorical_choicesobject[]
score_configobject
passing_conditionsobject nullable
llm_configobject nullable
code_configobject nullable
projectstring nullable
is_publicboolean required
eval_classstring
idstring
versioninteger
is_read_onlyboolean
version_descriptionstring
evaluator_slugstring
namestring required
descriptionstring
created_atstring date-time required
updated_atstring date-time required
type'llm' | 'code' | 'human' | 'function' | 'human_numerical' | 'human_categorical' | 'human_boolean' | 'human_text' | 'custom'
  • llm - Llm
  • code - Code
  • human - Human
  • function - Function
  • human_numerical - Human Numerical
  • human_categorical - Human Categorical
  • human_boolean - Human Boolean
  • human_text - Human Text
  • custom - Custom
score_value_type'numerical' | 'boolean' | 'percentage' | 'single_select' | 'multi_select' | 'text' | 'json' | 'comment' | 'categorical'
  • numerical - Numerical
  • boolean - Boolean
  • percentage - Percentage
  • single_select - Single Select
  • multi_select - Multi Select
  • text - Text
  • json - Json
  • comment - Comment
  • categorical - Categorical
custom_required_fieldsstring[]
starredboolean