v4

latestOpenAPI 3.1.02026-08-019681,1012.0 MB

data

prompts

rows

Create Llm Scorer Version

post/scorers/{scorer_id}/version/llm

Path parameters

scorer_idstring uuid4 required

Request body

model_namestring nullable

num_judgesinteger nullable

scoreable_node_typesstring[] nullable

cot_enabledboolean nullable

output_type'boolean' | 'categorical' | 'count' | 'discrete' | 'freeform' | 'percentage' | 'multilabel' | 'retrieved_chunk_list_boolean' | 'boolean_multilabel'

Enumeration of output types.

input_type'basic' | 'llm_spans' | 'retriever_spans' | 'sessions_normalized' | 'sessions_trace_io_only' | 'tool_spans' | 'trace_input_only' | 'trace_io_only' | 'trace_normalized' | 'trace_output_only' | 'agent_spans' | 'workflow_spans'

Enumeration of input types.

instructionsstring nullable

user_promptstring nullable

Response

Successful Response

idstring uuid4 required

versioninteger required

scorer_idstring uuid4 required

model_namestring nullable

num_judgesinteger nullable

scoreable_node_typesstring[] nullable

cot_enabledboolean nullable

output_type'boolean' | 'categorical' | 'count' | 'discrete' | 'freeform' | 'percentage' | 'multilabel' | 'retrieved_chunk_list_boolean' | 'boolean_multilabel'

Enumeration of output types.

input_type'basic' | 'llm_spans' | 'retriever_spans' | 'sessions_normalized' | 'sessions_trace_io_only' | 'tool_spans' | 'trace_input_only' | 'trace_io_only' | 'trace_normalized' | 'trace_output_only' | 'agent_spans' | 'workflow_spans'

Enumeration of input types.

created_atstring date-time required

updated_atstring date-time required

allowed_modelboolean nullable

created_bystring uuid4 nullable