run
Validate Rule
Validate a rule by executing it with test data without creating a saved rule.
This endpoint allows testing LLM-as-judge evaluators before saving them. It accepts a rule configuration (same as rule creation) and test data, executes the evaluator, and returns the evaluation results in the same format as batch_invoke_evaluator.
Only LLM-as-judge rules (evaluators) are supported. Code evaluators are not allowed.
The evaluator execution traces are written to the database (in the "evaluators" project), which allows users to see the evaluator execution history.
post/api/v1/runs/rules/validate
Request body
Response
Successful Response
object[] required