v2
latestOpenAPI 3.1.02026-07-26143251806.6 KBreports
Create Evaluation Pipeline
post/reports
Request body
Example request
{
"columns": [
{
"column_type": "LLM_ASSERTION",
"name": "Accuracy Check",
"configuration": {
"source": "response",
"prompt": "Is this response accurate?"
},
"is_part_of_score": true
}
],
"score_configuration": {
"code": "score = sum(1 for row in data if row.get(\"Accuracy Check\") is True) / len(data) * 100 if data else 0\nreturn {\"score\": score}",
"code_language": "PYTHON"
}
}Response
Evaluation pipeline created.