v2

latestOpenAPI 3.1.02026-07-26143251806.6 KB
reports

Create Evaluation Pipeline

post/reports

Request body

dataset_group_idinteger required

ID of the dataset group to use.

namestring nullable

Name for the pipeline. Auto-generated if omitted.

folder_idinteger nullable

Folder ID for organization.

dataset_version_numberinteger nullable

Specific dataset version. Uses latest published version if omitted.

Example request

{
  "columns": [
    {
      "column_type": "LLM_ASSERTION",
      "name": "Accuracy Check",
      "configuration": {
        "source": "response",
        "prompt": "Is this response accurate?"
      },
      "is_part_of_score": true
    }
  ],
  "score_configuration": {
    "code": "score = sum(1 for row in data if row.get(\"Accuracy Check\") is True) / len(data) * 100 if data else 0\nreturn {\"score\": score}",
    "code_language": "PYTHON"
  }
}

Response

Evaluation pipeline created.

successtrue required
report_idinteger required

ID of the created evaluation pipeline.