v3

OpenAPI 3.1.0MIT2026-07-31192456807.8 KB

evaluation

Create an evaluation job

post/evaluation

Request body

type'classify' | 'score' | 'compare' required

The type of evaluation to perform

Example request

{
  "type": "classify",
  "parameters": {
    "judge": {
      "model": "Qwen/Qwen3.5-9B",
      "system_template": "Imagine you are a helpful assistant",
      "num_workers": 5,
      "max_tokens": 8192
    },
    "labels": [
      "yes",
      "no"
    ],
    "pass_labels": [
      "yes"
    ],
    "model_to_evaluate": {
      "model": "Qwen/Qwen3.5-9B",
      "max_tokens": 512,
      "temperature": 0.7,
      "system_template": "You are a helpful assistant.",
      "input_template": "Please answer the following question: {{ question }}",
      "num_workers": 5
    },
    "input_data_file_path": "file-1234-aefd"
  }
}

Response

Evaluation job created successfully

workflow_idstring

The ID of the created evaluation job

status'pending'

Initial status of the job

Example response

{
  "workflow_id": "eval-1234-1244513"
}