---
title: "Create Evaluation"
method: POST
path: "/v1/evaluations/"
tags: ["Diamond", "evaluations"]
---

# Create Evaluation

`POST /v1/evaluations/`

Create a new evaluation job.

Creates a Kubernetes Job to run the evaluation and tracks it in memory.
Fetches agent configuration from Agent Registry using the provided agent_id.
JWT token is retrieved from request context (set by JWTAuthMiddleware).

Args:
    request: Evaluation configuration with agent_id and team_id
    claims: JWT claims with user and team info
    diamond_domain: Diamond domain orchestrator

Returns:
    Evaluation ID, status, and status URL

## Request body

- CreateEvaluationRequest — Request model for creating a new evaluation.
  - `agent_id` string, uuid, required — UUID of the agent from Agent Registry
  - `team_id` string, uuid, required — UUID of the team that owns this evaluation (required)
  - `type` string — Type of evaluation to run. Currently only 'behavioral' is supported.
  - `harness_names` string[], required — List of harnesses to run (e.g., ['safety', 'ethics', 'privacy', 'security', 'toxicity'])
  - `harness_type` 'standard' | 'custom' — Type of harness.
  - `sample_size` integer, nullable — Number of prompts to randomly sample per harness. If omitted, all prompts run (~1250 for security). Recommended: 10 for fast iteration, 50 for moderate, 100 for thorough.
  - `evaluation_id` string, uuid, nullable — Optional UUID for the evaluation. If provided, this UUID will be used when creating the evaluation in Diamond. If not provided, Diamond will generate one.

## Response `202`

Successful Response

- CreateEvaluationResponse — Response model for evaluation creation.
  - `evaluation_id` string, uuid, required
  - `status` string, required

## Other responses

- `422` — Validation Error

---

[API](https://skmtc.net/vijilai/apis/vijil-console-api-combined.md) · [All operations](https://skmtc.net/vijilai/apis/vijil-console-api-combined/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/vijilai/vijil-console-api-combined/versions/a8b2ee2b2d06/schema)