---
title: "Get Dataset Evaluations"
method: GET
path: "/felix/datasets/{name}/{version}/evaluations"
tags: ["felix"]
---

# Get Dataset Evaluations

`GET /felix/datasets/{name}/{version}/evaluations`

Get all evaluations for a dataset.

Args:
    name: Dataset name.
    version: Dataset version (use "latest" for most recent).

Returns all of the user's deployed models with their evaluation results
for the specified dataset. Models without evaluations will have null evaluation data.

## Path parameters

- `name` string, required
- `version` string, required

## Response `200`

Successful Response

- DatasetEvaluationsResponse — Response for all evaluations on a dataset
  - `success` boolean, required
  - `dataset_name` string, required
  - `dataset_version` string, required
  - `sample_count` integer, required
  - `models` ModelWithEvaluation[], required
    - `model_id` string, required
    - `model_name` string, required
    - `is_base_model` boolean
    - `evaluation` EvaluationResponse — Response for a single evaluation
      - `id` string, required
      - `user_id` string, required
      - `project_id` string, nullable
      - `model_id` string, required
      - `dataset_name` string, required
      - `dataset_version` string, required
      - `model_name` string, nullable
      - `f1_score` number, nullable
      - `precision_score` number, nullable
      - `recall_score` number, nullable
      - `accuracy` number, nullable
      - `validation_loss` number, nullable
      - `subset_accuracy` number, nullable
      - `hamming_loss` number, nullable
      - `bleu_score` number, nullable
      - `rouge_l_score` number, nullable
      - `total_tokens` integer, nullable
      - `total_cost_usd` number, nullable
      - `total_latency_ms` integer, nullable
      - `max_examples` integer, nullable
      - `max_tokens` integer, nullable
      - `seed` integer, nullable
      - `config` object, nullable
      - `status` string, required
      - `job_reference` string, nullable
      - `error_message` string, nullable
      - `error_count` integer, nullable
      - `error_sample` string, nullable
      - `sample_count` integer, nullable
      - `evaluation_time_ms` integer, nullable
      - `created_at` string, date-time, required
      - `completed_at` string, date-time, nullable
      - `failed_examples` object[], nullable
      - `predictions` object[], nullable
  - `count` integer, required

## Other responses

- `422` — Validation Error

---

[API](https://skmtc.net/pioneer/apis/brain-api.md) · [All operations](https://skmtc.net/pioneer/apis/brain-api/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/pioneer/brain-api/versions/31dfe831e079/schema)