---
title: "Resolve or create a file-owned eval suite"
method: POST
path: "/projects/{projectId}/eval-suites/from-file"
tags: ["Eval runs"]
---

# Resolve or create a file-owned eval suite

`POST /projects/{projectId}/eval-suites/from-file`

Resolve a file-owned suite by declared id within the project, or create one. Lookup is by `(projectId, declaredSuiteId)` and never by name. A UI-authored suite has no declared id and cannot be claimed. The inspector parses the suite file; this body is the declared identity, source hash, optional provenance, and hosted settings — not the raw file.

`201` on first create; `200` on a later update of the same declared id.

## Path parameters

- `projectId` string, required

## Request body

- EvalSuiteFromFileRequest — Declared identity and hosted settings for a file-owned suite. The inspector parses the suite file; this is not the raw file.
  - `declaredSuiteId` string, required — The file's `suite.id`. Lookup is by this id within the project, never by name.
  - `name` string, required
  - `description` string
  - `sourceHash` string, required — SHA-256 hex of the suite-file bytes. Lowercase, 64 characters.
  - `provenance` object
    - `sourceHash` string, required
    - `sourceFormat` string, required
    - `sourceFormatVersion` string
    - `converter` string
    - `converterVersion` string
    - `model` string
    - `discoverySnapshotHash` string
    - `reportHash` string, required
    - `importedAt` string
  - `environment` object
    - `servers` string[]
    - `serverBindings` object[]
      - `serverName` string, required
      - `projectServerId` string
  - `defaultConfig` object
    - `modelId` string, required
    - `systemPrompt` string, required
    - `temperature` number, required
  - `minIterations` integer
  - `defaultPassCriteria` object
    - `minimumPassRate` number

## Response `200`

The existing file-owned suite was updated.

- EvalSuiteFromFileSynced
  - `created` boolean, required — True on the first upload of this declared id in the project; false on a later update of the same suite.
  - `suite` EvalSuiteDetail, required — One eval suite's full configuration. Distinct from the `EvalSuite` summary returned by the list route, which carries run rollups instead of settings.
    - `id` string, required
    - `declaredId` string — The suite's declared file identity (`suite.id` in a suite file). Present on file-owned suites; absent on UI-authored suites, which have no declared id and cannot be claimed by `eval run --file`.
    - `name` string, nullable
    - `description` string, nullable
    - `projectId` string, nullable
    - `environment` object, required — LEGACY server bag, kept as rollback data, plus the suite's sandbox-image pin. Unrelated to `environmentIds`.
      - `servers` string[]
      - `computerEnvironment` EvalSuiteComputerEnvironment — The sandbox image a suite's eval runs boot from.
        - `id` string, required
        - `name` string, nullable, required — The image's name, resolved for you so a caller can echo back what it set. `null` when the pinned image could not be resolved (deleted, or not visible to this caller).
    - `executionConfig` object, nullable
      - `model` string
      - `systemPrompt` string
      - `temperature` number
    - `hosts` object[], required
      - `id` string, required
      - `name` string, required
      - `servers` string[]
    - `environmentIds` string[] — Attached project environments, in attach order.
    - `settings` object, required
      - `minimumAccuracy` number, nullable — Minimum pass rate for the suite to count as passing.
      - `minimumIterations` number, nullable — Suite-level floor on per-case iterations, 1–10: every case runs at least this many times (`max(case.iterations, minimumIterations)`). `null` means no floor — the suite's real state, not a stand-in for 1. PATCH `null` to remove it.
      - `matchOptions` object, nullable
      - `checks` object[]
      - `judge` object — Goal-completion judge (LLM as Judge), FULLY RESOLVED: every field is the platform default where the suite set none, so this is what a run on this suite would actually grade with.
        - `enabled` boolean — Judge is available on the suite. On its own this grades nothing.
        - `model` string, nullable — Resolved judge model. `null` only from deployments that predate resolution.
        - `autoRun` boolean — The flag that makes grading HAPPEN: grade every run as it completes. Spends per run.
        - `threshold` number — Advisory pass threshold, 0–1 (`passed = score >= threshold`).
    - `schedule` EvalSuiteSchedule, required — Recurring-run schedule. A schedule fires exactly ONE run, so an environment-based suite pins the environment it runs against.
      - `enabled` boolean, required
      - `intervalMinutes` integer, nullable — Minutes between runs. 5 minutes to 7 days.
      - `environmentId` string, nullable — The single attached environment scheduled runs use. Null on a legacy (non-environment) suite.
    - `createdAt` number, nullable — Epoch milliseconds.
    - `updatedAt` number, nullable

## Other responses

- `201` — A new file-owned suite was created.
- `400` — Malformed body or parameters.
- `401` — Missing, invalid, revoked, or orphaned key (`UNAUTHORIZED`) — or the **target MCP server** needs an OAuth grant (`OAUTH_REQUIRED`), which is a property of the server, not your key.
- `403` — Key is valid but not allowed to do this.
- `404` — Unknown project, server, or resource.
- `409` — The resource is not in a state that accepts this write — a stale `expectedRevision`, a duplicate name, or an environment that cannot currently be launched. The request was well-formed; re-read the resource and retry.
- `429` — Per-key rate limit exceeded (60 requests/minute sustained, bursts up to 10). Honor `Retry-After` and back off with jitter.
- `500` — Something failed on MCPJam's side.
- `502` — Could not connect to the target MCP server.

---

[API](https://skmtc.net/mcpjam/apis/mcpjam-api.md) · [All operations](https://skmtc.net/mcpjam/apis/mcpjam-api/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/mcpjam/mcpjam-api/revisions/9a3b3893f016/schema)