OpenAPI 3.1.0raw.githubusercontent.com2026-08-19150216600.1 KB

ece7d99ceaf3

Eval suites

Attach one environment to a suite (atomic append)

APPEND one project environment to the suite's attachments, if it is not already there.

Distinct from PATCH /eval-suites/{suiteId} with environmentIds, which REPLACES the whole list. An append built on the replace door is a read-modify-write across two round trips, and a concurrent attach landing in between is silently DETACHED. The compose-and-run path attaches on every launch, which makes that race ordinary rather than theoretical, so the append happens inside one transaction instead.

Idempotent: attaching an already-attached environment reports attached: false and changes nothing, which is what lets a retried launch converge instead of erroring. Subject to the same cap, membership and schedule-pin rules as the replace door — growing a single-environment suite to two is exactly the edit that strands an enabled unpinned schedule.

post/projects/{projectId}/eval-suites/{suiteId}/environments

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

suiteIdstring required

Eval suite ID, as returned by POST /eval-runs.

Request body

environmentIdstring required

Response

The suite's attachments after the call.

suiteIdstring required
attachedboolean required

false when it was ALREADY attached — a no-op, not a failure, which is what lets a retried compose-and-run converge.

environmentIdsstring[] required

The suite's attachments after the call, in attach order.