b8c36aef7731

latestOpenAPI 3.1.0raw.githubusercontent.com2026-08-108296301.0 KB
Eval runs

Create an eval case

Adds one case to the suite. Both title and a non-empty steps array are required — steps is optional on the shared case shape so PATCH can be partial, but a case persisted without executable steps could never run. When models is omitted the suite's configured model is used.

post/projects/{projectId}/eval-suites/{suiteId}/cases

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

suiteIdstring required

Eval suite ID, as returned by POST /eval-runs.

Request body

titlestring required
expectedOutputstring
iterationsinteger
isNegativeboolean
scenariostring
matchOptionsobject nullable

null clears the case override and inherits the suite's.

Response

The created case.

idstring required
titlestring required
expectedOutputstring
iterationsinteger required
isNegativeboolean required

When true, the case passes if NO tools are called.

scenariostring
matchOptionsobject nullable
createdAtnumber nullable
updatedAtnumber nullable