v36

OpenAPI 3.1.0raw.githubusercontent.com2026-08-0187270483.0 KB

Function Accuracy

Trigger Transformation Evaluations

Queue evaluation jobs for a batch of transformations.

Evaluations run asynchronously and score each transformation's output against the function's schema for confidence, hallucination detection, and relevance. Transformations must belong to events of a supported type: extract, transform, analyze, or join.

Returns immediately with a summary of queued vs. skipped transformations and per-transformation errors. Poll GET /v3/eval/results to retrieve results once evaluations complete.

post/v3/eval

Request body

transformationIDsstring[] required

Transformation IDs to evaluate. Up to 100 per request.

evaluationVersionstring

Optional evaluation version (e.g. 0.1.0-gemini). When omitted the server's default evaluation version is used.

Response

The request has been accepted for processing, but processing has not yet completed.

queuedinteger required

Number of evaluation jobs newly queued.

skippedinteger required

Number of transformations skipped because an evaluation job was already pending or already completed for them.

errorsobject

Map of transformation ID to human-readable error message for any transformations that could not be queued (e.g. not found, unsupported event type).