v36

OpenAPI 3.1.0raw.githubusercontent.com2026-08-0187270483.0 KB

Webhooks

Evaluation event

Delivered when a function-accuracy evaluation completes for a transformation. The evaluator's scores and per-field judgments are in result; check status for terminal success/failure.

For signing-secret setup and retry semantics that apply to every variant, see the Webhooks overview.

postWebhookevaluation

Payload

functionCallTryNumberinteger

The attempt number of the function call that created this event. 1 indexed.

eventIDstring required

Unique ID generated by bem to identify the event.

createdAtstring date-time

Timestamp indicating when the event was created.

referenceIDstring required

The unique ID you use internally to refer to this data point, propagated from the original function input.

eventType'evaluation'

functionCallIDstring

Unique identifier of function call that this event is associated with.

functionIDstring required

Unique identifier of function that this event is associated with.

functionNamestring required

Unique name of function that this event is associated with.

functionVersionNuminteger

Version number of function that this event is associated with.

callIDstring

Unique identifier of workflow call that this event is associated with.

workflowIDstring

Unique identifier of workflow that this event is associated with.

workflowNamestring

Name of workflow that this event is associated with.

workflowVersionNuminteger

Version number of workflow that this event is associated with.

transformIdstring required

Unique ID of the transformation that was evaluated.

evaluationVersionstring required

Version identifier of the evaluation logic that produced this result.

resultobject required

Evaluator output. Shape depends on evaluationVersion and includes confidence scores, per-field hallucination flags, and relevance metrics.

status'success' | 'failed' required

Terminal status of the evaluation run.

errorMessagestring

Failure reason populated when status is failed.

Response

Return any 2XX status code to acknowledge receipt. The exact code is not inspected.