Sign in

v1

latestOpenAPI 3.0.02026-07-1346146138.4 KB
evaluators

Execute action-advancement evaluator

Measure whether the assistant made progress toward at least one user goal in a conversation

Request Body:

  • input.messages (string, required): JSON array of the conversation messages assembled from the trace
post/v2/evaluators/action-advancement/execute

Request body

Example request

{
  "input": {
    "messages": "[{\"role\":\"user\",\"content\":\"Book me a flight to Paris\"},{\"role\":\"assistant\",\"content\":\"I found 3 flights to Paris. Booking the cheapest one now.\"}]"
  }
}

Response

OK

passboolean
reasonstring

Example response

{
  "pass": true,
  "reason": "The assistant advanced the user's goal by booking the requested flight"
}