Sign in

v1

latestOpenAPI 3.0.02026-07-1346146138.4 KB
evaluators

Execute agent-goal-completeness evaluator

Measure if agent accomplished all user goals

Request Body:

  • input.trajectory_prompts (string, required): JSON array of prompts in the agent trajectory
  • input.trajectory_completions (string, required): JSON array of completions in the agent trajectory
  • config.threshold (number, required): Score threshold for pass/fail determination (0.0-1.0)
post/v2/evaluators/agent-goal-completeness/execute

Request body

Example request

{
  "config": {
    "threshold": 0.5
  },
  "input": {
    "trajectory_completions": "[\"Account created\", \"Preferences saved\", \"Notifications enabled\"]",
    "trajectory_prompts": "[\"Create new account\", \"Set preferences\", \"Enable notifications\"]"
  }
}

Response

OK

reasonstring
scorenumber
successboolean

Example response

{
  "reason": "All user goals were accomplished",
  "score": 0.95,
  "success": true
}