Sign in

v51

latestOpenAPI 3.0.0raw.githubusercontent.com2026-08-01979563.0 MB
Eval

Create Eval

post/eval

Request body

namestring

This is the name of the eval. It helps identify what the eval is checking for.

descriptionstring

This is the description of the eval. This helps describe the eval and its purpose in detail. It will not be used to evaluate the flow of the conversation.

type'chat.mockConversation' required

This is the type of the eval. Currently it is fixed to chat.mockConversation.

Example request

{
  "messages": [
    {
      "content": "The weather in San Francisco is sunny.",
      "toolCalls": [
        {
          "name": "get_weather"
        }
      ]
    }
  ],
  "name": "Verified User Flow Eval",
  "description": "This eval checks if the user flow is verified.",
  "type": "chat.mockConversation"
}

Response

idstring required
orgIdstring required
createdAtstring date-time required
updatedAtstring date-time required
namestring

This is the name of the eval. It helps identify what the eval is checking for.

descriptionstring

This is the description of the eval. This helps describe the eval and its purpose in detail. It will not be used to evaluate the flow of the conversation.

type'chat.mockConversation' required

This is the type of the eval. Currently it is fixed to chat.mockConversation.

Example response

{
  "messages": [
    {
      "content": "The weather in San Francisco is sunny.",
      "toolCalls": [
        {
          "name": "get_weather"
        }
      ]
    }
  ],
  "name": "Verified User Flow Eval",
  "description": "This eval checks if the user flow is verified.",
  "type": "chat.mockConversation"
}