v50

latestOpenAPI 3.0.0raw.githubusercontent.com2024-08-26226284.9 KB

Create Evaluation

Create a new evaluation.

post/sdk/v1/evaluations

Request body

promptIdstring required
variablesPromptVariables required

The template variables added to the prompt when executing the prompt.

weightnumber

How heavily to weigh the evaluation within the prompt.

thresholdnumber

What percentage of assertions must pass for the evaluation to pass.

Response

Successful operation

idstring required
promptIdstring required
variablesPromptVariables required

The template variables added to the prompt when executing the prompt.

weightnumber

How heavily to weigh the evaluation within the prompt.

thresholdnumber

What percentage of assertions must pass for the evaluation to pass.