v1

latestOpenAPI 3.0.02026-07-1346146138.4 KB
evaluators

Execute perplexity evaluator

Measure text perplexity from logprobs

Request Body:

  • input.logprobs (string, required): JSON array of log probabilities from the model
post/v2/evaluators/perplexity/execute

Request body

Example request

{
  "input": {
    "logprobs": "[-2.3, -1.5, -0.8, -1.2, -0.5]"
  }
}

Response

OK

perplexity_scorenumber

Example response

{
  "perplexity_score": 12.5
}