v1

latestOpenAPI 3.0.32026-07-2659199427.5 KB

Get predictions

Standalone query rewriter

The standalone query rewriter use case rewrites the text in reference to the context based on the memoryUuid.

post/ai/prediction/standalone-query-rewriter/{MODEL_ID}

Headers

Authorizationstring required

Bearer token used for authentication. Format: Authorization: Bearer ACCESS_TOKEN.

Content-Typestring

Example:application/json

application/json

Request body

Example request

{
  "batch": [
    {
      "text": "Is it a framework?"
    }
  ],
  "useCaseConfig": {
    "memoryUuid": "27a887fe-3d7c-4ef0-9597-e2dfc054c20e"
  },
  "modelConfig": {
    "vectorQuantizationMethod": "min-max",
    "dimReductionSize": 256
  }
}

Response

Example response

{
  "predictions": [
    {
      "response": "Is RAG a framework?",
      "tokensUsed": {
        "promptTokens": 148,
        "completionTokens": 27,
        "totalTokens": 175
      }
    }
  ]
}