v1
latestOpenAPI 3.0.32026-07-2659199427.5 KBGet predictions
Summarization use case
In the summarization use case, the LLM ingests text and returns a summary of the text as a response.
The context length is 2048 tokens. No options can be configured.
post/ai/prediction/summarization/{MODEL_ID}
Headers
Authorizationstring required
Bearer token used for authentication. Format: Authorization: Bearer ACCESS_TOKEN.
Content-Typestring
Example:application/json
application/json
Request body
Example request
{
"batch": [
{
"text": "Nearly ten years had passed since the Dursleys had woken up to find their nephew on the front step, but Privet Drive had hardly changed at all. The sun rose on the same tidy front gardens and lit up the brass number four on the Dursleys''' front door; it crept into their living room, which was almost exactly the same as it had been on the night when Mr. Dursley had seen that fateful news report about the owls. Only the photographs on the mantelpiece really showed how much time had passed. Ten years ago, there had been lots of pictures of what looked like a large pink beach ball wearing different-colored bonnets - but Dudley Dursley was no longer a baby, and now the photographs showed a large blond boy riding his first bicycle, on a carousel at the fair, playing a computer game with his father, being hugged and kissed by his mother. The room held no sign at all that another boy lived in the house, too."
}
],
"useCaseConfig": {
"maxWords": 100
},
"modelConfig": {
"vectorQuantizationMethod": "min-max",
"dimReductionSize": 256
}
}Response
OK
Example response
{
"predictions": [
{
"tokensUsed": {
"promptTokens": 148,
"completionTokens": 27,
"totalTokens": 175
},
"response": "A decade after the Dursleys found their nephew on their doorstep, Privet Drive remains largely unchanged. The only noticeable difference is in the family photographs, which now depict Dudley Dursley as a large blond boy engaged in various activities, replacing his baby pictures. There is no indication of another boy living in the house."
}
]
}