Sign in
latestOpenAPI 3.0.02026-08-10525163.8 KB

327b3674db26

/ai/

post/ai/generate-stream

Request body

inputstring required

Input for the text generation model

model'2.7B' | '6B-v4' | 'euterpe-v2' | 'genji-python-6b' | 'genji-jp-6b' | 'genji-jp-6b-v2' | 'krake-v2' | 'hypebot' | 'infillmodel' | 'cassandra' | 'sigurd-2.9b-v1' | 'blue' | 'red' | 'green' | 'purple' | 'clio-v1' | 'kayra-v1' required

Used text generation model

Example request

{
  "input": "Text generation example.",
  "parameters": {
    "logit_bias_exp": [
      {
        "sequence": [
          9288,
          286,
          10690
        ],
        "bias": 4,
        "ensure_sequence_finish": true,
        "generate_once": true
      },
      {
        "sequence": [
          9288,
          286
        ],
        "bias": 2
      }
    ]
  }
}

Response

The request has been accepted and the output is generating (SSE).

ptrnumber

Incrementing token pointer

tokenstring

Generated token

finalboolean

Set to true if the token is final and the generation ended

errorstring

Error from the generation node, if defined. Usually means the end of stream