v1

latestOpenAPI 3.1.02026-08-06213193627.0 KB

models

Get Rank Of Best Models For Payload

post/v1/models/rank

Request body

modelstring nullable

https://docs.pulze.ai/overview/models Specify the model you'd like Pulze to use. (optional). Can be the full model name, or a subset for multi-matching.

Defaults to our dynamic routing, i.e. best model for this request.

max_tokensinteger nullable

The maximum number of tokens that the response can contain.

temperaturenumber nullable

Optionally specify the temperature for this request only. Leave empty to allow Pulze to guess it for you.

top_pnumber nullable

https://octo.ai/docs/text-gen-solution/rest-api#input-parameters A value between 0.0 and 1.0 that controls the probability of the model generating a particular token.

ninteger nullable

How many completions to generate for each prompt. @default 1

streamboolean nullable

Specify if you want the response to be streamed or to be returned as a standard HTTP request. Currently we only support streaming for OpenAI-compatible models.

logprobsinteger nullable

COMING SOON https://platform.openai.com/docs/api-reference/completions/create#completions/create-logprobs Include the log probabilities on the logprobs most likely tokens, as well the chosen tokens.

presence_penaltynumber nullable

https://platform.openai.com/docs/api-reference/completions/create#completions/create-presence_penalty Increase the model's likelihood to talk about new topics

frequency_penaltynumber nullable

https://platform.openai.com/docs/api-reference/completions/create#completions/create-frequency_penalty Increase the model's likelihood to not repeat tokens/words

best_ofinteger nullable

The number of responses to generate. Out of those, it will return the best n.

logit_biasobject nullable

COMING SOON https://platform.openai.com/docs/api-reference/completions/create#completions/create-logit_bias Modify the likelihood of specified tokens appearing in the completion.

See here for a detailed explanation on how to use: https://help.openai.com/en/articles/5247780-using-logit-bias-to-define-token-probability

assistant_idstring uuid nullable

The Assistant ID to use for this request

assistant_version_idstring uuid nullable

The Assistant version ID to use for this request

conversation_idstring uuid nullable

The Conversation ID to use for this request

parent_request_idstring uuid nullable

The Parent Request ID to use for this request

pluginsstring[]

The list of plugins to enable for the request

imagesstring[] nullable

Images to be analyzed

filesstring[] nullable

A list of file urls that should be included. Images, audio, etc.

Response

Successful Response