Generate a response

Model name

Text for the model to generate a response from

Used for fill-in-the-middle models, text that appears after the user prompt and before the model response

System prompt for the model to generate a response from

When true, returns a stream of partial responses

When true, returns the raw response from the model without any prompt templating

Whether to return log probabilities of the output tokens

Number of most likely tokens to return at each token position when logprobs are enabled

Model name

ISO 8601 timestamp of response creation

The model's generated text response

The model's generated thinking output

Indicates whether generation has finished

Reason the generation stopped

Time spent generating the response in nanoseconds

Time spent loading the model in nanoseconds

Number of input tokens in the prompt

Time spent evaluating the prompt in nanoseconds

Number of output tokens generated in the response

Time spent generating tokens in nanoseconds