---
title: "Inference Post"
method: POST
path: "/inference/v1{path}"
tags: ["Inference"]
---

# Inference Post

`POST /inference/v1{path}`

OpenAI-compatible APIs.

## Path parameters

- `path` string, required

## Request body

- CompletionsCreateRequestInputs
  - `model` string, required
  - `messages` unknown[]
    - unknown
  - `timeout` union
    - number
    - string
  - `temperature` number, nullable
  - `top_p` number, nullable
  - `n` integer, nullable
  - `stop` union
    - string
    - unknown[]
      - unknown
  - `max_completion_tokens` integer, nullable
  - `max_tokens` integer, nullable
  - `modalities` unknown[], nullable
    - unknown
  - `presence_penalty` number, nullable
  - `frequency_penalty` number, nullable
  - `stream` boolean, nullable
  - `logit_bias` object, nullable
  - `user` string, nullable
  - `response_format` union
    - object
    - unknown
  - `seed` integer, nullable
  - `tools` unknown[], nullable
    - unknown
  - `tool_choice` union
    - string
    - object
  - `logprobs` boolean, nullable
  - `top_logprobs` integer, nullable
  - `parallel_tool_calls` boolean, nullable
  - `extra_headers` object, nullable
  - `functions` unknown[], nullable
    - unknown
  - `function_call` string, nullable
  - `api_version` string, nullable
  - `prompt` string, nullable — Reference to a Weave Prompt object (e.g., 'weave:///entity/project/object/prompt_name:version'). If provided, the messages from this prompt will be prepended to the messages in this request. Template variables in the prompt messages can be substituted using the template_vars parameter.
  - `template_vars` object, nullable — Dictionary of template variables to substitute in prompt messages. Variables in messages like '{variable_name}' will be replaced with the corresponding values. Applied to both prompt messages (if prompt is provided) and regular messages.

## Response `200`

Successful Response

- unknown

## Other responses

- `422` — Validation Error

---

[API](https://skmtc.net/wandb/apis/fastapi.md) · [All operations](https://skmtc.net/wandb/apis/fastapi/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/wandb/fastapi/revisions/56745769989b/schema)