latestOpenAPI 3.1.02026-08-197104501.1 MB

8fbaab4fc7c5

Cost Tracking

Estimate Cost

Estimate cost for a given model and token counts.

This endpoint uses the same cost calculation logic as actual requests, including any configured margins and discounts.

Parameters:

  • model: Model name (e.g., "gpt-4", "claude-3-opus")
  • input_tokens: Expected input tokens per request
  • output_tokens: Expected output tokens per request
  • num_requests_per_day: Number of requests per day (optional)
  • num_requests_per_month: Number of requests per month (optional)

Returns cost breakdown including:

  • Per-request costs (input, output, margin)
  • Daily costs (if num_requests_per_day provided)
  • Monthly costs (if num_requests_per_month provided)

Example:

{
    "model": "gpt-4",
    "input_tokens": 1000,
    "output_tokens": 500,
    "num_requests_per_day": 100,
    "num_requests_per_month": 3000
}
post/cost/estimate

Request body

modelstring required

Model name (from /model_group/info)

input_tokensinteger required

Expected input tokens per request

output_tokensinteger required

Expected output tokens per request

num_requests_per_dayinteger nullable

Number of requests per day

num_requests_per_monthinteger nullable

Number of requests per month

Response

Successful Response

modelstring required
input_tokensinteger required
output_tokensinteger required
num_requests_per_dayinteger nullable
num_requests_per_monthinteger nullable
cost_per_requestnumber required

Total cost per request (includes margin)

input_cost_per_requestnumber required

Input token cost per request (before margin)

output_cost_per_requestnumber required

Output token cost per request (before margin)

margin_cost_per_requestnumber

Margin/fee added per request

daily_costnumber nullable

Total daily cost (includes margin)

daily_input_costnumber nullable

Daily input token cost

daily_output_costnumber nullable

Daily output token cost

daily_margin_costnumber nullable

Daily margin/fee

monthly_costnumber nullable

Total monthly cost (includes margin)

monthly_input_costnumber nullable

Monthly input token cost

monthly_output_costnumber nullable

Monthly output token cost

monthly_margin_costnumber nullable

Monthly margin/fee

input_cost_per_tokennumber nullable
output_cost_per_tokennumber nullable
providerstring nullable