v3
latestOpenAPI 3.1.02026-07-311,4541,5202.3 MBFilter Batch Jobs
POST for filtering (not creation) - delegate to GET.
Headers
Use a dashboard JWT only for dashboard-authenticated endpoints. Respan API-key endpoints use the respanApiKey auth field instead.
Request body
Provider's batch ID (e.g., batch_...)
Provider ID matching litellm_provider_id (e.g., 'openai', 'parasail')
- pending - Pending
- validating - Validating
- in_progress - In Progress
- finalizing - Finalizing
- completed - Completed
- failed - Failed
- cancelling - Cancelling
- cancelled - Cancelled
- expired - Expired
Total cost calculated from output (populated on completion)
When batch reached terminal status
Last time status was polled (for smart backoff)
unique_id of the start log (log_type=BATCH)
unique_id of the completion log (populated when status=completed and logged)
Response
Provider's batch ID (e.g., batch_...)
Provider ID matching litellm_provider_id (e.g., 'openai', 'parasail')
- pending - Pending
- validating - Validating
- in_progress - In Progress
- finalizing - Finalizing
- completed - Completed
- failed - Failed
- cancelling - Cancelling
- cancelled - Cancelled
- expired - Expired
Total cost calculated from output (populated on completion)
When batch reached terminal status
Last time status was polled (for smart backoff)
unique_id of the start log (log_type=BATCH)
unique_id of the completion log (populated when status=completed and logged)