latestOpenAPI 3.1.02026-08-236994571.1 MB
79928a3d37d3
OpenAI Evals API - Runs
Create Run
Create a new run for an evaluation.
Model-based routing (for multi-account support):
- Pass model via header: x-litellm-model: gpt-4-account-1
- Pass model via query: ?model=gpt-4-account-1
- Pass model via body: {"model": "gpt-4-account-1"}
- Pass model via completion.model: {"completion": {"model": "gpt-4-account-1"}}
Example usage:
curl -X POST "http://localhost:4000/v1/evals/eval_123/runs" -H "Authorization: Bearer your-key" -H "Content-Type: application/json" -d '{
"data_source": {"type": "dataset", "dataset_id": "dataset_123"},
"completion": {"model": "gpt-4", "temperature": 0.7}
}'
Returns: Run object with id, status, timestamps, etc.
post/v1/evals/{eval_id}/runs
Path parameters
eval_idstring required
Query parameters
custom_llm_providerstring nullable
Response
Successful Response