Everywhere Inference
Check inference deployment quota
Check if global quota is exceeded, if yes the number of additional quotas needed to create the specified inference deployment will be calculated.
post/cloud/v3/inference/{project_id}/deployments/check_limits
Path parameters
project_idinteger required
Project ID
Example:1
Project ID
Request body
Example request
{
"containers": [
{
"region_id": 1,
"scale": {
"max": 3,
"min": 1
}
}
],
"flavor_name": "inference-16vcpu-232gib-1xh100-80gb"
}Response
OK
Example response
{
"inference_cpu_millicore_count_limit": 8000,
"inference_cpu_millicore_count_requested": 3000,
"inference_cpu_millicore_count_usage": 2000,
"inference_gpu_a100_count_limit": 4,
"inference_gpu_a100_count_requested": 2,
"inference_gpu_a100_count_usage": 1,
"inference_gpu_h100_count_limit": 4,
"inference_gpu_h100_count_requested": 2,
"inference_gpu_h100_count_usage": 1,
"inference_gpu_l40s_count_limit": 4,
"inference_gpu_l40s_count_requested": 2,
"inference_gpu_l40s_count_usage": 1,
"inference_instance_count_limit": 10,
"inference_instance_count_requested": 1,
"inference_instance_count_usage": 1
}