---
title: "Model Group Info"
method: GET
path: "/model_group/info"
tags: ["model management"]
---

# Model Group Info

`GET /model_group/info`

Get information about all the deployments on litellm proxy, including config.yaml descriptions (except api key and api base)

- /model_group/info returns all model groups. End users of proxy should use /model_group/info since those models will be used for /chat/completions, /embeddings, etc.
- /model_group/info?model_group=rerank-english-v3.0 returns all model groups for a specific model group (`model_name` in config.yaml)



Example Request (All Models):
```shell
curl -X 'GET'     'http://localhost:4000/model_group/info'     -H 'accept: application/json'     -H 'x-api-key: sk-1234'
```

Example Request (Specific Model Group):
```shell
curl -X 'GET'     'http://localhost:4000/model_group/info?model_group=rerank-english-v3.0'     -H 'accept: application/json'     -H 'Authorization: Bearer sk-1234'
```

Example Request (Specific Wildcard Model Group): (e.g. `model_name: openai/*` on config.yaml)
```shell
curl -X 'GET'     'http://localhost:4000/model_group/info?model_group=openai/tts-1'
-H 'accept: application/json'     -H 'Authorization: Bearersk-1234'
```

Learn how to use and set wildcard models [here](https://docs.litellm.ai/docs/wildcard_routing)

Example Response:
```json
    {
        "data": [
            {
            "model_group": "rerank-english-v3.0",
            "providers": [
                "cohere"
            ],
            "max_input_tokens": null,
            "max_output_tokens": null,
            "input_cost_per_token": 0.0,
            "output_cost_per_token": 0.0,
            "mode": null,
            "tpm": null,
            "rpm": null,
            "supports_parallel_function_calling": false,
            "supports_vision": false,
            "supports_function_calling": false,
            "supported_openai_params": [
                "stream",
                "temperature",
                "max_tokens",
                "logit_bias",
                "top_p",
                "frequency_penalty",
                "presence_penalty",
                "stop",
                "n",
                "extra_headers"
            ]
            },
            {
            "model_group": "gpt-3.5-turbo",
            "providers": [
                "openai"
            ],
            "max_input_tokens": 16385.0,
            "max_output_tokens": 4096.0,
            "input_cost_per_token": 1.5e-06,
            "output_cost_per_token": 2e-06,
            "mode": "chat",
            "tpm": null,
            "rpm": null,
            "supports_parallel_function_calling": false,
            "supports_vision": false,
            "supports_function_calling": true,
            "supported_openai_params": [
                "frequency_penalty",
                "logit_bias",
                "logprobs",
                "top_logprobs",
                "max_tokens",
                "max_completion_tokens",
                "n",
                "presence_penalty",
                "seed",
                "stop",
                "stream",
                "stream_options",
                "temperature",
                "top_p",
                "tools",
                "tool_choice",
                "function_call",
                "functions",
                "max_retries",
                "extra_headers",
                "parallel_tool_calls",
                "response_format"
            ]
            },
            {
            "model_group": "llava-hf",
            "providers": [
                "openai"
            ],
            "max_input_tokens": null,
            "max_output_tokens": null,
            "input_cost_per_token": 0.0,
            "output_cost_per_token": 0.0,
            "mode": null,
            "tpm": null,
            "rpm": null,
            "supports_parallel_function_calling": false,
            "supports_vision": true,
            "supports_function_calling": false,
            "supported_openai_params": [
                "frequency_penalty",
                "logit_bias",
                "logprobs",
                "top_logprobs",
                "max_tokens",
                "max_completion_tokens",
                "n",
                "presence_penalty",
                "seed",
                "stop",
                "stream",
                "stream_options",
                "temperature",
                "top_p",
                "tools",
                "tool_choice",
                "function_call",
                "functions",
                "max_retries",
                "extra_headers",
                "parallel_tool_calls",
                "response_format"
            ]
            }
        ]
        }
```

## Query parameters

- `model_group` string, nullable

## Response `200`

Successful Response

- unknown

## Other responses

- `422` — Validation Error

---

[API](https://skmtc.net/flock/apis/litellm-api.md) · [All operations](https://skmtc.net/flock/apis/litellm-api/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/flock/litellm-api/revisions/8fbaab4fc7c5/schema)