--- title: "List AI Gateway Models" method: GET path: "/v1/ai-gateways/{gatewayId}/models" tags: ["AI Gateway Models"] --- # List AI Gateway Models `GET /v1/ai-gateways/{gatewayId}/models` **Pre-release Endpoint** This endpoint is currently in beta and is subject to change. Returns a list of all models registered in the AI Gateway. ## Query parameters - `page[size]` integer - `page[after]` string ## Response `200` A successful response listing AI Gateway Models. - object - `data` AIGatewayModel[], required - union — **Pre-release Feature** This feature is currently in beta and is subject to change. Configuration for an AI Gateway model. - object — Configuration for proxying asynchronous requests/responses to/from an AI Gateway model using the files and batches APIs. - `id` string, uuid, required — Contains a unique identifier used for this resource. - `created_at` string, date-time, required — An ISO-8601 timestamp representation of entity creation date. - `updated_at` string, date-time, required — An ISO-8601 timestamp representation of entity update date. - `display_name` string, required — The display name for this model instance. - `name` string, required — Identifier for an AI Gateway entity. In some cases, this may be the entity name or ID. - `enabled` boolean — Whether the model is enabled. - `access` AIGatewayModelAccess — **Pre-release Feature** This feature is currently in beta and is subject to change. Access control configuration for a model. - `acls` union — **Pre-release Feature** This feature is currently in beta and is subject to change. Access control rules. Configure exactly one of `allow` or `deny`. - AIGatewayAllowACL — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayDenyACL — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - `identity_providers` AIGatewayIdentityProviderReference[] — List of identity providers for granting access to the model. At most 1 identity provider of each identity provider type can be referenced. - `formats` AIGatewayModelFormat[], required — List of request/response formats supported by this model. - `type` 'anthropic' | 'bedrock' | 'cohere' | 'gemini' | 'huggingface' | 'openai' | 'vertex' — The format type. - `targets` AIGatewayTarget[], required — One or more backend models that this model entry routes to. - `name` string, required — The name of the model defined in the upstream provider that will be executed. - `weight` integer — The weight this target gets within the upstream load balancer - `semantic_description` string — The semantic description of the target, required if using semantic load balancing. Specially, setting this to 'CATCHALL' will indicate such target to be used when no other targets match the semantic threshold. - `allow_auth_override` boolean — When enabled, request-level auth parameters (such as API keys or bearer tokens) will override the static values defined for the provider. - `provider` string, required — Reference to a model provider instance by name. - `config` union, required — **Pre-release Feature** This feature is currently in beta and is subject to change. Configuration for a target model. - AIGatewayTargetAnthropicConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Anthropic-specific configuration for a model. - … - AIGatewayTargetAzureConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Azure-specific configuration for a model. - … - AIGatewayTargetBedrockConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. AWS Bedrock-specific configuration for a model. - … - AIGatewayTargetCerebrasConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Cerebras-specific configuration for a model. - … - AIGatewayTargetCohereConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Cohere-specific configuration for a model. - … - AIGatewayTargetDashscopeConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Alibaba DashScope-specific configuration for a model. - … - AIGatewayTargetDatabricksConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Databricks-specific configuration for a model. - … - AIGatewayTargetDeepseekConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Deepseek-specific configuration for a model. - … - AIGatewayTargetGeminiConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Google Gemini-specific configuration for a model. - … - AIGatewayTargetHuggingfaceConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Hugging Face-specific configuration for a model. - … - AIGatewayTargetKimiConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Kimi (Moonshot AI)-specific configuration for a model. - … - AIGatewayTargetLlama2Config — **Pre-release Feature** This feature is currently in beta and is subject to change. Llama2-specific configuration for a model. - … - AIGatewayTargetMistralConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Mistral-specific configuration for a model. - … - AIGatewayTargetOllamaConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Ollama-specific configuration for a model. - … - AIGatewayTargetOpenaiConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Openai-specific configuration for a model. - … - AIGatewayTargetVercelConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Vercel AI Gateway-specific configuration for a model. - … - AIGatewayTargetVertexConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Google Vertex-specific configuration for a model. - … - AIGatewayTargetVllmConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Vllm-specific configuration for a model. - … - AIGatewayTargetXaiConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Xai-specific configuration for a model. - … - AIGatewayTargetSagemakerConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. AWS SageMaker-specific configuration for a model. - … - `policies` string[] — List of policy references. - `labels` PublicLabels — Public labels store information about an entity that can be used for filtering a list of objects. Public labels are intended to store **PUBLIC** metadata. Keys must be of length 1-63 characters, and cannot start with "kong", "konnect", "mesh", "kic", or "_". - `managed_by` ManagedBy — Stores information about what manages this entity, such as the tool or system responsible for its lifecycle (for example, `terraform`). Keys must be 1–63 characters long and start with an alphanumeric character. - `type` 'api', required - `config` AIGatewayModelAPIConfig, required — Routing, logging, and load balancing configuration for the model. - `route` AIGatewayModelRouteConfig, required — **Pre-release Feature** This feature is currently in beta and is subject to change. Configuration for an AI Gateway route. - `headers` object — One or more lists of values indexed by header name that will cause this route to match if present in the request. The `Host` header cannot be used with this attribute: hosts should be specified using the `hosts` attribute. When `headers` contains only one value and that value starts with the special prefix `~*`, the value is interpreted as a regular expression. - `hosts` string[] — A list of domain names that match this route. Note that the hosts value is case sensitive. - `https_redirect_status_code` integer — The status code Kong responds with when all properties of a route match except the protocol i.e. if the protocol of the request is `HTTP` instead of `HTTPS`. `Location` header is injected by Kong if the field is set to 301, 302, 307 or 308. Note: This config applies only if the route is configured to only accept the `https` protocol. - `methods` string[] — A list of HTTP methods that match this route. - `paths` string[] — A list of paths that match this route. - `preserve_host` boolean — When matching a route via one of the `hosts` domain names, use the request `Host` header in the upstream request headers. If set to `false`, the upstream `Host` header will be that of the service's `host`. - `protocols` string[] — An array of the protocols this route should allow. See the [route Object](#route-object) section for a list of accepted protocols. When set to only `https`, HTTP requests are answered with an upgrade error. When set to only `http`, HTTPS requests are answered with an error. - `regex_priority` integer — A number used to choose which route resolves a given request when several routes match it using regexes simultaneously. When two routes match the path and have the same `regex_priority`, the older one (lowest `created_at`) is used. Note that the priority for non-regex routes is different (longer non-regex routes are matched before shorter ones). - `request_buffering` boolean — Whether to enable request body buffering or not. With HTTP 1.1, it may make sense to turn this off on services that receive data with chunked transfer encoding. - `response_buffering` boolean — Whether to enable response body buffering or not. With HTTP 1.1, it may make sense to turn this off on services that send data with chunked transfer encoding. - `strip_path` boolean — When matching a route via one of the `paths`, strip the matching prefix from the upstream request URL. - `tags` string[] — An optional set of strings associated with the route for grouping and filtering. - `model` AIGatewayModelSelectorConfig — Configuration for overriding routing to this model using a selector. When no selector location is set, the format default selector is used. When values are not set, the model name is used as the selector value. - … - `logging` AIGatewayLoggingConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Configuration for AI Gateway logging. - `payloads` boolean - `response_streaming` 'allow' | 'always' | 'deny' - `max_request_body_size` integer — Maximum size of request body to parse. Set to 0 for unlimited. - `balancer` union — **Pre-release Feature** This feature is currently in beta and is subject to change. Configuration for a model's load balancer when multiple target models are configured. - AIGatewayModelBalancerConsistentHashingConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerLeastConnectionsConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerLowestLatencyConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerLowestUsageConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerPriorityConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerRoundRobinConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerSemanticConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - `proxy` AIGatewayProxyConfig — HTTP/HTTPS proxy configuration for outbound requests to the upstream AI provider. - `http_proxy` object — HTTP proxy server to route plaintext outbound requests through. - … - `https_proxy` object — HTTPS proxy server to route TLS outbound requests through. - … - `proxy_scheme` 'http' — The proxy scheme to use when connecting to the proxy server. - `auth` object — Credentials used to authenticate to the proxy server. - … - `no_proxy` string — Comma-separated list of hosts that should not be proxied. - `capabilities` string[], required — List of AI capabilities enabled for this API model. - object — Configuration for proxying synchronous requests/responses to/from an AI Gateway model using generative APIs. - `id` string, uuid, required — Contains a unique identifier used for this resource. - `created_at` string, date-time, required — An ISO-8601 timestamp representation of entity creation date. - `updated_at` string, date-time, required — An ISO-8601 timestamp representation of entity update date. - `display_name` string, required — The display name for this model instance. - `name` string, required — Identifier for an AI Gateway entity. In some cases, this may be the entity name or ID. - `enabled` boolean — Whether the model is enabled. - `access` AIGatewayModelAccess — **Pre-release Feature** This feature is currently in beta and is subject to change. Access control configuration for a model. - `acls` union — **Pre-release Feature** This feature is currently in beta and is subject to change. Access control rules. Configure exactly one of `allow` or `deny`. - AIGatewayAllowACL — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayDenyACL — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - `identity_providers` AIGatewayIdentityProviderReference[] — List of identity providers for granting access to the model. At most 1 identity provider of each identity provider type can be referenced. - `formats` AIGatewayModelFormat[], required — List of request/response formats supported by this model. - `type` 'anthropic' | 'bedrock' | 'cohere' | 'gemini' | 'huggingface' | 'openai' | 'vertex' — The format type. - `targets` AIGatewayTarget[], required — One or more backend models that this model entry routes to. - `name` string, required — The name of the model defined in the upstream provider that will be executed. - `weight` integer — The weight this target gets within the upstream load balancer - `semantic_description` string — The semantic description of the target, required if using semantic load balancing. Specially, setting this to 'CATCHALL' will indicate such target to be used when no other targets match the semantic threshold. - `allow_auth_override` boolean — When enabled, request-level auth parameters (such as API keys or bearer tokens) will override the static values defined for the provider. - `provider` string, required — Reference to a model provider instance by name. - `config` union, required — **Pre-release Feature** This feature is currently in beta and is subject to change. Configuration for a target model. - AIGatewayTargetAnthropicConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Anthropic-specific configuration for a model. - … - AIGatewayTargetAzureConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Azure-specific configuration for a model. - … - AIGatewayTargetBedrockConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. AWS Bedrock-specific configuration for a model. - … - AIGatewayTargetCerebrasConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Cerebras-specific configuration for a model. - … - AIGatewayTargetCohereConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Cohere-specific configuration for a model. - … - AIGatewayTargetDashscopeConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Alibaba DashScope-specific configuration for a model. - … - AIGatewayTargetDatabricksConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Databricks-specific configuration for a model. - … - AIGatewayTargetDeepseekConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Deepseek-specific configuration for a model. - … - AIGatewayTargetGeminiConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Google Gemini-specific configuration for a model. - … - AIGatewayTargetHuggingfaceConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Hugging Face-specific configuration for a model. - … - AIGatewayTargetKimiConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Kimi (Moonshot AI)-specific configuration for a model. - … - AIGatewayTargetLlama2Config — **Pre-release Feature** This feature is currently in beta and is subject to change. Llama2-specific configuration for a model. - … - AIGatewayTargetMistralConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Mistral-specific configuration for a model. - … - AIGatewayTargetOllamaConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Ollama-specific configuration for a model. - … - AIGatewayTargetOpenaiConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Openai-specific configuration for a model. - … - AIGatewayTargetVercelConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Vercel AI Gateway-specific configuration for a model. - … - AIGatewayTargetVertexConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Google Vertex-specific configuration for a model. - … - AIGatewayTargetVllmConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Vllm-specific configuration for a model. - … - AIGatewayTargetXaiConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Xai-specific configuration for a model. - … - AIGatewayTargetSagemakerConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. AWS SageMaker-specific configuration for a model. - … - `policies` string[] — List of policy references. - `labels` PublicLabels — Public labels store information about an entity that can be used for filtering a list of objects. Public labels are intended to store **PUBLIC** metadata. Keys must be of length 1-63 characters, and cannot start with "kong", "konnect", "mesh", "kic", or "_". - `managed_by` ManagedBy — Stores information about what manages this entity, such as the tool or system responsible for its lifecycle (for example, `terraform`). Keys must be 1–63 characters long and start with an alphanumeric character. - `type` 'model', required - `config` AIGatewayModelModelConfig, required — Routing, logging, and load balancing configuration for the model. - `route` AIGatewayModelRouteConfig, required — **Pre-release Feature** This feature is currently in beta and is subject to change. Configuration for an AI Gateway route. - `headers` object — One or more lists of values indexed by header name that will cause this route to match if present in the request. The `Host` header cannot be used with this attribute: hosts should be specified using the `hosts` attribute. When `headers` contains only one value and that value starts with the special prefix `~*`, the value is interpreted as a regular expression. - `hosts` string[] — A list of domain names that match this route. Note that the hosts value is case sensitive. - `https_redirect_status_code` integer — The status code Kong responds with when all properties of a route match except the protocol i.e. if the protocol of the request is `HTTP` instead of `HTTPS`. `Location` header is injected by Kong if the field is set to 301, 302, 307 or 308. Note: This config applies only if the route is configured to only accept the `https` protocol. - `methods` string[] — A list of HTTP methods that match this route. - `paths` string[] — A list of paths that match this route. - `preserve_host` boolean — When matching a route via one of the `hosts` domain names, use the request `Host` header in the upstream request headers. If set to `false`, the upstream `Host` header will be that of the service's `host`. - `protocols` string[] — An array of the protocols this route should allow. See the [route Object](#route-object) section for a list of accepted protocols. When set to only `https`, HTTP requests are answered with an upgrade error. When set to only `http`, HTTPS requests are answered with an error. - `regex_priority` integer — A number used to choose which route resolves a given request when several routes match it using regexes simultaneously. When two routes match the path and have the same `regex_priority`, the older one (lowest `created_at`) is used. Note that the priority for non-regex routes is different (longer non-regex routes are matched before shorter ones). - `request_buffering` boolean — Whether to enable request body buffering or not. With HTTP 1.1, it may make sense to turn this off on services that receive data with chunked transfer encoding. - `response_buffering` boolean — Whether to enable response body buffering or not. With HTTP 1.1, it may make sense to turn this off on services that send data with chunked transfer encoding. - `strip_path` boolean — When matching a route via one of the `paths`, strip the matching prefix from the upstream request URL. - `tags` string[] — An optional set of strings associated with the route for grouping and filtering. - `model` AIGatewayModelSelectorConfig — Configuration for overriding routing to this model using a selector. When no selector location is set, the format default selector is used. When values are not set, the model name is used as the selector value. - … - `logging` AIGatewayLoggingConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. Configuration for AI Gateway logging. - `payloads` boolean - `response_streaming` 'allow' | 'always' | 'deny' - `max_request_body_size` integer — Maximum size of request body to parse. Set to 0 for unlimited. - `model` object — **Pre-release Feature** This feature is currently in beta and is subject to change. - `name_header` boolean — **Pre-release Feature** This feature is currently in beta and is subject to change. Display the model name selected in the X-Kong-LLM-Model response header - `balancer` union — **Pre-release Feature** This feature is currently in beta and is subject to change. Configuration for a model's load balancer when multiple target models are configured. - AIGatewayModelBalancerConsistentHashingConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerLeastConnectionsConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerLowestLatencyConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerLowestUsageConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerPriorityConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerRoundRobinConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - AIGatewayModelBalancerSemanticConfig — **Pre-release Feature** This feature is currently in beta and is subject to change. - … - `proxy` AIGatewayProxyConfig — HTTP/HTTPS proxy configuration for outbound requests to the upstream AI provider. - `http_proxy` object — HTTP proxy server to route plaintext outbound requests through. - … - `https_proxy` object — HTTPS proxy server to route TLS outbound requests through. - … - `proxy_scheme` 'http' — The proxy scheme to use when connecting to the proxy server. - `auth` object — Credentials used to authenticate to the proxy server. - … - `no_proxy` string — Comma-separated list of hosts that should not be proxied. - `capabilities` string[], required — List of AI capabilities enabled for this model. - `meta` CursorMeta, required — Pagination metadata. - `page` CursorMetaPage, required - `first` string, path — URI to the first page - `last` string, path — URI to the last page - `next` string, path, nullable, required — URI to the next page - `previous` string, path, nullable, required — URI to the previous page - `size` number, required — Requested page size ## Other responses - `401` — Unauthorized - `403` — Forbidden - `404` — Not Found - `429` — Too Many Requests --- [API](https://skmtc.net/kong/apis/konnect-api-go-sdk.md) · [All operations](https://skmtc.net/kong/apis/konnect-api-go-sdk/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/kong/konnect-api-go-sdk/revisions/0aee8d012787/schema)