Sign in

v1

latestOpenAPI 3.1.0raw.githubusercontent.com2026-06-25173140700.7 KB
LlmSetting

Create LLM settings

Create a provider-specific settings entry for a catalog model.

post/llm/settings

Query parameters

cookie_namestring nullable

Request body

llm_catalog_idinteger required

ID of the catalog model these settings configure.

providerstring required

Provider backing the model.

librarystring required

Client library used to call the provider.

max_tokensinteger required

Maximum tokens allowed per request for this model.

regionstring nullable

Provider region hosting the deployment.

argsobject nullable

Extra provider-specific arguments passed to the client.

openai_resourcestring nullable

Azure OpenAI resource name.

api_versionstring nullable

Provider API version to target.

deployment_namestring nullable

Provider deployment name for the model.

endpointstring nullable

Base URL of the provider endpoint.

api_keystring nullable

Secret API key used to authenticate with the provider.

Example request

{
  "llm_catalog_id": 1,
  "provider": "azure",
  "library": "openai",
  "max_tokens": 128000,
  "region": "westeurope",
  "args": {
    "temperature": 0.2
  },
  "openai_resource": "my-openai-resource",
  "api_version": "2024-02-01",
  "deployment_name": "gpt-4o-deployment",
  "endpoint": "https://my-resource.openai.azure.com",
  "api_key": "sk-..."
}

Response

Successful Response

{"stackTrail":"paths:/llm/settings:post:responses:201:content:application/json:schema","oasType":"schema","type":"unknown"}