Create Provider
Request body
Model provider API url. The url must only contain the domain name (without /v1 suffix for example). Depends of the model provider type, the url can be optional (Albert, OpenAI).
Model provider API key.
Timeout for the model provider requests, after user receive an 503 error (model is too busy).
Model name from the model provider.
Total params of the model in billions of parameters for carbon footprint computation. For more information, see https://ecologits.ai
Active params of the model in billions of parameters for carbon footprint computation. For more information, see https://ecologits.ai
The value to use for the quality of service. Depends of the metric, the value can be a percentile, a threshold, etc.
ID of the model to create the provider for (router ID, eg. 123).
Response
Successful Response
Provider ID.
ID of the router that owns the provider.
ID of the user that owns the provider.
Provider API url. The url must only contain the domain name (without /v1 suffix for example).
Provider API key.
Timeout for the provider requests, after user receive an 500 error (model is too busy).
Model name from the model provider.
Total params of the model in billions of parameters for carbon footprint computation. If not provided, the active params will be used if provided, else carbon footprint will not be computed. For more information, see https://ecologits.ai
Active params of the model in billions of parameters for carbon footprint computation. If not provided, the total params will be used if provided, else carbon footprint will not be computed. For more information, see https://ecologits.ai
The value to use for the quality of service. Depends of the metric, the value can be a percentile, a threshold, etc.
Time of creation, as Unix timestamp.
Time of last update, as Unix timestamp.