v1

latestOpenAPI 3.0.3Apache 2.02026-07-17124145.8 KB

Text Embeddings Inference

Text Embeddings Inference endpoint info

get/info

Response

Served model info

auto_truncateboolean required

docker_labelstring nullable

max_batch_requestsinteger nullable

max_batch_tokensinteger required

max_client_batch_sizeinteger required

max_concurrent_requestsinteger required

Router Parameters

max_input_lengthinteger required

model_dtypestring required

model_idstring required

Model info

model_shastring nullable

shastring nullable

tokenization_workersinteger required

versionstring required

Router Info

Example response

{
  "docker_label": "null",
  "model_dtype": "float16",
  "model_id": "thenlper/gte-base",
  "model_sha": "fca14538aa9956a46526bd1d0d11d69e19b5a101",
  "model_type": {
    "classifier": {
      "id2label": {
        "0": "LABEL"
      },
      "label2id": {
        "LABEL": 0
      }
    }
  },
  "sha": "null",
  "version": "0.5.0"
}