---
title: "Obtain a response to the user query from LLMs hosted on HuggingFace."
method: GET
path: "/demo_inference"
tags: ["demo_inference"]
---

# Obtain a response to the user query from LLMs hosted on HuggingFace.

`GET /demo_inference`

Given an input prompt, returns the response from text completion using LLMs hosted on HuggingFace.

## Query parameters

- `prompt` string
- `model_id` string
- `max_new_tokens` string
- `temperature` string

## Response `200`

successful text completion

## Other responses

- `404` — invalid input parameters or model unavailable

---

[API](https://skmtc.net/ibm/apis/responsible-prompt-recommendation-api.md) · [All operations](https://skmtc.net/ibm/apis/responsible-prompt-recommendation-api/llms.txt) · [OpenAPI document](https://skmtc-service-staging.skmtc.workers.dev/v1/apis/ibm/responsible-prompt-recommendation-api/revisions/289f88c3eca1/schema)