v1

latestOpenAPI 3.1.0Apache 2.02026-07-264001921002.3 KB

Bedrock Integration

Invoke model with streaming (Bedrock format)

Invokes a model with streaming using AWS Bedrock InvokeModelWithResponseStream API format.

post/bedrock/model/{modelId}/invoke-with-response-stream

modelIdstring required

Model ID (e.g., anthropic.claude-3-sonnet-20240229-v1:0)

promptstring

Text prompt to complete

max_tokensinteger

max_tokens_to_sampleinteger

Anthropic-style max tokens

temperaturenumber

top_pnumber

top_kinteger

stopstring[]

stop_sequencesstring[]

Anthropic-style stop sequences

messagesobject[]

For Claude 3 models

anthropic_versionstring

Successful streaming response