v2

latestOpenAPI 3.1.02026-08-07139158192.4 KB

Internal

Set the deployment pool's member-selection routing (platform admin)

Sets the endpoint pool's member-selection policy and/or the prefix_affinity load guard. This edits the POOL (deployments sharing a pool share the setting) and reaches every gateway task in ~2s via the config generation stamp; setting policy back to p2c_util is the instant rollback. Returns the refreshed replica view.

post/v1/admin/inference/deployments/{id}/pool-routing

Path parameters

idstring required

Request body

affinityGuardUtilnumber double

policy'p2c_util' | 'prefix_affinity'

Response

Updated

affinityGuardUtilnumber double

prefix_affinity overflow bound; absent = the gateway default

policy'p2c_util' | 'prefix_affinity' required

The pool's member-selection policy (p2c_util when the pool row does not exist yet)

poolIdstring required

The deployment's endpoint pool id

strayMembersstring[]

Pool member hostnames no current replica owns (pending the reconcile loop's stray sweep). Usually empty.