API reference · Schema
UpdateEndpointDeploymentRequest
min_replicasintegerFewest replicas kept running while the endpoint runs
1–32
max_replicasintegerMost replicas the autoscaler may run
1–32
autoscalingEndpointAutoscalingShowHide 1 field of
autoscalingtarget_concurrencyintegerrequiredConcurrent requests per replica to aim for: replicas = ceil(concurrency / target), between min and max
1–1024
Example
{
"max_replicas": 3
}Used by
- Change replica bounds or the autoscaling target (replicas are not recreated)
PATCH /v1/endpoint-deployments/{deployment_id}