API reference
Serverless
21 operations. Each page has the request, the response, the errors and examples in curl, TypeScript, Python and the CLI.
- GETList serverless endpoints in the project
/v1/serverless/endpoints - POSTCreate a serverless endpoint (the webhook secret is returned once)
/v1/serverless/endpoints - GETGet a serverless endpoint
/v1/serverless/endpoints/{endpoint_id} - PATCHUpdate an endpoint. Changing the image, command, environment, SKUs, GPU count, concurrency, disk or HTTP settings creates a new release; workers are replaced progressively (busy ones finish first; an HTTP endpoint keeps old workers serving until new ones are healthy).
/v1/serverless/endpoints/{endpoint_id} - DELETEDelete an endpoint: its jobs are canceled and its workers removed
/v1/serverless/endpoints/{endpoint_id} - POSTReplace the webhook signing secret (returned once)
/v1/serverless/endpoints/{endpoint_id}/rotate-webhook-secret - GETRelease history, newest first
/v1/serverless/endpoints/{endpoint_id}/releases - GETGet a release
/v1/serverless/releases/{release_id} - POSTRoll back: a new release with an earlier release's worker spec
/v1/serverless/endpoints/{endpoint_id}/rollback - GETList jobs of an endpoint, newest first
/v1/serverless/endpoints/{endpoint_id}/jobs - POSTSubmit a job. With `wait`, answer once it finishes or the wait runs out (then poll the job).
/v1/serverless/endpoints/{endpoint_id}/jobs - GETJob status and result. With `wait`, long-poll until it finishes.
/v1/serverless/jobs/{job_id} - GETPartial output streamed by the handler, in order (long-poll with `wait`)
/v1/serverless/jobs/{job_id}/stream - POSTCancel a queued or running job (a running handler is told to stop)
/v1/serverless/jobs/{job_id}/cancel - POSTCancel every queued job of the endpoint (running jobs continue)
/v1/serverless/endpoints/{endpoint_id}/purge-queue - GETQueue depth, jobs by state, workers by state and rollout progress
/v1/serverless/endpoints/{endpoint_id}/health - GETQueue delay, execution time, cold starts and job counts over time
/v1/serverless/endpoints/{endpoint_id}/metrics - GETHTTP endpoints: request rate, status classes, latency percentiles, requests in flight and cold-start waits over time, per endpoint and per worker
/v1/serverless/endpoints/{endpoint_id}/request-metrics - GETWorkers of the endpoint with their state (live ones and those removed in the last hour)
/v1/serverless/endpoints/{endpoint_id}/workers - GETRecent container logs of the endpoint's workers
/v1/serverless/endpoints/{endpoint_id}/logs - GETCompletion webhook deliveries with their attempt log, newest first
/v1/serverless/endpoints/{endpoint_id}/webhook-deliveries