Skip to content
Hayonix

API reference · Schema

CreateEndpointDeploymentRequest

  • namestringrequired

    Its name

    1–48 characters

  • modelstring | HuggingFaceModelSource | FineTunedModelSourcerequired

    Model ID (`publisher/name`)

  • hardwareEndpointHardwarerequired
    Show 2 fields of hardware
    • skustringrequired

      Hardware type code

      1–64 characters

    • gpu_countinteger

      GPUs per replica on GPU SKUs

      0–8

  • regionstring

    Region code

    1–64 characters

  • engineany JSON
  • engine_optionsEngineOptions
    Show 2 fields of engine_options
    • context_lengthinteger

      Context length in tokens each request may use (default: the model's context length, else the engine's default)

      128–1048576

    • parallelinteger

      Requests one replica runs at once

      1–256

  • disk_gbinteger

    Room for the weights (default 10 on CPU, 200 on GPU)

    1–2000

  • min_replicasinteger

    Default 1

    1–32

  • max_replicasinteger

    Default 1

    1–32

  • Show 1 field of autoscaling
    • target_concurrencyintegerrequired

      Concurrent requests per replica to aim for: replicas = ceil(concurrency / target), between min and max

      1–1024

Example
{
  "name": "candidate",
  "model": "qwen/qwen2.5-0.5b-instruct",
  "hardware": {
    "sku": "cpu-2c-4gb"
  }
}

Used by