Skip to content
Hayonix

API reference · Schema

RateLevelLimits

  • inference_rpmintegerrequired

    Inference requests per minute, per model

  • inference_tpmintegerrequired

    Inference tokens (prompt + completion) per minute, per model

  • batch_rpmintegerrequired

    Batch requests per minute, per model

  • batch_tpmintegerrequired

    Batch tokens per minute, per model

Example
{
  "inference_rpm": 1,
  "inference_tpm": 1,
  "batch_rpm": 1,
  "batch_tpm": 1
}