API reference · Schema
DeployableModel
A public catalog model whose weights a dedicated endpoint can serve
objectstringrequiredAlways `deployable_model`: the type of this object
One of
deployable_modelmodelstringrequiredModel ID (`publisher/name`)
display_namestringrequiredName to show people
typestringrequiredWhat the model does
One of
chatcompletionembeddingrerankpublisherstring | nullrequiredWho published the model; null when not recorded
context_lengthinteger | nullrequiredThe model's context length in tokens; null when not known
weightsobjectrequiredThe weights a deployment of this model serves
ShowHide 2 fields of
weightsrepositorystringrequiredThe Hugging Face repository the weights come from
filestring | nullrequiredThe weights file or quantisation tag used; null when the whole repository is used
enginesobjectrequiredThe engine chosen by default on each kind of hardware
ShowHide 2 fields of
enginescpustring | nullrequiredThe engine used on CPU hardware (null: GPU only)
One of
llama_cppteivllmgpustringrequiredThe engine used on GPU hardware
One of
llama_cppteivllm
Example
{
"object": "deployable_model",
"model": "qwen/qwen2.5-0.5b-instruct",
"display_name": "string",
"type": "chat",
"publisher": "string",
"context_length": 1,
"weights": {
"repository": "string",
"file": "string"
},
"engines": {
"cpu": "llama_cpp",
"gpu": "llama_cpp"
}
}