API reference · Schema
EvaluationCandidateInput
Modes label and grade
columnstringJudge the text already in this dataset column
1–128 characters
modelstringOr generate the text during the run with this model (see GET /v1/evaluations/models)
1–256 characters
promptstringWith `model`: the user message, a template over the row (`{{column}}`)
up to 20000 characters
system_promptstring | nullWith `model`: an optional system message (also a template)
up to 20000 characters
max_tokensintegerWith `model`: most tokens to generate (default 512)
1–4096
temperaturenumberWith `model`: sampling temperature, 0–2 (default 0)
0–2
Example
{
"column": "answer",
"model": "qwen/qwen2.5-0.5b-instruct",
"prompt": "Answer briefly: {{question}}",
"system_prompt": "string",
"max_tokens": 1,
"temperature": 0
}