API reference · Schema
EvaluationVerdict
labelstringMode `label`: the chosen label
scorenumberMode `grade`: the score given
winnerstringMode `pairwise`: `a`, `b` or `tie` when both judging passes agree; `inconsistent` when they disagree
One of
abtieinconsistentpassesobjectPairwise: the winner of each judging pass
ShowHide 2 fields of
passesa_firststringrequiredThe winner when A was shown to the judge first
One of
abtieb_firststringrequiredThe winner when B was shown to the judge first
One of
abtie
Example
{
"label": "string",
"score": 1.5,
"winner": "a",
"passes": {
"a_first": "a",
"b_first": "a"
}
}