API reference
Evaluations
7 operations. Each page has the request, the response, the errors and examples in curl, TypeScript, Python and the CLI.
- GETList the models this project can use as a judge or to generate candidates
/v1/evaluations/models - POSTEstimate an evaluation: the most it can cost, and its first row’s requests
/v1/evaluations/estimate - GETList evaluations in the project, newest first
/v1/evaluations - POSTCreate an evaluation over an uploaded dataset (validated and run asynchronously)
/v1/evaluations - GETGet an evaluation: status, progress, results so far, cost
/v1/evaluations/{evaluation_id} - POSTCancel an evaluation (calls in flight may finish; finished rows are kept)
/v1/evaluations/{evaluation_id}/cancel - GETList an evaluation’s rows in dataset order: verdict, reasoning, texts, cost
/v1/evaluations/{evaluation_id}/rows