Run evaluation on sessions
Grades up to 200 existing sessions with this evaluation. Grading is asynchronous: each accepted session gets a result with status: queued; poll it with GET /evaluations/{evaluation_id}/results/{result_id} until it is completed or failed.
POST
cURL
Which sessions are skipped, and what does it cost?
Which sessions are skipped, and what does it cost?
Sessions are skipped, not rejected, when they are not completed sessions of an agent the evaluation covers (
ineligible) or already have a queued or running result for this evaluation (in_flight, with the existing result_id). The caller is charged one credit per queued session. Set dry_run: true to see the cost and skips without queuing anything.Authorizations
Path Parameters
ID of the organization evaluation.
Body
application/json