Run evaluations
Grades up to 200 of the agent’s finished sessions with its own evaluation configuration.
POST
cURL
How does grading work?
How does grading work?
Grading is asynchronous: each accepted session gets a result with
status: queued; poll it with GET /agents/{agent_id}/evaluations/{evaluation_id} until it is completed or failed. A new result replaces the previous result for that session.Sessions are skipped, not rejected, when they are unfinished, incognito, or not owned by this agent (ineligible), or already have a queued or running result (in_flight, with the existing result_id). The caller is charged one credit per queued session. Set dry_run: true to see the cost and skips without queuing anything.Requires edit access on the agent and a plan with evaluations enabled.Authorizations
Path Parameters
ID of the agent that owns the sessions.
Body
application/json