
Performance reporting depends on your analytics permissions. Access to a saved conversation also follows Agent access, including your organization’s conversation visibility policy. For organization-wide reporting, see Insights.
Insights
Pick a date range, and optionally Compare to previous period to see the change. The chart’s interval is chosen for you to suit the range, and you can switch to any other interval that still makes a readable chart:
Usage & Credit Trend charts credits and tasks so you can distinguish a rise in spend from a rise in usage. Hover a point to see cost per task.
The overview on the right gives you the headline numbers for the range:
Further down, two breakdown tables:
- Credits by: Models, Sources, Triggers (credits charged per trigger), Members, and Connectors. Sources shows where tasks came from, such as a trigger, Slack, or the app, with all triggers in one Triggers row.
- Usage by: Connectors, Skills, Triggers, Artifacts, Subagents, and Knowledge Sources. The Triggers view lists Share, Failed, Status, and Runs for each trigger. Status is Active, Paused, or Deleted, and deleted triggers keep their name. The view groups one-time triggers under One-off triggers and runs that applied suggestions you approved under Self-improvement. In the full trigger list, use Search triggers to find one.

Task outcomes
Under the trend chart, Task outcomes charts how tasks ended over time, on the same range and interval as the rest of the tab:Which kinds of tasks cost the most?
Cost vs completion plots each kind of task the agent handles, such as Answer a question or Produce content. Higher means a better completion rate, further right means more credits per task, and a bigger dot means more tasks. Hover a dot to see Tasks, Credits per task, Completed, and Tool calls per task. Orchestrivo labels tasks shortly after they finish.Is a connector failing?
Usage by > Connectors shows each connected app’s Share of tool calls, Failed share, Typical (median) response time, and Calls.
What changed, and what it did to cost
Markers along the bottom of Usage & Credit Trend show when the agent was changed, so you can line a change up against the spend and volume around it. Each marker covers one interval of the chart. Select one to see the changes inside it, newest first, with who made each one:- Agent created
- Model changed: the model it moved to, and the one it came from
- Instructions edited
- Connectors, skills, and knowledge sources added or removed
- Reflections the agent applied. Select one to open the suggestion.
A change made before the agent ran any tasks is marked No tasks yet, since there is nothing yet to compare against.
Impact report
Have Orchestrivo send this summary out on a schedule, by Email or to a Channel, to the people you add under To. Useful for keeping a team lead in the loop without giving them the builder.Evaluations and Reflections
Both features live in the summary panel on the right of this page, and both are switched on from here:
See the linked guides for criteria, tags, data points, schedules, reports, and API details.
Evaluations tab
Once evaluations are on, this tab shows the grades: how completed tasks scored against your criteria, which ones failed, and the trend over time. That is where you catch a regression after changing the instructions or the model.Tasks tab
Review this agent’s task history to see who started each task, its source, and its credit cost. Open a saved task you have access to when you need to investigate an evaluation result. Filter the list by Source, Trigger, Person, Status, task label, Date range, and Credits (tasks over a credit amount). Source puts all triggered tasks under one Triggers option. Use Trigger to pick individual triggers. Task labels come in two groups, named Kind of work and Area unless your organization renamed them.
Related
Evaluations
Define criteria and grade the agent’s answers.
Reflections
Let the agent propose its own improvements.
Credits
What the agent is charged for.
Organization Insights
The same picture across every agent and team.