Rated Turns
When users of your Tenant rate one of the agentâs answers đ or đ, that Turn becomes a rated Turn. Holders of the Right Read rated Turns can read it on the Rated Turns page of the Admin App, so they can see where the agent helps and where it fails. Admins hold the Right; give it to others with a Role, as described in Roles and Rights.
A rated Turn is the only part of a Conversation that anyone but its user can read. You see that one Turn, never the rest of its Conversation.
Find rated Turns
Section titled âFind rated TurnsâIn the Admin App, open Rated Turns. The newest Feedback comes first. Each one shows:
- the Feedback, Helpful for đ or Not helpful for đ, and when it was given;
- who rated it, by their email;
- with a đ, the reasons and the comment, if the user gave any.
The list never shows what was asked or answered. Select Show older rated Turns to see more.
Narrow the list with the filters above it:
- Feedback: only đ or only đ.
- Reason: only đ given for one reason.
- From and To: the first and last day a Turn was rated.
The filters apply at once. Select Clear filters to see everything again.
Read a rated Turn
Section titled âRead a rated TurnâSelect Read the Turn on an entry. The page shows the Feedback and the Turn as its user saw it: the question, the agentâs answer, and its steps, closed at first. Open the steps to see the agentâs reasoning, under Reasoning, and each tool the agent used. Expand a tool to see its inputs and result, with the data in plain text. You can only read: nothing on the page changes the Conversation, and the agent isnât asked anything.
Users may rate a Turn about data you canât access yourself, and you see that data in the Turn all the same: in the toolsâ results, and in the agentâs reasoning, which can contain data the agent read, such as rows from a Data Source or the contents of a web page.
When a rated Turn goes away
Section titled âWhen a rated Turn goes awayâA user can remove their Feedback or delete the Conversation at any time. From that moment, the Turn is private again: it leaves the list, and opening it shows This rated Turn is no longer available.
The Audit Log records every reading
Section titled âThe Audit Log records every readingâEach time someone opens a rated Turn, your Tenantâs Audit Log gets an entry Opened a rated Turn. It names who opened it and which Turn: the user who had it, the Conversationâs ID and the Turnâs number. It never holds what the Turn says. Opening the list leaves no entry.
Our staff
Section titled âOur staffâAuthorised Scavenger AI staff can read rated Turns too, to improve the agent. They read them from their own area of the Admin App, which lists the rated Turns of every Tenant, under the same rules as yours: one Turn at a time, never the rest of its Conversation, and only while its Feedback stands. Only the staff members we grant the right to read rated Turns can open them. The others hold every Right in your Tenant but Read rated Turns: they donât see your Rated Turns page either.
Each time one of them opens a rated Turn of your Tenant, your Tenantâs Audit Log gets the same entry Opened a rated Turn, with the staff member marked Scavenger AI staff. See Privacy.