Monitor agent performance - Writer AI Studio

AI Studio Observability

AI Studio provides session logs and observability metrics for agents so you can understand how your agents are performing. The following observability views are available for individual agents:

You can also view organization-wide usage and spend.

Session logs

Organization admins can choose to retain logs from agent sessions. When enabled, you can view the logs for an agent for the given retention period.

Session logs are only available to organization admins. Logs are available for custom no-code agents and Writer Agent, but are not yet available for prebuilt agents.

Enable session logging

To enable session logging, log in to AI Studio and navigate to the Admin tab in the left sidebar. From there, you can enable session logging for your organization. Once enabled, you can choose the retention period for session logs for each agent. The default is no retention. The possible retention periods are 7 days, 30 days, 90 days, or 180 days. Whenever someone updates an agent’s session log settings, all organization admins receive an email notification.

View session logs

To view session logs, navigate to AI Studio and select Agents from the left sidebar. Select an agent from the list, then select the Observability tab from the top of the page and choose the Session logs view. Click on an individual session to view the logs.

Flagged responses

In a chat with a no-code agent, an end user can flag a response as inappropriate or inaccurate. An organization admin can then view the flagged responses within the session logs. To flag a response in a chat, the user clicks the Flag button in the bottom right corner of the response. In the session logs for a particular conversation, you can see any flagged responses by clicking the View flagged responses button in the top right corner of the session log.

Agent observability

Agent observability provides a detailed view of an agent’s engagement, performance, and usage. Anyone can view these metrics for agents in your organization. Session logs are also available, but only for organization admins if the agent’s session log settings are enabled. These metrics are only available for deployed agents. To view metrics for deployed agents, navigate to AI Studio and select Agents from the left sidebar. Select an agent from the list, then select the Observability tab from the top of the page and choose the specific metric you want to view.

Next steps