AI insights and activity
Use the AI Dashboard's AI Insights, AI Activity and Bot Activity tabs to track AI usage, cost, failures and latency, and to audit individual AI calls and assistant chats.
Overview
The AI Dashboard gives master admins one place to see how AI is used across every household: how many calls, what they cost, which features and providers they used, and what went wrong. It has four tabs: Providers, AI Insights, AI Activity and Bot Activity. This article covers the last three.
Before you start
- You must be a master admin. Other users don't see AI Dashboard in the sidebar.
- These views include questions and AI results that can contain personal details. They are stored encrypted and shown only here. Open them only when you have a reason, such as a support request.
Steps
AI Insights — the trends
- In the sidebar, under Workspace, click AI Dashboard.
- Open AI Insights.
- Pick a period: 7d, 30d or 90d.
- Read the headline figures: | Figure | Meaning | |---|---| | AI calls | Total, split into bot (assistant) and app (in-app features) | | Est. cost | Estimated spend; shows "free" when only free providers were used | | Tokens in / out | Volume of text sent and received | | Failures | Calls that did not succeed | | Active users | People who triggered AI in the period | | Avg latency | Average response time in milliseconds |
- Use Usage trend to see daily calls, split into bot and in-app.
- Compare By provider and By feature to see where calls and cost come from.
AI Activity — every in-app AI call
- Open AI Activity.
- Each row shows When, Feature, Provider, Tokens, Cost, Status and Detail.
- Click a row to expand it and see the full detail, the result and, for a failure, the Failure response from the provider.
Feature names you'll see include LAB_EXTRACT (reading lab values from a report), LAB_ASK, LAB_INSIGHTS, REPORT_CHAT (Ask AI on a report) and HEALTH_PROFILE.
Bot Activity — assistant conversations
- Open Bot Activity.
- Each entry shows the question, whether it came from web or telegram, the user and role, provider, tokens, cost and time.
- Click an entry to see the Question and Reply.
Example
A member of the Iyer household reports that scanning a lab report keeps failing. The master admin opens AI Activity, finds LAB_EXTRACT rows marked FAILED, and expands one. The failure response shows a rate-limit error from the first provider. They move a different vision-capable provider higher on the Providers tab, and the next attempt succeeds.
FAQs
Why does Cloud & Billing show more tokens than AI Insights?
AI Insights counts feature-level events. Cloud & Billing counts every underlying provider call, including fallback retries and multi-page scans, so its numbers are higher and closer to what you're billed.
Does a lab extraction that finds no values count as a failure?
No. A file with no lab numbers, such as a vaccination card, is a successful call with zero results. Only real errors are marked FAILED.
Are assistant questions in the household Activity log too?
The household Activity log records only that a question was asked, not its text. The full question and reply are visible only in Bot Activity.
Troubleshooting
"No in-app AI calls logged yet." or "No assistant queries logged yet."
Nothing has been recorded yet. Use an AI feature or ask the assistant, then refresh.
Costs show "free" but I was billed
Estimates use a fixed price table. Check the provider's own console using the ↗ link on the Providers tab.