TL;DR
- The feature: Anthropic’s Smart Reports lets admins read session summaries of employee Claude chats and rank people by token cost across a 28-day window.
- The controls: 8 protected topic categories, names hidden by default, every reveal logged. Reasonable product decisions, not a management strategy.
- The flaw: It measures activity, not outcomes. Sessions are not shipped work, the same way impressions are not pipeline.
- The cost: Surveillance changes behavior. People stop asking the clumsy questions where the real learning happens.
- The fix: Define what good output looks like, use the data to fix workflows and coach, keep the governance with the employer.
TL;DR in one line: Anthropic shipped a capable monitoring tool with real guardrails, and it is still a poor way to run a team. The companies that win with AI will use these reports to understand their systems, not to supervise their people.
This is the oldest mistake in marketing wearing a new interface. I have watched teams chase impressions for fifteen years and call it pipeline; reading AI chats is the same reflex with a bigger invoice. Here is what the feature does, why the metric is wrong before the ethics are, and what to do instead.
The feature is real, and so is the temptation
Anthropic’s documentation on Smart Reports is worth reading closely. An admin selects a team, a time window of up to 28 days, a surface such as Claude or Claude Code, and a custom question. Claude samples transcripts, groups activity into workstreams, estimates list-price cost, and returns a structured report. Drill down and the tool serves session-level summaries: date, product, output type, cost. Not just a usage count. Names stay hidden by default, but an admin can reveal them on demand, and every reveal is logged automatically.
That logging detail tells you Anthropic knows what it built. The company also blocked session-level drilldowns on 8 protected categories: personal life, health and medical matters, political and religious views, protected characteristics, union activity, harassment and whistleblower complaints, privileged legal content, and sentiment about a named person. Those protections cannot be disabled. Admins cannot submit custom questions targeting a restricted topic. Because the classification is automated, Anthropic is explicit that there is no guaranteed detection rate.
Credit where it is due: the guardrails are real. The problem is that they are probabilistic, and the governance conversation Anthropic leaves to the customer is the one most customers are not prepared to have. Gartner’s 2025 AI governance survey found that 61% of organizations still had no formal AI usage policy, while 43% had deployed generative tools to 500 or more employees. That gap is where the trouble starts.
Protected categories, default-hidden names, and reveal logging are thoughtful engineering. They are also vendor defaults. Consent, notice, purpose limitation, and proportionality sit with the employer. A toggle does not satisfy a regulator, and a compliance page is not legal review.
The metric is wrong before the ethics are
Strip the privacy argument out for a second and look at what Smart Reports measures. It measures usage. It measures token spend. It measures whether people talk to Claude about the right things. None of those numbers tell you whether the work got better.
Impressions are not pipeline. Sessions are not shipped work. A 40-person team can burn $40,000 in tokens across 6,000 sessions summarizing meetings that should never have happened and produce a beautiful 2,000-word report that proves it. The dashboard shows engagement at 92%. The business shows nothing. LinkedIn’s 2024 workplace data put the average cost of a wasted enterprise meeting at $1,200 in salary time; a 12-person leadership team holding 3 such meetings a week burns $187,200 a year before AI touches it.
The question worth asking about every campaign is the question worth asking about every AI session: what changed because this happened? Did a rep close a deal 3 days faster? Did an analyst catch an error before it reached a $2 million client? Did a writer ship a piece that generated 5 qualified conversations? Those are outcomes. Smart Reports cannot see them, because the outcome lives in the CRM, the repository, or the revenue line, and the report only knows what happened inside the chat window.
Cost visibility is genuinely useful. Spend is real, and enterprise AI budgets are under scrutiny in every Q4 planning cycle from 2026 onward. But cost without context invites the wrong conversation. An admin who sees a $4,000 workstream and no matching output assumes waste. Often the opposite is true: that session replaced 40 hours of manual research at $150 an hour, or $6,000 in analyst time. Measuring the invoice without measuring the return is how finance kills the programs that were working.
Surveillance changes behavior, and not in the direction you want
The cultural problem is bigger than the legal one. People who know their AI conversations are being read do not stop using AI. They get careful. They stop asking the dumb question that would have taught them something. They stop pasting the messy first draft. They stop using the tool for the uncertain, exploratory work where AI is strongest, the work that looks inefficient on a dashboard and produces the insight nobody else has.
Content teams have run through this dynamic already. The people who got good at AI were the ones who felt safe being bad at it for a month. The first 30 days of any real skill are clumsy. If every clumsy session becomes a line item in a report to a manager, the learning stops inside 2 weeks. You end up with a workforce that uses AI only for safe, sanctioned, low-value tasks, drafting routine emails and formatting documents, while the high-value thinking goes back to being done alone, unobserved, and unimproved.
Microsoft’s 2024 Work Trend Index found that 78% of AI users bring their own tools to work, up from 67% in 2023. Shadow AI is not a discipline problem. It is a surveillance response.
Surveillance signals distrust. A company that reads your chats tells you, in the most concrete way available, that it expects you to misuse the tool. People reciprocate that expectation. They withhold. They perform. They game the metric. The report says usage is up 40% month over month. The business says the 12 best people are leaving. That is an expensive way to buy a dashboard.
The governance gap is the real story
Anthropic’s controls reflect product decisions. Whether a rollout is lawful depends on local employment law, data-protection rules, works-council obligations, and the contracts a company signed with its own people. Anthropic’s documentation says technical access is not legal permission. Consent, notice, proportionality, purpose limitation, and data minimization sit with the employer, not the model vendor. Some jurisdictions have already moved to restrict how cloud providers handle sensitive workplace data. A product toggle does not satisfy a regulator.
This is where most enterprises stumble. The feature ships turned off. Somebody turns it on because it is there and the license covers it. Nobody checks whether the employee handbook discloses session-level monitoring, whether the works council was consulted, whether the retention policy matches what the tool stores, or whether the local regulator treats AI chat logs as employee monitoring under a stricter regime than the vendor’s terms assume.
Under GDPR alone, unlawful workplace monitoring can draw fines of €20 million or 4% of global annual revenue, whichever is higher; California’s CCPA adds statutory damages of $2,500 to $7,500 per violation. The vendor’s compliance page is not legal review. A lawyer’s sign-off is legal review.
The reveal logging is good design. It creates accountability. It does not create consent. Those are different things, and conflating them is how a company ends up explaining itself to a regulator 6 months later.
What to do instead
The strategic move is not to ban the feature. It is to change what you ask it to answer.
What I actually think
Anthropic is not the villain. The company shipped a capable tool with genuine protections and disclosed the limits in public documentation.
The villain is the management reflex that reaches for a dashboard whenever it feels uncertain, and I have watched it take over every time a new metric becomes available. Marketing leaders did this with vanity metrics from 2010 to 2025. HR and operations leaders are doing it with AI usage now, across 3,000-seat Claude Enterprise deployments.
The reflex says: if it can be measured, it can be managed. The reality says the things worth measuring in knowledge work, judgment, initiative, and willingness to experiment, do not show up in a session summary. They show up 6 months later in the quality of the work and the retention of the people doing it.
A tool that makes people afraid to think out loud is not an oversight tool. It is a tax on the exact capability the company hired for. Salesforce learned this in 2019, when Einstein Activity Capture monitored rep email across 40,000 seats and the rollout stalled for 18 months.
The bottom line
Anthropic built a capable monitoring product and shipped it with real guardrails. That deserves respect. It is still not a management strategy. The companies that turn AI into an advantage will use these reports to understand their systems, not to supervise their people. They will measure what changed in the business, not what happened in the chat window. They will accept that the messy, exploratory, sometimes expensive work is where the learning happens, and they will defend the conditions that make it possible.
The alternative is a workplace where everyone is watched and nobody is thinking. That is not a productivity problem. It is a leadership problem, and no dashboard will fix it.
Before you turn Smart Reports on, write down the 3 business outcomes AI usage should produce this quarter and the 5 metrics that prove it. Pick the reviewer and publish the retention window. Then let the tool answer one question only: where is the work getting stuck? Fix that workflow, coach that team, and leave the person out of it.
Smart Reports measures activity, not outcomes, and surveillance changes behavior in the direction you least want: people stop experimenting where AI is strongest. Use the data to understand your systems, be explicit with your people about what is collected and what is never used against them, and keep the governance, notice, and consent with the employer. A dashboard can tell you when a team is busy. It can never tell you whether they thought.
Build the system, not the surveillance →
