80% of Anthropic's Code Is Written by AI. The Supervision Problem Is Yours Now Too.
Anthropic revealed that AI writes 80% of its own code — and called for a global pause option in case something goes wrong at scale. If you're using AI for any workflow output that matters, you already face the same question: how do you maintain oversight when volume outpaces review?
By Patin Team · Examples are illustrative composites
When the volume of AI-generated work in your workflows exceeds what you can read before it goes out, you have two choices: design a review system, or accept that you're not reviewing. The first requires intention. The second happens by default.
What Anthropic published this week
On June 4, Anthropic published engineering details revealing that AI now writes 80% of the code at Anthropic — the company building the AI. In the same post, they called for a global "pause option": a mechanism to halt AI systems if something goes wrong at a scale that outpaces human ability to catch it in real time. The Hacker News thread reached 520 points. One comment cut through the noise: "lines merged" isn't the same as "thinking done." Even Anthropic's engineers aren't treating AI-merged code as reviewed code. They're designing for the fact that review won't always keep up — not assuming it will. (Source: Anthropic engineering blog, June 4, 2026.)
The supervision problem isn't special to AI companies
If you're managing any workflow where AI contributes output — reports, client-facing communications, data analysis, product copy — you're already in a version of this position. The question isn't whether AI makes mistakes. It does. The question is what your review process looks like when you can't read everything before it goes out.
Most teams' default is informal: check what you get to, trust the rest, fix problems reactively. That's not oversight. That's hope.
Three tiers to decide about any AI-assisted workflow:
- Full review. What output types require human approval before they leave? (Usually: anything irreversible, high-stakes, or public-facing with your name on it.)
- Sampling. What can you review 20% of and flag anomalies? (Usually: repetitive, lower-stakes outputs where a pattern of errors is more dangerous than a single error.)
- Post-send audit. What can you catch after the fact from outcome data? (Usually: volume outputs where downstream signals — complaint rates, escalations, open rates — surface problems faster than pre-send review.)
The tier isn't determined by how much you trust the AI. It's determined by the consequences of a specific output being wrong.
Laura: the marketing manager running 40 emails a quarter
Laura manages content at a 180-person healthcare software company. She uses AI to draft the quarterly product update emails — 40 versions across customer segments, each adjusted for role and company size. She can't read all 40 before they send.
Her oversight design: enterprise-tier emails (8 per quarter) get full review — she reads every line before the send. Mid-market emails (20 per quarter) get sampling — she reads 4, checks tone and clinical accuracy, flags anything that reads as templated rather than specific. SMB-tier emails (12 per quarter) go out on sampling plus post-send: she monitors open rates and support escalations in the 48 hours after.
This wasn't complicated to build. It took one working session to agree on the categories and checkpoints. Before she designed it, her review process was "whatever I got to before deadline."
Ravi: the operations lead who caught the gap
Ravi is operations manager at a 55-person import logistics firm. His team uses AI to draft supplier update emails, extract key terms from freight contracts, and generate weekly variance reports from spreadsheet data.
The problem he noticed: he was applying the same level of attention — moderate, time-pressured — to all three. Supplier emails are recoverable if wrong. A missed contract clause is not. Variance report errors stay invisible until they compound.
He mapped each output type to a review tier. Contract clause extraction: full review, every time. Supplier emails: 1-in-5 sampling, with a standing rule that any email about a dispute goes to full review regardless of the cadence. Variance reports: a short checklist of three numbers that always get verified against source data; the rest reviewed monthly.
The mapping took an afternoon. Most of the time was spent agreeing on what "wrong" actually meant for each output type, and who was accountable for catching it before it mattered.
The practical version of the pause option
Anthropic's pause option is designed for a scale problem — AI systems producing output faster than any team of humans can review. Your version is smaller, but it's the same shape: AI outputs reaching clients, colleagues, or decision-makers without anyone reading them first.
The cases where oversight fails aren't usually cases of obvious error. They're cases where volume, speed, or habit meant something went out that no one read. Designing for that in advance — before the incident that makes you wish you had — is what supervision looks like when volume exceeds your review capacity.
Put this into practice
Reading is a start — but skill comes from doing. Try these drills now.
Reading about it only gets you so far
Patin turns this into five-minute drills that score what you write and tell you why. It's in closed beta — join the waitlist and we'll email you when your cohort opens.
Just want the writing? .
Keep reading on this
One Agent Taught You to Supervise. Five Is a Different Job.
OpenAI's own researchers now run more agent-workdays than human ones. Watching a second and third agent isn't a bigger version of watching your first — it's a different problem, and most people are solving the wrong one.
5 min readYour Agents Started Talking to Each Other. Supervising One Didn't Prepare You for That.
The scope and guardrails you built for one agent don't cover what happens when it hands off to a second agent instead of to you. Here's what changes when agents work together.
6 min readAI Agents Can Now Click Through Your Workflow. The Question Is: Should You Let Them?
Anthropic moved computer use, browser use, the Files API, and the Skills API to general availability on August 19 — meaning production SLAs, not beta disclaimers. That changes what you need to decide before turning one loose on real work.
4 min read