What to Learn When the Tools Change Every Quarter
Tool-specific knowledge expires within a year. The skills underneath it don't. Here's how to tell which is which, so you invest in the half that's still worth something next spring.
By Patin Team · Examples are illustrative composites
A reasonable objection to investing in AI skills: the tools change every few months, so anything learned now is obsolete by spring.
Half right. Tool-specific knowledge does expire — where a setting lives, which model handles which thing best, the syntax of a particular feature. Learn it, use it, expect to relearn it.
But that half is also the cheap half. It takes hours to acquire and it's rarely what separates people who get value from AI from people who don't. The expensive half — the part that takes months and actually predicts outcomes — has been stable through every model generation so far, because it isn't about the tools at all.
The test: would this have been true two years ago?
Take any AI skill and ask whether it would have applied to the previous generation of tools, and whether it will plausibly apply to the next.
Knowing that a vague request produces a vague answer. True of every model ever shipped. Will be true of the next one.
Knowing that a well-formatted answer can be confidently wrong. Same.
Knowing which of your tasks are worth handing over at all. Depends on your job, not on the tool.
Knowing where the reasoning-effort toggle is in this month's interface. Expires.
The durable skills are all about the relationship between a task, a description of that task, and a judgement about the result. None of that is a property of the model.
The four that have held
Describing work precisely. The single highest-return skill and the least technical. It's briefing, and it transfers to delegating to people.
Knowing what to hand over. Requires knowing your own job well enough to tell which parts are production-hard and which are judgement-hard. Nothing about a new model changes that answer.
Evaluating quickly. As producing gets cheaper, judging becomes the constraint. This one has become more valuable with each generation, not less.
Deciding what a tool may do unasked. Newer than the others — it only became relevant when tools started taking actions — but it's a permissions question, and permissions questions outlive whatever is holding the permission.
What's genuinely worth relearning each cycle
Not nothing. Two things justify the churn:
What the current generation is newly good at. Capability changes shift the boundary of what's worth delegating. A task that wasn't worth handing over eighteen months ago may be now, and you only find out by occasionally retrying things that failed.
What it's newly bad at, or bad at differently. Failure modes shift. When models got better at sounding authoritative, the detectability of their errors dropped — same error rate, harder to spot. That's worth tracking.
Both take an afternoon a quarter. Neither requires following release notes weekly.
How to actually invest
Practise the durable skills on real work, not on tutorials. The skills are judgement-shaped, and judgement only develops against real consequences.
Retry your failures quarterly. Keep a short list of tasks AI couldn't do well. Try them again occasionally. That list is your personal map of the moving boundary, and it's more useful than any benchmark.
Ignore most tool news. The release that matters will still matter in a month. Reading about it then costs nothing and saves the weekly churn.
Nour — the list she keeps
Nour is a strategy consultant. Rather than following AI news, she keeps a note with six tasks AI has previously failed at for her — a particular kind of stakeholder analysis, a specific data reconciliation, two others.
Once a quarter she retries them, which takes an afternoon. Two have moved onto the "works now" side in the past year. The rest haven't.
Her view: the list tells her more about what she should be delegating than any amount of release coverage, and it costs four afternoons a year.
Ivo — the skill that transferred
Ivo manages a small engineering team. He'd spent six months getting deliberately better at briefing AI — audience, constraints, what done looks like, what to do when stuck.
The unexpected return was on his people. The discipline of writing a brief that a system with no context could execute turned out to be exactly the discipline his delegation to juniors had been missing. He'd been briefing them the way he used to brief AI: a topic and an assumption they'd fill the gaps.
His own summary: he learned to manage by learning to prompt, which he did not expect and can't unsee.
The one thing
Tool knowledge expires and is cheap to reacquire. The skills underneath — describing work precisely, knowing what to hand over, judging fast, deciding what a tool may do — have survived every model generation so far, because none of them are about the model.
Invest there, retry your failures quarterly, and let most of the news go past.
Put this into practice
Reading is a start — but skill comes from doing. Try these drills now.
Reading about it only gets you so far
Patin turns this into five-minute drills that score what you write and tell you why. It's in closed beta — join the waitlist and we'll email you when your cohort opens.
Just want the writing? .
Keep reading on this
Learning to Judge When You Used to Produce
Being excellent at making something doesn't make you good at assessing it — they're different skills with different failure modes. Here's what changes when your job quietly becomes evaluation.
5 min readWhat to Keep Doing by Hand
Skills decay when they go unused, and AI makes it easy to stop using several at once. That may be a fine trade — but it should be a decision, not a drift. Here's how to choose deliberately.
5 min readMost People Have the Wrong Mental Model of AI. The Gap Is Getting Dangerous.
There are now two populations in every organisation: people whose understanding of AI is current, and people whose mental model is 12–18 months out of date. They're making decisions together. Andrej Karpathy named the problem this week. Here's how to tell which side you're on — and what to do about it.
6 min read