The Intelligence Distraction
Why "how smart is AI?" is the wrong question
If a billion-dollar AI scored 200 on an IQ test, what would change most about the world?
Pick one. Then scroll.
"How smart is the AI?"
It's the question every magazine cover asks. Every panel debate. Every chart of model performance on benchmarks.
It's also the wrong question. Or rather: it's a real question, just not the one that explains the economics of what's happening.
ScrollIf "smarter AI → bigger impact" were the rule, then GPT-4 would sit cleanly in the top-right of this chart.
Plot it. There it is. High IQ. High impact. The story seems to confirm itself.
Until you add the next dot.
ScrollOtter doesn't reason. It transcribes. Speech-to-text. A model that would have looked unremarkable in 2010.
It also restructured 50 million meetings per day. Note-taking is now AI's job. The person who used to take notes does something else. Or doesn't get hired in the first place.
Low intelligence. Massive impact. The line breaks.
ScrollTikTok's recommender doesn't even read the videos. It watches what you watch.
One billion humans. Two hours a day each. The thing deciding what they see has no language model, no reasoning, no understanding. Just engagement signal.
Zero intelligence in the AI sense. Civilization-scale impact.
ScrollAnd Tesla's autopilot is brilliant — at one thing. It can stay in a lane, follow traffic, brake when a kid runs out.
Its impact is real but contained. It hasn't restructured anything beyond the cabin. The model is sharp; the placement is narrow.
Four dots. None on the expected line.
ScrollPlot the rest of the AI economy and the picture only gets worse. The correlation between model intelligence and real-world impact rounds to zero.
The intelligence is real. The impact is real. They just don't track each other.
If two variables don't correlate, one of them is the wrong axis to debate.
ScrollThe intelligence is the distraction. The system around it — what it routes, who depends on it, what it lets a system see — is the story.
"How smart is the AI" is a consumer-magazine question. Where does it sit in the system is the strategy question.
And the strategy question is the only one that pays.
Sangeet on this in Chapter 2 ↗
Scroll