Terence Tao – Kepler, Newton, and the true nature of mathematical discovery
Episode
83 min
Read time
3 min
Topics
Productivity, Design & UX, Artificial Intelligence
AI-Generated Summary
Key Takeaways
- ✓AI Verification Bottleneck: AI has reduced hypothesis generation costs to near zero, but verification hasn't scaled to match. Journals report being flooded with AI-generated submissions that overwhelm peer review systems. The critical constraint in science is now evaluating which of thousands of generated theories represent real progress — a structural problem that existing scientific institutions were not designed to handle at this volume or speed.
- ✓AI Math Success Rate: Large-scale systematic sweeps of Erdős problems reveal AI tools solve roughly 1-2% of problems attempted. The 50 problems solved out of ~1,100 look impressive in aggregate, but only because scale allows cherry-picking wins. Nearly all AI-solved problems had minimal prior literature — they required combining one obscure technique with an existing result, which represents the current median capability ceiling for autonomous AI math.
- ✓Breadth vs. Depth Complementarity: AI systems excel at breadth — applying known techniques across thousands of problems simultaneously — while human experts excel at depth. Tao recommends redesigning mathematical workflows to exploit this: use AI to map new fields, clear low-difficulty problems, and identify "islands of difficulty," then direct human expertise specifically at those resistant clusters rather than distributing human attention broadly across all open problems.
- ✓Cumulative Progress Gap: Current AI lacks the ability to build on partial progress within a problem. Models run a session, fail, and restart with no retained understanding — they cannot identify a partial handhold, consolidate it, and attempt the next step from that position. This trial-and-error-without-accumulation pattern is the core distinction Tao draws between "artificial cleverness" and genuine mathematical intelligence, which requires adaptive, iterative strategy refinement.
- ✓Formal Strategy Language: Lean and similar proof assistants have automated deductive verification, but no equivalent formal language exists for mathematical strategy or plausibility assessment. Tao argues that formalizing how mathematicians evaluate whether a conjecture is worth pursuing — the semi-structured reasoning between raw data and full proof — could unlock the next wave of AI-assisted discovery, similar to how axiomatizing logic enabled automated theorem proving.
What It Covers
Terence Tao uses Kepler's 83-year journey from Platonic solid theories to elliptical orbit laws as a framework for analyzing where AI currently fits in mathematical discovery — covering hypothesis generation, verification bottlenecks, the Erdős problem dataset, AI success rates of 1-2% per problem, and what "artificial cleverness" versus genuine intelligence means for the future of math research.
Key Questions Answered
- •AI Verification Bottleneck: AI has reduced hypothesis generation costs to near zero, but verification hasn't scaled to match. Journals report being flooded with AI-generated submissions that overwhelm peer review systems. The critical constraint in science is now evaluating which of thousands of generated theories represent real progress — a structural problem that existing scientific institutions were not designed to handle at this volume or speed.
- •AI Math Success Rate: Large-scale systematic sweeps of Erdős problems reveal AI tools solve roughly 1-2% of problems attempted. The 50 problems solved out of ~1,100 look impressive in aggregate, but only because scale allows cherry-picking wins. Nearly all AI-solved problems had minimal prior literature — they required combining one obscure technique with an existing result, which represents the current median capability ceiling for autonomous AI math.
- •Breadth vs. Depth Complementarity: AI systems excel at breadth — applying known techniques across thousands of problems simultaneously — while human experts excel at depth. Tao recommends redesigning mathematical workflows to exploit this: use AI to map new fields, clear low-difficulty problems, and identify "islands of difficulty," then direct human expertise specifically at those resistant clusters rather than distributing human attention broadly across all open problems.
- •Cumulative Progress Gap: Current AI lacks the ability to build on partial progress within a problem. Models run a session, fail, and restart with no retained understanding — they cannot identify a partial handhold, consolidate it, and attempt the next step from that position. This trial-and-error-without-accumulation pattern is the core distinction Tao draws between "artificial cleverness" and genuine mathematical intelligence, which requires adaptive, iterative strategy refinement.
- •Formal Strategy Language: Lean and similar proof assistants have automated deductive verification, but no equivalent formal language exists for mathematical strategy or plausibility assessment. Tao argues that formalizing how mathematicians evaluate whether a conjecture is worth pursuing — the semi-structured reasoning between raw data and full proof — could unlock the next wave of AI-assisted discovery, similar to how axiomatizing logic enabled automated theorem proving.
- •Productivity Shift in Practice: Tao reports AI has changed the character of his papers more than their speed. Tasks like literature searches, generating numerical plots, and reformatting LaTeX now take minutes instead of hours, enabling richer papers with more code and visuals. However, the core work — solving the hardest 20% of a problem where existing methods fail — remains unchanged and still requires pen and paper without meaningful AI assistance.
Notable Moment
Tao notes that Copernicus's heliocentric model was actually less accurate than Ptolemy's geocentric system when first proposed — Kepler made it more precise decades later. A simpler but initially worse theory can still represent genuine progress, which raises the unresolved question of how any automated system would recognize that distinction in real time.
Episode Transcript
Okay. Today, I'm chatting with Terrence Tao, who needs some introduction. Terrence, I wanna begin by having you retell the story of how Kepler discovered the laws of planetary motion, because I think this will be a great jumping off point to talk about AI for math. Okay. Yeah. So I've always had an amateur interest in astronomy, and so I've I've I've loved stories of how the early astronomers worked out, the nature of the universe. So, Kepler was building on the work of Copernicus, who is himself building on the work of Aristarchus. So, Copernicus very famously proposed the heliocentric model that, instead of the planets and the sun going around the Earth, that the sun was at the center of the solar system and the other planets were going around, the sun. And Copernicus proposed that the orbits of the planets were perfect circles. And his theory kind of fits, the observations that, the the Greeks and the Arabs and Indians had worked out over over centuries. I think, Kepler got interested like, he learned about these these theories, in his in his studies, and he made this observation that the ratios of the, size of the orbits that predicted seem to have some geometric meaning. I think, he he started proposing that, you know, if you if you take, say, the orbit of of, let's say, the Earth and you enclose it in, I think, maybe a cube, the, the outer sphere of that that encloses the cube almost matched perfectly the orbit of Mars and so forth. And there were six planets, none at the time, five gaps between them, and there were five perfect platonic solids, the cube, the tetrahedron, isocletion, octahedron, and dodecahedron. And so he had this this theory which he thought was absolutely beautiful that he could inscribe these platonic solids between the spheres of the planets, and it seemed to fit. And it it it seemed to read to him like, you know, God's design of the planets was was matching this mathematical perfection of the platonic solids. So he needed data to, confirm this theory. And at the time, there was only one really high quality dataset, almost in existence, okay, which was the so, Tycho Brahe, this Danish astronomer, very wealthy eccentric astronomer, had managed to convince the Danish government to fund this extremely expensive observatory. This, in fact, an entire island, where he had taken decades of observations of all the planets, Mars, Jupiter, every night of at least every night for which the weather was clear. With the naked eye, actually, this is, he was the last of the of the naked eye astronomers. And so he had all this data which Kepler could use to confirm his theory. And so Kepler started working with with Tycho, but Tycho was very jealous of the data. He only gave little bit bits of it at a time. And I think, Kepler eventually just stole the data. He …
Get the full transcript (16,206 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 80-minute episode.
Get Dwarkesh Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Dwarkesh Podcast
Why smarter AI models could drive up compute prices 10x
Aug 3 · 11 min
No Priors: Artificial Intelligence | Technology | Startups
Travel Through the Lens of AI with with Booking.com CEO Glenn Fogel
Jul 9
More from Dwarkesh Podcast
Adam Brown – A deep but accessible introduction to general relativity
Jul 10 · 98 min
My First Million
I dropped out of college and built a $3.6B company from scratch
Jul 2
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
“Lean and similar proof assistants have automated deductive verification, but no equivalent formal language exists for mathematical strategy or plausibility assessment.”
More from Dwarkesh Podcast
We summarize every new episode. Want them in your inbox?
Why smarter AI models could drive up compute prices 10x
Adam Brown – A deep but accessible introduction to general relativity
Grant Sanderson – AI and the future of math
The next big breakthrough will be AIs learning on the job
The data black hole at the center of AI
Similar Episodes
Related episodes from other podcasts
No Priors: Artificial Intelligence | Technology | Startups
Jul 9
Travel Through the Lens of AI with with Booking.com CEO Glenn Fogel
My First Million
Jul 2
I dropped out of college and built a $3.6B company from scratch
Startups For the Rest of Us
Jun 30
Episode 839 | The Journey Growing Help Scout to $35M ARR
20VC (20 Minute VC)
Jun 29
20VC: Leo Aschenbrenner's Largest Holding: Inside the $90BN Bloom Energy | Why Electricity, Not AI Models, Will Decide the Winners of the AI Race | Why We Are Not in an AI Capex Bubble | Energy Sovereignty and The Future of Power with KR Sridhar
Stuff You Should Know
Jun 25
Freetown Christiania
Explore Related Topics
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Dwarkesh Podcast.
Every Monday, we deliver AI summaries of the latest episodes from Dwarkesh Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime