Skip to main content
Dwarkesh Podcast

Terence Tao – Kepler, Newton, and the true nature of mathematical discovery

83 min episode · 3 min read
·

Episode

83 min

Read time

3 min

Topics

Productivity, Design & UX, Artificial Intelligence

AI-Generated Summary

Key Takeaways

  • AI Verification Bottleneck: AI has reduced hypothesis generation costs to near zero, but verification hasn't scaled to match. Journals report being flooded with AI-generated submissions that overwhelm peer review systems. The critical constraint in science is now evaluating which of thousands of generated theories represent real progress — a structural problem that existing scientific institutions were not designed to handle at this volume or speed.
  • AI Math Success Rate: Large-scale systematic sweeps of Erdős problems reveal AI tools solve roughly 1-2% of problems attempted. The 50 problems solved out of ~1,100 look impressive in aggregate, but only because scale allows cherry-picking wins. Nearly all AI-solved problems had minimal prior literature — they required combining one obscure technique with an existing result, which represents the current median capability ceiling for autonomous AI math.
  • Breadth vs. Depth Complementarity: AI systems excel at breadth — applying known techniques across thousands of problems simultaneously — while human experts excel at depth. Tao recommends redesigning mathematical workflows to exploit this: use AI to map new fields, clear low-difficulty problems, and identify "islands of difficulty," then direct human expertise specifically at those resistant clusters rather than distributing human attention broadly across all open problems.
  • Cumulative Progress Gap: Current AI lacks the ability to build on partial progress within a problem. Models run a session, fail, and restart with no retained understanding — they cannot identify a partial handhold, consolidate it, and attempt the next step from that position. This trial-and-error-without-accumulation pattern is the core distinction Tao draws between "artificial cleverness" and genuine mathematical intelligence, which requires adaptive, iterative strategy refinement.
  • Formal Strategy Language: Lean and similar proof assistants have automated deductive verification, but no equivalent formal language exists for mathematical strategy or plausibility assessment. Tao argues that formalizing how mathematicians evaluate whether a conjecture is worth pursuing — the semi-structured reasoning between raw data and full proof — could unlock the next wave of AI-assisted discovery, similar to how axiomatizing logic enabled automated theorem proving.

What It Covers

Terence Tao uses Kepler's 83-year journey from Platonic solid theories to elliptical orbit laws as a framework for analyzing where AI currently fits in mathematical discovery — covering hypothesis generation, verification bottlenecks, the Erdős problem dataset, AI success rates of 1-2% per problem, and what "artificial cleverness" versus genuine intelligence means for the future of math research.

Key Questions Answered

  • AI Verification Bottleneck: AI has reduced hypothesis generation costs to near zero, but verification hasn't scaled to match. Journals report being flooded with AI-generated submissions that overwhelm peer review systems. The critical constraint in science is now evaluating which of thousands of generated theories represent real progress — a structural problem that existing scientific institutions were not designed to handle at this volume or speed.
  • AI Math Success Rate: Large-scale systematic sweeps of Erdős problems reveal AI tools solve roughly 1-2% of problems attempted. The 50 problems solved out of ~1,100 look impressive in aggregate, but only because scale allows cherry-picking wins. Nearly all AI-solved problems had minimal prior literature — they required combining one obscure technique with an existing result, which represents the current median capability ceiling for autonomous AI math.
  • Breadth vs. Depth Complementarity: AI systems excel at breadth — applying known techniques across thousands of problems simultaneously — while human experts excel at depth. Tao recommends redesigning mathematical workflows to exploit this: use AI to map new fields, clear low-difficulty problems, and identify "islands of difficulty," then direct human expertise specifically at those resistant clusters rather than distributing human attention broadly across all open problems.
  • Cumulative Progress Gap: Current AI lacks the ability to build on partial progress within a problem. Models run a session, fail, and restart with no retained understanding — they cannot identify a partial handhold, consolidate it, and attempt the next step from that position. This trial-and-error-without-accumulation pattern is the core distinction Tao draws between "artificial cleverness" and genuine mathematical intelligence, which requires adaptive, iterative strategy refinement.
  • Formal Strategy Language: Lean and similar proof assistants have automated deductive verification, but no equivalent formal language exists for mathematical strategy or plausibility assessment. Tao argues that formalizing how mathematicians evaluate whether a conjecture is worth pursuing — the semi-structured reasoning between raw data and full proof — could unlock the next wave of AI-assisted discovery, similar to how axiomatizing logic enabled automated theorem proving.
  • Productivity Shift in Practice: Tao reports AI has changed the character of his papers more than their speed. Tasks like literature searches, generating numerical plots, and reformatting LaTeX now take minutes instead of hours, enabling richer papers with more code and visuals. However, the core work — solving the hardest 20% of a problem where existing methods fail — remains unchanged and still requires pen and paper without meaningful AI assistance.

Notable Moment

Tao notes that Copernicus's heliocentric model was actually less accurate than Ptolemy's geocentric system when first proposed — Kepler made it more precise decades later. A simpler but initially worse theory can still represent genuine progress, which raises the unresolved question of how any automated system would recognize that distinction in real time.

Know someone who'd find this useful?

Episode Transcript

Okay. Today, I'm chatting with Terrence Tao, who needs some introduction. Terrence, I wanna begin by having you retell the story of how Kepler discovered the laws of planetary motion, because I think this will be a great jumping off point to talk about AI for math. Okay. Yeah. So I've always had an amateur interest in astronomy, and so I've I've I've loved stories of how the early astronomers worked out, the nature of the universe. So, Kepler was building on the work of Copernicus, who is himself building on the work of Aristarchus. So, Copernicus very famously proposed the heliocentric model that, instead of the planets and the sun going around the Earth, that the sun was at the center of the solar system and the other planets were going around, the sun. And Copernicus proposed that the orbits of the planets were perfect circles. And his theory kind of fits, the observations that, the the Greeks and the Arabs and Indians had worked out over over centuries. I think, Kepler got interested like, he learned about these these theories, in his in his studies, and he made this observation that the ratios of the, size of the orbits that predicted seem to have some geometric meaning. I think, he he started proposing that, you know, if you if you take, say, the orbit of of, let's say, the Earth and you enclose it in, I think, maybe a cube, the, the outer sphere of that that encloses the cube almost matched perfectly the orbit of Mars and so forth. And there were six planets, none at the time, five gaps between them, and there were five perfect platonic solids, the cube, the tetrahedron, isocletion, octahedron, and dodecahedron. And so he had this this theory which he thought was absolutely beautiful that he could inscribe these platonic solids between the spheres of the planets, and it seemed to fit. And it it it seemed to read to him like, you know, God's design of the planets was was matching this mathematical perfection of the platonic solids. So he needed data to, confirm this theory. And at the time, there was only one really high quality dataset, almost in existence, okay, which was the so, Tycho Brahe, this Danish astronomer, very wealthy eccentric astronomer, had managed to convince the Danish government to fund this extremely expensive observatory. This, in fact, an entire island, where he had taken decades of observations of all the planets, Mars, Jupiter, every night of at least every night for which the weather was clear. With the naked eye, actually, this is, he was the last of the of the naked eye astronomers. And so he had all this data which Kepler could use to confirm his theory. And so Kepler started working with with Tycho, but Tycho was very jealous of the data. He only gave little bit bits of it at a time. And I think, Kepler eventually just stole the data. He …

Get the full transcript (16,206 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Dwarkesh Podcast transcripts →

You just read a 3-minute summary of a 80-minute episode.

Get Dwarkesh Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links.

Tools

  • Lean and similar proof assistants have automated deductive verification, but no equivalent formal language exists for mathematical strategy or plausibility assessment.

More from Dwarkesh Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into Dwarkesh Podcast.

Every Monday, we deliver AI summaries of the latest episodes from Dwarkesh Podcast and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime