How AI Is Upending the World of Mathematics
Episode
60 min
Read time
3 min
Topics
Career Growth, Productivity, Design & UX
AI-Generated Summary
Key Takeaways
- ✓Proof verification via Lean: AI models generate mathematical proofs but cannot reliably self-check them. The productive workflow pairs a large language model with Lean, a formal programming language that independently verifies each logical step against built-in axioms. This human-AI-software triangle produces results the math community can trust more than AI output alone, and represents the current state-of-the-art in AI-assisted theorem proving.
- ✓Academic publishing breakdown: Machine learning conference submissions have grown from roughly 1,000–2,000 to 60,000 annually at venues like ICLR over the past decade. This volume breaks peer review entirely — reviewers lack bandwidth to open every PDF, and anecdotal reports describe high school students being assigned as peer reviewers. Any field relying on conference publication as a quality signal should treat that signal as significantly degraded.
- ✓Compute access as competitive advantage: When news of progress toward the Navier-Stokes counterexample emerged, OpenAI reportedly redirected substantial compute resources to publish a proof first. Individual academic mathematicians cannot match that capacity. A $200-per-month cloud AI account already creates equity gaps among PhD students, and the gap between frontier internal models and publicly available models compounds this structural disadvantage further.
- ✓AI operates inside the "convex hull" of existing knowledge: Current models excel at recombining and extending known mathematical facts in novel ways but have not demonstrated the ability to generate genuinely new conjectures or theoretical frameworks from scratch. The distinction matters for AGI claims — brute-forcing a well-defined open problem differs fundamentally from identifying which problems are worth asking in the first place, a judgment that remains human-driven.
- ✓Assessment redesign for AI-era classrooms: Solomon's MIT course now pairs traditional problem sets with immediate follow-up quizzes using near-identical problems to verify student comprehension rather than AI capability. Projects require oral presentation components. The framing shift treats homework as weightlifting — process-oriented skill-building — rather than output production. Institutions can adapt this two-layer assessment model without abandoning mathematical rigor.
What It Covers
MIT Associate Dean of Engineering Justin Solomon joins Odd Lots to examine how AI models are reshaping mathematics — from the recent AI-assisted Navier-Stokes counterexample to collapsing academic peer review systems. The conversation covers proof verification tools like Lean, credit attribution challenges, and how math education at institutions like MIT is restructuring around experiential learning rather than problem sets.
Key Questions Answered
- •Proof verification via Lean: AI models generate mathematical proofs but cannot reliably self-check them. The productive workflow pairs a large language model with Lean, a formal programming language that independently verifies each logical step against built-in axioms. This human-AI-software triangle produces results the math community can trust more than AI output alone, and represents the current state-of-the-art in AI-assisted theorem proving.
- •Academic publishing breakdown: Machine learning conference submissions have grown from roughly 1,000–2,000 to 60,000 annually at venues like ICLR over the past decade. This volume breaks peer review entirely — reviewers lack bandwidth to open every PDF, and anecdotal reports describe high school students being assigned as peer reviewers. Any field relying on conference publication as a quality signal should treat that signal as significantly degraded.
- •Compute access as competitive advantage: When news of progress toward the Navier-Stokes counterexample emerged, OpenAI reportedly redirected substantial compute resources to publish a proof first. Individual academic mathematicians cannot match that capacity. A $200-per-month cloud AI account already creates equity gaps among PhD students, and the gap between frontier internal models and publicly available models compounds this structural disadvantage further.
- •AI operates inside the "convex hull" of existing knowledge: Current models excel at recombining and extending known mathematical facts in novel ways but have not demonstrated the ability to generate genuinely new conjectures or theoretical frameworks from scratch. The distinction matters for AGI claims — brute-forcing a well-defined open problem differs fundamentally from identifying which problems are worth asking in the first place, a judgment that remains human-driven.
- •Assessment redesign for AI-era classrooms: Solomon's MIT course now pairs traditional problem sets with immediate follow-up quizzes using near-identical problems to verify student comprehension rather than AI capability. Projects require oral presentation components. The framing shift treats homework as weightlifting — process-oriented skill-building — rather than output production. Institutions can adapt this two-layer assessment model without abandoning mathematical rigor.
- •Credit attribution in AI-assisted proofs is unresolved: The Navier-Stokes counterexample involved years of foundational work by a Spanish mathematics team, followed by AI completing the final steps. No clear framework exists for assigning academic credit, hiring weight, or prize eligibility in such cases. The Clay Mathematics Institute's $1 million prize criteria require multi-year community verification, and OpenAI has already stated it does not need the money — removing the traditional incentive structure entirely.
Notable Moment
Solomon revealed that after testing AI tools on open problems in his own research area, the model produced a superficial result and then automatically offered to format it as a journal submission — complete with a note claiming the result appeared novel. He connects this directly to the flood of unsolicited emails he now receives from non-mathematicians seeking MIT validation of AI-generated proofs.
Episode Transcript
00:00:00 Speaker 1: Hey, Odd Lots listeners, the Odd Lots tour continues and our next stop is in Chicago. 00:00:04 Speaker 2: That's right. Joe and I will be at the City Winery Chicago on October 15th for a live Odd Lots recording. Tickets are on sale now at Bloomberg.com forward slash Odd Lots. 00:00:14 Speaker 1: And of course, a special thank you to Barclays for supporting Odd Lots Live. 00:00:19 Speaker 2: So that's October 15th at City Winery in Chicago. Get your tickets now. 00:00:26 Speaker 1: Bloomberg Audio Studios. Podcasts, radio, news. Hello and welcome to another episode of the Odd Laws Podcast. I'm Joe Weisenthal. 00:00:47 Speaker 2: And I'm Tracy Allaway. 00:00:48 Speaker 1: So Tracy, with AI, you know, obviously one of the big concerns is like job loss. What are we going to, in the future, what are humans going to be better at and What. 00:00:59 Speaker 2: Are we going to do all day? 00:01:00 Speaker 1: What are we going to do all day, et cetera? And we really don't know the answer, I think, to any of these questions yet. But I am aware, obviously, the models are getting very good at math, and at least some mathematicians perceive, you know, they're in a state of existential angst about this, and certainly crisis, perhaps, some feel about, like, well, what are we doing here? These problems that I devoted my life to solving and the model solves it in a weekend. Is this what's potentially coming for many of us? 00:01:32 Speaker 2: Yeah. Math is an interesting one because you can tell that a lot of the AI companies themselves have an interest in math. They see math as a sort of holy grail for, I guess, proving that the models are able to reason. It's the thing they need to do and able to say that they've achieved AGI, I think, is the way it's couched. And it also makes good headlines. So even though I have no idea what the Navier-Stokes problem actually is. I don't know even if I'm pronouncing that correctly. Is it Navier or Navier? Okay, Navier-Stokes. I see the headline and I'm like, ooh, a model has solved the Navier-Stokes problem, as if I know what that actually means and the significance for the mathematics profession. 00:02:13 Speaker 1: It's also funny because I downloaded the paper and it's like one paragraph and I have no idea. I can't even begin to parse the output. Another fascinating aspect of this is just, like, it would not have been intuitive to me, say, two years ago or three years ago, that a language model would be so good at mathematics. In fact, at one point, they weren't very good at math at all. Like, go back to, like, I don't know, GPT-3 or GPT-3.5. 00:02:44 Speaker 2: If you asked them to count, like, the number of letters in a word or …
Get the full transcript (12,154 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 57-minute episode.
Get Odd Lots summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Odd Lots
What Everyone Gets Wrong About the Economic Problems in Europe
Oct 8 · 52 min
Software Engineering Daily
AI-Powered Threats to the Software Supply Chain
Aug 4
More from Odd Lots
Why Treasuries Became Risky Again
Oct 5 · 50 min
a16z Podcast
AI Micro Dramas, Generative Media, and the Future of Creativity
Jul 29
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
- LeanRecommended
“The productive workflow pairs a large language model with Lean, a formal programming language that independently verifies each logical step against built-in axioms.”
More from Odd Lots
We summarize every new episode. Want them in your inbox?
What Everyone Gets Wrong About the Economic Problems in Europe
Why Treasuries Became Risky Again
How Airlines Actually Hedge Higher Fuel Prices
Everything in Markets Is Now Moving Incredibly Fast
Why Building a Crosswalk in LA Is Kafkaesque
Similar Episodes
Related episodes from other podcasts
Software Engineering Daily
Aug 4
AI-Powered Threats to the Software Supply Chain
a16z Podcast
Jul 29
AI Micro Dramas, Generative Media, and the Future of Creativity
The School of Greatness
Apr 8
The Real Reason You Keep Stopping Before You Succeed | Dean Graziosi
Latent Space
Mar 5
Every Agent Needs a Box — Aaron Levie, Box
Stacking Benjamins
Jan 23
How to Afford Life Without Living Like a Monk (SB1794)
Explore Related Topics
This podcast is featured in Best Finance Podcasts (2026) — ranked and reviewed with AI summaries.
You're clearly into Odd Lots.
Every Monday, we deliver AI summaries of the latest episodes from Odd Lots and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime