Skip to main content
Odd Lots

How AI Is Upending the World of Mathematics

60 min episode · 3 min read
·
Justin Solomon

Episode

60 min

Read time

3 min

Topics

Career Growth, Productivity, Design & UX

AI-Generated Summary

Key Takeaways

  • ✓Proof verification via Lean: AI models generate mathematical proofs but cannot reliably self-check them. The productive workflow pairs a large language model with Lean, a formal programming language that independently verifies each logical step against built-in axioms. This human-AI-software triangle produces results the math community can trust more than AI output alone, and represents the current state-of-the-art in AI-assisted theorem proving.
  • ✓Academic publishing breakdown: Machine learning conference submissions have grown from roughly 1,000–2,000 to 60,000 annually at venues like ICLR over the past decade. This volume breaks peer review entirely — reviewers lack bandwidth to open every PDF, and anecdotal reports describe high school students being assigned as peer reviewers. Any field relying on conference publication as a quality signal should treat that signal as significantly degraded.
  • ✓Compute access as competitive advantage: When news of progress toward the Navier-Stokes counterexample emerged, OpenAI reportedly redirected substantial compute resources to publish a proof first. Individual academic mathematicians cannot match that capacity. A $200-per-month cloud AI account already creates equity gaps among PhD students, and the gap between frontier internal models and publicly available models compounds this structural disadvantage further.
  • ✓AI operates inside the "convex hull" of existing knowledge: Current models excel at recombining and extending known mathematical facts in novel ways but have not demonstrated the ability to generate genuinely new conjectures or theoretical frameworks from scratch. The distinction matters for AGI claims — brute-forcing a well-defined open problem differs fundamentally from identifying which problems are worth asking in the first place, a judgment that remains human-driven.
  • ✓Assessment redesign for AI-era classrooms: Solomon's MIT course now pairs traditional problem sets with immediate follow-up quizzes using near-identical problems to verify student comprehension rather than AI capability. Projects require oral presentation components. The framing shift treats homework as weightlifting — process-oriented skill-building — rather than output production. Institutions can adapt this two-layer assessment model without abandoning mathematical rigor.

What It Covers

MIT Associate Dean of Engineering Justin Solomon joins Odd Lots to examine how AI models are reshaping mathematics — from the recent AI-assisted Navier-Stokes counterexample to collapsing academic peer review systems. The conversation covers proof verification tools like Lean, credit attribution challenges, and how math education at institutions like MIT is restructuring around experiential learning rather than problem sets.

Key Questions Answered

  • •Proof verification via Lean: AI models generate mathematical proofs but cannot reliably self-check them. The productive workflow pairs a large language model with Lean, a formal programming language that independently verifies each logical step against built-in axioms. This human-AI-software triangle produces results the math community can trust more than AI output alone, and represents the current state-of-the-art in AI-assisted theorem proving.
  • •Academic publishing breakdown: Machine learning conference submissions have grown from roughly 1,000–2,000 to 60,000 annually at venues like ICLR over the past decade. This volume breaks peer review entirely — reviewers lack bandwidth to open every PDF, and anecdotal reports describe high school students being assigned as peer reviewers. Any field relying on conference publication as a quality signal should treat that signal as significantly degraded.
  • •Compute access as competitive advantage: When news of progress toward the Navier-Stokes counterexample emerged, OpenAI reportedly redirected substantial compute resources to publish a proof first. Individual academic mathematicians cannot match that capacity. A $200-per-month cloud AI account already creates equity gaps among PhD students, and the gap between frontier internal models and publicly available models compounds this structural disadvantage further.
  • •AI operates inside the "convex hull" of existing knowledge: Current models excel at recombining and extending known mathematical facts in novel ways but have not demonstrated the ability to generate genuinely new conjectures or theoretical frameworks from scratch. The distinction matters for AGI claims — brute-forcing a well-defined open problem differs fundamentally from identifying which problems are worth asking in the first place, a judgment that remains human-driven.
  • •Assessment redesign for AI-era classrooms: Solomon's MIT course now pairs traditional problem sets with immediate follow-up quizzes using near-identical problems to verify student comprehension rather than AI capability. Projects require oral presentation components. The framing shift treats homework as weightlifting — process-oriented skill-building — rather than output production. Institutions can adapt this two-layer assessment model without abandoning mathematical rigor.
  • •Credit attribution in AI-assisted proofs is unresolved: The Navier-Stokes counterexample involved years of foundational work by a Spanish mathematics team, followed by AI completing the final steps. No clear framework exists for assigning academic credit, hiring weight, or prize eligibility in such cases. The Clay Mathematics Institute's $1 million prize criteria require multi-year community verification, and OpenAI has already stated it does not need the money — removing the traditional incentive structure entirely.

Notable Moment

Solomon revealed that after testing AI tools on open problems in his own research area, the model produced a superficial result and then automatically offered to format it as a journal submission — complete with a note claiming the result appeared novel. He connects this directly to the flood of unsolicited emails he now receives from non-mathematicians seeking MIT validation of AI-generated proofs.

Know someone who'd find this useful?

Episode Transcript

00:00:00 Speaker 1: Hey, Odd Lots listeners, the Odd Lots tour continues and our next stop is in Chicago. 00:00:04 Speaker 2: That's right. Joe and I will be at the City Winery Chicago on October 15th for a live Odd Lots recording. Tickets are on sale now at Bloomberg.com forward slash Odd Lots. 00:00:14 Speaker 1: And of course, a special thank you to Barclays for supporting Odd Lots Live. 00:00:19 Speaker 2: So that's October 15th at City Winery in Chicago. Get your tickets now. 00:00:26 Speaker 1: Bloomberg Audio Studios. Podcasts, radio, news. Hello and welcome to another episode of the Odd Laws Podcast. I'm Joe Weisenthal. 00:00:47 Speaker 2: And I'm Tracy Allaway. 00:00:48 Speaker 1: So Tracy, with AI, you know, obviously one of the big concerns is like job loss. What are we going to, in the future, what are humans going to be better at and What. 00:00:59 Speaker 2: Are we going to do all day? 00:01:00 Speaker 1: What are we going to do all day, et cetera? And we really don't know the answer, I think, to any of these questions yet. But I am aware, obviously, the models are getting very good at math, and at least some mathematicians perceive, you know, they're in a state of existential angst about this, and certainly crisis, perhaps, some feel about, like, well, what are we doing here? These problems that I devoted my life to solving and the model solves it in a weekend. Is this what's potentially coming for many of us? 00:01:32 Speaker 2: Yeah. Math is an interesting one because you can tell that a lot of the AI companies themselves have an interest in math. They see math as a sort of holy grail for, I guess, proving that the models are able to reason. It's the thing they need to do and able to say that they've achieved AGI, I think, is the way it's couched. And it also makes good headlines. So even though I have no idea what the Navier-Stokes problem actually is. I don't know even if I'm pronouncing that correctly. Is it Navier or Navier? Okay, Navier-Stokes. I see the headline and I'm like, ooh, a model has solved the Navier-Stokes problem, as if I know what that actually means and the significance for the mathematics profession. 00:02:13 Speaker 1: It's also funny because I downloaded the paper and it's like one paragraph and I have no idea. I can't even begin to parse the output. Another fascinating aspect of this is just, like, it would not have been intuitive to me, say, two years ago or three years ago, that a language model would be so good at mathematics. In fact, at one point, they weren't very good at math at all. Like, go back to, like, I don't know, GPT-3 or GPT-3.5. 00:02:44 Speaker 2: If you asked them to count, like, the number of letters in a word or …

Get the full transcript (12,154 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Odd Lots transcripts →

You just read a 3-minute summary of a 57-minute episode.

Get Odd Lots summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links.

Tools

  • LeanRecommended
    “The productive workflow pairs a large language model with Lean, a formal programming language that independently verifies each logical step against built-in axioms.”

More from Odd Lots

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best Finance Podcasts (2026) — ranked and reviewed with AI summaries.

You're clearly into Odd Lots.

Every Monday, we deliver AI summaries of the latest episodes from Odd Lots and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime