Skip to main content
a16z Podcast

Columbia CS Professor: Why LLMs Can’t Discover New Science

50 min episode · 2 min read

Episode

50 min

Read time

2 min

Topics

Science & Discovery

AI-Generated Summary

Key Takeaways

  • Why can't LLMs create genuinely new scientific discoveries?
  • How do LLMs actually process information and generate responses?
  • What architectural advances are needed to reach AGI?

What It Covers

Columbia CS Professor Vishal Mishra explains why LLMs cannot discover new science, discussing his formal mathematical models that define the boundaries of current AI capabilities.

Key Questions Answered

  • Why can't LLMs create genuinely new scientific discoveries?
  • How do LLMs actually process information and generate responses?
  • What architectural advances are needed to reach AGI?

Notable Moment

Mishra accidentally invented retrieval augmented generation while trying to fix a cricket statistics website interface, creating a natural language query system fifteen months before ChatGPT launched.

Know someone who'd find this useful?

You just read a 3-minute summary of a 47-minute episode.

Get a16z Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

More from a16z Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best Business Podcasts (2026) — ranked and reviewed with AI summaries.

You're clearly into a16z Podcast.

Every Monday, we deliver AI summaries of the latest episodes from a16z Podcast and 192+ other podcasts. Free for up to 3 shows.

Start My Monday Digest

No credit card · Unsubscribe anytime