Skip to main content
Latent Space

Bitter Lessons in Venture vs Growth: Anthropic vs OpenAI, Noam Shazeer, World Labs, Thinking Machines, Cursor, ASIC Economics — Martin Casado & Sarah Wang of a16z

55 min episode · 2 min read
·

Episode

55 min

Read time

2 min

Topics

Fundraising & VC, Artificial Intelligence, Economics & Policy

AI-Generated Summary

Key Takeaways

  • ASIC Economics Threshold: Once a training run exceeds $1 billion, building a custom ASIC becomes economically justified. Saving even 20% yields $200 million — enough to tape out a dedicated chip. In practice, efficiency gains closer to 2x are achievable, making custom silicon economics far more compelling than generic NVIDIA hardware at scale.
  • Capital Flywheel Risk: Frontier model companies are currently gross-margin positive on existing models but gross-margin negative when accounting for next-generation training costs. This means growth is structurally borrowed against future fundraising rounds. If a company cannot raise its next round, the model cycle breaks and market fragmentation likely follows rapidly.
  • Vertical Dominance Math: If a foundation model company can raise more capital than the aggregate of all companies building on top of its API, it can systematically expand into every application layer above it. Unlike prior tech eras, engineering bottlenecks no longer slow this expansion — capital converts directly into capability within roughly 12 months.
  • Cursor's Reverse Verticalization: Cursor built a near-state-of-the-art coding model at roughly one-hundredth the cost of frontier labs by starting at the application layer and moving downward, rather than the reverse. This demonstrates that companies with dense product usage data and a focused vertical can compete on model quality without frontier-scale compute budgets.
  • Boring Software Is Underinvested: Enterprise software companies growing 5x annually in large markets are being systematically ignored because they lack AI narrative momentum. From an LP returns perspective — targeting 3x net over a fund lifecycle — a focused, high-margin software company in a large market represents a structurally sound investment that current VC attention patterns consistently overlook.

What It Covers

Martin Casado and Sarah Wang of a16z join Latent Space to analyze how AI's capital flywheel is reshaping venture investing, blurring lines between infrastructure and applications, and creating structural dynamics where frontier model companies like Anthropic and OpenAI may outspend the entire ecosystem built on top of them.

Key Questions Answered

  • ASIC Economics Threshold: Once a training run exceeds $1 billion, building a custom ASIC becomes economically justified. Saving even 20% yields $200 million — enough to tape out a dedicated chip. In practice, efficiency gains closer to 2x are achievable, making custom silicon economics far more compelling than generic NVIDIA hardware at scale.
  • Capital Flywheel Risk: Frontier model companies are currently gross-margin positive on existing models but gross-margin negative when accounting for next-generation training costs. This means growth is structurally borrowed against future fundraising rounds. If a company cannot raise its next round, the model cycle breaks and market fragmentation likely follows rapidly.
  • Vertical Dominance Math: If a foundation model company can raise more capital than the aggregate of all companies building on top of its API, it can systematically expand into every application layer above it. Unlike prior tech eras, engineering bottlenecks no longer slow this expansion — capital converts directly into capability within roughly 12 months.
  • Cursor's Reverse Verticalization: Cursor built a near-state-of-the-art coding model at roughly one-hundredth the cost of frontier labs by starting at the application layer and moving downward, rather than the reverse. This demonstrates that companies with dense product usage data and a focused vertical can compete on model quality without frontier-scale compute budgets.
  • Boring Software Is Underinvested: Enterprise software companies growing 5x annually in large markets are being systematically ignored because they lack AI narrative momentum. From an LP returns perspective — targeting 3x net over a fund lifecycle — a focused, high-margin software company in a large market represents a structurally sound investment that current VC attention patterns consistently overlook.

Notable Moment

Casado reframes the "bitter lesson" concept for startups: a foundation model company that can raise three times more than the combined revenue of its entire API customer base can simply outspend and absorb every application built on top of it — something engineering constraints previously made structurally impossible.

Know someone who'd find this useful?

You just read a 3-minute summary of a 52-minute episode.

Get Latent Space summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

More from Latent Space

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into Latent Space.

Every Monday, we deliver AI summaries of the latest episodes from Latent Space and 192+ other podcasts. Free for up to 3 shows.

Start My Monday Digest

No credit card · Unsubscribe anytime