Skip to main content
a16z Podcast

The Infrastructure Behind the Machine Age

55 min episode · 2 min read
·
Raghul Ram,Martine Casado

Episode

55 min

Read time

2 min

Topics

Productivity, Investing, Startups

AI-Generated Summary

Key Takeaways

  • Supply Collapse Timeline: Leading memory vendors report current demand alone would require three full years of production capacity to fulfill — and that figure excludes future growth. GPU supply is presold through 2028, with multi-day auctions occurring for small lots of a few thousand units. Investors and founders should treat hardware availability as a hard constraint, not a procurement detail.
  • Capital-to-Compute Conversion: AI breaks the Mythical Man Month rule — throwing money at engineering problems historically failed, but today $3–5B invested directly into a training cluster produces measurable intelligence gains. This means well-capitalized late entrants can close competitive gaps that would have been insurmountable in traditional software, fundamentally changing startup strategy and fundraising calculus.
  • Per-Model ASIC Economics: Training a frontier model costs $3–5B, meaning inference must generate roughly $10B to justify the investment. A 20% efficiency gain equals $2B in savings — enough to fund a custom ASIC built specifically for that model's fixed weight architecture. Founders should evaluate bespoke silicon as economically viable at current model-scale capital deployments.
  • Power Infrastructure Gap: New data centers require 44 gigawatts of additional power by 2028 against roughly 25 gigawatts of expected grid additions. Rack power density is climbing from 5–10 kilowatts to 100–250 kilowatts, forcing a shift from AC to DC power — yet only 2% of U.S. electricians hold DC certification. Infrastructure founders should target power delivery, cooling systems, and workforce training as near-term bottlenecks.
  • Founder Profile Shift: Hardware and systems startups now represent 20–30% of top-founder deal flow at a16z, up from roughly 3–5% previously. The strongest teams combine young founders with experienced operators who understand chip design, manufacturing supply chains, and system architecture simultaneously. Frontier AI labs are signing purchase commitments with hardware startups before products ship, providing unusually early commercial validation.

What It Covers

a16z announces the Machine Age Fund, a dedicated vehicle targeting AI infrastructure — chips, memory, networking, power, and data centers. Ben Horowitz, Martin Casado, and Raghul Raghuram argue the next AI bottleneck is not model capability but physical supply constraints across the entire hardware stack.

Key Questions Answered

  • Supply Collapse Timeline: Leading memory vendors report current demand alone would require three full years of production capacity to fulfill — and that figure excludes future growth. GPU supply is presold through 2028, with multi-day auctions occurring for small lots of a few thousand units. Investors and founders should treat hardware availability as a hard constraint, not a procurement detail.
  • Capital-to-Compute Conversion: AI breaks the Mythical Man Month rule — throwing money at engineering problems historically failed, but today $3–5B invested directly into a training cluster produces measurable intelligence gains. This means well-capitalized late entrants can close competitive gaps that would have been insurmountable in traditional software, fundamentally changing startup strategy and fundraising calculus.
  • Per-Model ASIC Economics: Training a frontier model costs $3–5B, meaning inference must generate roughly $10B to justify the investment. A 20% efficiency gain equals $2B in savings — enough to fund a custom ASIC built specifically for that model's fixed weight architecture. Founders should evaluate bespoke silicon as economically viable at current model-scale capital deployments.
  • Power Infrastructure Gap: New data centers require 44 gigawatts of additional power by 2028 against roughly 25 gigawatts of expected grid additions. Rack power density is climbing from 5–10 kilowatts to 100–250 kilowatts, forcing a shift from AC to DC power — yet only 2% of U.S. electricians hold DC certification. Infrastructure founders should target power delivery, cooling systems, and workforce training as near-term bottlenecks.
  • Founder Profile Shift: Hardware and systems startups now represent 20–30% of top-founder deal flow at a16z, up from roughly 3–5% previously. The strongest teams combine young founders with experienced operators who understand chip design, manufacturing supply chains, and system architecture simultaneously. Frontier AI labs are signing purchase commitments with hardware startups before products ship, providing unusually early commercial validation.

Notable Moment

Casado reframes the Grok agent not as a chatbot or search tool but as a literal employee with its own computer and browser. He used it over a weekend to cancel subscriptions and update payment details — tasks requiring no coding, signaling a shift to general-purpose autonomous computer use.

Know someone who'd find this useful?

Episode Transcript

We have a whole new technology that's the most important technology ever, and you need a whole new infrastructure. Normally, when we talk about the infrastructure world, we're talking about the servers, the storage, and the network. Here, it goes all the way down to the mines copper mines. Yeah. That's how widespread this thing's gonna be. It used to be when you built something, it was an engineering problem. And here, it feels like it really is a resource limitation. So whether it's tokens or not, we're pouring a ton of money into systems, and then those systems are producing a result. And right now, we're bottlenecked on the systems' ability to actually match the resource we're pouring into them. The leading memory web said the demand they have today, it will take them three years of capacity to supply. If this fund does what we think it will do, how do we see the world in five to ten years? America wins in the infrastructure day. Damn. That would be awesome. Today, a sixteen z is announcing the Machine Age Fund, a new fund dedicated to the infrastructure powering the next era of AI. I'm joined by Ben Horowitz, Raghul Raghul Ram, and Martine Casado to explain why we're launching it now and why we believe the next major bottleneck in AI isn't necessarily the model. It's everything underneath it. Chips, memory, networking, power, cooling, and data centers are all being pushed beyond what they were originally designed to handle. At the same time, AI is changing an old rule of technology. Throwing money at an engineering problem didn't necessarily make it move faster. Increasingly, capital can be converted directly into compute and compute into more capable intelligence. We unpack what that shift means, where new infrastructure companies can break through and why a new generation of founders is returning to some of the hardest problems in computing. Ben, Martin, Raghu, welcome. Thank you. Alright. Thank you. I wanna start with a mark quote to introduce this new fund. This is the biggest technological revolution of my lifetime. This is clearly bigger than the Internet. The comps on this are the microprocessor, the steam engine, and electricity, or maybe the wheel. Guys, the Machine Age Fund, please introduce it. Ben, start us off. Well, basically, what's happened is we have a whole new technology that's the most important technology ever. And what happens every time there's a dramatic new way of using all of the things that we love, infrastructure. You need a whole new infrastructure. And never has it been more high impact as it is on this one. So not only do we need new chips, new system software, we need new ways of doing power. We need to replace copper. I mean, like, it's absolutely everything. So it it's a very exciting time. So particularly for the kind of hardware aspects of this new era, we needed a new approach. Yeah. I would agree. I …

Get the full transcript (10,235 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all a16z Podcast transcripts →

You just read a 3-minute summary of a 52-minute episode.

Get a16z Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

More from a16z Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best Business Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's Investing & Markets Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into a16z Podcast.

Every Monday, we deliver AI summaries of the latest episodes from a16z Podcast and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime