Skip to main content
BG2Pod with Brad Gerstner and Bill Gurley

NVIDIA: OpenAI, Future of Compute, and the American Dream | BG2 w/ Bill Gurley and Brad Gerstner

104 min episode · 2 min read

Episode

104 min

Read time

2 min

Topics

Productivity, Relationships, Investing

AI-Generated Summary

Key Takeaways

  • Three Scaling Laws Economics: AI now operates on pretraining, post-training reinforcement learning, and inference-time reasoning scaling laws simultaneously. This creates compounding exponential compute demand as models both practice skills through post-training and think before answering, fundamentally changing infrastructure requirements from one-shot inference to continuous token generation requiring persistent AI factories.
  • Revenue Per Watt Metric: NVIDIA revenue correlates directly to power consumption as performance per watt becomes the critical metric. Alibaba plans 10x data center power increase by 2030 while token generation doubles every few months, making energy efficiency the primary competitive differentiator. Customers prioritize maximum revenue from fixed gigawatt capacity over chip purchase price discounts.
  • Annual Release Cycle Moat: NVIDIA ships six to seven co-designed chips annually across GPUs, CPUs, networking, and NVLink, delivering 30x performance improvement from Hopper to Blackwell in one year. This extreme co-design at data center scale requires starting hundreds of billions in wafer capacity years ahead, creating insurmountable barriers for competitors attempting single ASIC approaches.
  • OpenAI Hyperscaler Trajectory: OpenAI transitions from outsourcing to Microsoft Azure toward self-building AI infrastructure like Meta and X, establishing direct NVIDIA partnerships. Huang projects OpenAI becomes the next multitrillion-dollar hyperscaler company, making pre-IPO investment opportunities at current scale exceptionally valuable given 800 million weekly active users generating exponentially more tokens through reasoning.
  • China Market Strategic Imperative: Restricting NVIDIA sales to China created monopoly profits funding Huawei's three-year plan to surpass NVIDIA while eliminating 95% market share. Chinese AI researchers choosing US opportunities dropped from 90% to 10-15% in three years. Competing in China's market with half the world's AI engineers strengthens rather than weakens American AI leadership position.

What It Covers

Jensen Huang discusses NVIDIA's $100B OpenAI Stargate partnership, three AI scaling laws driving exponential compute demand, competitive moats in accelerated computing, China market strategy, and why token generation economics justify $5 trillion annual AI infrastructure spending by decade's end.

Key Questions Answered

  • Three Scaling Laws Economics: AI now operates on pretraining, post-training reinforcement learning, and inference-time reasoning scaling laws simultaneously. This creates compounding exponential compute demand as models both practice skills through post-training and think before answering, fundamentally changing infrastructure requirements from one-shot inference to continuous token generation requiring persistent AI factories.
  • Revenue Per Watt Metric: NVIDIA revenue correlates directly to power consumption as performance per watt becomes the critical metric. Alibaba plans 10x data center power increase by 2030 while token generation doubles every few months, making energy efficiency the primary competitive differentiator. Customers prioritize maximum revenue from fixed gigawatt capacity over chip purchase price discounts.
  • Annual Release Cycle Moat: NVIDIA ships six to seven co-designed chips annually across GPUs, CPUs, networking, and NVLink, delivering 30x performance improvement from Hopper to Blackwell in one year. This extreme co-design at data center scale requires starting hundreds of billions in wafer capacity years ahead, creating insurmountable barriers for competitors attempting single ASIC approaches.
  • OpenAI Hyperscaler Trajectory: OpenAI transitions from outsourcing to Microsoft Azure toward self-building AI infrastructure like Meta and X, establishing direct NVIDIA partnerships. Huang projects OpenAI becomes the next multitrillion-dollar hyperscaler company, making pre-IPO investment opportunities at current scale exceptionally valuable given 800 million weekly active users generating exponentially more tokens through reasoning.
  • China Market Strategic Imperative: Restricting NVIDIA sales to China created monopoly profits funding Huawei's three-year plan to surpass NVIDIA while eliminating 95% market share. Chinese AI researchers choosing US opportunities dropped from 90% to 10-15% in three years. Competing in China's market with half the world's AI engineers strengthens rather than weakens American AI leadership position.

Notable Moment

Huang argues competitors could price chips at zero and customers would still choose NVIDIA systems because performance per watt determines revenue generation from power-limited data centers. A 30x performance advantage means 30x more revenue from the same gigawatt capacity, making the opportunity cost of inferior chips far exceed any purchase price discount offered.

Know someone who'd find this useful?

Episode Transcript

I think that OpenAI is likely going to be the next multitrillion dollar hyperscale company. K. Gents and great to be back, of course, with my partner Clark Tang. You know, I can't believe it's Welcome to NVIDIA. Oh, and nice glasses. Those actually look really good on you. The problem is now everybody's gonna want you to wear them all the time. They're gonna say, where are the red glasses? I can vouch for that. So it's been over a year since we did the last pod. Yeah. Over 40% of your revenue today is inference. But inference is about ready because of chain of reasoning. Yeah. Right? It's about to go up by a billion times. Right. By by by a million x by a by a billion x. That's right. That's the part that most people have, you know, haven't completely internalized. This is that industry we were talking about, but this is the industrial revolution. Honestly, it's it's felt like you and I have had a continuation of the pod every day since then. You know, in AI time, it's been about a hundred years. I was rewatching the pod recently and the many things that we talked about that stood out. The most the one that that was probably most profound for me was you pounding the table that you know, remember at the time, there was kind of a slump in terms of pretraining. Mhmm. And people were like, oh my god. Pretraining. Right. We're at the end of pretraining, we're not gonna we're overbuilding. Yeah. This is about a year and a half ago. And you said inference isn't going to a 100 x, a thousand x. It's gonna 1,000,000,000 x. Mhmm. Which brings us to where we are today. You know? You announced this huge deal. We ought to start there. I underestimated. Let me just go on record. I underestimated. We we now have three scaling laws. Right? We have pretraining scaling law. We have post training scaling law. Post training is basically like, AI practicing. Yes. Practicing a skill until it gets it right. And so it tries a whole bunch of different ways. And and, in order to do that, yeah, you you you've gotta do inference. So now training and inference are now integrated in reinforcement learning. Really complicated. And so that's called post training. And then the third is inference. The old way of doing inference was one shot. Right. But the new way of doing inference, which we appreciate, is thinking. So think before you answer. Yeah. And so now you have three scaling laws. The the longer you think, the better the quality answer you get. While you're thinking, you do research. You go check on some ground truth, and, you know, you learn some things, you think some more, you go learn some more, and then you generate an answer. Don't just generate right off the bat. Right. And so thinking, post training, pre …

Get the full transcript (18,314 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all BG2Pod with Brad Gerstner and Bill Gurley transcripts →

You just read a 3-minute summary of a 101-minute episode.

Get BG2Pod with Brad Gerstner and Bill Gurley summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

More from BG2Pod with Brad Gerstner and Bill Gurley

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best Investing Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's Investing & Markets Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into BG2Pod with Brad Gerstner and Bill Gurley.

Every Monday, we deliver AI summaries of the latest episodes from BG2Pod with Brad Gerstner and Bill Gurley and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime