IBM’s $10 billion bet on what comes after AI
Episode
41 min
Read time
2 min
Topics
Productivity, Fundraising & VC, Leadership
AI-Generated Summary
Key Takeaways
- ✓AI Model Commoditization: Foundation models will become commodities within two to three years, meaning switching costs between providers drop near zero. As GPU pricing has already doubled in six months, enterprises should begin optimizing which model size handles which task rather than defaulting to large frontier models for every workload, reducing token costs significantly.
- ✓AI Implementation ROI Timeline: Expect negative returns for the first six to twelve months of AI deployment. IBM spent more than it saved initially due to engineer costs, infrastructure, and opportunity costs. Returns turned 10x positive after year two, reaching $4.5 billion in savings against 2022 baseline spending by year four — scale is the prerequisite.
- ✓Right-Sizing AI Tools: Enterprises currently use large frontier models for tasks that smaller, cheaper, on-premise models handle adequately — analogous to using an 18-wheeler for grocery runs. IBM predicts this mismatch corrects within 24 months as token prices rise, forcing cost-conscious procurement of fit-for-purpose models rather than one-size-fits-all deployments.
- ✓AI Adoption Strategy — Focus Over Breadth: Rather than running 100 AI experiments simultaneously, Krishna recommends selecting three to five use cases and deploying them fully at scale. This teaches change management, data organization, and process redesign. Once that playbook is proven, expand to 10, then 20 initiatives — building organizational confidence incrementally rather than spreading resources thin.
- ✓Quantum Computing Acceleration: IBM's quantum systems progressed from simulating 5-atom molecules in summer 2025 to 12,000 atoms by April — approaching the protein simulation range of 10,000–40,000 atoms. Enterprises should begin developing quantum algorithms now so they are deployment-ready when hardware matures, treating quantum preparation as parallel work alongside AI, not a future-state decision.
What It Covers
IBM CEO Arvind Krishna outlines why foundation models will become commodities within two to three years, why enterprises are mismatching AI tools to tasks, how IBM extracted $4.5 billion in efficiency gains from AI deployment, and why the company is betting $10 billion on quantum computing as the next computing frontier.
Key Questions Answered
- •AI Model Commoditization: Foundation models will become commodities within two to three years, meaning switching costs between providers drop near zero. As GPU pricing has already doubled in six months, enterprises should begin optimizing which model size handles which task rather than defaulting to large frontier models for every workload, reducing token costs significantly.
- •AI Implementation ROI Timeline: Expect negative returns for the first six to twelve months of AI deployment. IBM spent more than it saved initially due to engineer costs, infrastructure, and opportunity costs. Returns turned 10x positive after year two, reaching $4.5 billion in savings against 2022 baseline spending by year four — scale is the prerequisite.
- •Right-Sizing AI Tools: Enterprises currently use large frontier models for tasks that smaller, cheaper, on-premise models handle adequately — analogous to using an 18-wheeler for grocery runs. IBM predicts this mismatch corrects within 24 months as token prices rise, forcing cost-conscious procurement of fit-for-purpose models rather than one-size-fits-all deployments.
- •AI Adoption Strategy — Focus Over Breadth: Rather than running 100 AI experiments simultaneously, Krishna recommends selecting three to five use cases and deploying them fully at scale. This teaches change management, data organization, and process redesign. Once that playbook is proven, expand to 10, then 20 initiatives — building organizational confidence incrementally rather than spreading resources thin.
- •Quantum Computing Acceleration: IBM's quantum systems progressed from simulating 5-atom molecules in summer 2025 to 12,000 atoms by April — approaching the protein simulation range of 10,000–40,000 atoms. Enterprises should begin developing quantum algorithms now so they are deployment-ready when hardware matures, treating quantum preparation as parallel work alongside AI, not a future-state decision.
Notable Moment
Krishna argued that zero risk-taking is actually the highest-risk corporate strategy. Companies that avoid innovation allow competitors to clone their profitable segments, shrinking margins until leadership cuts investment further — accelerating decline toward acquisition or collapse within roughly a decade of the initial conservative pivot.
You just read a 3-minute summary of a 38-minute episode.
Get Masters of Scale summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Masters of Scale
The U.S. at 250: The case for reckoning and rebuild, with Ian Bremmer
Jun 16 · 31 min
20VC (20 Minute VC)
20VC: Mercor CEO on Why Application Layer Companies Have No Defensibility, The Model is the Product | Token Spend Will Exceed Headcount Spend in 5 Years | The True Cost of Hiring AI Researchers in the Valley Today with Brendan Foody
Jun 1
More from Masters of Scale
The future of EVs, with Rivian’s RJ Scaringe
Jun 11 · 40 min
The TWIML AI Podcast
Why AI Agents Break the GenAI Security Model with Devvret Rishi - #770
Jun 16
More from Masters of Scale
We summarize every new episode. Want them in your inbox?
The U.S. at 250: The case for reckoning and rebuild, with Ian Bremmer
The future of EVs, with Rivian’s RJ Scaringe
World Cup kickoff: Goals, greed, and geopolitics, with ESPN’s Sam Borden
Rapid Response: The Guardian’s secret weapon against media’s collapse, with CEO Anna Bateson
Rohan Oza: The playbook for building billion-dollar consumer brands
Similar Episodes
Related episodes from other podcasts
20VC (20 Minute VC)
Jun 1
20VC: Mercor CEO on Why Application Layer Companies Have No Defensibility, The Model is the Product | Token Spend Will Exceed Headcount Spend in 5 Years | The True Cost of Hiring AI Researchers in the Valley Today with Brendan Foody
The TWIML AI Podcast
Jun 16
Why AI Agents Break the GenAI Security Model with Devvret Rishi - #770
Accidental Tech Podcast
Jun 15
696: It Seems Petty, But I Endorse It
NVIDIA AI Podcast
Jun 10
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Invest Like the Best with Patrick O'Shaughnessy
Jun 9
Alex Sacerdote - How to Invest Through Technology Cycles - [Invest Like the Best, EP.477]
Explore Related Topics
This podcast is featured in Best Business Podcasts (2026) — ranked and reviewed with AI summaries.
You're clearly into Masters of Scale.
Every Monday, we deliver AI summaries of the latest episodes from Masters of Scale and 192+ other podcasts. Free for up to 3 shows.
Start My Monday DigestNo credit card · Unsubscribe anytime