What are the key takeaways from this Masters of Scale episode?

Key insights include: **AI Model Commoditization:** Foundation models will become commodities within two to three years, meaning switching costs between providers drop near zero. As GPU pricing has already doubled in six months, enterprises should begin optimizing which model size handles which task rather than defaulting to large frontier models for every workload, reducing token costs significantly.; **AI Implementation ROI Timeline:** Expect negative returns for the first six to twelve months of AI deployment. IBM spent more than it saved initially due to engineer costs, infrastructure, and opportunity costs. Returns turned 10x positive after year two, reaching $4.5 billion in savings against 2022 baseline spending by year four — scale is the prerequisite.; **Right-Sizing AI Tools:** Enterprises currently use large frontier models for tasks that smaller, cheaper, on-premise models handle adequately — analogous to using an 18-wheeler for grocery runs. IBM predicts this mismatch corrects within 24 months as token prices rise, forcing cost-conscious procurement of fit-for-purpose models rather than one-size-fits-all deployments.

What did Arvind Krishna discuss on Masters of Scale?

IBM CEO Arvind Krishna outlines why foundation models will become commodities within two to three years, why enterprises are mismatching AI tools to tasks, how IBM extracted $4.5 billion in efficiency gains from AI deployment, and why the company is betting $10 billion on quantum computing as the next computing frontier. Key topics include: **AI Model Commoditization:** Foundation models will become commodities within two to three years, meaning switching costs between providers drop near zero. As GPU pricing has already doubled in six months, enterprises should begin optimizing which model size handles which task rather than defaulting to large frontier models for every workload, reducing token costs significantly.; **AI Implementation ROI Timeline:** Expect negative returns for the first six to twelve months of AI deployment. IBM spent more than it saved initially due to engineer costs, infrastructure, and opportunity costs. Returns turned 10x positive after year two, reaching $4.5 billion in savings against 2022 baseline spending by year four — scale is the prerequisite..

How long is this episode of Masters of Scale?

This episode is 41 minutes long. SignalCast provides an AI-generated summary so you can get the key insights in about 3 minutes.

Masters of Scale

IBM’s $10 billion bet on what comes after AI

June 18, 2026

41 min episode · 2 min read

Arvind Krishna

Episode

41 min

Read time

2 min

Topics

Productivity, Fundraising & VC, Leadership

AI-Generated Summary

Published Jun 18, 2026

Key Takeaways

✓AI Model Commoditization: Foundation models will become commodities within two to three years, meaning switching costs between providers drop near zero. As GPU pricing has already doubled in six months, enterprises should begin optimizing which model size handles which task rather than defaulting to large frontier models for every workload, reducing token costs significantly.
✓AI Implementation ROI Timeline: Expect negative returns for the first six to twelve months of AI deployment. IBM spent more than it saved initially due to engineer costs, infrastructure, and opportunity costs. Returns turned 10x positive after year two, reaching $4.5 billion in savings against 2022 baseline spending by year four — scale is the prerequisite.
✓Right-Sizing AI Tools: Enterprises currently use large frontier models for tasks that smaller, cheaper, on-premise models handle adequately — analogous to using an 18-wheeler for grocery runs. IBM predicts this mismatch corrects within 24 months as token prices rise, forcing cost-conscious procurement of fit-for-purpose models rather than one-size-fits-all deployments.
✓AI Adoption Strategy — Focus Over Breadth: Rather than running 100 AI experiments simultaneously, Krishna recommends selecting three to five use cases and deploying them fully at scale. This teaches change management, data organization, and process redesign. Once that playbook is proven, expand to 10, then 20 initiatives — building organizational confidence incrementally rather than spreading resources thin.
✓Quantum Computing Acceleration: IBM's quantum systems progressed from simulating 5-atom molecules in summer 2025 to 12,000 atoms by April — approaching the protein simulation range of 10,000–40,000 atoms. Enterprises should begin developing quantum algorithms now so they are deployment-ready when hardware matures, treating quantum preparation as parallel work alongside AI, not a future-state decision.

What It Covers

IBM CEO Arvind Krishna outlines why foundation models will become commodities within two to three years, why enterprises are mismatching AI tools to tasks, how IBM extracted $4.5 billion in efficiency gains from AI deployment, and why the company is betting $10 billion on quantum computing as the next computing frontier.

Key Questions Answered

•AI Model Commoditization: Foundation models will become commodities within two to three years, meaning switching costs between providers drop near zero. As GPU pricing has already doubled in six months, enterprises should begin optimizing which model size handles which task rather than defaulting to large frontier models for every workload, reducing token costs significantly.
•AI Implementation ROI Timeline: Expect negative returns for the first six to twelve months of AI deployment. IBM spent more than it saved initially due to engineer costs, infrastructure, and opportunity costs. Returns turned 10x positive after year two, reaching $4.5 billion in savings against 2022 baseline spending by year four — scale is the prerequisite.
•Right-Sizing AI Tools: Enterprises currently use large frontier models for tasks that smaller, cheaper, on-premise models handle adequately — analogous to using an 18-wheeler for grocery runs. IBM predicts this mismatch corrects within 24 months as token prices rise, forcing cost-conscious procurement of fit-for-purpose models rather than one-size-fits-all deployments.
•AI Adoption Strategy — Focus Over Breadth: Rather than running 100 AI experiments simultaneously, Krishna recommends selecting three to five use cases and deploying them fully at scale. This teaches change management, data organization, and process redesign. Once that playbook is proven, expand to 10, then 20 initiatives — building organizational confidence incrementally rather than spreading resources thin.
•Quantum Computing Acceleration: IBM's quantum systems progressed from simulating 5-atom molecules in summer 2025 to 12,000 atoms by April — approaching the protein simulation range of 10,000–40,000 atoms. Enterprises should begin developing quantum algorithms now so they are deployment-ready when hardware matures, treating quantum preparation as parallel work alongside AI, not a future-state decision.

Notable Moment

Krishna argued that zero risk-taking is actually the highest-risk corporate strategy. Companies that avoid innovation allow competitors to clone their profitable segments, shrinking margins until leadership cuts investment further — accelerating decline toward acquisition or collapse within roughly a decade of the initial conservative pivot.

Know someone who'd find this useful?

Episode Transcript

The very best founders I know are brilliant at building systems. They connect teams, they remove bottlenecks, and they eliminate single points of failure. And yet, when it comes to their own wealth, most are running a disconnected stack. A tax accountant here and a state attorney there, a wealth manager who doesn't talk to either one of them. Creative planning was built to fix exactly that. One integrated team of tax professionals, estate planners, investment specialists, all coordinated by a dedicated wealth manager who sees your full financial picture and keeps every piece working together. Proactive tax efficiency, estate strategy, investments all under one roof. Creative planning, where wealth works together. Learn more at creativeplanning.com/mastersofscale. Hey, folks. Jeff Berman here. Exciting news. Applications are now open for the Masters of Scale Summit. It's happening October 20 through October 22 in San Francisco, and it is a really special event. Please join our curated community of founders, innovators, and leaders shaping the future. Expect ideas that challenge your assumptions and connections that move your business and maybe even your life forward. It's an experience that can change literally everything. Apply now at mastersofscale.com/apply20six. That's mastersofscale.com/apply20six. Hey, listeners. Bob here. If you listen to rapid response on masters of scale, you may be missing half the show because every Friday, we release a second rapid response exclusively in the rapid response feed. The guests and topics are just as compelling and timely from Ford CEO to NASA's administrator to the lessons from The Devil Wears Prada. It takes about ten seconds to find. Just search rapid response wherever you listen to podcasts and hit follow to make sure you never miss an episode. I hope to see you there. I'll say something provocative. I think foundation models are going to become commodities. I think that right now, the token price on all of these is going to go way up. It just has to to justify the capital investments. That's Arvind Krishna, CEO of IBM, and he has a strong metaphor for current AI systems that are just not the right size for all uses. I guess you could, for those in the suburbs, take your kids to school in an 18 wheeler every morning. You could go milk shopping in an 18 wheeler. Then you'd ask yourself, is it really the most effective vehicle for that? I think right now we're using the 18 wheeler for everything. This is Masters of Scale. I'm Bob Safian, your host. IBM is playing a distinctive role in the AI race, not building AI models, but betting on how best to use them and on what comes after them. In this conversation recorded in front of a live audience as part of New York Tech Week at IBM's Manhattan HQ, we dig into why Arvin thinks most enterprises are using an 18 wheeler for every task, plus what kind of risk taking businesses need to take right now, how to think about cost versus …

Get the full transcript (7,695 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Masters of Scale transcripts →