An audio version of my blog post, Thoughts on AI progress (Dec 2025)
Episode
12 min
Read time
2 min
Topics
Fundraising & VC, Sales & Revenue, Artificial Intelligence
AI-Generated Summary
Key Takeaways
- ✓RL Training Paradox: Labs spend billions having PhDs create training examples for specific tasks like Excel or web browsing, suggesting models cannot learn on-the-job like humans who adapt without rehearsing every software tool beforehand.
- ✓Deployment Reality Check: If models truly matched human capability, they would generate trillions in annual revenue matching global knowledge worker wages, but current figures fall orders of magnitude short, revealing capability gaps despite benchmark improvements.
- ✓Continual Learning Timeline: Achieving human-level on-the-job learning may require five to ten years beyond initial continual learning releases, similar to how GPT-3 demonstrated in-context learning in 2020 but improvements continue today across comprehension and context length.
What It Covers
Dwarkesh Patel examines contradictions between short AGI timelines and current reinforcement learning approaches, arguing that models lack human-like on-the-job learning capabilities essential for broad automation.
Key Questions Answered
- •RL Training Paradox: Labs spend billions having PhDs create training examples for specific tasks like Excel or web browsing, suggesting models cannot learn on-the-job like humans who adapt without rehearsing every software tool beforehand.
- •Deployment Reality Check: If models truly matched human capability, they would generate trillions in annual revenue matching global knowledge worker wages, but current figures fall orders of magnitude short, revealing capability gaps despite benchmark improvements.
- •Continual Learning Timeline: Achieving human-level on-the-job learning may require five to ten years beyond initial continual learning releases, similar to how GPT-3 demonstrated in-context learning in 2020 but improvements continue today across comprehension and context length.
Notable Moment
A biologist describes identifying macrophages in slides as requiring judgment an AI researcher dismissed as solved, illustrating how real jobs demand context-specific skills that resist pre-baked training pipelines.
You just read a 3-minute summary of a 9-minute episode.
Get Dwarkesh Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Dwarkesh Podcast
Adam Brown – A deep but accessible introduction to general relativity
Jul 10 · 98 min
Hard Fork
‘Hard Fork’ Live, Part 3: Differing Visions of an A.I. Future
Jun 19
More from Dwarkesh Podcast
Grant Sanderson – AI and the future of math
Jun 30 · 93 min
Eye on AI
#335 Sriram Raghavan: Why IBM Is Betting Everything on Small AI Models
Apr 19
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
by OpenAI
“similar to how GPT-3 demonstrated in-context learning in 2020 but improvements continue today across comprehension and context length”
other
by Dwarkesh Patel
“An audio version of my blog post, Thoughts on AI progress (Dec 2025)”
More from Dwarkesh Podcast
We summarize every new episode. Want them in your inbox?
Adam Brown – A deep but accessible introduction to general relativity
Grant Sanderson – AI and the future of math
The next big breakthrough will be AIs learning on the job
The data black hole at the center of AI
Ada Palmer – Machiavelli is the most misunderstood thinker of all time
Similar Episodes
Related episodes from other podcasts
Hard Fork
Jun 19
‘Hard Fork’ Live, Part 3: Differing Visions of an A.I. Future
Eye on AI
Apr 19
#335 Sriram Raghavan: Why IBM Is Betting Everything on Small AI Models
Cognitive Revolution
Apr 15
Welcome to AI in the AM: RL for EE, Oversight w/out Nationalization, & the first AI-Run Retail Store
Cognitive Revolution
Apr 1
Success without Dignity? Nathan finds Hope Amidst Chaos, from The Intelligence Horizon Podcast
Machine Learning Street Talk
Dec 24
"I Desperately Want To Live In The Matrix" - Dr. Mike Israetel
Explore Related Topics
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Dwarkesh Podcast.
Every Monday, we deliver AI summaries of the latest episodes from Dwarkesh Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime