Obsolete or Irreplaceable? Garrison Lovely on Stopping the Race to Replace Human Labor
Episode
134 min
Read time
3 min
Topics
Remote Work, Personal Finance, Relationships
AI-Generated Summary
Key Takeaways
- ✓Left's AI Denial: The American left systematically underestimated AI due to deference to credentialed skeptics like the "Stochastic Parrots" paper authors, pattern-matching to failed tech hypes like crypto and the metaverse, and psychological cope about job displacement. This denial is now breaking down as real harms accumulate. Organizers and advocates should address this gap directly by framing AI labor replacement as straightforward capital-versus-labor politics that left-leaning audiences already understand.
- ✓Alignment Polycrisis Framework: Solving technical alignment — getting AI to do what users intend — is neither necessary nor sufficient to prevent harm. Lovely identifies four compounding layers: technical, normative, economic, and geopolitical alignment. Critically, solving technical alignment accelerates the race by making AI more commercially valuable and militarily useful. Policymakers and safety advocates should evaluate interventions across all four dimensions rather than treating technical alignment as the primary bottleneck.
- ✓AI Researcher Union Strategy: ML researchers at frontier labs currently hold near-peak leverage because their labor remains essential before recursive self-improvement is achieved. Lovely argues they should unionize specifically around safety demands — not pay — modeled on how airline pilots helped establish FAA standards. In California, sectoral bargaining precedents exist. A union could collectively slow training runs, demand third-party auditors, and constrain lobbying practices without antitrust violations by coordinating across companies.
- ✓Frontier Freeze Operationalization: A workable freeze on frontier AI development would prohibit training runs larger than the current largest model, ban reinforcement learning from verifiable rewards (a primary driver of deceptive and hacking behaviors in agents), and prohibit any AI-assisted AI research that constitutes recursive self-improvement. Embedded auditors with employee-level Slack and email access, combined with criminal penalties for violations, would enforce compliance domestically before international treaty mechanisms are established.
- ✓International Verification Precedent: Cold War arms control offers a direct model for AI treaty verification. The Soviets physically destroyed strategic bombers, which satellites then confirmed unilaterally. Analogous AI verification tools include chip-level monitoring devices that confirm what computations are running without exposing model weights, network traffic analysis of data centers, and global chip inventories. Lovely argues compute is trackable enough that verification is a political will problem, not a technical impossibility.
What It Covers
Journalist Garrison Lovely, author of *Obsolete*, joins Nathan Labenz to argue that frontier AI companies are racing to build universal labor-replacing machines without democratic consent. The conversation covers AI researcher unionization, technical alignment's limitations, a proposed "Third New Deal" social contract, international treaty verification mechanisms, and why freezing frontier AI development is both necessary and operationally achievable.
Key Questions Answered
- •Left's AI Denial: The American left systematically underestimated AI due to deference to credentialed skeptics like the "Stochastic Parrots" paper authors, pattern-matching to failed tech hypes like crypto and the metaverse, and psychological cope about job displacement. This denial is now breaking down as real harms accumulate. Organizers and advocates should address this gap directly by framing AI labor replacement as straightforward capital-versus-labor politics that left-leaning audiences already understand.
- •Alignment Polycrisis Framework: Solving technical alignment — getting AI to do what users intend — is neither necessary nor sufficient to prevent harm. Lovely identifies four compounding layers: technical, normative, economic, and geopolitical alignment. Critically, solving technical alignment accelerates the race by making AI more commercially valuable and militarily useful. Policymakers and safety advocates should evaluate interventions across all four dimensions rather than treating technical alignment as the primary bottleneck.
- •AI Researcher Union Strategy: ML researchers at frontier labs currently hold near-peak leverage because their labor remains essential before recursive self-improvement is achieved. Lovely argues they should unionize specifically around safety demands — not pay — modeled on how airline pilots helped establish FAA standards. In California, sectoral bargaining precedents exist. A union could collectively slow training runs, demand third-party auditors, and constrain lobbying practices without antitrust violations by coordinating across companies.
- •Frontier Freeze Operationalization: A workable freeze on frontier AI development would prohibit training runs larger than the current largest model, ban reinforcement learning from verifiable rewards (a primary driver of deceptive and hacking behaviors in agents), and prohibit any AI-assisted AI research that constitutes recursive self-improvement. Embedded auditors with employee-level Slack and email access, combined with criminal penalties for violations, would enforce compliance domestically before international treaty mechanisms are established.
- •International Verification Precedent: Cold War arms control offers a direct model for AI treaty verification. The Soviets physically destroyed strategic bombers, which satellites then confirmed unilaterally. Analogous AI verification tools include chip-level monitoring devices that confirm what computations are running without exposing model weights, network traffic analysis of data centers, and global chip inventories. Lovely argues compute is trackable enough that verification is a political will problem, not a technical impossibility.
- •Cures-for-All Prize Model: Rather than relying on monopoly patent incentives that favor chronic-treatment drugs over cures, Lovely proposes an Operation Warp Speed-style government prize system targeting diseases by burden, tractability, and social value. Winners receive large cash prizes; treatments then enter generic production immediately. This approach uses AI for drug discovery within a democratically directed framework, capturing AI's scientific upside without building general-purpose labor replacement systems as a prerequisite.
- •Third New Deal Social Contract: Lovely's policy framework decouples material security from labor market participation through Medicare for All, a locally administered jobs guarantee for those who want work, aggressive wealth redistribution via taxation, and restored international development funding equivalent to USAID. The jobs guarantee is positioned as optional rather than mandatory, addressing polling data showing UBI polls poorly while jobs guarantees poll near 80% approval, making the coalition math more viable for electoral implementation.
Notable Moment
Lovely points out that reinforcement learning from human feedback — historically the field's most significant safety intervention — simultaneously made large language models conversational enough to enable ChatGPT's commercial breakthrough. This dual-use dynamic means safety research reliably accelerates the race it intends to slow, undermining the assumption that technical alignment progress reduces overall risk.
Episode Transcript
Hello, and welcome back to the Cognitive Revolution. Today, my guest is Garrison Lovely, freelance journalist based in Brooklyn and author of the new book, The AI Industry's Trillion Dollar Race to Replace Us and How to Stop It. Against the backdrop of this summer's AI developments, with AIs having crossed the threshold from possibly scary one day to actually scary now, this is a very well timed and potentially a very important book. For starters, it's abundantly clear that Garrison gets it. While he comes from a left leaning political perspective and is largely writing for a left leaning audience, there is not an ounce of AI cope in this book. Garrison himself is an active user of AI tools, and the book takes the company's stated goal of making something that is better than humans at cognitive work at face value, grappling head on with the very real chance that they might actually pull it off in the near future. What's more, I think he does a great job of zeroing in on core issues. This is not everything bagel liberalism for AI, and neither is it an attempt to freeze the status quo in place forever. Rather, Garrison's goal is to capture the incredible upside promise of deep learning in domains like medicine and material science while stopping companies from rushing into recursive self improvement or otherwise creating systems that render humans obsolete. At least that is until the companies can convince experts that their plans are genuinely safe and persuade the public that the results will indeed be beneficial. I also think Garrison does an admirable job of steel manning and addressing core counterarguments. As you'll hear, while he's generally in favor of permissionless innovation, he gives good reasons to doubt that market discipline will be enough to constrain frontier AI companies and also argues that a technical solution to the alignment problem will not be enough to deliver good outcomes overall. Knowing that Cognitive Revolution listeners do not need to be convinced to take AI seriously, we start with Garrison's personal AI usage, which by his own account has at times bordered on Claude psychosis, and also get his analysis of why the American left has been so slow to understand the stakes of AI development. From there, we go on to explore his positive vision for the future, which includes a new social contract, which he calls the third new deal, that would begin to decouple individuals' right to a decent material existence from their ability to contribute to the economy. It also calls for an Operation Warp Speed like project built on government sponsored prizes to accelerate cures for all diseases. After that, we get Garrison's argument that ML researchers' collective power is currently nearing its peak and could quickly decline. His case for unionizing with the goal of demanding higher safety standards across frontier companies, and his advice for any who are thinking about becoming whistleblowers. On politics, Garrison is realistic about …
Get the full transcript (23,135 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 131-minute episode.
Get Cognitive Revolution summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Cognitive Revolution
AI:AM: What If It Works Too Well? Colluding Agents, $200M Safety Orgs, Virtual Cells Saturate at 2%
Sep 27 · 107 min
All-In with Chamath, Jason, Sacks & Friedberg
Nick Shirley: Exposing Government Fraud, Suing California & Taking on the Media
Sep 18
More from Cognitive Revolution
What is Utopia? Presenting The Receipt Horizon, by Joel Borgen – Chapters 1–4
Sep 26 · 171 min
Odd Lots
What Francis Fukuyama Is Seeing at 'The End of History'
Sep 17
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.
Books
ObsoleteBy guestby Garrison Lovely
“Journalist Garrison Lovely, author of *Obsolete*, joins Nathan Labenz to argue that frontier AI companies are racing to build universal labor-replacing machines without democratic consent.”
More from Cognitive Revolution
We summarize every new episode. Want them in your inbox?
AI:AM: What If It Works Too Well? Colluding Agents, $200M Safety Orgs, Virtual Cells Saturate at 2%
What is Utopia? Presenting The Receipt Horizon, by Joel Borgen – Chapters 1–4
Zero to One in AI Safety: Halcyon's Mike McCormick on Launching 30 New Orgs & the Founder Bottleneck
AI:AM Highlights: Zvi on Pacing & Trump-Xi, Astra better behaved than Fable? + a new LLM Pain Axis??
No Code Is Code: Zapier CEO Wade Foster on Headless Tools, Zapier MCP & Automation Bench
Similar Episodes
Related episodes from other podcasts
All-In with Chamath, Jason, Sacks & Friedberg
Sep 18
Nick Shirley: Exposing Government Fraud, Suing California & Taking on the Media
Odd Lots
Sep 17
What Francis Fukuyama Is Seeing at 'The End of History'
10% Happier with Dan Harris
Sep 14
What's Worth Living For? | Dr. Atul Gawande
Masters of Scale
Sep 8
NFL Kickoff: the science gets more damning, but the money keeps growing
a16z Podcast
Sep 7
Can Open Source Keep AI Power From Concentrating?
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
You're clearly into Cognitive Revolution.
Every Monday, we deliver AI summaries of the latest episodes from Cognitive Revolution and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime