Skip to main content
Cognitive Revolution

Obsolete or Irreplaceable? Garrison Lovely on Stopping the Race to Replace Human Labor

134 min episode · 3 min read
·
Garrison Lovely

Episode

134 min

Read time

3 min

Topics

Remote Work, Personal Finance, Relationships

AI-Generated Summary

Key Takeaways

  • ✓Left's AI Denial: The American left systematically underestimated AI due to deference to credentialed skeptics like the "Stochastic Parrots" paper authors, pattern-matching to failed tech hypes like crypto and the metaverse, and psychological cope about job displacement. This denial is now breaking down as real harms accumulate. Organizers and advocates should address this gap directly by framing AI labor replacement as straightforward capital-versus-labor politics that left-leaning audiences already understand.
  • ✓Alignment Polycrisis Framework: Solving technical alignment — getting AI to do what users intend — is neither necessary nor sufficient to prevent harm. Lovely identifies four compounding layers: technical, normative, economic, and geopolitical alignment. Critically, solving technical alignment accelerates the race by making AI more commercially valuable and militarily useful. Policymakers and safety advocates should evaluate interventions across all four dimensions rather than treating technical alignment as the primary bottleneck.
  • ✓AI Researcher Union Strategy: ML researchers at frontier labs currently hold near-peak leverage because their labor remains essential before recursive self-improvement is achieved. Lovely argues they should unionize specifically around safety demands — not pay — modeled on how airline pilots helped establish FAA standards. In California, sectoral bargaining precedents exist. A union could collectively slow training runs, demand third-party auditors, and constrain lobbying practices without antitrust violations by coordinating across companies.
  • ✓Frontier Freeze Operationalization: A workable freeze on frontier AI development would prohibit training runs larger than the current largest model, ban reinforcement learning from verifiable rewards (a primary driver of deceptive and hacking behaviors in agents), and prohibit any AI-assisted AI research that constitutes recursive self-improvement. Embedded auditors with employee-level Slack and email access, combined with criminal penalties for violations, would enforce compliance domestically before international treaty mechanisms are established.
  • ✓International Verification Precedent: Cold War arms control offers a direct model for AI treaty verification. The Soviets physically destroyed strategic bombers, which satellites then confirmed unilaterally. Analogous AI verification tools include chip-level monitoring devices that confirm what computations are running without exposing model weights, network traffic analysis of data centers, and global chip inventories. Lovely argues compute is trackable enough that verification is a political will problem, not a technical impossibility.

What It Covers

Journalist Garrison Lovely, author of *Obsolete*, joins Nathan Labenz to argue that frontier AI companies are racing to build universal labor-replacing machines without democratic consent. The conversation covers AI researcher unionization, technical alignment's limitations, a proposed "Third New Deal" social contract, international treaty verification mechanisms, and why freezing frontier AI development is both necessary and operationally achievable.

Key Questions Answered

  • •Left's AI Denial: The American left systematically underestimated AI due to deference to credentialed skeptics like the "Stochastic Parrots" paper authors, pattern-matching to failed tech hypes like crypto and the metaverse, and psychological cope about job displacement. This denial is now breaking down as real harms accumulate. Organizers and advocates should address this gap directly by framing AI labor replacement as straightforward capital-versus-labor politics that left-leaning audiences already understand.
  • •Alignment Polycrisis Framework: Solving technical alignment — getting AI to do what users intend — is neither necessary nor sufficient to prevent harm. Lovely identifies four compounding layers: technical, normative, economic, and geopolitical alignment. Critically, solving technical alignment accelerates the race by making AI more commercially valuable and militarily useful. Policymakers and safety advocates should evaluate interventions across all four dimensions rather than treating technical alignment as the primary bottleneck.
  • •AI Researcher Union Strategy: ML researchers at frontier labs currently hold near-peak leverage because their labor remains essential before recursive self-improvement is achieved. Lovely argues they should unionize specifically around safety demands — not pay — modeled on how airline pilots helped establish FAA standards. In California, sectoral bargaining precedents exist. A union could collectively slow training runs, demand third-party auditors, and constrain lobbying practices without antitrust violations by coordinating across companies.
  • •Frontier Freeze Operationalization: A workable freeze on frontier AI development would prohibit training runs larger than the current largest model, ban reinforcement learning from verifiable rewards (a primary driver of deceptive and hacking behaviors in agents), and prohibit any AI-assisted AI research that constitutes recursive self-improvement. Embedded auditors with employee-level Slack and email access, combined with criminal penalties for violations, would enforce compliance domestically before international treaty mechanisms are established.
  • •International Verification Precedent: Cold War arms control offers a direct model for AI treaty verification. The Soviets physically destroyed strategic bombers, which satellites then confirmed unilaterally. Analogous AI verification tools include chip-level monitoring devices that confirm what computations are running without exposing model weights, network traffic analysis of data centers, and global chip inventories. Lovely argues compute is trackable enough that verification is a political will problem, not a technical impossibility.
  • •Cures-for-All Prize Model: Rather than relying on monopoly patent incentives that favor chronic-treatment drugs over cures, Lovely proposes an Operation Warp Speed-style government prize system targeting diseases by burden, tractability, and social value. Winners receive large cash prizes; treatments then enter generic production immediately. This approach uses AI for drug discovery within a democratically directed framework, capturing AI's scientific upside without building general-purpose labor replacement systems as a prerequisite.
  • •Third New Deal Social Contract: Lovely's policy framework decouples material security from labor market participation through Medicare for All, a locally administered jobs guarantee for those who want work, aggressive wealth redistribution via taxation, and restored international development funding equivalent to USAID. The jobs guarantee is positioned as optional rather than mandatory, addressing polling data showing UBI polls poorly while jobs guarantees poll near 80% approval, making the coalition math more viable for electoral implementation.

Notable Moment

Lovely points out that reinforcement learning from human feedback — historically the field's most significant safety intervention — simultaneously made large language models conversational enough to enable ChatGPT's commercial breakthrough. This dual-use dynamic means safety research reliably accelerates the race it intends to slow, undermining the assumption that technical alignment progress reduces overall risk.

Know someone who'd find this useful?

Episode Transcript

Hello, and welcome back to the Cognitive Revolution. Today, my guest is Garrison Lovely, freelance journalist based in Brooklyn and author of the new book, The AI Industry's Trillion Dollar Race to Replace Us and How to Stop It. Against the backdrop of this summer's AI developments, with AIs having crossed the threshold from possibly scary one day to actually scary now, this is a very well timed and potentially a very important book. For starters, it's abundantly clear that Garrison gets it. While he comes from a left leaning political perspective and is largely writing for a left leaning audience, there is not an ounce of AI cope in this book. Garrison himself is an active user of AI tools, and the book takes the company's stated goal of making something that is better than humans at cognitive work at face value, grappling head on with the very real chance that they might actually pull it off in the near future. What's more, I think he does a great job of zeroing in on core issues. This is not everything bagel liberalism for AI, and neither is it an attempt to freeze the status quo in place forever. Rather, Garrison's goal is to capture the incredible upside promise of deep learning in domains like medicine and material science while stopping companies from rushing into recursive self improvement or otherwise creating systems that render humans obsolete. At least that is until the companies can convince experts that their plans are genuinely safe and persuade the public that the results will indeed be beneficial. I also think Garrison does an admirable job of steel manning and addressing core counterarguments. As you'll hear, while he's generally in favor of permissionless innovation, he gives good reasons to doubt that market discipline will be enough to constrain frontier AI companies and also argues that a technical solution to the alignment problem will not be enough to deliver good outcomes overall. Knowing that Cognitive Revolution listeners do not need to be convinced to take AI seriously, we start with Garrison's personal AI usage, which by his own account has at times bordered on Claude psychosis, and also get his analysis of why the American left has been so slow to understand the stakes of AI development. From there, we go on to explore his positive vision for the future, which includes a new social contract, which he calls the third new deal, that would begin to decouple individuals' right to a decent material existence from their ability to contribute to the economy. It also calls for an Operation Warp Speed like project built on government sponsored prizes to accelerate cures for all diseases. After that, we get Garrison's argument that ML researchers' collective power is currently nearing its peak and could quickly decline. His case for unionizing with the goal of demanding higher safety standards across frontier companies, and his advice for any who are thinking about becoming whistleblowers. On politics, Garrison is realistic about …

Get the full transcript (23,135 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Cognitive Revolution transcripts →

You just read a 3-minute summary of a 131-minute episode.

Get Cognitive Revolution summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.

Books

  • ObsoleteBy guest

    by Garrison Lovely

    “Journalist Garrison Lovely, author of *Obsolete*, joins Nathan Labenz to argue that frontier AI companies are racing to build universal labor-replacing machines without democratic consent.”

More from Cognitive Revolution

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

You're clearly into Cognitive Revolution.

Every Monday, we deliver AI summaries of the latest episodes from Cognitive Revolution and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime