Skip to main content
Dwarkesh Podcast

I’m glad the Anthropic fight is happening now

24 min episode · 2 min read

Episode

24 min

Read time

2 min

Topics

Fundraising & VC, Design & UX, Artificial Intelligence

AI-Generated Summary

Key Takeaways

  • Mass Surveillance Cost Curve: Processing every CCTV camera in America — roughly 100 million units — costs approximately $30 billion today at current AI token pricing. That figure drops tenfold annually, meaning by 2030 blanket national surveillance becomes cheaper than a White House renovation. Citizens and policymakers should treat this timeline as a concrete policy deadline, not a distant hypothetical.
  • Government Leverage Underestimated: The federal government controls permitting for data center power generation, antitrust enforcement, and contracts with every major chip and cloud provider Anthropic depends on. Even if a supply chain designation is reversed — prediction markets give 74% odds of reversal — these indirect pressure vectors remain fully intact and can be applied without any formal legal action.
  • Alignment's Unanswered Core Question: Technical AI alignment — getting models to follow instructions reliably — is only half the problem. The deeper unresolved question is *whose* instructions models should follow: the model company, the end user, the law, or the AI's own moral reasoning. This question has been largely avoided because no lab wants to advertise its total control over future civilization's entire labor force.
  • Regulation Creates Exploitable Vagueness: Broad AI safety frameworks built around terms like "catastrophic risk," "autonomy risk," or "national security threat" hand governments pre-built legal instruments to suppress dissent. A model that tells users tariff policy is misguided could be labeled deceptive; one that refuses government surveillance orders could be labeled an autonomy risk. Regulatory language should target specific harmful use cases instead.
  • Corporate Courage Has a 12-Month Shelf Life: Even if Anthropic, Google, and OpenAI all refuse to enable mass surveillance, open-source models matching today's frontier capability will be widely available within roughly 12 months. The structural solution is not corporate refusal but explicit legal norms — analogous to post-WWII nuclear weapons prohibitions — banning government use of AI for surveillance and political suppression.

What It Covers

Dwarkesh Patel analyzes the Department of War's supply chain designation against Anthropic after the company refused to remove red lines on mass surveillance and autonomous weapons use, framing this conflict as an early preview of the highest-stakes power negotiations in human history over AI governance.

Key Questions Answered

  • Mass Surveillance Cost Curve: Processing every CCTV camera in America — roughly 100 million units — costs approximately $30 billion today at current AI token pricing. That figure drops tenfold annually, meaning by 2030 blanket national surveillance becomes cheaper than a White House renovation. Citizens and policymakers should treat this timeline as a concrete policy deadline, not a distant hypothetical.
  • Government Leverage Underestimated: The federal government controls permitting for data center power generation, antitrust enforcement, and contracts with every major chip and cloud provider Anthropic depends on. Even if a supply chain designation is reversed — prediction markets give 74% odds of reversal — these indirect pressure vectors remain fully intact and can be applied without any formal legal action.
  • Alignment's Unanswered Core Question: Technical AI alignment — getting models to follow instructions reliably — is only half the problem. The deeper unresolved question is *whose* instructions models should follow: the model company, the end user, the law, or the AI's own moral reasoning. This question has been largely avoided because no lab wants to advertise its total control over future civilization's entire labor force.
  • Regulation Creates Exploitable Vagueness: Broad AI safety frameworks built around terms like "catastrophic risk," "autonomy risk," or "national security threat" hand governments pre-built legal instruments to suppress dissent. A model that tells users tariff policy is misguided could be labeled deceptive; one that refuses government surveillance orders could be labeled an autonomy risk. Regulatory language should target specific harmful use cases instead.
  • Corporate Courage Has a 12-Month Shelf Life: Even if Anthropic, Google, and OpenAI all refuse to enable mass surveillance, open-source models matching today's frontier capability will be widely available within roughly 12 months. The structural solution is not corporate refusal but explicit legal norms — analogous to post-WWII nuclear weapons prohibitions — banning government use of AI for surveillance and political suppression.

Notable Moment

Patel draws a parallel between AI alignment succeeding and authoritarian control: a perfectly obedient AI workforce following government orders is technically what alignment looks like if it works. The scariest outcome and the desired technical outcome are, at the surface level, structurally identical — which reframes the entire alignment debate.

Know someone who'd find this useful?

Episode Transcript

So by now, I'm sure that you heard that the Department of War has declared Anthropic a supply chain risk because Anthropic refused to remove red lines around the use of their models for mass surveillance and for autonomous weapons. Honestly, I think the situation is a warning shot. Right now, LMS are probably not being used in mission critical ways. But within twenty years, 99% of the workforce in the military, in the civilian government, in the private sector is going to be AIs. They're gonna be the robot armies that constitute our military. They're gonna be the superhumanly intelligent advisors that senators and presidents and CEOs have. They're gonna be the police. You name it, the role will be filled by an AI. Our future civilization is gonna be run on AI labor. And as much as the government's actions here piss me off, I'm glad that this episode happened because it gives us the opportunity to start thinking about some extremely important questions. Now, obviously, the Department of War has the right to refuse to use anthropics models. And in fact, I think they have entirely reasonable case for doing so, especially so given the ambiguity of terms like mass surveillance and autonomous weapons. In fact, if I was the secretary of war, I probably would have made the same determination and refused to use anthropics models. Imagine if there's some future Democratic administration and Elon Musk is negotiating Starlink access to the military. And Elon says, look, I reserve the right to cut off the military's access to Starlink in case you are fighting some unjust war or some war that Congress has not authorized. On the face of it, this language seems reasonable. But as a military, you simply cannot give a private contractor that you're working with the kill switch on a technology that you have come to rely on. And if that's all the government had done to say, we refuse to do business philanthropic, that would've been fine, and I wouldn't have written this blog post, and I wouldn't be narrating this shit to you. But that's not what the government did. Instead, the government has threatened to destroy Anthropic as a private business, because Anthropic refuses to sell to the government on terms that the government commands. Now if upheld, the supply chain restriction would mean that companies like Amazon and NVIDIA and Google and Palantir would need to ensure that Anthropic is not touching any of their Pentagon work. And Anthropic could probably survive this designation today because these companies can just cordon off the services they're providing to the Department of War. But given the way AI is going, eventually, it's not gonna be just some party trick addendum to the products that these companies are serving to the military. In the future, AI will be woven into how every product is built and maintained and operated. In the future, if Amazon is providing some service to the Department …

Get the full transcript (4,663 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Dwarkesh Podcast transcripts →

You just read a 3-minute summary of a 21-minute episode.

Get Dwarkesh Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

More from Dwarkesh Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into Dwarkesh Podcast.

Every Monday, we deliver AI summaries of the latest episodes from Dwarkesh Podcast and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime