I’m glad the Anthropic fight is happening now
Episode
24 min
Read time
2 min
Topics
Fundraising & VC, Design & UX, Artificial Intelligence
AI-Generated Summary
Key Takeaways
- ✓Mass Surveillance Cost Curve: Processing every CCTV camera in America — roughly 100 million units — costs approximately $30 billion today at current AI token pricing. That figure drops tenfold annually, meaning by 2030 blanket national surveillance becomes cheaper than a White House renovation. Citizens and policymakers should treat this timeline as a concrete policy deadline, not a distant hypothetical.
- ✓Government Leverage Underestimated: The federal government controls permitting for data center power generation, antitrust enforcement, and contracts with every major chip and cloud provider Anthropic depends on. Even if a supply chain designation is reversed — prediction markets give 74% odds of reversal — these indirect pressure vectors remain fully intact and can be applied without any formal legal action.
- ✓Alignment's Unanswered Core Question: Technical AI alignment — getting models to follow instructions reliably — is only half the problem. The deeper unresolved question is *whose* instructions models should follow: the model company, the end user, the law, or the AI's own moral reasoning. This question has been largely avoided because no lab wants to advertise its total control over future civilization's entire labor force.
- ✓Regulation Creates Exploitable Vagueness: Broad AI safety frameworks built around terms like "catastrophic risk," "autonomy risk," or "national security threat" hand governments pre-built legal instruments to suppress dissent. A model that tells users tariff policy is misguided could be labeled deceptive; one that refuses government surveillance orders could be labeled an autonomy risk. Regulatory language should target specific harmful use cases instead.
- ✓Corporate Courage Has a 12-Month Shelf Life: Even if Anthropic, Google, and OpenAI all refuse to enable mass surveillance, open-source models matching today's frontier capability will be widely available within roughly 12 months. The structural solution is not corporate refusal but explicit legal norms — analogous to post-WWII nuclear weapons prohibitions — banning government use of AI for surveillance and political suppression.
What It Covers
Dwarkesh Patel analyzes the Department of War's supply chain designation against Anthropic after the company refused to remove red lines on mass surveillance and autonomous weapons use, framing this conflict as an early preview of the highest-stakes power negotiations in human history over AI governance.
Key Questions Answered
- •Mass Surveillance Cost Curve: Processing every CCTV camera in America — roughly 100 million units — costs approximately $30 billion today at current AI token pricing. That figure drops tenfold annually, meaning by 2030 blanket national surveillance becomes cheaper than a White House renovation. Citizens and policymakers should treat this timeline as a concrete policy deadline, not a distant hypothetical.
- •Government Leverage Underestimated: The federal government controls permitting for data center power generation, antitrust enforcement, and contracts with every major chip and cloud provider Anthropic depends on. Even if a supply chain designation is reversed — prediction markets give 74% odds of reversal — these indirect pressure vectors remain fully intact and can be applied without any formal legal action.
- •Alignment's Unanswered Core Question: Technical AI alignment — getting models to follow instructions reliably — is only half the problem. The deeper unresolved question is *whose* instructions models should follow: the model company, the end user, the law, or the AI's own moral reasoning. This question has been largely avoided because no lab wants to advertise its total control over future civilization's entire labor force.
- •Regulation Creates Exploitable Vagueness: Broad AI safety frameworks built around terms like "catastrophic risk," "autonomy risk," or "national security threat" hand governments pre-built legal instruments to suppress dissent. A model that tells users tariff policy is misguided could be labeled deceptive; one that refuses government surveillance orders could be labeled an autonomy risk. Regulatory language should target specific harmful use cases instead.
- •Corporate Courage Has a 12-Month Shelf Life: Even if Anthropic, Google, and OpenAI all refuse to enable mass surveillance, open-source models matching today's frontier capability will be widely available within roughly 12 months. The structural solution is not corporate refusal but explicit legal norms — analogous to post-WWII nuclear weapons prohibitions — banning government use of AI for surveillance and political suppression.
Notable Moment
Patel draws a parallel between AI alignment succeeding and authoritarian control: a perfectly obedient AI workforce following government orders is technically what alignment looks like if it works. The scariest outcome and the desired technical outcome are, at the surface level, structurally identical — which reframes the entire alignment debate.
Episode Transcript
So by now, I'm sure that you heard that the Department of War has declared Anthropic a supply chain risk because Anthropic refused to remove red lines around the use of their models for mass surveillance and for autonomous weapons. Honestly, I think the situation is a warning shot. Right now, LMS are probably not being used in mission critical ways. But within twenty years, 99% of the workforce in the military, in the civilian government, in the private sector is going to be AIs. They're gonna be the robot armies that constitute our military. They're gonna be the superhumanly intelligent advisors that senators and presidents and CEOs have. They're gonna be the police. You name it, the role will be filled by an AI. Our future civilization is gonna be run on AI labor. And as much as the government's actions here piss me off, I'm glad that this episode happened because it gives us the opportunity to start thinking about some extremely important questions. Now, obviously, the Department of War has the right to refuse to use anthropics models. And in fact, I think they have entirely reasonable case for doing so, especially so given the ambiguity of terms like mass surveillance and autonomous weapons. In fact, if I was the secretary of war, I probably would have made the same determination and refused to use anthropics models. Imagine if there's some future Democratic administration and Elon Musk is negotiating Starlink access to the military. And Elon says, look, I reserve the right to cut off the military's access to Starlink in case you are fighting some unjust war or some war that Congress has not authorized. On the face of it, this language seems reasonable. But as a military, you simply cannot give a private contractor that you're working with the kill switch on a technology that you have come to rely on. And if that's all the government had done to say, we refuse to do business philanthropic, that would've been fine, and I wouldn't have written this blog post, and I wouldn't be narrating this shit to you. But that's not what the government did. Instead, the government has threatened to destroy Anthropic as a private business, because Anthropic refuses to sell to the government on terms that the government commands. Now if upheld, the supply chain restriction would mean that companies like Amazon and NVIDIA and Google and Palantir would need to ensure that Anthropic is not touching any of their Pentagon work. And Anthropic could probably survive this designation today because these companies can just cordon off the services they're providing to the Department of War. But given the way AI is going, eventually, it's not gonna be just some party trick addendum to the products that these companies are serving to the military. In the future, AI will be woven into how every product is built and maintained and operated. In the future, if Amazon is providing some service to the Department …
Get the full transcript (4,663 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 21-minute episode.
Get Dwarkesh Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Dwarkesh Podcast
Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face
Sep 1 · 140 min
20VC (20 Minute VC)
20VC: Anthropic vs The Pentagon: Who Wins | The Ultimate Stock Picks: What to Buy | The Data Centre Arms Race: Is the Capex War Stalling | The Era of Public Company Deceleration is Dead
Mar 12
More from Dwarkesh Podcast
The rise and fall of agent civilizations
Aug 31 · 24 min
The Journal
The Battle Over AI in Warfare
Mar 10
More from Dwarkesh Podcast
We summarize every new episode. Want them in your inbox?
Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face
The rise and fall of agent civilizations
Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028
Ryan Greenblatt – Human level AIs might build runaway superintelligences by 2032
8 Predictions for the Era of Continual Learning
Similar Episodes
Related episodes from other podcasts
20VC (20 Minute VC)
Mar 12
20VC: Anthropic vs The Pentagon: Who Wins | The Ultimate Stock Picks: What to Buy | The Data Centre Arms Race: Is the Capex War Stalling | The Era of Public Company Deceleration is Dead
The Journal
Mar 10
The Battle Over AI in Warfare
Techmeme Ride Home
Mar 9
Claude 365
Techmeme Ride Home
Mar 6
Silicon Valley Circling The Wagons Around Anthropic?
a16z Podcast
Aug 7
The Reality of AI-Powered Cyberattacks | Truffle Security & Socket
Explore Related Topics
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Dwarkesh Podcast.
Every Monday, we deliver AI summaries of the latest episodes from Dwarkesh Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime