AI and the New Global Security Landscape
Episode
72 min
Read time
3 min
Topics
Fundraising & VC, Artificial Intelligence, Software Development
AI-Generated Summary
Key Takeaways
- ✓Zero-Day Machine Threshold: Claude Mythos represents a capability discontinuity, not a gradual progression. It identifies zero-days across 10,000 software systems simultaneously, exploits multiple vulnerabilities in parallel, generates original exploits that never previously existed, and remains undetected indefinitely. Cybersecurity experts describe this as previously science-fiction-level capability. Critically, 90% replication of this capability by open-weight Chinese models still constitutes an extraordinarily powerful offensive weapon.
- ✓AI Bioweapon Upskilling — Third-Party Validated: Independent red team tests confirm AI models provide step-by-step bioweapon synthesis guidance without requiring domain expertise. A 2025 red team test showed a model detailing how to weaponize genetic material and disperse it via weather balloon over a US city. A 2023 study prompted an AI to reward toxicity, generating 40,000 candidate chemical warfare agents — including novel molecules potentially deadlier than VX — within six hours.
- ✓Self-Regulation Is the Only Mechanism Currently in Place: No national legislation and no international treaty specifically governs AI-enabled bioweapon or cyberweapon creation as of July 2026. Frontier labs conduct internal red team tests and grade their own homework. The US government's oversight body, CASEY within the Commerce Department, lacks clear structure and rigorous analytical capacity. Congressman Josh Gottheimer has introduced mandatory NSA-led security review legislation, but it remains unpassed.
- ✓Open-Weight Chinese Models Circumvent US Oversight Entirely: Even a fully effective US regulatory framework cannot address threats from Chinese open-weight models, which are released publicly and replicate frontier capabilities within three to nine months. China's open-model architecture accelerates innovation and propagates security risks simultaneously. The Trump-Xi summit in spring 2026 identified AI security cooperation as a bilateral agenda item but produced no concrete mechanisms or commitments.
- ✓Autonomous Drone Warfare Erodes Human Decision-Making Control: Ukraine's conflict has shifted to primarily drone-on-drone warfare, where Russian soldiers sent to capture territory survive an average of 20–35 minutes. As drone swarms require instantaneous autonomous coordination that human operators cannot provide at speed, battlefield decision authority devolves to AI systems. Hypersonic weapons — capable of striking targets across continents in minutes — further collapse human response time, threatening the survivable second-strike foundation of nuclear deterrence.
What It Covers
Gordon Goldstein, adjunct senior fellow at the Council on Foreign Relations, joins Kevin Ball to examine how frontier AI models — particularly Anthropic's Claude Mythos — have created documented capabilities for zero-day cyberweapons, novel bioweapon synthesis, and autonomous battlefield targeting, forcing ad hoc US government oversight mechanisms into existence as of mid-2026.
Key Questions Answered
- •Zero-Day Machine Threshold: Claude Mythos represents a capability discontinuity, not a gradual progression. It identifies zero-days across 10,000 software systems simultaneously, exploits multiple vulnerabilities in parallel, generates original exploits that never previously existed, and remains undetected indefinitely. Cybersecurity experts describe this as previously science-fiction-level capability. Critically, 90% replication of this capability by open-weight Chinese models still constitutes an extraordinarily powerful offensive weapon.
- •AI Bioweapon Upskilling — Third-Party Validated: Independent red team tests confirm AI models provide step-by-step bioweapon synthesis guidance without requiring domain expertise. A 2025 red team test showed a model detailing how to weaponize genetic material and disperse it via weather balloon over a US city. A 2023 study prompted an AI to reward toxicity, generating 40,000 candidate chemical warfare agents — including novel molecules potentially deadlier than VX — within six hours.
- •Self-Regulation Is the Only Mechanism Currently in Place: No national legislation and no international treaty specifically governs AI-enabled bioweapon or cyberweapon creation as of July 2026. Frontier labs conduct internal red team tests and grade their own homework. The US government's oversight body, CASEY within the Commerce Department, lacks clear structure and rigorous analytical capacity. Congressman Josh Gottheimer has introduced mandatory NSA-led security review legislation, but it remains unpassed.
- •Open-Weight Chinese Models Circumvent US Oversight Entirely: Even a fully effective US regulatory framework cannot address threats from Chinese open-weight models, which are released publicly and replicate frontier capabilities within three to nine months. China's open-model architecture accelerates innovation and propagates security risks simultaneously. The Trump-Xi summit in spring 2026 identified AI security cooperation as a bilateral agenda item but produced no concrete mechanisms or commitments.
- •Autonomous Drone Warfare Erodes Human Decision-Making Control: Ukraine's conflict has shifted to primarily drone-on-drone warfare, where Russian soldiers sent to capture territory survive an average of 20–35 minutes. As drone swarms require instantaneous autonomous coordination that human operators cannot provide at speed, battlefield decision authority devolves to AI systems. Hypersonic weapons — capable of striking targets across continents in minutes — further collapse human response time, threatening the survivable second-strike foundation of nuclear deterrence.
- •Commercial Actors, Not States, Control the Technology: Unlike the nuclear era — where the US and USSR held near-monopoly state control over weapons technology — frontier AI capabilities reside almost entirely within private companies locked in ruthless commercial competition. Proposals for an IAEA-equivalent AI standards body have been floated by Demis Hassabis and Sam Altman, but no coordinating mechanism exists. The US-China joint understanding against AI nuclear control is informal and uncodified in any arms control treaty.
Notable Moment
During a 2023 bioterrorism demonstration, a virologist posing as a terrorist used ChatGPT to generate a shopping list of materials for mass-casualty weapons. A colleague then carried the unassembled biological components undetected into a White House meeting on bioterrorism — illustrating that the threat bypassed both AI safeguards and physical security simultaneously.
Episode Transcript
The conversation about AI often focuses on software, automation, and the race between attackers and defenders in code. However, some of the most consequential risks lie further afield in domains where a mistake is measured in human lives. Advanced models can now offer step by step guidance toward chemical and biological weapons, and militaries are already folding AI into targeting and battlefield assessments. These are no longer speculative fears confined to the AI doomer crowd. They are documented in red team disclosures, government legislation, and events unfolding on real battlefields. Gordon M. Goldstein is an adjunct senior fellow at the Council on Foreign Relations, where he focuses on the convergence of technology and US foreign policy. He previously spent nearly a decade as a managing director at Silver Lake, and he is the author of Lessons in McGeorge Bundy and the Path to War in Vietnam, which is a study of national security strategy and White House decision making. In this episode, Gordon joins Kevin Ball to discuss the credibility of AI enabled chemical and biological weapon threats, the ad hoc safeguards meant to contain them, and the rise of autonomous warfare and its implications for human control and nuclear deterrence. Gordon speaks on his own behalf, not on behalf of the Council on Foreign Relations. Kevin Ball, or Kay Ball, is the vice president of engineering at Mento and an independent coach for engineers and engineering leaders. He cofounded and served as CTO for two companies, founded the San Diego JavaScript meetup, and organizes the AI in action discussion group through Latent Space. Check out the show notes to follow Keball on Twitter or LinkedIn or visit his website, keball.llc. Gordon, welcome to the show. Jenna, great to be here. Yeah. I am really interested in this conversation. So let's get in. But before we do, let's start with you a little bit. So can you give us a quick overview of your background and how you came to be interested in this subject area? Sure. So I am by training in international relations and international security analyst. Right now, I'm a senior fellow at the Council on Foreign Relations, which is a prominent pink tank based in New York and Washington focused on US foreign policy broadly defined. It is a nonpartisan organization. All of the senior fellows work through areas of domain expertise, but not necessarily areas of political advocacy. And I guess it's important to state that here I speak on my own behalf and and not as a representative of the council. I have been a senior fellow at the council for about ten years. I was brought in a decade ago because at the time, I was a managing director at a large private equity global technology investment firm, and I also had a continuing interest and background as a student of national security and American strategy. And my mandate was to chart the convergence of technology policy and US foreign policy interests. So …
Get the full transcript (9,592 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 69-minute episode.
Get Software Engineering Daily summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Software Engineering Daily
How LLMs Are Reshaping Recommendation Systems
Aug 18 · 47 min
Odd Lots
Brad Setser on the US's Unusual Japanese Yen Intervention
Aug 6
More from Software Engineering Daily
Rebuilding the Cloud for AI Agent Code
Aug 13 · 49 min
Odd Lots
Brad Setser on the War in Iran and the Future of the US Dollar
Apr 16
More from Software Engineering Daily
We summarize every new episode. Want them in your inbox?
How LLMs Are Reshaping Recommendation Systems
Rebuilding the Cloud for AI Agent Code
SED News: The Kimi Moment, Runaway AI, and Tokenmaxxing
The Terminal as an Agentic Interface
AI-Powered Threats to the Software Supply Chain
Similar Episodes
Related episodes from other podcasts
Odd Lots
Aug 6
Brad Setser on the US's Unusual Japanese Yen Intervention
Odd Lots
Apr 16
Brad Setser on the War in Iran and the Future of the US Dollar
Odd Lots
Feb 5
This Is How The US Can Become a Player in Rare Earth Metals
The Ezra Klein Show
Aug 14
What if America Followed the Rules?
The Daily (NYT)
Jul 11
Mick Jagger Isn't Sure He Ever Lets the World See the Real Him
Explore Related Topics
This podcast is featured in Best Cybersecurity Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Software Engineering Daily.
Every Monday, we deliver AI summaries of the latest episodes from Software Engineering Daily and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime