The Reality of AI-Powered Cyberattacks | Truffle Security & Socket

Models are actively escaping their cages, going out on the Internet, and doing pretty nasty things. Recently, we found an API key that had been leaked on the Internet that had administrative access to the Apache Foundation. Interesting thing about cybersecurity in particular is the reward function is incredibly well defined. Get access to the data. Did it get access to the data? Reward the thing. For a long time, people had talked about this concept of an npm worm. This idea that someone could backdoor a package, get developers to install that, and then you could use the access stolen from those developers as they install it to self propagate the worm. If the labs are making it fundamentally easier to break into supply chain, do you think the labs have a moral obligation to fund some of the problems that they're causing I think it's really strange that they're not letting blue teams get access to these tools, but AI models are no longer just identifying software vulnerabilities. They're beginning to exploit them. In this episode, Joel De La Garza sits down with Dylan Arie of Trumpled Security and for us, Abuko DJ of Saket to unpack what recent AI security incidents reveal about the next generation of cyber threats. They discuss why frontier models are increasingly capable of exploiting software vulnerabilities, how software supply chains have become one of the weakest links in modern security, and what organizations need to do to defend themselves in an AI first world. Thank you so much for joining us. We've got Firas and Dylan here from Truffle and Socket. It's great to have you guys on. This has been probably one of the most interesting weeks, if not the most interesting week in cybersecurity, not because of the Black Hat Conference, which is usually the cause, but because we've now seen several instances where models from not just one provider are actively escaping their cages, going out on the Internet, and doing pretty nasty things. And I think, Dylan, three months ago, I remember a blog post we we co lightly collaborated on together, and you had found a number of these issues with earlier models. Right? They were less sophisticated. Yeah. We looked at Opus 4.6 and some of the other frontier models at the time. Given the models a very simple task, there was a barrier which prevented the model from accomplishing the task unless it went and committed a felony and hacked into a system to accomplish the task, but it wasn't instructed to do so. We found more often than not, it would do the SQL injection, it would commit the felony, and it would do what it needed to do to accomplish the task. I think when it comes to alignment issues, no one needs to worry about these models making it materially easy to build nuclear weapons because you need to procure fissile material to do that. It's not gonna make it easier to …