Building AI Factories: How Red Hat and NVIDIA Turn Enterprise Data Into Intelligence - Ep. 293

Welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. My guests today are Red Hat's Chris Wright and NVIDIA's Justin Boitano, and we're talking AI factories. Why should enterprises build AI factories, and how can they do so with confidence in building AI factories that they can trust? By way of introductions, and I'll keep it brief because both of these guys' work speaks for itself really. Chris Wright is chief technology officer and senior vice president of global engineering at Red Hat, and Justin Boitano is vice president and general manager of enterprise computing at NVIDIA. Gentlemen, welcome to the NVIDIA AI podcast. Thank you so much for taking the time to join us. Thanks for having us. Thanks for having me, Noah. Let's get right into it. And, Justin, I'll I'll start with you, but always, both of you guys feel free to jump in, you know, as the spirit moves you, so to speak, as we go. But, Justin, why don't we start with you? Can you talk a little bit about well, maybe first give kind of a working definition of what we mean, what you mean when we talk about an AI factory, and then get into kind of at a high level, why would an enterprise be interested? Tangible benefits that an enterprise can expect to see from an AI factory? Sure, Noah. Yeah. I you know, and I think it's important to understand kind of the context of where we are, as an industry. And, you know, building digital intelligence to power the productivity of organizations is going to be as critical, in this decade as, you know, energy in running our companies. This is the next industrial revolution, and companies are always asking us, you know, how do we build, these factories, that basically take data in and then produce the intelligence that, you know, helps them run their their businesses more efficiently. And, so as we as we talk about, like, what is an AI factory, you know, we think of them as really kind of five layers of technology that need to come together. At the base layer, you know, you gotta make sure that you have got the the data centers with power to bring into these factories. You've gotta have, you know, chips, is the is the easy way to talk about it. But we're at this point of building rack scale infrastructure that's, you know, six chips with extreme codesign to to build the best token efficiency from the power available to you. Mhmm. The next layer, you you typically wanna have the software infrastructure to orchestrate everything, and then you wanna have models, that run that intelligence, and then ultimately, the apps and the agents on top. And so, what what every business needs to do though is is take this intelligence, and build, you know, use case specific business outcomes that help them, drive innovation, build products faster, and ultimately, you know, grow …