What Open Source Teaches Us About Making AI Better - Ep. 278

Hello, and welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. Right now, the world is watching AI evolve faster than ever before, and that progress isn't just being fueled by technological breakthroughs in scale. It's being fueled by human collaboration. Open source models, open datasets, and shared research are giving developers, enterprises, and governments the building blocks they need to innovate together. NVIDIA has been part of this movement from the very beginning, contributing open libraries, publishing datasets and research, and most recently, sharing families of open models, which brings us to today's episode. We're talking about Nematron, specifically unlocking the secret of Nematron. On the surface, Nematron may look like just another open model family, but the real story is how it anchors NVIDIA's strategy for building accelerated infrastructure and driving increased adoption of AI everywhere. Joining us to unpack this open secret are two of the leaders driving this work forward. Brian Catanzaro is vice president of applied deep learning research at NVIDIA, and Jonathan Cohen is vice president of applied research at NVIDIA. Brian and Jonathan are here today to talk Neutron. I can't wait. Gentlemen, welcome to the AI podcast. Thank you so much for making the time to join us. Thank you for having us. Yeah. It's great to be here. So let's start at the top, and I'll direct this one to you, Brian, to get us going if if that's alright. What is Neumatron? And as a follow-up, why did NVIDIA decide to build its own family of models when you already work with essentially every major model builder out there? Nemotron is NVIDIA's open technology for artificial intelligence. Nemotron includes models that we train. It also includes datasets that we release as well as algorithms and methodologies. And our goal with Nemotron is to support the community in building customizable AI that can be integrated deeply and tightly, into the beating heart of every business around the world. Our second goal with Nemotron is to help NVIDIA design systems for deploying and constructing AI. There's a lot of questions about, how AI works that touch the various design decisions that go into building NVIDIA software and hardware systems. And we can answer those questions better because we build Neutron. So, you know, ultimately, we're, excited to open up Neutron even further and continue to, put it out there for the community. We love learning from the community. Nemotron is is built in collaboration with the community where we learn a lot from what what others are doing in the community, and then, we try to, you know, contribute what we can back. We think that, this is a a great opportunity for for NVIDIA to support, the AI industry. Yeah. So Nemotron is collection of large language models, and it's probably worth saying so they're text models and and, multimodal LLMs. And we've kind of settled on, like, three sizes or we we think of them as weight classes. …