NVIDIA’s Bartley Richardson on Why ‘Agentic AI Is Next-Level Automation’ - Ep. 258
Episode
28 min
Read time
2 min
Topics
Productivity, Remote Work, Relationships
AI-Generated Summary
Key Takeaways
- ✓NEMA Retriever Performance: Processes complex PDFs at 10 pages per second on single GPU with 15x throughput improvement over competitors and 50% fewer accuracy errors, handling multimodal documents with text, tables, charts while preserving contextual relationships between elements.
- ✓Agent Ops Tools Efficiency: Fine-tuning through successive iterations and tool emulation delivers 10x model size reduction while increasing accuracy by 4%, with human feedback loops using thumbs up/down plus free-form text to steer model behavior toward specific enterprise use cases.
- ✓AgentIQ Observability Platform: Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks, allowing developers to inspect input/output tokens, timing, and sequences—customers achieve 15x speed improvements and 5x accuracy gains through optimization.
- ✓Context-Based Security Model: Moves beyond firewall and application-based security to analyze the context of each query, examining who asks, what information accompanies the request, and what data should be returned—adding 10% new security requirements to existing 90% application security practices.
What It Covers
Bartley Richardson explains agentic AI as next-level automation for enterprises, covering NVIDIA's technology stack including NEMA Retriever for multimodal data ingestion, reasoning models, AgentIQ observability platform, and context-based security approaches for distributed agent systems.
Key Questions Answered
- •NEMA Retriever Performance: Processes complex PDFs at 10 pages per second on single GPU with 15x throughput improvement over competitors and 50% fewer accuracy errors, handling multimodal documents with text, tables, charts while preserving contextual relationships between elements.
- •Agent Ops Tools Efficiency: Fine-tuning through successive iterations and tool emulation delivers 10x model size reduction while increasing accuracy by 4%, with human feedback loops using thumbs up/down plus free-form text to steer model behavior toward specific enterprise use cases.
- •AgentIQ Observability Platform: Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks, allowing developers to inspect input/output tokens, timing, and sequences—customers achieve 15x speed improvements and 5x accuracy gains through optimization.
- •Context-Based Security Model: Moves beyond firewall and application-based security to analyze the context of each query, examining who asks, what information accompanies the request, and what data should be returned—adding 10% new security requirements to existing 90% application security practices.
Notable Moment
Richardson demonstrates how reasoning models facilitate human-in-the-loop workflows where AI generates brainstorming questions from customer issues, humans meet to discuss while drawing diagrams, then the system produces 75-80% complete product requirement documents from meeting transcripts and whiteboard photos.
Episode Transcript
Hello, and welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. AgenTic AI is on the tips of everyone's tongues right now, it seems. But what is it? What makes AgenTic AI so exciting, and what should AI leaders like CIOs and IT execs be thinking about when designing an AgenTic AI system for an enterprise? Here to break it down for us, live from GTC twenty twenty five, is Bartley Richardson. Bartley is senior director of engineering and AI infrastructure here at NVIDIA, where he leads AgenTek AI and cybersecurity AI. Previously, Bartley was a technical lead on multiple DARPA projects. He holds a PhD in computer science and engineering with a focus on AI, and he's here right now. Bartley, thanks for taking time out of a busy GTC week to join the podcast. Thanks, Noah. I really appreciate it. That's a great intro, by the way. I'm gonna I'm gonna bring you along with me everywhere I go, and you can do that intro every time. I I'm I'm anything I can for the cause. Happy to do it. So maybe we can start with to put you on the spot, you don't have to define things, but talk about AgenTek AI, what it is, why is it so exciting, you know, in this context of enterprise leaders. Yeah. You know, I I feel like what we're really good at at the in the tech industry, and I'll include us at NVIDIA and that and everybody, right, is we're really good at making things very complicated. It's one of our primary concentrations. Right? And and when I talk with people about agents and agent take AI, what I really want to say is automation. Mhmm. Right? Like, that's the word I really wanna use. But automation used to just get half of it out of your mouth and people fall asleep. Right? So so we call it agents take an agent AI, an agent take AI. And really what it is, it is that next level of automation. If you think about the evolution of automation and how we were doing things manually, and even if you go back to factories, right, and that these types of things, these I don't wanna say mundane, but I obviously just said it, but these kind of, like, everyday repeatable tasks Right. Right, we've come up with better ways to do it. Right? Like, I example, I grew up on a farm in the middle of Ohio, and we we would dig post holes by ourselves. So you get these terrible tools. We we have technology that does this now for us. Right? Agents are very similar. They're just instead of working in the dirt in the middle of Ohio, they're working on massive petabyte scale data silos or, you know, information repositories to take that data, turn on a little bit, do this, like, mundane task, and then instead of returning data that the human has to …
Get the full transcript (6,054 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 25-minute episode.
Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from NVIDIA AI Podcast
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
Jun 24 · 39 min
Software Engineering Daily
Agentic Mesh with Eric Broda
Apr 16
More from NVIDIA AI Podcast
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Jun 10 · 21 min
Eye on AI
AI Agents Fixing Your IT Before You Even Know Something Broke | Erhan Giral & Ryan Manning, BMC Helix
Aug 3
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
- AgentIQBy guest
by NVIDIA
“AgentIQ Observability Platform: Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks”
“Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks”
“Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks”
- NEMA RetrieverBy guest
by NVIDIA
“NVIDIA's technology stack including NEMA Retriever for multimodal data ingestion, reasoning models, AgentIQ observability platform”
More from NVIDIA AI Podcast
We summarize every new episode. Want them in your inbox?
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300
Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299
Snap’s Secret to Processing 10 Petabytes a Day: GPU-Accelerated Spark | NVIDIA AI Podcast Ep. 298
Similar Episodes
Related episodes from other podcasts
Software Engineering Daily
Apr 16
Agentic Mesh with Eric Broda
Eye on AI
Aug 3
AI Agents Fixing Your IT Before You Even Know Something Broke | Erhan Giral & Ryan Manning, BMC Helix
Eye on AI
Jun 13
One Company Now Has More AI Agents Than Human Employees | Ryan Gavin of Slack
Odd Lots
May 16
Stripe's John Collison on How Agentic Commerce Will Reshape the Internet
Eye on AI
May 15
Why Agentic-First Startups Won't Disrupt Enterprises as Fast as Everyone Thinks | Kris Lovejoy
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
You're clearly into NVIDIA AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime