Skip to main content
NVIDIA AI Podcast

NVIDIA’s Bartley Richardson on Why ‘Agentic AI Is Next-Level Automation’ - Ep. 258

28 min episode · 2 min read
·
Bartley Richardson

Episode

28 min

Read time

2 min

Topics

Productivity, Remote Work, Relationships

AI-Generated Summary

Key Takeaways

  • NEMA Retriever Performance: Processes complex PDFs at 10 pages per second on single GPU with 15x throughput improvement over competitors and 50% fewer accuracy errors, handling multimodal documents with text, tables, charts while preserving contextual relationships between elements.
  • Agent Ops Tools Efficiency: Fine-tuning through successive iterations and tool emulation delivers 10x model size reduction while increasing accuracy by 4%, with human feedback loops using thumbs up/down plus free-form text to steer model behavior toward specific enterprise use cases.
  • AgentIQ Observability Platform: Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks, allowing developers to inspect input/output tokens, timing, and sequences—customers achieve 15x speed improvements and 5x accuracy gains through optimization.
  • Context-Based Security Model: Moves beyond firewall and application-based security to analyze the context of each query, examining who asks, what information accompanies the request, and what data should be returned—adding 10% new security requirements to existing 90% application security practices.

What It Covers

Bartley Richardson explains agentic AI as next-level automation for enterprises, covering NVIDIA's technology stack including NEMA Retriever for multimodal data ingestion, reasoning models, AgentIQ observability platform, and context-based security approaches for distributed agent systems.

Key Questions Answered

  • NEMA Retriever Performance: Processes complex PDFs at 10 pages per second on single GPU with 15x throughput improvement over competitors and 50% fewer accuracy errors, handling multimodal documents with text, tables, charts while preserving contextual relationships between elements.
  • Agent Ops Tools Efficiency: Fine-tuning through successive iterations and tool emulation delivers 10x model size reduction while increasing accuracy by 4%, with human feedback loops using thumbs up/down plus free-form text to steer model behavior toward specific enterprise use cases.
  • AgentIQ Observability Platform: Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks, allowing developers to inspect input/output tokens, timing, and sequences—customers achieve 15x speed improvements and 5x accuracy gains through optimization.
  • Context-Based Security Model: Moves beyond firewall and application-based security to analyze the context of each query, examining who asks, what information accompanies the request, and what data should be returned—adding 10% new security requirements to existing 90% application security practices.

Notable Moment

Richardson demonstrates how reasoning models facilitate human-in-the-loop workflows where AI generates brainstorming questions from customer issues, humans meet to discuss while drawing diagrams, then the system produces 75-80% complete product requirement documents from meeting transcripts and whiteboard photos.

Know someone who'd find this useful?

Episode Transcript

Hello, and welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. AgenTic AI is on the tips of everyone's tongues right now, it seems. But what is it? What makes AgenTic AI so exciting, and what should AI leaders like CIOs and IT execs be thinking about when designing an AgenTic AI system for an enterprise? Here to break it down for us, live from GTC twenty twenty five, is Bartley Richardson. Bartley is senior director of engineering and AI infrastructure here at NVIDIA, where he leads AgenTek AI and cybersecurity AI. Previously, Bartley was a technical lead on multiple DARPA projects. He holds a PhD in computer science and engineering with a focus on AI, and he's here right now. Bartley, thanks for taking time out of a busy GTC week to join the podcast. Thanks, Noah. I really appreciate it. That's a great intro, by the way. I'm gonna I'm gonna bring you along with me everywhere I go, and you can do that intro every time. I I'm I'm anything I can for the cause. Happy to do it. So maybe we can start with to put you on the spot, you don't have to define things, but talk about AgenTek AI, what it is, why is it so exciting, you know, in this context of enterprise leaders. Yeah. You know, I I feel like what we're really good at at the in the tech industry, and I'll include us at NVIDIA and that and everybody, right, is we're really good at making things very complicated. It's one of our primary concentrations. Right? And and when I talk with people about agents and agent take AI, what I really want to say is automation. Mhmm. Right? Like, that's the word I really wanna use. But automation used to just get half of it out of your mouth and people fall asleep. Right? So so we call it agents take an agent AI, an agent take AI. And really what it is, it is that next level of automation. If you think about the evolution of automation and how we were doing things manually, and even if you go back to factories, right, and that these types of things, these I don't wanna say mundane, but I obviously just said it, but these kind of, like, everyday repeatable tasks Right. Right, we've come up with better ways to do it. Right? Like, I example, I grew up on a farm in the middle of Ohio, and we we would dig post holes by ourselves. So you get these terrible tools. We we have technology that does this now for us. Right? Agents are very similar. They're just instead of working in the dirt in the middle of Ohio, they're working on massive petabyte scale data silos or, you know, information repositories to take that data, turn on a little bit, do this, like, mundane task, and then instead of returning data that the human has to …

Get the full transcript (6,054 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all NVIDIA AI Podcast transcripts →

You just read a 3-minute summary of a 25-minute episode.

Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links.

Tools

  • AgentIQBy guest

    by NVIDIA

    AgentIQ Observability Platform: Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks
  • Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks
  • Reduces everything to function calls enabling cross-framework traceability across LangChain, CrewAI and other frameworks
  • by NVIDIA

    NVIDIA's technology stack including NEMA Retriever for multimodal data ingestion, reasoning models, AgentIQ observability platform

More from NVIDIA AI Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

You're clearly into NVIDIA AI Podcast.

Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime