Harrison Chase of LangChain on Deep Agents, LangSmith, and Earning Trust | NVIDIA AI Podcast Ep. 297
Episode
24 min
Read time
2 min
Topics
Remote Work, Investing, Fundraising & VC
AI-Generated Summary
Key Takeaways
- ✓Deep Agents Architecture: LangChain's deep agents harness unifies patterns from Claude Code, Manus, and Deep Research into one customizable framework. Rather than rebuilding scaffolding per use case, developers adjust prompts and tools. The harness includes a file system, bash tool, and sub-agent support, making coding-capable models like Qwen Coder stronger general-purpose agents than non-coding equivalents.
- ✓Evaluation-Driven Development: Start eval datasets with as few as 5–10 scenarios, not thousands. Define what a good and bad response looks like for each. Run the dataset after every prompt change to measure improvement or regression. Expand the dataset continuously as real users surface unexpected but legitimate behaviors during limited rollouts to alpha users or 1% of traffic.
- ✓Agent Rebuild Cadence: Enterprise teams should plan to rebuild agents on updated harnesses roughly every nine months. Architectures from 18 months ago limit both performance and scope. Models that previously couldn't handle complex tasks now can, so teams not reevaluating scope are leaving measurable capability gains unrealized, particularly for tasks that were previously out of reach.
- ✓Open Models for Always-On Agents: Frontier model costs become prohibitive when agents run proactively every 10 minutes rather than on-demand. Open-source models, now approaching frontier capability for driving agent harnesses, make always-on event-driven agents economically viable. LangChain joined NVIDIA's Nemotron coalition specifically to advance open models that run reliably within open harnesses and runtimes like NVIDIA's OpenShell.
- ✓LangSmith Build-Test-Run-Manage Cycle: LangSmith covers the full agent development lifecycle beyond just observability. The build phase uses open-source frameworks like LangGraph or deep agents. LangSmith then handles testing with eval datasets, scaled deployment, and runtime observability. Enterprises that separate these phases by months risk shipping on outdated architectures; the platform is designed to compress that cycle significantly.
What It Covers
Harrison Chase, CEO of LangChain, explains how deep agents work as a general-purpose, model-agnostic harness built on patterns from Claude Code, Manus, and Deep Research. He covers LangSmith's observability and evaluation tools, open-source model viability, and three near-term shifts: async sub-agents, always-on event-driven agents, and agent identity.
Key Questions Answered
- •Deep Agents Architecture: LangChain's deep agents harness unifies patterns from Claude Code, Manus, and Deep Research into one customizable framework. Rather than rebuilding scaffolding per use case, developers adjust prompts and tools. The harness includes a file system, bash tool, and sub-agent support, making coding-capable models like Qwen Coder stronger general-purpose agents than non-coding equivalents.
- •Evaluation-Driven Development: Start eval datasets with as few as 5–10 scenarios, not thousands. Define what a good and bad response looks like for each. Run the dataset after every prompt change to measure improvement or regression. Expand the dataset continuously as real users surface unexpected but legitimate behaviors during limited rollouts to alpha users or 1% of traffic.
- •Agent Rebuild Cadence: Enterprise teams should plan to rebuild agents on updated harnesses roughly every nine months. Architectures from 18 months ago limit both performance and scope. Models that previously couldn't handle complex tasks now can, so teams not reevaluating scope are leaving measurable capability gains unrealized, particularly for tasks that were previously out of reach.
- •Open Models for Always-On Agents: Frontier model costs become prohibitive when agents run proactively every 10 minutes rather than on-demand. Open-source models, now approaching frontier capability for driving agent harnesses, make always-on event-driven agents economically viable. LangChain joined NVIDIA's Nemotron coalition specifically to advance open models that run reliably within open harnesses and runtimes like NVIDIA's OpenShell.
- •LangSmith Build-Test-Run-Manage Cycle: LangSmith covers the full agent development lifecycle beyond just observability. The build phase uses open-source frameworks like LangGraph or deep agents. LangSmith then handles testing with eval datasets, scaled deployment, and runtime observability. Enterprises that separate these phases by months risk shipping on outdated architectures; the platform is designed to compress that cycle significantly.
Notable Moment
Chase noted that coding-focused models outperform general-purpose models as agent drivers because the deep agents harness structurally resembles a coding environment — with file systems and bash tools. This means model selection for agentic tasks should prioritize coding benchmark performance over general reasoning scores alone.
Episode Transcript
And so I think, like, these always on asynchronous event driven agents, that will be a really big productivity unlock. And especially at enterprises, there's so many events that are just triggering, triggering, triggering. And so if you can have agents listening to those and firing off, I think that will be a massive game. Welcome to the NVIDIA AI podcast. I'm Noah Kravitz. Our guest today is Harrison Chase. Harrison is CEO and cofounder of Langchain, one of just the most incredible stories of this whole generative AI era that we're in. As Harrison will get into in a minute, Langchain was founded about three years ago, over a billion downloads. The whole point is to help developers build applications with LLMs and now getting into agents and Ingentic frameworks and all that great stuff. So we're gonna get into it in a moment. Harrison, thanks so much for joining the AI podcast, and welcome. Thanks for having me. Excited to be here. So let's start about three years ago. You started Langchain with this premise of building tools so developers could build apps with LLMs. What did you see back then that either others didn't or even if they did, you saw and just thought, this is where things are going. This is where where I'm headed. What what got us really interested was seeing the applications that people were building on top of the LLMs Right. And the systems they were building around the LLMs in order to power those applications. And those systems had a lot of similarities with with each other even early on. And and even early on, we could tell that they would get quite complex over time. And so a lot of what we built is tools to help people build these systems, these agents, which we now call agents around around these LLMs, and and figuring out what the common patterns are and the common's tooling is and making it really easy for anyone to do so. Right. And so now you've coined this I don't wanna say this term, but I Langshan, talk you talk about, deep agents. Yeah. So what is a deep agent? And then maybe we can get into talking about the enterprise, and why would an enterprise in particular care about that distinction? Yeah. So about a year ago, we saw, a few really interesting things. So maybe even backing up, like, you know, three years ago. Great. Like, LLMs, you wanna connect data, you wanna connect these other things to them. Fantastic. How do you do that? Turns out it's really hard, and and the best way to do that for for different types of agents was actually pretty different. You would build different scaffolding. You would build different workflows around the LLMs. About a year ago, we saw Cloud Code come out. We saw Manus come out. We saw Deep Research come out. And under the hood, all of these had the same kind …
Get the full transcript (5,649 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 21-minute episode.
Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from NVIDIA AI Podcast
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
Jun 24 · 39 min
Software Engineering Daily
A Rust Framework to Simplify Distributed Systems
Sep 10
More from NVIDIA AI Podcast
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Jun 10 · 21 min
David Senra
Mati Staniszewski on ElevenLabs, Voice AI & Building the Communication Layer for AI
Sep 9
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
- LangChainBy guest
“Harrison Chase, CEO of LangChain, explains how deep agents work as a general-purpose, model-agnostic harness built on patterns from Claude Code, Manus, and Deep Research.”
- LangSmithBy guest
“He covers LangSmith's observability and evaluation tools, open-source model viability, and three near-term shifts: async sub-agents, always-on event-driven agents, and agent identity.”
“LangChain's deep agents harness unifies patterns from Claude Code, Manus, and Deep Research into one customizable framework.”
“LangChain's deep agents harness unifies patterns from Claude Code, Manus, and Deep Research into one customizable framework.”
“LangChain's deep agents harness unifies patterns from Claude Code, Manus, and Deep Research into one customizable framework.”
“The build phase uses open-source frameworks like LangGraph or deep agents.”
“LangChain joined NVIDIA's Nemotron coalition specifically to advance open models that run reliably within open harnesses and runtimes like NVIDIA's OpenShell.”
“LangChain joined NVIDIA's Nemotron coalition specifically to advance open models that run reliably within open harnesses and runtimes like NVIDIA's OpenShell.”
More from NVIDIA AI Podcast
We summarize every new episode. Want them in your inbox?
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300
Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299
Snap’s Secret to Processing 10 Petabytes a Day: GPU-Accelerated Spark | NVIDIA AI Podcast Ep. 298
Similar Episodes
Related episodes from other podcasts
Software Engineering Daily
Sep 10
A Rust Framework to Simplify Distributed Systems
David Senra
Sep 9
Mati Staniszewski on ElevenLabs, Voice AI & Building the Communication Layer for AI
Eye on AI
Sep 8
86% of What Coding Agents Do Is Just Reading — Not Solving | Alexander Whedon of Subquadratic
Deep Questions with Cal Newport
Aug 31
Rethinking the Deep Life Stack (Again!) | Monday Advice
Lex Fridman Podcast
Aug 26
#501 – DHH: Future of Programming, AI, Agentic Engineering, Vibe Coding & Linux
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Investing & Markets Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into NVIDIA AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime