Firsthand's Jon Heller Shares How AI Agents Enhance Consumer Journeys in Retail - Ep. 242
Episode
35 min
Read time
2 min
Topics
Remote Work, Leadership, Design & UX
AI-Generated Summary
Key Takeaways
- ✓Brand Agent Platform Architecture: Agents combine composable AI capabilities including Lakebed data management, retrieval systems, content generation, and configurable UI frames. Each component adapts based on objectives like awareness, acquisition, or conversion, with different configurations for retailers with 300,000 SKUs versus three product packages.
- ✓Connected Journey Transformation: Brand agents maintain context across the entire consumer path from search to purchase, eliminating disconnected hops between websites. When consumers arrive at retail sites, agents receive them at step five instead of zero, using knowledge from previous interactions to present relevant products immediately.
- ✓Marketing as Research: Every agent interaction generates transcript data showing what consumers asked, which configurations worked, and what products they need but brands don't sell yet. This census-level feedback creates continuous improvement loops while functioning as simultaneous customer research at scale across all marketing touchpoints.
- ✓Distributed Expertise Model: Brands and retailers possess the best product data, not consumer habit data. Their agents syndicate this expertise to publisher sites, social platforms, and search engines where consumers actually are, rather than forcing everyone to central destinations. Results show multiples higher engagement than traditional ads.
What It Covers
Jon Heller, co-CEO of Firsthand, explains how brand agents transform retail by syndicating product expertise across the consumer journey, creating adaptive experiences that understand intent and deliver personalized content at every touchpoint.
Key Questions Answered
- •Brand Agent Platform Architecture: Agents combine composable AI capabilities including Lakebed data management, retrieval systems, content generation, and configurable UI frames. Each component adapts based on objectives like awareness, acquisition, or conversion, with different configurations for retailers with 300,000 SKUs versus three product packages.
- •Connected Journey Transformation: Brand agents maintain context across the entire consumer path from search to purchase, eliminating disconnected hops between websites. When consumers arrive at retail sites, agents receive them at step five instead of zero, using knowledge from previous interactions to present relevant products immediately.
- •Marketing as Research: Every agent interaction generates transcript data showing what consumers asked, which configurations worked, and what products they need but brands don't sell yet. This census-level feedback creates continuous improvement loops while functioning as simultaneous customer research at scale across all marketing touchpoints.
- •Distributed Expertise Model: Brands and retailers possess the best product data, not consumer habit data. Their agents syndicate this expertise to publisher sites, social platforms, and search engines where consumers actually are, rather than forcing everyone to central destinations. Results show multiples higher engagement than traditional ads.
Notable Moment
Heller reveals his initial assumption that brand agents would primarily benefit high-consideration purchases like automotive and financial services proved wrong. Food brands using agents to suggest holiday meal planning and balanced lifestyle shopping lists generated equally strong interest and engagement.
Episode Transcript
Hello, and welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. The AI community is abuzz with agents. As NVIDIA CEO Jensen Huang said in his CES keynote this past January, Agensic AI represents the next wave in the evolution of generative AI and a multitrillion dollar opportunity at that. AI agents enable applications to move beyond simple chatbot interactions to tackle complex, multi step problems through sophisticated reasoning and planning. They're expected to become a centerpiece of enterprise AI systems going forward. Our guest is John Heller, co CEO and founder of Firsthand, whose brand agent platform is transforming how advertisers and publishers engage consumers online. Firsthand is also a member of Inception, NVIDIA's program for start ups. John, welcome, and thanks so much for taking the time to join the AI podcast. Hey, Noah. Thank you. It's great to be here. Very excited. So let's start with the basics. If you don't mind, tell us a little bit about Firsthand. Sure. As you said, firsthand is building the brand agent platform, and that's because when we see AI, we believe it is itself a new medium, not just a technology. Perhaps I can explain that a little bit about how we came to be. So I've been working in advertising tech since the Internet started in the nineties. And, I've worked at DoubleClick for quite a long time. More recently, I was the co CEO and cofounder of FreeWheel, which is now Comcast ad serving platform. Right. And I've been doing ad tech for a long time. And actually, when I left Comcast, I went back to school, finger quoted in AI, so online courses, because I wanted to work in something that was much more broadly applicable Mhmm. And much earlier in its life. And I'd actually started by working on, reinforcement learning robots to act as minions and artificial teammates in video games. And that's how I started learning the the guts of it. I'm biting my tongue so we don't take us off course because that sounds fascinating as well. Oh, yeah. Then that that could be a separate conversation. But I've been working in the in the gaming world and some of the generative AI abilities for gaming assets when language models really came out. Mhmm. And something struck us, something very powerful, which is and this is a a metaphor for the math inside, but AI now understands the ideas and intents needs you may have from what you're reading, what you're watching, what you might ask it outright, and it can go find the right response or take the right responding action. And everything is presented to you in a very natural human way. And if you back up a step and think of that happening all the way through a consumer's use of the digital world from when they're searching and becoming aware of things they might need, when they do some investigation and read up on products or …
Get the full transcript (6,556 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 32-minute episode.
Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from NVIDIA AI Podcast
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
Jun 24 · 39 min
Eye on AI
86% of What Coding Agents Do Is Just Reading — Not Solving | Alexander Whedon of Subquadratic
Sep 8
More from NVIDIA AI Podcast
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Jun 10 · 21 min
Lex Fridman Podcast
#501 – DHH: Future of Programming, AI, Agentic Engineering, Vibe Coding & Linux
Aug 26
More from NVIDIA AI Podcast
We summarize every new episode. Want them in your inbox?
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300
Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299
Snap’s Secret to Processing 10 Petabytes a Day: GPU-Accelerated Spark | NVIDIA AI Podcast Ep. 298
Similar Episodes
Related episodes from other podcasts
Eye on AI
Sep 8
86% of What Coding Agents Do Is Just Reading — Not Solving | Alexander Whedon of Subquadratic
Lex Fridman Podcast
Aug 26
#501 – DHH: Future of Programming, AI, Agentic Engineering, Vibe Coding & Linux
WorkLife with Adam Grant
Jul 21
Why you should give away your most valuable assets with TED Chairman Chris Anderson
In Good Company with Nicolai Tangen
Jun 17
Snowflake CEO: Scaling Data, AI Agents and the New Software Era
Eye on AI
Jun 12
AI Is Already Resolving 90% of Customer Service Tickets - and It's Getting Smarter | Shashi Upadhyay, Zendesk
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
You're clearly into NVIDIA AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime