Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
Episode
39 min
Read time
2 min
Topics
Fundraising & VC, Sales & Revenue, Artificial Intelligence
AI-Generated Summary
Key Takeaways
- ✓Edge AI over cloud dependency: Caper Cart runs basket-recognition AI locally on an NVIDIA Jetson board because cloud response times measure in seconds while consumers expect sub-100-millisecond feedback. Sensor fusion combines weight scales, multiple cameras, and location sensors to accurately identify items even when store WiFi drops or cart movement creates ambiguous signals.
- ✓Multi-sensor basket accuracy: Relying on cameras alone fails in real grocery environments due to variable lighting, cart crowding, and natural shopper movement. The weight sensor functions as a ground-truth "x-ray" of the basket, cross-validated against visual inputs. This combination is essential for checkout accuracy when no store associate is nearby to resolve disputes.
- ✓Personalized "did you forget" feature drives ~1% absolute sales lift: A checkout-prompt feature surfacing items a specific shopper regularly buys but skipped that trip produced nearly a 1% absolute increase in in-store sales. A subsequent recommendation algorithm update incorporating online delivery signals added another 1% absolute lift on top, demonstrating compounding returns from merging online and in-store data.
- ✓Accurate planogram replacement via shelf-facing cameras: Most retailers lack accurate store planograms, and layouts vary store-to-store within the same banner. Caper Cart's side-facing cameras continuously scan shelves to determine what is actually stocked and where, feeding a real-time location system that corrects aisle-level ambiguity and prevents irrelevant recommendations that erode user trust over time.
- ✓Grocery foundation model built on 1.6B orders and 2B-item catalog: Instacart is constructing a grocery-specific foundation model ingesting lifetime delivery orders, a two-billion-item catalog, and in-store behavioral signals — including cart pause locations and item removal patterns. This model underpins agentic applications for shoppers, store associates, and CPG brands, such as automated restocking alerts and shelf-placement optimization recommendations.
What It Covers
Instacart's Chief Connected Stores Officer David McIntosh explains how the company's Caper Cart — a smart shopping cart powered by NVIDIA Jetson edge AI, sensor fusion, and 1.6 billion historical grocery orders — is digitizing physical retail to unify in-store and online shopping into one personalized experience.
Key Questions Answered
- •Edge AI over cloud dependency: Caper Cart runs basket-recognition AI locally on an NVIDIA Jetson board because cloud response times measure in seconds while consumers expect sub-100-millisecond feedback. Sensor fusion combines weight scales, multiple cameras, and location sensors to accurately identify items even when store WiFi drops or cart movement creates ambiguous signals.
- •Multi-sensor basket accuracy: Relying on cameras alone fails in real grocery environments due to variable lighting, cart crowding, and natural shopper movement. The weight sensor functions as a ground-truth "x-ray" of the basket, cross-validated against visual inputs. This combination is essential for checkout accuracy when no store associate is nearby to resolve disputes.
- •Personalized "did you forget" feature drives ~1% absolute sales lift: A checkout-prompt feature surfacing items a specific shopper regularly buys but skipped that trip produced nearly a 1% absolute increase in in-store sales. A subsequent recommendation algorithm update incorporating online delivery signals added another 1% absolute lift on top, demonstrating compounding returns from merging online and in-store data.
- •Accurate planogram replacement via shelf-facing cameras: Most retailers lack accurate store planograms, and layouts vary store-to-store within the same banner. Caper Cart's side-facing cameras continuously scan shelves to determine what is actually stocked and where, feeding a real-time location system that corrects aisle-level ambiguity and prevents irrelevant recommendations that erode user trust over time.
- •Grocery foundation model built on 1.6B orders and 2B-item catalog: Instacart is constructing a grocery-specific foundation model ingesting lifetime delivery orders, a two-billion-item catalog, and in-store behavioral signals — including cart pause locations and item removal patterns. This model underpins agentic applications for shoppers, store associates, and CPG brands, such as automated restocking alerts and shelf-placement optimization recommendations.
Notable Moment
McIntosh revealed that migrating ad-serving workflows from CPUs to GPUs — announced at GTC — simultaneously reduced latency and increased ad click-through rates in experiments. The result was counterintuitive: a backend infrastructure change produced a measurable consumer-facing behavioral improvement without any change to ad creative or targeting logic.
Episode Transcript
Our view is that in five to ten years, customers shouldn't have to think about shopping in store or online. It will be one single unified mode powered by this continuously learning AI system that incorporates what customers are doing in store online states at the shelf to build a fully personalized experience. Welcome to the NVIDIA AI podcast. Our guest today is David McIntosh. David is the chief connected stores officer at Instacart, and we're here to talk about the present and future of grocery shopping and AI in retail. David, welcome to the podcast. Thanks so much for joining us. Thank you for having me. So maybe we can start, with the basics. You can tell us a little bit about yourself, your role at Instacart, and kind of your journey that brought you here. Yeah. Happy to. So fundamentally, I'm a technology entrepreneur. My prior company, cofounder, CEO of Tenor, which is a expression search company, an animated GIF search company. If you're an animated GIF person, you probably use the product that, you know, is embedded in all the major messengers, keyboard companies, and so forth. When Google bought the company, we had a couple 100,000,000 users, several 100,000,000 queries per day. And then over three years at Google, we grew it to a billion users over a billion, queries a day. And what attracted me to Instacart was that I saw a company that is the leader in delivery online, but had an even broader market opportunity to really digitize the grocery industry, to bring technology to all of our grocery partners. And so in my first year at Instacart, I led what's called our enterprise business, the Instacart platform and launched that. And you you probably know Instacart is an app on your phone Sure. Marketplace. But what's less well known about the company is we have a very significant enterprise business. So for example, if you go to sprouts.com in The US, that entire experience, website, fulfillment, ads, all powered by by Instacart end to end. Yeah. And so as a result, I would talk to retailers very frequently. And what I heard was retailers saying, hey, Instacart, you brought me online. You brought my business online. Website, you know, ecom, loyalty, etcetera. But I have all these problems in store. Mhmm. I'm I'm dealing with how do I get more of my customers to sign up for loyalty in store? How should I think about retail media in the store? How do I create a more personalized experience? And then on the other side, we had a lot of customers, a lot of users saying, Instacart, I love the convenience and delivery of the online experience. But I also like going to the the store. I'm an omni I'm a omni channel customer. How can you take what I love about the online experience, the convenience, the personalization, and bring it to the store? And so the birth of connected store really …
Get the full transcript (7,843 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 36-minute episode.
Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from NVIDIA AI Podcast
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Jun 10 · 21 min
Eye on AI
Inside the Enterprise Browser Rebuilding Security for the AI Era | Bradon Rogers, Island
Jul 13
More from NVIDIA AI Podcast
Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300
May 27 · 29 min
Odd Lots
How a Major Grocery Store Chain Can Dramatically Lower the Cost of Food
Jul 3
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.
Gear
- Caper CartBy guest
by Instacart
“Instacart's Chief Connected Stores Officer David McIntosh explains how the company's Caper Cart — a smart shopping cart powered by NVIDIA Jetson edge AI, sensor fusion, and 1.6 billion historical grocery orders — is digitizing physical retail to unify in-store and online shopping into one personalized experience.”
by NVIDIA
“Caper Cart runs basket-recognition AI locally on an NVIDIA Jetson board because cloud response times measure in seconds while consumers expect sub-100-millisecond feedback.”
More from NVIDIA AI Podcast
We summarize every new episode. Want them in your inbox?
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300
Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299
Snap’s Secret to Processing 10 Petabytes a Day: GPU-Accelerated Spark | NVIDIA AI Podcast Ep. 298
Harrison Chase of LangChain on Deep Agents, LangSmith, and Earning Trust | NVIDIA AI Podcast Ep. 297
Similar Episodes
Related episodes from other podcasts
Eye on AI
Jul 13
Inside the Enterprise Browser Rebuilding Security for the AI Era | Bradon Rogers, Island
Odd Lots
Jul 3
How a Major Grocery Store Chain Can Dramatically Lower the Cost of Food
Eye on AI
Jun 18
Only 12% of Companies Generate Value From AI. Here's What They're Doing | Sanjeev Vohra, Genpact
The Diary of a CEO
Jun 1
Tech Whistleblower: You Only Have 3 Years Left Before This Hits! - Mo Gawdat
Software Engineering Daily
Apr 9
Mobile App Security with Ryan Lloyd
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into NVIDIA AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime