How AI Data Platforms Are Shaping the Future of Enterprise Storage - Ep. 281
Episode
35 min
Read time
2 min
Topics
Fundraising & VC, Design & UX, Artificial Intelligence
AI-Generated Summary
Key Takeaways
- ✓AI-Ready Data Pipeline: Making unstructured enterprise data usable for AI requires finding, gathering, extracting text, chunking into uniform sizes, enriching with metadata, embedding into numeric representations, and indexing into vector databases for retrieval augmented generation systems.
- ✓Data Velocity Challenge: Enterprises face dual pressure from new data creation plus constant changes to existing documents. Without tracking which files changed, organizations must reindex entire datasets repeatedly, wasting compute resources like rewashing all dishes when only one is dirty.
- ✓Security Through In-Place Processing: Traditional AI pipelines create seven to thirteen copies of datasets across different systems, disconnecting them from source permissions. When access rights change, copied data remains accessible, creating major security vulnerabilities that GPU-in-storage architecture eliminates.
- ✓Agent Deployment in Storage: Storage vendors deploy AI agents directly on GPUs within storage systems to perform tasks like identifying unclassified documents that should be classified, monitoring system telemetry for optimization recommendations, and operating on data without unnecessary movement or copying.
What It Covers
Jacob Lieberman explains how NVIDIA's AI data platform reference design enables GPU-accelerated storage systems that prepare enterprise data for AI agents continuously in place, eliminating security risks from data copying and movement.
Key Questions Answered
- •AI-Ready Data Pipeline: Making unstructured enterprise data usable for AI requires finding, gathering, extracting text, chunking into uniform sizes, enriching with metadata, embedding into numeric representations, and indexing into vector databases for retrieval augmented generation systems.
- •Data Velocity Challenge: Enterprises face dual pressure from new data creation plus constant changes to existing documents. Without tracking which files changed, organizations must reindex entire datasets repeatedly, wasting compute resources like rewashing all dishes when only one is dirty.
- •Security Through In-Place Processing: Traditional AI pipelines create seven to thirteen copies of datasets across different systems, disconnecting them from source permissions. When access rights change, copied data remains accessible, creating major security vulnerabilities that GPU-in-storage architecture eliminates.
- •Agent Deployment in Storage: Storage vendors deploy AI agents directly on GPUs within storage systems to perform tasks like identifying unclassified documents that should be classified, monitoring system telemetry for optimization recommendations, and operating on data without unnecessary movement or copying.
Notable Moment
Lieberman compares AI agents working in storage systems to remote workers being more productive at home, avoiding commute time by keeping compute close to data rather than moving massive datasets to distant processing centers for transformation and analysis.
Episode Transcript
Hello, and welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. Quick note before we get started. If you're enjoying the pod, please take a moment to follow us wherever you get your podcasts. It'll only take a second. It helps us deliver a better show to you, and it helps you make sure you don't miss an episode because they'll all show up in your feed. That being said, let's get to it because we've got Jacob Lieberman back on the podcast, and I can't wait to get into this. Jacob is the director of product management for NVIDIA's enterprise product group. He was on the show recently. It feels like just yesterday, but so much has happened since then. We were talking about AgenTek AI and at the time it was kind of a new thing and Jacob was explaining what it's all about but really getting getting into the potential, the sort of the promise of human and AI agent collaboration in the workplace and the enterprise in particular. So we've got Jacob back and I can't wait to dive into it, but first man, welcome. How are you? Thank you, Noah. I'm very grateful to be here and I'm very happy to be back. So we're gonna talk to agents. Also, we're gonna talk you're gonna talk. I'm gonna be able to ask some questions about something called the AI data platform, which is a new class of GPU accelerated storage as I understand it that I don't wanna put words in your mouth, but it sounds like it could be game changer, at least like another big step along the path to this this promise of human AI agent collaboration that we're fulfilling. I use agents all the time, but, I'm excited to get into it. So why don't you dive in and tell us how it's going with Agintiq AI adoption in the enterprise? Yeah. It I it's interesting to hear that you said, you're using it yourself because I think many of us are. Many of us are now starting to use AI agents in our daily lives as consumers. Right. But the needs of a consumer are very different than the needs of an enterprise. Yeah. And so since last time we talked, AI agents, the technology's come a long way. The open models of today are just as powerful as the commercial models were a little while ago, but it's still challenging for enterprises to put agents into production. So it sounds like the technology's there or, you know, there enough because it's always advancing. Right? Yes. What are the challenges then, that enterprises are facing to actually deploy and gain adoption of agents? That's a great question. So almost every enterprise and every CEO and CIO, CTO, they are increasing their spending on AI. They want to deploy AIs to production, but it's difficult to move from a POC state to production. So the enterprise adoption is happening, …
Get the full transcript (5,979 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 32-minute episode.
Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from NVIDIA AI Podcast
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
Jun 24 · 39 min
Cognitive Revolution
The Internet Computer: Caffeine.ai CEO Dominic Williams on Unstoppable, Self-Writing Software
Jan 25
More from NVIDIA AI Podcast
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Jun 10 · 21 min
How I AI
Build your own company brain: the enterprise AI playbook from Stripe’s engineering team | Sharadh Krishnamurthy
Sep 7
More from NVIDIA AI Podcast
We summarize every new episode. Want them in your inbox?
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300
Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299
Snap’s Secret to Processing 10 Petabytes a Day: GPU-Accelerated Spark | NVIDIA AI Podcast Ep. 298
Similar Episodes
Related episodes from other podcasts
Cognitive Revolution
Jan 25
The Internet Computer: Caffeine.ai CEO Dominic Williams on Unstoppable, Self-Writing Software
How I AI
Sep 7
Build your own company brain: the enterprise AI playbook from Stripe’s engineering team | Sharadh Krishnamurthy
This Week in Startups
Sep 4
Dr. Mark Hyman on Function Health & GLP-1 microdosing | E2334
Beyond Biotech
Aug 21
Beyond biology: Nanobiotix's physics-first approach to cancer
The AI Breakdown
Aug 12
Grok Bot Finally Makes AI Agents Easy
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into NVIDIA AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime