How AI Data Platforms Are Shaping the Future of Enterprise Storage - Ep. 281

What It Covers

Jacob Lieberman explains how NVIDIA's AI data platform reference design enables GPU-accelerated storage systems that prepare enterprise data for AI agents continuously in place, eliminating security risks from data copying and movement.

Key Questions Answered

• •AI-Ready Data Pipeline: Making unstructured enterprise data usable for AI requires finding, gathering, extracting text, chunking into uniform sizes, enriching with metadata, embedding into numeric representations, and indexing into vector databases for retrieval augmented generation systems.
• •Data Velocity Challenge: Enterprises face dual pressure from new data creation plus constant changes to existing documents. Without tracking which files changed, organizations must reindex entire datasets repeatedly, wasting compute resources like rewashing all dishes when only one is dirty.
• •Security Through In-Place Processing: Traditional AI pipelines create seven to thirteen copies of datasets across different systems, disconnecting them from source permissions. When access rights change, copied data remains accessible, creating major security vulnerabilities that GPU-in-storage architecture eliminates.
• •Agent Deployment in Storage: Storage vendors deploy AI agents directly on GPUs within storage systems to perform tasks like identifying unclassified documents that should be classified, monitoring system telemetry for optimization recommendations, and operating on data without unnecessary movement or copying.