How OpenUSD and AI Are Building Smarter Virtual Worlds - Ep. 268
Episode
24 min
Read time
2 min
Topics
Leadership, Artificial Intelligence, Software Development
AI-Generated Summary
Key Takeaways
- ✓Composable Layer Architecture: OpenUSD unifies disparate data sources through stackable layers that preserve each contributor's work while presenting a holistic scene graph, enabling factory planners, work cell specialists, and robot engineers to iterate simultaneously without overwriting changes.
- ✓Sim-to-Real Training: Physical AI systems train in OpenUSD environments using Sensor RTX for pixel-perfect sensor simulation and NVIDIA Cosmos for scenario variation, allowing robots to experience vast training conditions before real-world deployment while maintaining physically accurate physics solvers.
- ✓Standards Bridge Flexibility: OpenUSD core specification defines composition algorithms while mapping existing industrial standards like CAD formats, OPC UA, and Web of Things into unified schemas, eliminating ambiguity while preserving adaptability across manufacturing, retail, and operational twin applications.
- ✓Certification Pathway: NVIDIA Deep Learning Institute offers LearnOpenUSD curriculum with hands-on courses leading to formal USD certification, enabling developers to build physical AI pipelines even using AI copilots to generate Python scripts for scene creation without traditional coding backgrounds.
What It Covers
OpenUSD revolutionizes three-dimensional graphics and simulation by enabling non-destructive collaboration across industrial digital twins, manufacturing, and robotics. Aaron Luke explains how this Pixar-originated framework combines with physical AI to train autonomous systems.
Key Questions Answered
- •Composable Layer Architecture: OpenUSD unifies disparate data sources through stackable layers that preserve each contributor's work while presenting a holistic scene graph, enabling factory planners, work cell specialists, and robot engineers to iterate simultaneously without overwriting changes.
- •Sim-to-Real Training: Physical AI systems train in OpenUSD environments using Sensor RTX for pixel-perfect sensor simulation and NVIDIA Cosmos for scenario variation, allowing robots to experience vast training conditions before real-world deployment while maintaining physically accurate physics solvers.
- •Standards Bridge Flexibility: OpenUSD core specification defines composition algorithms while mapping existing industrial standards like CAD formats, OPC UA, and Web of Things into unified schemas, eliminating ambiguity while preserving adaptability across manufacturing, retail, and operational twin applications.
- •Certification Pathway: NVIDIA Deep Learning Institute offers LearnOpenUSD curriculum with hands-on courses leading to formal USD certification, enabling developers to build physical AI pipelines even using AI copilots to generate Python scripts for scene creation without traditional coding backgrounds.
Notable Moment
Aaron Luke reveals he co-developed the original OpenUSD as a pair programming project at Pixar starting in 2012, combining animation composition engines dating back to A Bug's Life with scene cache formats to solve cross-department data organization challenges.
Episode Transcript
Hello, and welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. Today, we're talking about the future of collaboration in three d. Universal scene description, Open USD, is revolutionizing three d graphics and simulation, especially when you combine it with the latest in physical AI. The technology is transforming industries from manufacturing to robots. And here to explain what Open USD is and why it works so well together with AI is NVIDIA's Aaron Luke. Aaron is a director of product management for NVIDIA simulation technology, leading universal scene description ecosystem development. Aaron, welcome to the AI podcast. Hi, Noah. Good to be here. Great to have you. Thanks for taking the time, to join us. So, let's start kind of at the at the beginning and work our way up, if you will. What is Open USD, and why does it matter so much? That's right. So as you mentioned, Open USD, the USD stands for universal scene description. It's a project that was open sourced by Pixar animation studios in 2016, but it's the result of evolution of decades of data engineering at Pixar around, you know, basically three d world building. Three d world building among all the sort of disciplines that it requires for filmmaking, but it generalizes quite beautifully to world building in the industrial world and in the real world, as well too. So it's an open source project that also now is under the governance of the Alliance for Open Universal Scene Description, the AOUSD, in which, we are formalizing USD as industry standards, with a lot of great partners. Fabulous. And so what are some of the benefits? I mean, obviously, having an open source standardized framework for describing and and working with three d world is great in itself. But what are some of the particulars about OpenUST that, make it really great to work with? So the really interesting thing about USD is that it's designed to bring lots of different types of data sources together. In particular, it's called composition within USD and every document in USD is called a layer. So when you bring all these things together, you have these network of layer stacks, within USD that presents itself as a holistic composed scene graph. And every object in that scene graph is like an object in three d that you can do for movie making, but also for industrial layout and design. And the power of USD is all of that is abstracted from the actual data source and the actual data serialization, the actual formats. And this was a boon within Pixar because like I said, every type of artist, within Pixar, whether they're doing, modeling animation, effects animation with with physics and and other simulation, lighting, all that kind of stuff, they They might have different tools. They might have different ways of working, with things. And what Pixar did was that they kind of unified them all around these common data …
Get the full transcript (4,545 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 21-minute episode.
Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from NVIDIA AI Podcast
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
Jun 24 · 39 min
No Priors: Artificial Intelligence | Technology | Startups
Coinbase’s Everything Exchange: Agentic Finance, Stablecoins, and Tokenization with CEO Brian Armstrong
Sep 10
More from NVIDIA AI Podcast
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Jun 10 · 21 min
The Prof G Pod
Why We’re Having Less Sex — and Why It Matters (ft. Dr. Debra Soh)
Aug 13
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
- OpenUSDBy guest
by Pixar
“Aaron Luke explains how this Pixar-originated framework combines with physical AI to train autonomous systems. Aaron Luke reveals he co-developed the original OpenUSD as a pair programming project at Pixar starting in 2012.”
by NVIDIA
“Physical AI systems train in OpenUSD environments using Sensor RTX for pixel-perfect sensor simulation and NVIDIA Cosmos for scenario variation.”
by Nvidia
“Physical AI systems train in OpenUSD environments using Sensor RTX for pixel-perfect sensor simulation and NVIDIA Cosmos for scenario variation.”
course
by NVIDIA Deep Learning Institute
“NVIDIA Deep Learning Institute offers LearnOpenUSD curriculum with hands-on courses leading to formal USD certification.”
More from NVIDIA AI Podcast
We summarize every new episode. Want them in your inbox?
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300
Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299
Snap’s Secret to Processing 10 Petabytes a Day: GPU-Accelerated Spark | NVIDIA AI Podcast Ep. 298
Similar Episodes
Related episodes from other podcasts
No Priors: Artificial Intelligence | Technology | Startups
Sep 10
Coinbase’s Everything Exchange: Agentic Finance, Stablecoins, and Tokenization with CEO Brian Armstrong
The Prof G Pod
Aug 13
Why We’re Having Less Sex — and Why It Matters (ft. Dr. Debra Soh)
Investing for Beginners
Jul 30
Why 100-Baggers Cause Bad Decisions and How to Stay Grounded
Up First (NPR)
Jul 11
Election Betting on Prediction Markets, Special Education, Breastmilk Storage
Cognitive Revolution
Jul 1
1000 Designs a Day: Neural Concept's Thomas von Tschammer on AI-Native Engineering
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into NVIDIA AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime