Skip to main content
NVIDIA AI Podcast

How OpenUSD and AI Are Building Smarter Virtual Worlds - Ep. 268

24 min episode · 2 min read
·
Aaron Luke

Episode

24 min

Read time

2 min

Topics

Leadership, Artificial Intelligence, Software Development

AI-Generated Summary

Key Takeaways

  • Composable Layer Architecture: OpenUSD unifies disparate data sources through stackable layers that preserve each contributor's work while presenting a holistic scene graph, enabling factory planners, work cell specialists, and robot engineers to iterate simultaneously without overwriting changes.
  • Sim-to-Real Training: Physical AI systems train in OpenUSD environments using Sensor RTX for pixel-perfect sensor simulation and NVIDIA Cosmos for scenario variation, allowing robots to experience vast training conditions before real-world deployment while maintaining physically accurate physics solvers.
  • Standards Bridge Flexibility: OpenUSD core specification defines composition algorithms while mapping existing industrial standards like CAD formats, OPC UA, and Web of Things into unified schemas, eliminating ambiguity while preserving adaptability across manufacturing, retail, and operational twin applications.
  • Certification Pathway: NVIDIA Deep Learning Institute offers LearnOpenUSD curriculum with hands-on courses leading to formal USD certification, enabling developers to build physical AI pipelines even using AI copilots to generate Python scripts for scene creation without traditional coding backgrounds.

What It Covers

OpenUSD revolutionizes three-dimensional graphics and simulation by enabling non-destructive collaboration across industrial digital twins, manufacturing, and robotics. Aaron Luke explains how this Pixar-originated framework combines with physical AI to train autonomous systems.

Key Questions Answered

  • Composable Layer Architecture: OpenUSD unifies disparate data sources through stackable layers that preserve each contributor's work while presenting a holistic scene graph, enabling factory planners, work cell specialists, and robot engineers to iterate simultaneously without overwriting changes.
  • Sim-to-Real Training: Physical AI systems train in OpenUSD environments using Sensor RTX for pixel-perfect sensor simulation and NVIDIA Cosmos for scenario variation, allowing robots to experience vast training conditions before real-world deployment while maintaining physically accurate physics solvers.
  • Standards Bridge Flexibility: OpenUSD core specification defines composition algorithms while mapping existing industrial standards like CAD formats, OPC UA, and Web of Things into unified schemas, eliminating ambiguity while preserving adaptability across manufacturing, retail, and operational twin applications.
  • Certification Pathway: NVIDIA Deep Learning Institute offers LearnOpenUSD curriculum with hands-on courses leading to formal USD certification, enabling developers to build physical AI pipelines even using AI copilots to generate Python scripts for scene creation without traditional coding backgrounds.

Notable Moment

Aaron Luke reveals he co-developed the original OpenUSD as a pair programming project at Pixar starting in 2012, combining animation composition engines dating back to A Bug's Life with scene cache formats to solve cross-department data organization challenges.

Know someone who'd find this useful?

Episode Transcript

Hello, and welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. Today, we're talking about the future of collaboration in three d. Universal scene description, Open USD, is revolutionizing three d graphics and simulation, especially when you combine it with the latest in physical AI. The technology is transforming industries from manufacturing to robots. And here to explain what Open USD is and why it works so well together with AI is NVIDIA's Aaron Luke. Aaron is a director of product management for NVIDIA simulation technology, leading universal scene description ecosystem development. Aaron, welcome to the AI podcast. Hi, Noah. Good to be here. Great to have you. Thanks for taking the time, to join us. So, let's start kind of at the at the beginning and work our way up, if you will. What is Open USD, and why does it matter so much? That's right. So as you mentioned, Open USD, the USD stands for universal scene description. It's a project that was open sourced by Pixar animation studios in 2016, but it's the result of evolution of decades of data engineering at Pixar around, you know, basically three d world building. Three d world building among all the sort of disciplines that it requires for filmmaking, but it generalizes quite beautifully to world building in the industrial world and in the real world, as well too. So it's an open source project that also now is under the governance of the Alliance for Open Universal Scene Description, the AOUSD, in which, we are formalizing USD as industry standards, with a lot of great partners. Fabulous. And so what are some of the benefits? I mean, obviously, having an open source standardized framework for describing and and working with three d world is great in itself. But what are some of the particulars about OpenUST that, make it really great to work with? So the really interesting thing about USD is that it's designed to bring lots of different types of data sources together. In particular, it's called composition within USD and every document in USD is called a layer. So when you bring all these things together, you have these network of layer stacks, within USD that presents itself as a holistic composed scene graph. And every object in that scene graph is like an object in three d that you can do for movie making, but also for industrial layout and design. And the power of USD is all of that is abstracted from the actual data source and the actual data serialization, the actual formats. And this was a boon within Pixar because like I said, every type of artist, within Pixar, whether they're doing, modeling animation, effects animation with with physics and and other simulation, lighting, all that kind of stuff, they They might have different tools. They might have different ways of working, with things. And what Pixar did was that they kind of unified them all around these common data …

Get the full transcript (4,545 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all NVIDIA AI Podcast transcripts →

You just read a 3-minute summary of a 21-minute episode.

Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links.

Tools

  • OpenUSDBy guest

    by Pixar

    Aaron Luke explains how this Pixar-originated framework combines with physical AI to train autonomous systems. Aaron Luke reveals he co-developed the original OpenUSD as a pair programming project at Pixar starting in 2012.
  • by NVIDIA

    Physical AI systems train in OpenUSD environments using Sensor RTX for pixel-perfect sensor simulation and NVIDIA Cosmos for scenario variation.
  • by Nvidia

    Physical AI systems train in OpenUSD environments using Sensor RTX for pixel-perfect sensor simulation and NVIDIA Cosmos for scenario variation.

course

  • by NVIDIA Deep Learning Institute

    NVIDIA Deep Learning Institute offers LearnOpenUSD curriculum with hands-on courses leading to formal USD certification.

More from NVIDIA AI Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into NVIDIA AI Podcast.

Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime