Fei-Fei Li on Spatial Intelligence and Robotics
Episode
43 min
Read time
2 min
Topics
Productivity, Investing, Fundraising & VC
AI-Generated Summary
Key Takeaways
- ✓Real-to-Sim-to-Real Pipeline: Robotics development is bottlenecked by slow, costly real-world data collection and evaluation. Scenix's approach maps physical environments into geometrically aligned digital worlds, enabling training and evaluation entirely in simulation. If a robot checkpoint performs better in the digital environment, it reliably performs better in the real world — dramatically accelerating iteration cycles.
- ✓Simulation's Unique Role — Counterfactual Reasoning: Simulation does not simply replace real-world data; it enables scenarios that cannot be collected physically. Like athletes reviewing game plans on whiteboards, robots need exposure to edge cases and rare states. Waymo publicly reports using billions of simulation hours, and cars represent the simplest two-dimensional robot — underscoring simulation's necessity for more complex tasks.
- ✓Evaluation Speed as the Hidden Bottleneck: Distinguishing between a robot policy checkpoint performing at 90% versus 92% success rate requires extensive real-world trials, taking orders of magnitude longer than evaluating language models. Simulation with proven real-world alignment compresses this process, giving robotics teams the fast feedback loops that software AI teams take for granted during model development.
- ✓Embodiment-Agnostic Infrastructure Over Hardware: World Labs and Scenix are building model-agnostic and embodiment-agnostic infrastructure — not robots. Their platform accepts single arms, bimanual systems, mobile manipulators, and varied end effectors. Robotics companies at near-deployment stages can plug their hardware and existing foundation models into the simulation stack for training data generation and policy evaluation without switching embodiments.
- ✓Semi-Structured Environments Before Humanoids: Robotics deployment follows a progression from fully structured environments like car factories, to semi-structured environments like Amazon warehouses, to unstructured home environments. Humanoid bodies are evolutionarily optimized for generality, not efficiency at specific tasks. Near-term commercial robotics value lies in semi-structured industrial and logistics settings, where constrained variability makes simulation coverage tractable and reliability achievable sooner.
What It Covers
Following a16z's Martin Casado, Fei-Fei Li of World Labs, and Yunzhu Li of Scenix discuss the acquisition of Scenix and the case for spatial intelligence as the next AI frontier — using simulation, 3D world models, and real-to-sim-to-real pipelines to solve robotics' core data and evaluation bottlenecks.
Key Questions Answered
- •Real-to-Sim-to-Real Pipeline: Robotics development is bottlenecked by slow, costly real-world data collection and evaluation. Scenix's approach maps physical environments into geometrically aligned digital worlds, enabling training and evaluation entirely in simulation. If a robot checkpoint performs better in the digital environment, it reliably performs better in the real world — dramatically accelerating iteration cycles.
- •Simulation's Unique Role — Counterfactual Reasoning: Simulation does not simply replace real-world data; it enables scenarios that cannot be collected physically. Like athletes reviewing game plans on whiteboards, robots need exposure to edge cases and rare states. Waymo publicly reports using billions of simulation hours, and cars represent the simplest two-dimensional robot — underscoring simulation's necessity for more complex tasks.
- •Evaluation Speed as the Hidden Bottleneck: Distinguishing between a robot policy checkpoint performing at 90% versus 92% success rate requires extensive real-world trials, taking orders of magnitude longer than evaluating language models. Simulation with proven real-world alignment compresses this process, giving robotics teams the fast feedback loops that software AI teams take for granted during model development.
- •Embodiment-Agnostic Infrastructure Over Hardware: World Labs and Scenix are building model-agnostic and embodiment-agnostic infrastructure — not robots. Their platform accepts single arms, bimanual systems, mobile manipulators, and varied end effectors. Robotics companies at near-deployment stages can plug their hardware and existing foundation models into the simulation stack for training data generation and policy evaluation without switching embodiments.
- •Semi-Structured Environments Before Humanoids: Robotics deployment follows a progression from fully structured environments like car factories, to semi-structured environments like Amazon warehouses, to unstructured home environments. Humanoid bodies are evolutionarily optimized for generality, not efficiency at specific tasks. Near-term commercial robotics value lies in semi-structured industrial and logistics settings, where constrained variability makes simulation coverage tractable and reliability achievable sooner.
Notable Moment
Scenix originally joined World Labs as a paying customer of its generative world model, Marble — not through any prior coordination. Fei-Fei Li only discovered Yunzhu Li's company after seeing the signup, prompting a call that revealed the acquisition-level synergy neither team had initially planned.
Episode Transcript
We are building the next frontier of AI, which is what we call spatial intelligence. At Synix, we are developing what we call a real to seam to real pipeline. We can replace all the data, all the evaluation we need in the real environment by using the data that can generate at a scalable way in our digital world. Think about human intelligence. We do a lot of simulation in our head. You know, why? There's a very important role simulation plays that real world data doesn't play, which is counterfactual reasoning. What we are building is a consistent world. Consistence both over space, over time, over different view points, and over different type of interactions. Minor stars, I won the real world work. The world we live in can be multiverse, that we create technology to allow people, builders, developers to act within different spaces. Do you believe we'll ever be able to build robots that have the power efficiency of a human being? How far away are we from this? Is this, like, five years or this is, like, never? The TLDR is Language models transformed how AI understands words. The next frontier is teaching AI to understand and act within the physical world. Following World Labs acquisition of Scenex, Martin Casado sits down with Fei Fei Li and Yunzhu Li to unpack the vision behind the deal. They discuss spatial intelligence, world models, simulation, and why solving robotics will require a new generation of AI built for three-dimensional reasoning, not just language. Alright. Well, it's great to have you both here. So Fei Fei, for the listeners that may not have the background, maybe you can give an overview of what World Labs does. Yeah. Well, World Lab is a two year old startup. I think we should just recognize it's a frontier model lab. We are building the next frontier of AI, which is what we call spatial intelligence. And spatial intelligence is about creating AI that has the ability to generate, understand, reason with, and interact with spaces, whether it's physical or virtual. And, of course, a means to an end towards spatial intelligence is building large world models. And that's what World Labs is mostly focused on. Yeah. So you've been saying this since the very beginning, which is the machine's ability to perceive and reason about spaces and act on spaces. Mhmm. But I always had the assumption that the acting on spaces was some long distance future thing, but now you're acquiring a robotics company. And so maybe talk a little bit about the timeliness of this and the intentions. Yeah. So first of all, it doesn't just take robotics to act within spaces or to interact. Right? I mean, look at the creative field, whether it's VFX or gaming and or design, many use cases, you can create and act within virtual spaces. World Labs' thesis has always been that the world we live in can be multiverse, that we …
Get the full transcript (7,428 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 40-minute episode.
Get a16z Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from a16z Podcast
What It Takes to Build a Startup | Andrew Chen & Matt Perault
Sep 11 · 38 min
All-In with Chamath, Jason, Sacks & Friedberg
Open Source Wins, AGI Is Here, and Scorsese's AI Toolkit with CEOs of Cerebras & Black Forest Labs
Jul 10
More from a16z Podcast
How AI Is Rewriting the Power Law of Venture Capital
Sep 10 · 49 min
The Tim Ferriss Show
#839: Dr. Fei-Fei Li, The Godmother of AI — Asking Audacious Questions, Civilizational Technology, and Finding Your North Star
Dec 9
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
- MarbleBy guest
by World Labs
“Scenix originally joined World Labs as a paying customer of its generative world model, Marble”
company
“Fei-Fei Li of World Labs, and Yunzhu Li of Scenix discuss the acquisition of Scenix and the case for spatial intelligence as the next AI frontier”
“Fei-Fei Li of World Labs, and Yunzhu Li of Scenix discuss the acquisition of Scenix and the case for spatial intelligence as the next AI frontier”
“Waymo publicly reports using billions of simulation hours, and cars represent the simplest two-dimensional robot”
More from a16z Podcast
We summarize every new episode. Want them in your inbox?
What It Takes to Build a Startup | Andrew Chen & Matt Perault
How AI Is Rewriting the Power Law of Venture Capital
Who Grades the AI Models? | Ben Horowitz & Rayan Krishnan
OpenAI Researchers on the Future of Mathematical Reasoning
Can Open Source Keep AI Power From Concentrating?
Similar Episodes
Related episodes from other podcasts
All-In with Chamath, Jason, Sacks & Friedberg
Jul 10
Open Source Wins, AGI Is Here, and Scorsese's AI Toolkit with CEOs of Cerebras & Black Forest Labs
The Tim Ferriss Show
Dec 9
#839: Dr. Fei-Fei Li, The Godmother of AI — Asking Audacious Questions, Civilizational Technology, and Finding Your North Star
Latent Space
Nov 25
After LLMs: Spatial Intelligence and World Models — Fei-Fei Li & Justin Johnson, World Labs
Eye on AI
Nov 23
#303 Fei-Fei Li: Spatial Intelligence, World Models & the Future of AI
Masters of Scale
Nov 20
How to be 'fearless' in the AI age, with Fei-Fei Li and Reid Hoffman
Explore Related Topics
This podcast is featured in Best Business Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Investing & Markets Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into a16z Podcast.
Every Monday, we deliver AI summaries of the latest episodes from a16z Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime