Intelligent Robots in 2026: Are We There Yet? with Nikita Rudin - #760
Episode
66 min
Read time
2 min
Topics
Productivity, Leadership, Software Development
AI-Generated Summary
Key Takeaways
- ✓Sim-to-Real Gap: Closing the simulation-to-reality gap requires deep understanding of both worlds, mapping every software layer from high-level commands down to motor currents. Real-to-sim processes identify critical parameters like torque limits and delays by hanging robots and collecting motor data, then abstracting these into fast simulators.
- ✓Locomotion Progress: Blind locomotion (reactive only) is robust for quadrupeds, but perception-based locomotion remains challenging. Adding cameras increases the sim-to-real gap significantly because sensor noise and visual rendering must be accurately simulated. Switching robots to new hardware takes only days, but adapting to new tasks requires substantial engineering effort.
- ✓Robot Deployment Reality: Most robotics demos use either live teleoperation or policies trained on thousands of hours of collected teleoperation data. No humanoid robot currently generates economic value in warehouses or factories because they perform approximate tasks requiring more human handlers than the original workforce, making value negative.
- ✓Model Architecture: Production systems use three-tier hierarchies: large VLMs for abstract task planning (running off-board or in cloud), vision-language-action models for motion planning at ten hertz (onboard, compute-limited), and small whole-body trackers at fifty hertz on CPU for motor control. Diffusion models in VLAs create the biggest onboard compute bottleneck.
- ✓Training Approach: Combining reinforcement learning with imitation learning works by using human demonstrations to guide RL exploration, not as pure pretraining. Training separate primitive skills (walking, picking, placing) then distilling into one VLA shows early generalization signs. Industrial deployment focuses on repetitive tasks where abstract reasoning can be precomputed, unlike home environments.
What It Covers
Nikita Rudin, CEO of Flexion Robotics, explains the gap between robotics demos and real-world deployment, covering simulation-to-reality challenges, reinforcement learning techniques, and why no humanoid robot generates actual economic value today in 2025.
Key Questions Answered
- •Sim-to-Real Gap: Closing the simulation-to-reality gap requires deep understanding of both worlds, mapping every software layer from high-level commands down to motor currents. Real-to-sim processes identify critical parameters like torque limits and delays by hanging robots and collecting motor data, then abstracting these into fast simulators.
- •Locomotion Progress: Blind locomotion (reactive only) is robust for quadrupeds, but perception-based locomotion remains challenging. Adding cameras increases the sim-to-real gap significantly because sensor noise and visual rendering must be accurately simulated. Switching robots to new hardware takes only days, but adapting to new tasks requires substantial engineering effort.
- •Robot Deployment Reality: Most robotics demos use either live teleoperation or policies trained on thousands of hours of collected teleoperation data. No humanoid robot currently generates economic value in warehouses or factories because they perform approximate tasks requiring more human handlers than the original workforce, making value negative.
- •Model Architecture: Production systems use three-tier hierarchies: large VLMs for abstract task planning (running off-board or in cloud), vision-language-action models for motion planning at ten hertz (onboard, compute-limited), and small whole-body trackers at fifty hertz on CPU for motor control. Diffusion models in VLAs create the biggest onboard compute bottleneck.
- •Training Approach: Combining reinforcement learning with imitation learning works by using human demonstrations to guide RL exploration, not as pure pretraining. Training separate primitive skills (walking, picking, placing) then distilling into one VLA shows early generalization signs. Industrial deployment focuses on repetitive tasks where abstract reasoning can be precomputed, unlike home environments.
Notable Moment
Rudin demonstrates live on-stage training where a quadruped robot learns to walk from scratch in three minutes on a laptop, with policies updating every fifteen seconds. The robot progresses from falling over to taking steps to walking around the stage, visually showing the reinforcement learning process.
You just read a 3-minute summary of a 63-minute episode.
Get The TWIML AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from The TWIML AI Podcast
Is RAG Dead? Lessons from Building AI for Tax Law with Alex Bowcut - #769
Jun 9 · 51 min
No Priors: Artificial Intelligence | Technology | Startups
NVIDIA’s Jensen Huang on Reasoning Models, Robotics, and Refuting the “AI Bubble” Narrative
Jan 8
More from The TWIML AI Podcast
Relational Foundation Models for Enterprise Data with Jure Leskovec - #768
May 21 · 66 min
Practical AI
Open Source Self-Driving with Comma AI
Apr 16
More from The TWIML AI Podcast
We summarize every new episode. Want them in your inbox?
Is RAG Dead? Lessons from Building AI for Tax Law with Alex Bowcut - #769
Relational Foundation Models for Enterprise Data with Jure Leskovec - #768
How to Find the Agent Failures Your Evals Miss with Scott Clark - #767
How to Engineer AI Inference Systems with Philip Kiely - #766
How Capital One Delivers Multi-Agent Systems with Rashmi Shetty - #765
Similar Episodes
Related episodes from other podcasts
No Priors: Artificial Intelligence | Technology | Startups
Jan 8
NVIDIA’s Jensen Huang on Reasoning Models, Robotics, and Refuting the “AI Bubble” Narrative
Practical AI
Apr 16
Open Source Self-Driving with Comma AI
Eye on AI
Apr 12
#331 Sergey Levine: The Robot Revolution Nobody Is Talking About
Cognitive Revolution
Apr 4
Training the AIs' Eyes: How Roboflow is Making the Real World Programmable, with CEO Joseph Nelson
Practical AI
Feb 13
AI incidents, audits, and the limits of benchmarks
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Software Engineering Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into The TWIML AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from The TWIML AI Podcast and 192+ other podcasts. Free for up to 3 shows.
Start My Monday DigestNo credit card · Unsubscribe anytime