Intelligent Robots in 2026: Are We There Yet? with Nikita Rudin - #760
Episode
66 min
Read time
2 min
AI-Generated Summary
Key Takeaways
- ✓Sim-to-Real Gap: Closing the simulation-to-reality gap requires deep understanding of both worlds, mapping every software layer from high-level commands down to motor currents. Real-to-sim processes identify critical parameters like torque limits and delays by hanging robots and collecting motor data, then abstracting these into fast simulators.
- ✓Locomotion Progress: Blind locomotion (reactive only) is robust for quadrupeds, but perception-based locomotion remains challenging. Adding cameras increases the sim-to-real gap significantly because sensor noise and visual rendering must be accurately simulated. Switching robots to new hardware takes only days, but adapting to new tasks requires substantial engineering effort.
- ✓Robot Deployment Reality: Most robotics demos use either live teleoperation or policies trained on thousands of hours of collected teleoperation data. No humanoid robot currently generates economic value in warehouses or factories because they perform approximate tasks requiring more human handlers than the original workforce, making value negative.
- ✓Model Architecture: Production systems use three-tier hierarchies: large VLMs for abstract task planning (running off-board or in cloud), vision-language-action models for motion planning at ten hertz (onboard, compute-limited), and small whole-body trackers at fifty hertz on CPU for motor control. Diffusion models in VLAs create the biggest onboard compute bottleneck.
- ✓Training Approach: Combining reinforcement learning with imitation learning works by using human demonstrations to guide RL exploration, not as pure pretraining. Training separate primitive skills (walking, picking, placing) then distilling into one VLA shows early generalization signs. Industrial deployment focuses on repetitive tasks where abstract reasoning can be precomputed, unlike home environments.
What It Covers
Nikita Rudin, CEO of Flexion Robotics, explains the gap between robotics demos and real-world deployment, covering simulation-to-reality challenges, reinforcement learning techniques, and why no humanoid robot generates actual economic value today in 2025.
Key Questions Answered
- •Sim-to-Real Gap: Closing the simulation-to-reality gap requires deep understanding of both worlds, mapping every software layer from high-level commands down to motor currents. Real-to-sim processes identify critical parameters like torque limits and delays by hanging robots and collecting motor data, then abstracting these into fast simulators.
- •Locomotion Progress: Blind locomotion (reactive only) is robust for quadrupeds, but perception-based locomotion remains challenging. Adding cameras increases the sim-to-real gap significantly because sensor noise and visual rendering must be accurately simulated. Switching robots to new hardware takes only days, but adapting to new tasks requires substantial engineering effort.
- •Robot Deployment Reality: Most robotics demos use either live teleoperation or policies trained on thousands of hours of collected teleoperation data. No humanoid robot currently generates economic value in warehouses or factories because they perform approximate tasks requiring more human handlers than the original workforce, making value negative.
- •Model Architecture: Production systems use three-tier hierarchies: large VLMs for abstract task planning (running off-board or in cloud), vision-language-action models for motion planning at ten hertz (onboard, compute-limited), and small whole-body trackers at fifty hertz on CPU for motor control. Diffusion models in VLAs create the biggest onboard compute bottleneck.
- •Training Approach: Combining reinforcement learning with imitation learning works by using human demonstrations to guide RL exploration, not as pure pretraining. Training separate primitive skills (walking, picking, placing) then distilling into one VLA shows early generalization signs. Industrial deployment focuses on repetitive tasks where abstract reasoning can be precomputed, unlike home environments.
Notable Moment
Rudin demonstrates live on-stage training where a quadruped robot learns to walk from scratch in three minutes on a laptop, with policies updating every fifteen seconds. The robot progresses from falling over to taking steps to walking around the stage, visually showing the reinforcement learning process.
You just read a 3-minute summary of a 63-minute episode.
Get The TWIML AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from The TWIML AI Podcast
How Capital One Delivers Multi-Agent Systems with Rashmi Shetty - #765
Apr 16 · 54 min
Odd Lots
Presenting Foundering Season 6: The Killing of Bob Lee, Part 1
Apr 26
More from The TWIML AI Podcast
The Race to Production-Grade Diffusion LLMs with Stefano Ermon - #764
Mar 26 · 63 min
Masters of Scale
Possible: Netflix co-founder Reed Hastings: stories, schools, superpowers
Apr 25
More from The TWIML AI Podcast
We summarize every new episode. Want them in your inbox?
How Capital One Delivers Multi-Agent Systems with Rashmi Shetty - #765
The Race to Production-Grade Diffusion LLMs with Stefano Ermon - #764
Agent Swarms and Knowledge Graphs for Autonomous Software Development with Siddhant Pardeshi - #763
AI Trends 2026: OpenClaw Agents, Reasoning LLMs, and More with Sebastian Raschka - #762
The Evolution of Reasoning in Small Language Models with Yejin Choi - #761
Similar Episodes
Related episodes from other podcasts
Odd Lots
Apr 26
Presenting Foundering Season 6: The Killing of Bob Lee, Part 1
Masters of Scale
Apr 25
Possible: Netflix co-founder Reed Hastings: stories, schools, superpowers
The Futur
Apr 25
Why Process is Better Than AI w/ Scott Clum | Ep 430
20VC (20 Minute VC)
Apr 25
20Product: Replit CEO on Why Coding Models Are Plateauing | Why the SaaS Apocalypse is Justified: Will Incumbents Be Replaced? | Why IDEs Are Dead and Do PMs Survive the Next 3-5 Years with Amjad Masad
This Week in Startups
Apr 25
The Defense Tech Startup YC Kicked Out of a Meeting is Now Arming America | E2280
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
You're clearly into The TWIML AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from The TWIML AI Podcast and 192+ other podcasts. Free for up to 3 shows.
Start My Monday DigestNo credit card · Unsubscribe anytime