Physical AI that Moves the World — Qasar Younis & Peter Ludwig, Applied Intuition
Episode
72 min
Read time
3 min
Topics
Career Growth, Productivity, Investing
AI-Generated Summary
Key Takeaways
- ✓LiDAR-to-camera training pipeline: LiDAR is valuable during R&D as a depth-labeling tool paired with cameras, not as a permanent production sensor. Tesla R&D vehicles still carry LiDAR today. The workflow: collect LiDAR-paired camera data, train depth perception into the camera model, then remove LiDAR for production. This reduces hardware cost while preserving depth capability in the final deployed system.
- ✓Physical AI OS fragmentation: The vehicle software landscape mirrors pre-Android mobile — dozens of incompatible firmware stacks make deploying AI applications nearly impossible. Applied Intuition's OS strategy mirrors Google's Android rationale: consolidate the platform so AI applications run reliably across diverse hardware. The OS handles real-time scheduling, memory management, fail-safes for cosmic-ray bit flips, and reliable over-the-air updates to safety-critical modules.
- ✓Onboard vs. offboard model architecture: Production physical AI splits into offboard models (no latency constraints, large GPU clusters, used for training) and onboard models (millisecond latency budgets, power-constrained embedded chips). Onboard models are distilled derivatives of larger offline models. Every fraction of a millisecond matters because exceeding latency budgets causes vehicle control failure, making performance optimization the primary engineering constraint — not model intelligence.
- ✓Simulation validation gap: Simulation results are only trustworthy after a rigorous sim-to-real matching process where real-world feedback calibrates simulator parameters. Skipping this step causes production failures. A concrete example: humanoid robot RL policies trained without actuator temperature as a simulation parameter will overheat motors in deployment. World models scale simulation via real-world data ingestion rather than adding manual physics equations, but cannot replace real-world testing entirely.
- ✓Technology stack two-year refresh cycle: Applied Intuition has completely rebuilt its technology stack roughly four times in ten years, maintaining an approximate two-year horizon for planned reinvestment. This cadence tracks published research and internal research advances. Engineering hiring reflects this: 83% of the roughly 1,000-person company are engineers, selected specifically for hardware-software boundary expertise and production deployment experience, not just implementation speed.
What It Covers
Applied Intuition co-founders Qasar Younis and Peter Ludwig explain how their 1,000-engineer company builds physical AI across automotive, trucking, mining, agriculture, and defense. With 18 of the top 20 non-Chinese automakers as customers, they cover simulation, safety-critical operating systems, onboard model efficiency, and the compounding nature of hard-tech infrastructure businesses.
Key Questions Answered
- •LiDAR-to-camera training pipeline: LiDAR is valuable during R&D as a depth-labeling tool paired with cameras, not as a permanent production sensor. Tesla R&D vehicles still carry LiDAR today. The workflow: collect LiDAR-paired camera data, train depth perception into the camera model, then remove LiDAR for production. This reduces hardware cost while preserving depth capability in the final deployed system.
- •Physical AI OS fragmentation: The vehicle software landscape mirrors pre-Android mobile — dozens of incompatible firmware stacks make deploying AI applications nearly impossible. Applied Intuition's OS strategy mirrors Google's Android rationale: consolidate the platform so AI applications run reliably across diverse hardware. The OS handles real-time scheduling, memory management, fail-safes for cosmic-ray bit flips, and reliable over-the-air updates to safety-critical modules.
- •Onboard vs. offboard model architecture: Production physical AI splits into offboard models (no latency constraints, large GPU clusters, used for training) and onboard models (millisecond latency budgets, power-constrained embedded chips). Onboard models are distilled derivatives of larger offline models. Every fraction of a millisecond matters because exceeding latency budgets causes vehicle control failure, making performance optimization the primary engineering constraint — not model intelligence.
- •Simulation validation gap: Simulation results are only trustworthy after a rigorous sim-to-real matching process where real-world feedback calibrates simulator parameters. Skipping this step causes production failures. A concrete example: humanoid robot RL policies trained without actuator temperature as a simulation parameter will overheat motors in deployment. World models scale simulation via real-world data ingestion rather than adding manual physics equations, but cannot replace real-world testing entirely.
- •Technology stack two-year refresh cycle: Applied Intuition has completely rebuilt its technology stack roughly four times in ten years, maintaining an approximate two-year horizon for planned reinvestment. This cadence tracks published research and internal research advances. Engineering hiring reflects this: 83% of the roughly 1,000-person company are engineers, selected specifically for hardware-software boundary expertise and production deployment experience, not just implementation speed.
- •Compounding hard-tech commercialization strategy: Founders in physical AI should impose early commercial constraints — a defined, narrow problem space — because hard-tech compounds over time but requires surviving long enough to reach scale. Applied Intuition's OS, dev tooling, and autonomy models all compound without being discarded. Applying mature-company strategies like full vertical integration too early depletes resources before compounding effects materialize, which is the primary reason most hard-tech startups fail.
Notable Moment
The Cruise incident reframing stands out: the founders argue the company's collapse was not primarily a technology failure but a regulatory communication failure. A version of Cruise surviving the accident was plausible. The compounding effect of prior trust deficits with regulators — not the crash itself — ended the company.
Episode Transcript
Everyone, welcome to the Later in Space podcast. This is Celestio, founder of Kernel Labs, and I'm joined by Swyx, editor of Later in Space. And today, we have we're very honored to have, the founders of Applied Intuition, Kasar and Peter. Welcome. You guys really know how to turn it on to podcast mode. That was that was, you guys are real real pros that says they were just joking around right before this, and then they flipped it pretty quick. Oh, yeah. It's good to have you guys. Maybe you just wanna introduce yourself so people know the voice on the mic and Oh, sure. Yeah. I'm Peter Ludwig. I'm the co founder and CTO of Applied Intuition. And, my name is Kasser Younis. I am the CEO and co founder with Peter. Nice. Can you guys give the high level of view of what applied intuition is? And I I was reading through some of the congress files, when you went out there, Peter, and 18 of the top 20 global non Chinese automakers use you guys. You have customers in agriculture, defense, construction. I think most people have heard of applying tuition tied to YC when it was first started and then you were kinda stealth for a long time. So maybe just give people the high level overview of what it is today and then we'll dive into the different pieces. Yeah. So Applied Intuition, our mission is to build physical AI for a safer, more prosperous world. And so we work on physical AI for all different types of moving systems, everything from cars to trucks to construction and mining equipment, to defense technologies. And, and we're a true technology company, so we we build and sell the technology. And we sell it to the companies that make the machines. We we sell it to to the government, or really anyone that wants to to buy a technology to make machines smart. Yeah. And I think, in the broader AI landscape, a lot of the focus, rightfully so in the last three years has been on large language models, and so everything that fits in a screen, you know, like, whether it's code complete products or or or things like that. And the what's different about us is we're deploying intelligence onto a lot of things that don't have screens. You know, they're physical machines. There are sometimes screens within the cabin or for for example of a car or a truck or something like that. But, most of the value we provide is putting intelligence that is in safety critical environments. So that the those two words are really important because learned systems can make mistakes if you're asking for, like, you know, some, you know, so something like tell me about these podcast hosts that I'm I'm about to go meet. But, you can't do that, obviously, when you're you know, we run, like, as an example, we run driverless trucks in …
Get the full transcript (14,681 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 69-minute episode.
Get Latent Space summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Latent Space
🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
Aug 26 · 83 min
Business Breakdowns
Applied Intuition: A Billion Intelligent Machines - [Business Breakdowns, EP.248]
Jul 27
More from Latent Space
Simulation: the new Scaling Law — Joon Sung Park, Simile AI
Aug 21 · 69 min
a16z Podcast
Why Physical AI Is the Next Frontier | Applied Intuition
Jul 21
More from Latent Space
We summarize every new episode. Want them in your inbox?
🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
Simulation: the new Scaling Law — Joon Sung Park, Simile AI
🔬The BioAI Phase Shift - Matthew McPartlon & Neil Patil, Chai Discovery
The Inference Engineering Masterclass — Philip Kiely & Ali Taha, Baseten
Codex from 0 to 10M Users: Building ChatGPT Work — Akshay Nathan, OpenAI
Similar Episodes
Related episodes from other podcasts
Business Breakdowns
Jul 27
Applied Intuition: A Billion Intelligent Machines - [Business Breakdowns, EP.248]
a16z Podcast
Jul 21
Why Physical AI Is the Next Frontier | Applied Intuition
Lenny's Podcast
Mar 8
The most successful AI company you’ve never heard of | Qasar Younis
No Priors: Artificial Intelligence | Technology | Startups
Aug 27
Rethinking Legacy Data Infrastructure with Eon Co-Founders Ofir Ehrlich and Gonen Stein
a16z Podcast
Aug 20
How Global Networks Are Reshaping Startup Success
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Investing & Markets Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Latent Space.
Every Monday, we deliver AI summaries of the latest episodes from Latent Space and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime