Safer, Smarter Construction Sites with Edge AI and Caterpillar Autonomous Machines - Ep. 285
Episode
39 min
Read time
2 min
Topics
Artificial Intelligence, Product & Tech Trends, Science & Discovery
AI-Generated Summary
Key Takeaways
- ✓Edge AI in Cabs: Caterpillar integrates NVIDIA Thor compute platforms with Riva voice services into excavator cabs, enabling operators to access machine controls and company knowledge through natural language without taking eyes off jobsites, developed in months not years.
- ✓Manufacturing Optimization: Using NVIDIA Omniverse digital twins and cuOpt models, Caterpillar calculates clear-to-build status across 30-day windows in 100 milliseconds at facility level, processing complex multi-layer supply chain signals that previously required extensive manual analysis by teams.
- ✓Autonomous Safety Approach: AI-based autonomy requires millions of simulation hours using digital twins of jobsites and machines before physical testing. Foundation models get reinforced with Caterpillar's century of operational data to handle construction-specific scenarios that generic models cannot address.
- ✓Sensor Innovation: Quadruped robots with thermal, acoustic and visual sensors walk factory floors to perform predictive maintenance on legacy equipment without shutting down production for months to install permanent sensors, simultaneously updating digital twin data in real-time.
What It Covers
Caterpillar's VP of AI Brandon Hootman explains how the century-old equipment manufacturer deploys NVIDIA edge AI systems in construction machines, achieving 100-millisecond supply chain optimization and autonomous capabilities through digital twins and onboard intelligence.
Key Questions Answered
- •Edge AI in Cabs: Caterpillar integrates NVIDIA Thor compute platforms with Riva voice services into excavator cabs, enabling operators to access machine controls and company knowledge through natural language without taking eyes off jobsites, developed in months not years.
- •Manufacturing Optimization: Using NVIDIA Omniverse digital twins and cuOpt models, Caterpillar calculates clear-to-build status across 30-day windows in 100 milliseconds at facility level, processing complex multi-layer supply chain signals that previously required extensive manual analysis by teams.
- •Autonomous Safety Approach: AI-based autonomy requires millions of simulation hours using digital twins of jobsites and machines before physical testing. Foundation models get reinforced with Caterpillar's century of operational data to handle construction-specific scenarios that generic models cannot address.
- •Sensor Innovation: Quadruped robots with thermal, acoustic and visual sensors walk factory floors to perform predictive maintenance on legacy equipment without shutting down production for months to install permanent sensors, simultaneously updating digital twin data in real-time.
Notable Moment
Brandon reveals that AI development requires abandoning traditional software approaches. Small teams of data engineers, prompt engineers and data scientists can build functional prototypes in three weeks, then scale rapidly rather than spending years on monolithic development cycles.
Episode Transcript
Welcome to the NVIDIA AI podcast. I'm Noah Kravitz. With me today is Brandon Hootman. Brandon is vice president of data and artificial intelligence at Caterpillar, and, we're speaking just after CES week twenty twenty six. Happy New Year, everybody. It's a big week for Caterpillar, so we're going to get into all the exciting stuff that's been going on, this week, but leading up to it, certainly. But before we do that, Brandon, welcome to the pod. Thank you so much for taking the time to join us. No. Awesome to be with you. Big week for Caterpillar. We are excited to, to be on stage at CES and also excited to, to announce some things in, in partnership with NVIDIA. Fantastic. We'll get into all that in a second. But first, if you would, can you tell us a little bit about Caterpillar? I I would think most people listening know the brand, have seen your machines, have seen the logo. But if you can give us a little bit of background about the company and then also maybe a little bit about your role, just kind of to set up the conversation. Be happy to, Noah. So 2025 was a big year for Caterpillar. We celebrated our 100 year anniversary. So we've Amazing. Been, helping build a better world, in multiple areas for the past century and really proud of that. And, you know, I think a lot of the audience would recognize Caterpillar from just the drives down the interstate and you see our machines doing the work and, you know, that's one area of our business, but we've also got a pretty significant footprint in other areas that individuals may not know about. We do a lot of work in in heavy mining and then we also do a significant amount of work in energy and power generation too, which with AI now really taking off, as you can imagine, has been a been a huge part of our business. We're really excited by that. Yeah. For sure. And so what about your role? How how long have you been at Caterpillar? If you want, you know, a little bit of backstory about you landed here, but then maybe you can just kinda describe what, what you do as VP of AI and data. Yeah. Yeah. Will do. Will do. So I'm a software engineer by by education and by most of most of my time in the workforce. I've been with Caterpillar for twenty seven years, and it doesn't doesn't really feel like that, but I've been here now for twenty seven years. And over the course of of my twenty seven years, while it feels like, you know, know, you could look at that and say, well, you've been been in one spot for quite a while. Like, I probably had six or seven different careers over the the course of that twenty seven years, so it's been been pretty cool to do. …
Get the full transcript (7,440 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 36-minute episode.
Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from NVIDIA AI Podcast
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
Jun 24 · 39 min
In Good Company with Nicolai Tangen
John Deere CEO: Farming's Future, Autonomous Tractors and AI in the Field
Sep 2
More from NVIDIA AI Podcast
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Jun 10 · 21 min
Masters of Scale
Pioneers of AI: John Deere's AI vision for future farms
Jul 11
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.
Tools
by NVIDIA
“Caterpillar integrates NVIDIA Thor compute platforms with Riva voice services into excavator cabs, enabling operators to access machine controls and company knowledge through natural language.”
by NVIDIA
“Using NVIDIA Omniverse digital twins and cuOpt models, Caterpillar calculates clear-to-build status across 30-day windows in 100 milliseconds at facility level.”
by NVIDIA
“Using NVIDIA Omniverse digital twins and cuOpt models, Caterpillar calculates clear-to-build status across 30-day windows in 100 milliseconds at facility level, processing complex multi-layer supply chain signals.”
Gear
by NVIDIA
“Caterpillar integrates NVIDIA Thor compute platforms with Riva voice services into excavator cabs, enabling operators to access machine controls and company knowledge through natural language.”
More from NVIDIA AI Podcast
We summarize every new episode. Want them in your inbox?
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300
Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299
Snap’s Secret to Processing 10 Petabytes a Day: GPU-Accelerated Spark | NVIDIA AI Podcast Ep. 298
Similar Episodes
Related episodes from other podcasts
In Good Company with Nicolai Tangen
Sep 2
John Deere CEO: Farming's Future, Autonomous Tractors and AI in the Field
Masters of Scale
Jul 11
Pioneers of AI: John Deere's AI vision for future farms
No Priors: Artificial Intelligence | Technology | Startups
Jul 31
Building an Autonomous Enterprise for Real-World Services with Netic Founder Melisa Tokmak
Eye on AI
Jul 10
What Industrial AI Actually Looks Like | Kriti Sharma, Nexus Black
The TWIML AI Podcast
Jul 8
How AI Learns to Smell with Alex Wiltschko - #771
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into NVIDIA AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime