Skip to main content
NVIDIA AI Podcast

Safer, Smarter Construction Sites with Edge AI and Caterpillar Autonomous Machines - Ep. 285

39 min episode · 2 min read

Episode

39 min

Read time

2 min

Topics

Artificial Intelligence, Product & Tech Trends, Science & Discovery

AI-Generated Summary

Key Takeaways

  • Edge AI in Cabs: Caterpillar integrates NVIDIA Thor compute platforms with Riva voice services into excavator cabs, enabling operators to access machine controls and company knowledge through natural language without taking eyes off jobsites, developed in months not years.
  • Manufacturing Optimization: Using NVIDIA Omniverse digital twins and cuOpt models, Caterpillar calculates clear-to-build status across 30-day windows in 100 milliseconds at facility level, processing complex multi-layer supply chain signals that previously required extensive manual analysis by teams.
  • Autonomous Safety Approach: AI-based autonomy requires millions of simulation hours using digital twins of jobsites and machines before physical testing. Foundation models get reinforced with Caterpillar's century of operational data to handle construction-specific scenarios that generic models cannot address.
  • Sensor Innovation: Quadruped robots with thermal, acoustic and visual sensors walk factory floors to perform predictive maintenance on legacy equipment without shutting down production for months to install permanent sensors, simultaneously updating digital twin data in real-time.

What It Covers

Caterpillar's VP of AI Brandon Hootman explains how the century-old equipment manufacturer deploys NVIDIA edge AI systems in construction machines, achieving 100-millisecond supply chain optimization and autonomous capabilities through digital twins and onboard intelligence.

Key Questions Answered

  • Edge AI in Cabs: Caterpillar integrates NVIDIA Thor compute platforms with Riva voice services into excavator cabs, enabling operators to access machine controls and company knowledge through natural language without taking eyes off jobsites, developed in months not years.
  • Manufacturing Optimization: Using NVIDIA Omniverse digital twins and cuOpt models, Caterpillar calculates clear-to-build status across 30-day windows in 100 milliseconds at facility level, processing complex multi-layer supply chain signals that previously required extensive manual analysis by teams.
  • Autonomous Safety Approach: AI-based autonomy requires millions of simulation hours using digital twins of jobsites and machines before physical testing. Foundation models get reinforced with Caterpillar's century of operational data to handle construction-specific scenarios that generic models cannot address.
  • Sensor Innovation: Quadruped robots with thermal, acoustic and visual sensors walk factory floors to perform predictive maintenance on legacy equipment without shutting down production for months to install permanent sensors, simultaneously updating digital twin data in real-time.

Notable Moment

Brandon reveals that AI development requires abandoning traditional software approaches. Small teams of data engineers, prompt engineers and data scientists can build functional prototypes in three weeks, then scale rapidly rather than spending years on monolithic development cycles.

Know someone who'd find this useful?

Episode Transcript

Welcome to the NVIDIA AI podcast. I'm Noah Kravitz. With me today is Brandon Hootman. Brandon is vice president of data and artificial intelligence at Caterpillar, and, we're speaking just after CES week twenty twenty six. Happy New Year, everybody. It's a big week for Caterpillar, so we're going to get into all the exciting stuff that's been going on, this week, but leading up to it, certainly. But before we do that, Brandon, welcome to the pod. Thank you so much for taking the time to join us. No. Awesome to be with you. Big week for Caterpillar. We are excited to, to be on stage at CES and also excited to, to announce some things in, in partnership with NVIDIA. Fantastic. We'll get into all that in a second. But first, if you would, can you tell us a little bit about Caterpillar? I I would think most people listening know the brand, have seen your machines, have seen the logo. But if you can give us a little bit of background about the company and then also maybe a little bit about your role, just kind of to set up the conversation. Be happy to, Noah. So 2025 was a big year for Caterpillar. We celebrated our 100 year anniversary. So we've Amazing. Been, helping build a better world, in multiple areas for the past century and really proud of that. And, you know, I think a lot of the audience would recognize Caterpillar from just the drives down the interstate and you see our machines doing the work and, you know, that's one area of our business, but we've also got a pretty significant footprint in other areas that individuals may not know about. We do a lot of work in in heavy mining and then we also do a significant amount of work in energy and power generation too, which with AI now really taking off, as you can imagine, has been a been a huge part of our business. We're really excited by that. Yeah. For sure. And so what about your role? How how long have you been at Caterpillar? If you want, you know, a little bit of backstory about you landed here, but then maybe you can just kinda describe what, what you do as VP of AI and data. Yeah. Yeah. Will do. Will do. So I'm a software engineer by by education and by most of most of my time in the workforce. I've been with Caterpillar for twenty seven years, and it doesn't doesn't really feel like that, but I've been here now for twenty seven years. And over the course of of my twenty seven years, while it feels like, you know, know, you could look at that and say, well, you've been been in one spot for quite a while. Like, I probably had six or seven different careers over the the course of that twenty seven years, so it's been been pretty cool to do. …

Get the full transcript (7,440 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all NVIDIA AI Podcast transcripts →

You just read a 3-minute summary of a 36-minute episode.

Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.

Tools

  • by NVIDIA

    Caterpillar integrates NVIDIA Thor compute platforms with Riva voice services into excavator cabs, enabling operators to access machine controls and company knowledge through natural language.
  • by NVIDIA

    Using NVIDIA Omniverse digital twins and cuOpt models, Caterpillar calculates clear-to-build status across 30-day windows in 100 milliseconds at facility level.
  • by NVIDIA

    Using NVIDIA Omniverse digital twins and cuOpt models, Caterpillar calculates clear-to-build status across 30-day windows in 100 milliseconds at facility level, processing complex multi-layer supply chain signals.

Gear

  • by NVIDIA

    Caterpillar integrates NVIDIA Thor compute platforms with Riva voice services into excavator cabs, enabling operators to access machine controls and company knowledge through natural language.

More from NVIDIA AI Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into NVIDIA AI Podcast.

Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime