Skip to main content
Lenny's Podcast

First interview with Scale AI’s CEO: $14B Meta deal, what’s working in enterprise AI, and what frontier labs are building next | Jason Droege

84 min episode · 2 min read
·
Scale Ai

Episode

84 min

Read time

2 min

Topics

Health & Wellness, Startups, Leadership

AI-Generated Summary

Key Takeaways

  • Expert Data Evolution: AI training shifted from simple preference tasks eighteen months ago to complex multi-hour projects requiring PhDs. Eighty percent of Scale's contributor network holds bachelor's degrees or higher, with 15% having PhDs earning significant income labeling specialized domains like cancer research and advanced web development.
  • Enterprise AI Reality: Production-ready AI systems require six to twelve months of development, not minutes shown in demos. Companies need legal approval, regulatory compliance, change management, and accuracy levels sufficient for mission-critical processes. POCs reaching 60-70% accuracy face exponential difficulty achieving the remaining reliability needed for automation.
  • Gross Margin Filter: High gross margins combined with healthy churn indicate value creation and differentiation. When evaluating new businesses, start by asking why a 60% gross margin wouldn't work—the answer reveals competitive alternatives, pricing power, and whether the business model can sustain itself as competitors emerge and margins compress.
  • Independent Customer Research: Scale reverse-engineered restaurant economics by ordering food, weighing ingredients, and matching supplier catalogs to build independent unit economics models. This ground-truth analysis revealed restaurants have 70-80% incremental gross margins on delivery orders, enabling confident pricing decisions despite initial restaurateur resistance to 30% commission rates.
  • Survival Precedes Thriving: Founders must prioritize asymmetrically positive decisions that ensure company survival over aggressive growth bets. The ability to persevere through years of difficulty matters more than optimal talent or timing. Markets change quickly—companies can transform from struggling to successful rapidly, but only if they survive long enough.

What It Covers

Jason Droege, new CEO of Scale AI, discusses the $14B Meta deal, how expert data labeling trains frontier AI models, enterprise AI implementation challenges, and lessons from building Uber Eats from zero to $20B.

Key Questions Answered

  • Expert Data Evolution: AI training shifted from simple preference tasks eighteen months ago to complex multi-hour projects requiring PhDs. Eighty percent of Scale's contributor network holds bachelor's degrees or higher, with 15% having PhDs earning significant income labeling specialized domains like cancer research and advanced web development.
  • Enterprise AI Reality: Production-ready AI systems require six to twelve months of development, not minutes shown in demos. Companies need legal approval, regulatory compliance, change management, and accuracy levels sufficient for mission-critical processes. POCs reaching 60-70% accuracy face exponential difficulty achieving the remaining reliability needed for automation.
  • Gross Margin Filter: High gross margins combined with healthy churn indicate value creation and differentiation. When evaluating new businesses, start by asking why a 60% gross margin wouldn't work—the answer reveals competitive alternatives, pricing power, and whether the business model can sustain itself as competitors emerge and margins compress.
  • Independent Customer Research: Scale reverse-engineered restaurant economics by ordering food, weighing ingredients, and matching supplier catalogs to build independent unit economics models. This ground-truth analysis revealed restaurants have 70-80% incremental gross margins on delivery orders, enabling confident pricing decisions despite initial restaurateur resistance to 30% commission rates.
  • Survival Precedes Thriving: Founders must prioritize asymmetrically positive decisions that ensure company survival over aggressive growth bets. The ability to persevere through years of difficulty matters more than optimal talent or timing. Markets change quickly—companies can transform from struggling to successful rapidly, but only if they survive long enough.

Notable Moment

McDonald's approached Scale to partner on food delivery, but Droege initially refused for months, wanting to focus on independent restaurants. His team convinced him to reconsider, and the delay resulted in an exclusive global relationship that caused the business to hockey stick at a different level three months later.

Know someone who'd find this useful?

Episode Transcript

There's been a lot of talk these days about AI not delivering on the promise that we hear, especially at enterprises. These things take six to twelve months to get them truly robust enough where an important process can be automated. Like with any of these major tech revolutions, headlines tell one story and then on the ground, laying broadband means you need to dig up every single road in America to lay it. Someone's gotta dig up the road or someone's gotta run the undersea cable. Is there anything you think people don't truly grasp or understand about where AI models are gonna be in the next two, three years? The general trend right now is going from models knowing things to models doing things. The next question becomes, what can it do for me? How does the agent make decisions for you? Let's talk about scale and this whole world of AI that you're in. You essentially pioneered data labeling, training data, creating evals for labs. Eighteen months ago, you would get a short story and it would say, is this short story better than this short story? And now you're at a point where one task is building an entire website by one of the world's best web developers, or it is explaining some very nuanced topic on cancer to a model. These tasks now take hours of time, and they require PhDs and professionals. I've talked to a bunch of people that I've worked with you over the years and I heard a lot about just how high of a bar you set for new businesses. From an entrepreneurship standpoint, it truly is about what insight do I have? Why am I so lucky to have this insight? Why in a world of a million entrepreneurs who are thinking, who are smart, who are trying everything, why am I in the position where I likely have an insight that others do not? Today, my guest is Jason Droge. Jason is the new CEO of Scale AI. This is the first interview that he's done since taking over for Alex Wang after the Meta deal. Alex now leads the super intelligence team at Meta. Prior to Scale, Jason co founded a company with Travis Kalanick before he started Uber, worked at a couple startups. Most famously, Jason launched and led Uber Eats, which went from an idea that he and his team had to what is now a multi billion dollar run rate business, and one that basically saved Uber during the pandemic when nobody was taking rides. This interview is following a theme that I've been following through a bunch of interviews, which is the evolution of how AI models actually get smarter. Along with scaling compute and improving the actual model code, much of the improvements we're seeing in JPGPT and Claude and every Frontier AI model is these labs hiring experts to fill in gaps in their knowledge and correcting their understanding of how …

Get the full transcript (17,241 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Lenny's Podcast transcripts →

You just read a 3-minute summary of a 81-minute episode.

Get Lenny's Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

More from Lenny's Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best Product Management Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's Health & Longevity Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into Lenny's Podcast.

Every Monday, we deliver AI summaries of the latest episodes from Lenny's Podcast and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime