Mati Staniszewski on ElevenLabs, Voice AI & Building the Communication Layer for AI
Episode
71 min
Read time
3 min
Topics
Productivity, Health & Wellness, Startups
AI-Generated Summary
Key Takeaways
- ✓Focused Research Defense: ElevenLabs deliberately restricts its research team to audio models only — text-to-speech, speech-to-text, transcription, and orchestration — as a competitive moat against larger labs. Before pursuing any new product, the internal test is whether audio represents the primary bottleneck. If a product's core problem is video or image quality, ElevenLabs explicitly passes, as demonstrated when they declined to build avatar and lip-sync tools two years ago.
- ✓FDE Model from Palantir: Forward-deployed engineers (FDEs) sit inside the product team, not go-to-market, at ElevenLabs. Teams of roughly five engineers embed directly with enterprise clients — physically traveling to their offices — to build integrations with CRM systems, SIP trunking, and phone infrastructure. Critically, every integration insight gets abstracted back into the core platform, so learnings from one client automatically improve the product for thousands of others.
- ✓Voice Marketplace as Ecosystem Lock-in: ElevenLabs built a 20,000-voice marketplace where individuals create authenticated AI voices, then earn passive compensation each time their voice is used. This creates a proprietary data asset and switching cost that pure model quality cannot replicate. When model performance converges across competitors, the ecosystem — brand trust, voice library, and revenue-sharing structure — becomes the durable differentiator.
- ✓Customer Discovery Before Product: When ElevenLabs initially pitched dubbing to creators, feedback revealed more immediate needs: editing recorded lines, narrating scripts before filming, and replacing their own voice in videos. This redirected the entire research roadmap toward high-quality single-language text-to-speech before tackling multilingual dubbing. Founders should treat early customer conversations as product prioritization data, not just validation exercises.
- ✓Small Teams with Embedded Engineers Across All Functions: ElevenLabs caps teams at under 10 people and embeds engineers inside legal, talent, and operations — not just product. This structure enables bottom-up AI adoption without top-down mandates. The revenue operations function uses AI tools to auto-transcribe sales calls, pre-fill CRM fields, and run a voice-based AI SDR on the website that collects significantly more prospect information than traditional dropdown forms.
What It Covers
ElevenLabs co-founder Mati Staniszewski explains how he and co-founder Piotr built a focused audio AI research-and-product company from 2022, starting with dubbing and evolving into a platform serving voice agents, marketing, and accessibility across industries including FinTech, healthcare, and telecom, with Deutsche Telekom as a deeply integrated enterprise customer.
Key Questions Answered
- •Focused Research Defense: ElevenLabs deliberately restricts its research team to audio models only — text-to-speech, speech-to-text, transcription, and orchestration — as a competitive moat against larger labs. Before pursuing any new product, the internal test is whether audio represents the primary bottleneck. If a product's core problem is video or image quality, ElevenLabs explicitly passes, as demonstrated when they declined to build avatar and lip-sync tools two years ago.
- •FDE Model from Palantir: Forward-deployed engineers (FDEs) sit inside the product team, not go-to-market, at ElevenLabs. Teams of roughly five engineers embed directly with enterprise clients — physically traveling to their offices — to build integrations with CRM systems, SIP trunking, and phone infrastructure. Critically, every integration insight gets abstracted back into the core platform, so learnings from one client automatically improve the product for thousands of others.
- •Voice Marketplace as Ecosystem Lock-in: ElevenLabs built a 20,000-voice marketplace where individuals create authenticated AI voices, then earn passive compensation each time their voice is used. This creates a proprietary data asset and switching cost that pure model quality cannot replicate. When model performance converges across competitors, the ecosystem — brand trust, voice library, and revenue-sharing structure — becomes the durable differentiator.
- •Customer Discovery Before Product: When ElevenLabs initially pitched dubbing to creators, feedback revealed more immediate needs: editing recorded lines, narrating scripts before filming, and replacing their own voice in videos. This redirected the entire research roadmap toward high-quality single-language text-to-speech before tackling multilingual dubbing. Founders should treat early customer conversations as product prioritization data, not just validation exercises.
- •Small Teams with Embedded Engineers Across All Functions: ElevenLabs caps teams at under 10 people and embeds engineers inside legal, talent, and operations — not just product. This structure enables bottom-up AI adoption without top-down mandates. The revenue operations function uses AI tools to auto-transcribe sales calls, pre-fill CRM fields, and run a voice-based AI SDR on the website that collects significantly more prospect information than traditional dropdown forms.
- •FinTech Leads Enterprise Voice Agent Adoption: Among ElevenLabs' enterprise verticals, FinTech — including Revolut, Klarna, and PagBank — moves fastest on deploying conversational voice agents, followed by healthcare and telecom. Retail and e-commerce began adopting at scale only in the current year. Enterprise expansion follows a prove-then-scale sequence: demonstrate measurable impact on one use case, complete deep integrations, run simulated call trials, then expand to additional product lines within the same account.
Notable Moment
Staniszewski revealed that adding verbal filler sounds — the equivalent of "ums" and pauses — to ElevenLabs voice agents caused user engagement to spike sharply. Counterintuitively, deliberately introducing imperfection made agents feel human enough that users became comfortable and willing to continue conversations they previously abandoned.
Episode Transcript
We ran into each other at Michael Dell's event a few months ago, and you're like, Oh, I'm very curious how building a company today is different from building one in the past. And Michael has forty plus years of experience. He's been dominating for decades. And when I saw him, we had like a thirty minute conversation about this. You read all these biographies of history sketch entrepreneurs and you just see this over and over again. It's like, oh, this time is different. Turns out, no, this time is not different. And Michael's like, no, no, I actually think this time is different. So I want to start with like how you think about building your company AI native from today. Yeah, Michael is a legend. He must have so many interesting perspectives, especially like he's still running the company. So will be interesting whether he applies some of that difference to the current running of the show. But for us, you know, in some ways, given we are first time founders, me and Piotr, my my co founder, my best friend of fifteen years, eleven Lapse is the first venture we started. That's insane. You started in 2022. You launched before the first version of ChetGPT, right? We did. It was still a year when the topics of the day were crypto and metaverse. 2022 was still a year where everybody was obsessed about those two. It was a perfect time because we could actually focus and build a lot on the AI side. What were you doing before you founded this company? I was a ponteer, so I was helping build optimization models and bring optimization models to the customers. So NHS during the COVID response on how you distribute vaccines across UK or working with oil and gas industry and figuring out how to optimize the energy work. So a lot of optimization models and then working with customers on like actually figuring out how you bring that into their production. And my co founder was at Google and he did a lot of the text models for knowledge graph. Before that, did research at university around image visual models. So incredible brain, the smartest person I know for developing a lot of the research work. I was happily on that intersection of building the product and bringing it out to the customers. So that was before Palantir's BlackRock, building risk models, bringing it out to customers and by background study mathematics. Good intersection of the things I liked. And now at eleven Labs, that's also what I do. That's also from the company lens that when we started, that was the whole goal of like, can we combine research and product deployment under one hood? On the research side, built all the audio models, starting with model to produce speech, text to speech model, and that was that 2022, the first model that could finally cross that human like quality. Then over time, now …
Get the full transcript (14,041 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 68-minute episode.
Get David Senra summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from David Senra
Zach Dell on Base Power, Energy Abundance & Building a Company for Life
Sep 6 · 76 min
20VC (20 Minute VC)
20VC: ElevenLabs Hits $200M ARR: The Untold Story of Europe's Fastest Growing AI Startup | The Real Cost of AI from Talent to Data Centres | How US VCs are in a Different League to Europeans | The Future of Foundation Models with Mati Staniszewski
Sep 8
More from David Senra
Doug Leone on Sequoia, Fear, Great Founders & Starting Over at 69
Aug 30 · 82 min
The Learning Leader Show
674: PJ Fleck - Building Elite Culture, Nekton Mindset, Selecting >Recruiting, Intrinsic Motivation, Row The Boat, and Transformational Coaching
Feb 9
More from David Senra
We summarize every new episode. Want them in your inbox?
Zach Dell on Base Power, Energy Abundance & Building a Company for Life
Doug Leone on Sequoia, Fear, Great Founders & Starting Over at 69
Building Defense Technologies to Protect Democracies | Torsten Reil, Helsing
Sam Altman on Building OpenAI & Betting on the Impossible
Travis Kalanick, Founder of Uber & Atoms
Similar Episodes
Related episodes from other podcasts
20VC (20 Minute VC)
Sep 8
20VC: ElevenLabs Hits $200M ARR: The Untold Story of Europe's Fastest Growing AI Startup | The Real Cost of AI from Talent to Data Centres | How US VCs are in a Different League to Europeans | The Future of Foundation Models with Mati Staniszewski
The Learning Leader Show
Feb 9
674: PJ Fleck - Building Elite Culture, Nekton Mindset, Selecting >Recruiting, Intrinsic Motivation, Row The Boat, and Transformational Coaching
Masters in Business
Feb 6
Unconventional Real Estate Investments: Masters in Business with Bob Moser
In Good Company with Nicolai Tangen
Jan 21
Mala Gaonkar: Building SurgoCap, Identifying Great Businesses and Learning from Mistakes
No Priors: Artificial Intelligence | Technology | Startups
Dec 11
The Future of Voice AI: Agents, Dubbing, and Real-Time Translation with ElevenLabs Co-Founder Mati Staniszewski
Explore Related Topics
This podcast is featured in Best Business Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Health & Longevity Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into David Senra.
Every Monday, we deliver AI summaries of the latest episodes from David Senra and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime