Skip to main content
David Senra

Mati Staniszewski on ElevenLabs, Voice AI & Building the Communication Layer for AI

71 min episode · 3 min read
·
Mati Staniszewski

Episode

71 min

Read time

3 min

Topics

Productivity, Health & Wellness, Startups

AI-Generated Summary

Key Takeaways

  • Focused Research Defense: ElevenLabs deliberately restricts its research team to audio models only — text-to-speech, speech-to-text, transcription, and orchestration — as a competitive moat against larger labs. Before pursuing any new product, the internal test is whether audio represents the primary bottleneck. If a product's core problem is video or image quality, ElevenLabs explicitly passes, as demonstrated when they declined to build avatar and lip-sync tools two years ago.
  • FDE Model from Palantir: Forward-deployed engineers (FDEs) sit inside the product team, not go-to-market, at ElevenLabs. Teams of roughly five engineers embed directly with enterprise clients — physically traveling to their offices — to build integrations with CRM systems, SIP trunking, and phone infrastructure. Critically, every integration insight gets abstracted back into the core platform, so learnings from one client automatically improve the product for thousands of others.
  • Voice Marketplace as Ecosystem Lock-in: ElevenLabs built a 20,000-voice marketplace where individuals create authenticated AI voices, then earn passive compensation each time their voice is used. This creates a proprietary data asset and switching cost that pure model quality cannot replicate. When model performance converges across competitors, the ecosystem — brand trust, voice library, and revenue-sharing structure — becomes the durable differentiator.
  • Customer Discovery Before Product: When ElevenLabs initially pitched dubbing to creators, feedback revealed more immediate needs: editing recorded lines, narrating scripts before filming, and replacing their own voice in videos. This redirected the entire research roadmap toward high-quality single-language text-to-speech before tackling multilingual dubbing. Founders should treat early customer conversations as product prioritization data, not just validation exercises.
  • Small Teams with Embedded Engineers Across All Functions: ElevenLabs caps teams at under 10 people and embeds engineers inside legal, talent, and operations — not just product. This structure enables bottom-up AI adoption without top-down mandates. The revenue operations function uses AI tools to auto-transcribe sales calls, pre-fill CRM fields, and run a voice-based AI SDR on the website that collects significantly more prospect information than traditional dropdown forms.

What It Covers

ElevenLabs co-founder Mati Staniszewski explains how he and co-founder Piotr built a focused audio AI research-and-product company from 2022, starting with dubbing and evolving into a platform serving voice agents, marketing, and accessibility across industries including FinTech, healthcare, and telecom, with Deutsche Telekom as a deeply integrated enterprise customer.

Key Questions Answered

  • Focused Research Defense: ElevenLabs deliberately restricts its research team to audio models only — text-to-speech, speech-to-text, transcription, and orchestration — as a competitive moat against larger labs. Before pursuing any new product, the internal test is whether audio represents the primary bottleneck. If a product's core problem is video or image quality, ElevenLabs explicitly passes, as demonstrated when they declined to build avatar and lip-sync tools two years ago.
  • FDE Model from Palantir: Forward-deployed engineers (FDEs) sit inside the product team, not go-to-market, at ElevenLabs. Teams of roughly five engineers embed directly with enterprise clients — physically traveling to their offices — to build integrations with CRM systems, SIP trunking, and phone infrastructure. Critically, every integration insight gets abstracted back into the core platform, so learnings from one client automatically improve the product for thousands of others.
  • Voice Marketplace as Ecosystem Lock-in: ElevenLabs built a 20,000-voice marketplace where individuals create authenticated AI voices, then earn passive compensation each time their voice is used. This creates a proprietary data asset and switching cost that pure model quality cannot replicate. When model performance converges across competitors, the ecosystem — brand trust, voice library, and revenue-sharing structure — becomes the durable differentiator.
  • Customer Discovery Before Product: When ElevenLabs initially pitched dubbing to creators, feedback revealed more immediate needs: editing recorded lines, narrating scripts before filming, and replacing their own voice in videos. This redirected the entire research roadmap toward high-quality single-language text-to-speech before tackling multilingual dubbing. Founders should treat early customer conversations as product prioritization data, not just validation exercises.
  • Small Teams with Embedded Engineers Across All Functions: ElevenLabs caps teams at under 10 people and embeds engineers inside legal, talent, and operations — not just product. This structure enables bottom-up AI adoption without top-down mandates. The revenue operations function uses AI tools to auto-transcribe sales calls, pre-fill CRM fields, and run a voice-based AI SDR on the website that collects significantly more prospect information than traditional dropdown forms.
  • FinTech Leads Enterprise Voice Agent Adoption: Among ElevenLabs' enterprise verticals, FinTech — including Revolut, Klarna, and PagBank — moves fastest on deploying conversational voice agents, followed by healthcare and telecom. Retail and e-commerce began adopting at scale only in the current year. Enterprise expansion follows a prove-then-scale sequence: demonstrate measurable impact on one use case, complete deep integrations, run simulated call trials, then expand to additional product lines within the same account.

Notable Moment

Staniszewski revealed that adding verbal filler sounds — the equivalent of "ums" and pauses — to ElevenLabs voice agents caused user engagement to spike sharply. Counterintuitively, deliberately introducing imperfection made agents feel human enough that users became comfortable and willing to continue conversations they previously abandoned.

Know someone who'd find this useful?

Episode Transcript

We ran into each other at Michael Dell's event a few months ago, and you're like, Oh, I'm very curious how building a company today is different from building one in the past. And Michael has forty plus years of experience. He's been dominating for decades. And when I saw him, we had like a thirty minute conversation about this. You read all these biographies of history sketch entrepreneurs and you just see this over and over again. It's like, oh, this time is different. Turns out, no, this time is not different. And Michael's like, no, no, I actually think this time is different. So I want to start with like how you think about building your company AI native from today. Yeah, Michael is a legend. He must have so many interesting perspectives, especially like he's still running the company. So will be interesting whether he applies some of that difference to the current running of the show. But for us, you know, in some ways, given we are first time founders, me and Piotr, my my co founder, my best friend of fifteen years, eleven Lapse is the first venture we started. That's insane. You started in 2022. You launched before the first version of ChetGPT, right? We did. It was still a year when the topics of the day were crypto and metaverse. 2022 was still a year where everybody was obsessed about those two. It was a perfect time because we could actually focus and build a lot on the AI side. What were you doing before you founded this company? I was a ponteer, so I was helping build optimization models and bring optimization models to the customers. So NHS during the COVID response on how you distribute vaccines across UK or working with oil and gas industry and figuring out how to optimize the energy work. So a lot of optimization models and then working with customers on like actually figuring out how you bring that into their production. And my co founder was at Google and he did a lot of the text models for knowledge graph. Before that, did research at university around image visual models. So incredible brain, the smartest person I know for developing a lot of the research work. I was happily on that intersection of building the product and bringing it out to the customers. So that was before Palantir's BlackRock, building risk models, bringing it out to customers and by background study mathematics. Good intersection of the things I liked. And now at eleven Labs, that's also what I do. That's also from the company lens that when we started, that was the whole goal of like, can we combine research and product deployment under one hood? On the research side, built all the audio models, starting with model to produce speech, text to speech model, and that was that 2022, the first model that could finally cross that human like quality. Then over time, now …

Get the full transcript (14,041 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all David Senra transcripts →

You just read a 3-minute summary of a 68-minute episode.

Get David Senra summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

More from David Senra

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best Business Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's Health & Longevity Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into David Senra.

Every Monday, we deliver AI summaries of the latest episodes from David Senra and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime