Skip to main content
a16z Podcast

Building AI for Creators | Luma & Phota Labs

48 min episode · 2 min read
·
Matt Tansick,Zack Hsia

Episode

48 min

Read time

2 min

Topics

Fundraising & VC, Design & UX, Artificial Intelligence

AI-Generated Summary

Key Takeaways

  • Creative Direction vs. Tool Mastery: The competitive advantage in AI-assisted creativity shifts from mastering software to directing agents effectively. Anyone can access the same tools, but outputs diverge based on the human vision behind them. Builders should design interfaces that reward directorial thinking rather than technical proficiency, reducing friction between intent and execution.
  • Researcher-to-Product Gap: Research teams optimize for benchmark metrics that rarely align with creator needs. Practically useful features like background removal or lighting correction score low on research novelty but drive high adoption. Product builders should maintain a deliberate balance: stay slightly ahead of user expectations technologically while continuously solving concrete, day-to-day workflow problems.
  • Iteration Over Single-Shot Prompting: Artists rarely know their exact end goal before starting. Fota Labs and Luma both found that tools supporting rapid iteration outperform single-prompt generation pipelines. Builders should design for cyclical refinement loops, where users react to outputs rather than pre-specifying results, mirroring how artists work with blank canvases.
  • Identity and Product Personalization Diverge: General foundation models fail at preserving specific human or product identity even when they appear capable in demos. Fota Labs separates personalization models from foundation models so users own their identity layer and can combine it with any base model. Text rendering accuracy becomes a distinct, critical requirement specifically for product photography use cases.
  • Controllability Requires Multi-Modal Input: Text prompts alone are insufficient for professional creative workflows. Luma's applied research prioritizes video-to-video pipelines and spatial controls like region-pointing and scribbling to add precise temporal and spatial direction. Models should also proactively request clarifying inputs from users rather than operating as a one-way instruction receiver, mirroring how professional studios handle briefs.

What It Covers

Matt Tancic of Luma and Zack Hsia of Fota Labs join a16z's Yoko Li to examine how AI reshapes creative workflows, why human direction remains the irreplaceable ingredient, and how personalization, controllability, and model-app co-design define the next generation of AI creative tools.

Key Questions Answered

  • Creative Direction vs. Tool Mastery: The competitive advantage in AI-assisted creativity shifts from mastering software to directing agents effectively. Anyone can access the same tools, but outputs diverge based on the human vision behind them. Builders should design interfaces that reward directorial thinking rather than technical proficiency, reducing friction between intent and execution.
  • Researcher-to-Product Gap: Research teams optimize for benchmark metrics that rarely align with creator needs. Practically useful features like background removal or lighting correction score low on research novelty but drive high adoption. Product builders should maintain a deliberate balance: stay slightly ahead of user expectations technologically while continuously solving concrete, day-to-day workflow problems.
  • Iteration Over Single-Shot Prompting: Artists rarely know their exact end goal before starting. Fota Labs and Luma both found that tools supporting rapid iteration outperform single-prompt generation pipelines. Builders should design for cyclical refinement loops, where users react to outputs rather than pre-specifying results, mirroring how artists work with blank canvases.
  • Identity and Product Personalization Diverge: General foundation models fail at preserving specific human or product identity even when they appear capable in demos. Fota Labs separates personalization models from foundation models so users own their identity layer and can combine it with any base model. Text rendering accuracy becomes a distinct, critical requirement specifically for product photography use cases.
  • Controllability Requires Multi-Modal Input: Text prompts alone are insufficient for professional creative workflows. Luma's applied research prioritizes video-to-video pipelines and spatial controls like region-pointing and scribbling to add precise temporal and spatial direction. Models should also proactively request clarifying inputs from users rather than operating as a one-way instruction receiver, mirroring how professional studios handle briefs.

Notable Moment

A user evaluated an AI-generated headshot from Fota Labs and acknowledged the likeness was technically accurate, then rejected it anyway because the image made them appear heavier than desired. This reveals that user satisfaction and benchmark accuracy are measurably different targets requiring separate optimization strategies.

Know someone who'd find this useful?

Episode Transcript

I think the creativity is building a story. The tools alone aren't a story. Someone has to direct them. It's not about mastering those tools. It's about directing an agent who can use those tools to achieve your creativity. Generated, I have become so good. You can be sort of authentic to that moment while getting a little bit creative of stuff. So I I just think a lot of photographers are having more fun post capturing than before. How do you make something unique with the tools you have access to now? There has to be something more than just text. If you go to, say, a studio and you say, make me a ten second video about a dog jumping in the grass, they're never gonna take that deal. They're they're gonna want more specific, and I think AI tools are no different. Something I heard from someone today earlier was they assume AI to be slop. It's up to the humans to create something out of it. What are your thoughts? I feel like that's such a hard question. Creative tools have always changed the way people make art. Photography changed painting. Digital software changed photography. And now AI is changing how images, videos, and entire creative workflows come together. The technology is improving at an incredible pace, but the most important ingredient in creative work may not be the model. It may still be the person behind it. In this episode, Yoko Li speaks with Matt Tansick of Luma and Zack Hsia of Foto Labs about AI generated imagery, creative workflows, personalization, and why they believe the future belongs not to the tools themselves, but to the people directing them. Today, we have Zack Hsia, who is the cofounder and CTO of FOTA Labs. He works on personalized AI and AI photography. We also have Matt Tancic, who is the head of applied research at LUMA. He works on agentic systems, fundamental research, and he was also the cocreator of NERF. Thanks for coming on the pod. So maybe let me start with this question, Matt. Many years ago, maybe three years ago, you had this online talk about Nerve. And how you started this online talk was you posed a really interesting question, which is, what is the role of the artist, and what is the role of technology? Now fast forward three years, which is a lifetime in AI. What is your answer then, and what's your answer now? Has it changed? Yeah. So if I recall correctly, my answer at that point was that, really, the point of this AI technology is to act as a tool for artists to better execute on the creative vision that they have. And at the time, NeRF was providing an ability for people to create three d assets in a way that didn't require tons and tons of manual effort. Right. Because when you're creating three d scenes, creating those assets isn't really where the creative …

Get the full transcript (9,483 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all a16z Podcast transcripts →

You just read a 3-minute summary of a 45-minute episode.

Get a16z Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links.

company

  • Matt Tancic of Luma and Zack Hsia of Fota Labs join a16z's Yoko Li to examine how AI reshapes creative workflows
  • Matt Tancic of Luma and Zack Hsia of Fota Labs join a16z's Yoko Li to examine how AI reshapes creative workflows

More from a16z Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best Business Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into a16z Podcast.

Every Monday, we deliver AI summaries of the latest episodes from a16z Podcast and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime