Skip to main content
How I AI

“Nobody wanted to do this work”: How Emmy Award–winning filmmakers use AI to automate the tedious parts of documentaries

47 min episode · 2 min read
·

Episode

47 min

Read time

2 min

Topics

Productivity, Artificial Intelligence, Software Development

AI-Generated Summary

Key Takeaways

  • Automated metadata generation: Combines OpenAI vision models with embedded file metadata and web scraping to auto-generate accurate descriptions for archival images, reducing manual data entry from hours to seconds while maintaining journalistic accuracy through guardrails that prevent hallucination.
  • Video processing architecture: Extracts frames at five-second intervals using GPT-4o nano for individual captions, pairs with Whisper audio transcription, then sends consolidated data to reasoning models. This multi-step approach balances cost efficiency with comprehensive video analysis for documentary footage databases.
  • Field research iOS app: Custom-built Flip Flop app captures front and back of archival photos, transcribes handwritten notes using OCR, and embeds metadata directly into image EXIF data. This eliminates post-trip file organization chaos and enables 1,400+ images captured per research trip.
  • Semantic discovery through embeddings: Generates dual embeddings using CLIP for image thumbnails and OpenAI text models for descriptions, then fuses them to enable semantic search. This replaces exact keyword matching, allowing editors to find similar portraits or scenes without knowing precise terminology.

What It Covers

Tim McLear from Ken Burns' Florentine Films uses AI to automate documentary post-production workflows, building custom tools that process hundreds of hours of footage and thousands of images through metadata extraction, embeddings, and semantic search capabilities.

Key Questions Answered

  • Automated metadata generation: Combines OpenAI vision models with embedded file metadata and web scraping to auto-generate accurate descriptions for archival images, reducing manual data entry from hours to seconds while maintaining journalistic accuracy through guardrails that prevent hallucination.
  • Video processing architecture: Extracts frames at five-second intervals using GPT-4o nano for individual captions, pairs with Whisper audio transcription, then sends consolidated data to reasoning models. This multi-step approach balances cost efficiency with comprehensive video analysis for documentary footage databases.
  • Field research iOS app: Custom-built Flip Flop app captures front and back of archival photos, transcribes handwritten notes using OCR, and embeds metadata directly into image EXIF data. This eliminates post-trip file organization chaos and enables 1,400+ images captured per research trip.
  • Semantic discovery through embeddings: Generates dual embeddings using CLIP for image thumbnails and OpenAI text models for descriptions, then fuses them to enable semantic search. This replaces exact keyword matching, allowing editors to find similar portraits or scenes without knowing precise terminology.

Notable Moment

McLear describes the Muhammad Ali documentary requiring management of 20,000 still images and over 100 hours of footage. The automated system freed researchers from data entry to focus on gathering 25% more archival material for projects.

Know someone who'd find this useful?

Episode Transcript

How did you think about what problems there were to solve in AI relative to your job and the people that you work with? And why did you start where you started? Post production is like a technical mess of media management. Filmed out in the field, interviews, transcripts. So it ends up being hundreds of hours of footage, tens of thousands of photos. The data management piece when when you're dealing with all that different stuff is the mess that I have used AI to tackle. My goal was to automate this. For years, this has been manual data entry. Automate away toil. That's what we wanna do. No one was gonna make me this app. And so the ability to make an extremely specific app that makes a workflow on my team and my company easier, it's been an unbelievable moment. Welcome back to How I AI. I'm Claire Vaux, product leader and AI obsessive here on a mission to help you build better with these new tools. Today, we have Tim McLear, a producer at Ken Burns Florentine Films who's responsible for the technology and processes that bring these amazing films to life. Instead of focusing on how AI can create creative for these films, we're actually gonna talk about how Tim uses AI to build software products that make his post production and research team's lives a lot better. If you're working with images, video, sound, or just a lot of data, this episode is a great one for you. Let's get to it. This episode is brought to you by Brex. If you're listening to intelligent finance platform built for founders. With autonomous agents running in the background, your finance stack basically runs itself. Cards are issues, expenses are filed, and fraud is stopped in real time without you having to think about it. Add Brex's banking solution with a high yield treasury account, and you've got a system that helps you spend smarter, move faster, and scale with confidence. One in three startups in The US already runs on Brex. You can too at brex.com/howi a I. Tim, welcome to How I a I am excited to have you here. Thank you for having me. What I love about what we're gonna talk about today is you work in a very interesting and creative industry putting out amazing content. And we're gonna talk a little bit about how AI is impacting the creation side of things. But you've actually used AI to smooth out some of the challenges you've had on the production and post production side of things. So I'm curious, how did you think about what problems there were to solve in AI relative to your job and the people that you work with? And why did you start where you started? Yeah. I think most of the flashiest use cases of AI in, creation or media and entertainment right now are often in, like, generating full video content or images or …

Get the full transcript (9,165 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all How I AI transcripts →

You just read a 3-minute summary of a 44-minute episode.

Get How I AI summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links.

Tools

  • by OpenAI

    Extracts frames at five-second intervals using GPT-4o nano for individual captions, pairs with Whisper audio transcription, then sends consolidated data to reasoning models.
  • Custom-built Flip Flop app captures front and back of archival photos, transcribes handwritten notes using OCR, and embeds metadata directly into image EXIF data.
  • by OpenAI

    Extracts frames at five-second intervals using GPT-4o nano for individual captions, pairs with Whisper audio transcription, then sends consolidated data to reasoning models.
  • by OpenAI

    Generates dual embeddings using CLIP for image thumbnails and OpenAI text models for descriptions, then fuses them to enable semantic search.

company

  • Tim McLear from Ken Burns' Florentine Films uses AI to automate documentary post-production workflows, building custom tools that process hundreds of hours of footage and thousands of images through metadata extraction, embeddings, and semantic search capabilities.
  • Sponsors: Brex at https://brex.com/howiai

More from How I AI

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into How I AI.

Every Monday, we deliver AI summaries of the latest episodes from How I AI and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime