How SDSC Uses AI to Transform Surgical Training and Practice - Ep. 241
Episode
26 min
Read time
2 min
Topics
Fundraising & VC, Leadership, Artificial Intelligence
AI-Generated Summary
Key Takeaways
- ✓Data Collection Challenge: Surgeons must manually press record, export video from devices, transfer via USB, and upload to cloud—a multi-step process that prevents most of the thousands of terabytes of surgical footage from being captured and analyzed.
- ✓Surgical Mortality Scale: Five billion people lack access to safe surgery globally, and 4.2 million die within 30 days of surgery annually. If treated as a disease, surgery would rank as the leading cause of death worldwide, making standardization critical.
- ✓Technical Architecture Approach: Start with simple models on small datasets for proof of concept, then iterate and scale. Combine CNN architectures with temporal models and vision transformers to handle long surgical videos with temporal dependencies and environmental challenges like obstructions.
- ✓Standardization Gap: Every surgeon in every hospital performs procedures differently with no agreed ABCD protocol for specific operations. Analyzing shared surgical videos creates the first mechanism for global surgeon collaboration and identification of best practices through outlier detection and pattern analysis.
What It Covers
Margo Mason Forsyth, Director of Machine Learning at Surgical Data Science Collective, explains how the nonprofit analyzes 40 terabytes of surgical video using computer vision to standardize techniques, improve education, and reduce surgical mortality worldwide.
Key Questions Answered
- •Data Collection Challenge: Surgeons must manually press record, export video from devices, transfer via USB, and upload to cloud—a multi-step process that prevents most of the thousands of terabytes of surgical footage from being captured and analyzed.
- •Surgical Mortality Scale: Five billion people lack access to safe surgery globally, and 4.2 million die within 30 days of surgery annually. If treated as a disease, surgery would rank as the leading cause of death worldwide, making standardization critical.
- •Technical Architecture Approach: Start with simple models on small datasets for proof of concept, then iterate and scale. Combine CNN architectures with temporal models and vision transformers to handle long surgical videos with temporal dependencies and environmental challenges like obstructions.
- •Standardization Gap: Every surgeon in every hospital performs procedures differently with no agreed ABCD protocol for specific operations. Analyzing shared surgical videos creates the first mechanism for global surgeon collaboration and identification of best practices through outlier detection and pattern analysis.
Notable Moment
Surgeons often cannot articulate what questions they want answered from their surgical video archives because they have never had the option to analyze this data before, requiring creative collaboration between clinicians and computer scientists to discover meaningful insights.
Episode Transcript
Hello, and welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. Our guest today is a machine learning and AI leader who's worked on projects ranging from sustainability and reforestation efforts to creating a virtual clothes swap platform for environmental family fashionistas. But for the past year and a half or so, she's been serving as director of machine learning at the nonprofit Surgical Data Science Collective, where she leads research focused on utilizing video data from surgeries to develop tools that can provide surgeons with immediate feedback and insights on their performance. Jessa recently gave a TEDx talk titled, why you want AI to watch your surgery, which I encourage you all to go check out on YouTube after you listen to our conversation. Because she's here right now to talk with us about the potential for AI to help surgeons bring better health care to everyone. Margo Mason Forsyth, welcome, and thank you so much for joining the NVIDIA AI podcast. Hi, Noah. Thanks for having me. Margo, maybe we can still do a little bit about your background. I alluded just a little bit in the intro. You've worked on various projects after studying machine learning and leveraging your skills and experience, for a lot of AI, for what we'd call AI for good projects, but really just in my view, projects that are helping, you know, improve quality of life for everyone. So maybe you can detail that a little bit and then, kind of bring up bring us up to the present with how you started got involved with the Surgical Data Science Collective. Yeah, sure. So like you said, I've been working in the AI field for for quite some time now. My first field of studies was computer science. So I've done enough software development, and then I realized that I wanted to do a bit more scientific projects. So went back to finish my master's and specialized in computer vision. Computer vision is something that I really, really love because I'm a very visual person. And so analyzing images and videos, is something that I'm pretty passionate about, I would say. And from that, I've worked on many different projects with very big video and image files. So like you said, I've worked on several projects that go from analyzing, lumber scanning, for example, to satellite imagery to detect deforestation or now surgical videos. So it's been it's been quite a ride for sure. And I've learned a lot mostly on how to productorize AI and how we can use AI to make an impact in the world and have a focus on is it actually gonna be useful, you know, and and make a difference at some point. So I that's kind of how I see my my career so far. Have you found that the projects you've been drawn to, has it been kind of being drawn to the next sort of technical or scientific challenge kind of …
Get the full transcript (4,494 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 23-minute episode.
Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from NVIDIA AI Podcast
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
Jun 24 · 39 min
Latent Space
🔬 Automating Science: World Models, Scientific Taste, Agent Loops — Andrew White
Jan 28
More from NVIDIA AI Podcast
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Jun 10 · 21 min
Practical AI
Less about Models; More about Architecture
Sep 3
More from NVIDIA AI Podcast
We summarize every new episode. Want them in your inbox?
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301
Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300
Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299
Snap’s Secret to Processing 10 Petabytes a Day: GPU-Accelerated Spark | NVIDIA AI Podcast Ep. 298
Similar Episodes
Related episodes from other podcasts
Latent Space
Jan 28
🔬 Automating Science: World Models, Scientific Taste, Agent Loops — Andrew White
Practical AI
Sep 3
Less about Models; More about Architecture
a16z Podcast
Aug 30
Why a16z Launched the Machine Age Fund | Jen Kha
a16z Podcast
Aug 28
The Infrastructure Behind the Machine Age
The Daily (NYT)
Aug 14
The Secret Spy Network Feeding Russia’s War Machine
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into NVIDIA AI Podcast.
Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime