#317 Steven Brown: Why Modern Medicine Needs AI-Assisted Decision Making
Episode
60 min
Read time
3 min
Topics
Productivity, Health & Wellness, Leadership
AI-Generated Summary
Key Takeaways
- ✓Multi-Agent Medical Analysis: Brown built a system using multiple AI agents modeled as different medical specialists (oncologist, hematologist, cardiologist, gastroenterologist) that analyze patient medical records from diverse perspectives. When agents converge on recommendations despite different viewpoints, confidence increases dramatically. The probability of multiple agents sharing the same hallucination approaches zero, creating a more reliable diagnostic framework than single-model queries. This methodology surfaces tests and treatment pathways that individual doctors might miss due to time constraints or specialty blind spots.
- ✓Context Window Medical Records: Modern LLMs with million-token context windows can process 750,000 words or hundreds of pages of medical documentation in a single prompt. Brown organizes patient medical records by categorizing recent relevant data (labs, imaging, genomics) rather than dumping entire electronic health records. This structured approach mimics how specialists prepare patient summaries for referrals, focusing on disease-relevant information while excluding outdated or irrelevant data. The system uses retrieval augmented generation to pull organized medical data into prompts without fine-tuning foundation models.
- ✓Precision Medicine Gap: Cancer treatments with thirty percent response rates mean seventy percent of patients receive no benefit from standard care protocols. Genetic mutations in cancer cells create vulnerabilities to specific treatments not included in standard protocols. Brown discovered his cancer had genetic markers making it less responsive to standard therapy but highly sensitive to an off-label treatment. Patients must actively request genomic testing and research mutation-specific therapies because oncologists managing diverse cancer types cannot track every precision medicine development for rare genetic variants.
- ✓Shared Decision Making Outcomes: Patient outcomes improve measurably when patients actively participate in treatment decisions rather than passively following doctor directives. Brown rehearses upcoming medical appointments by conversing with specialist AI agents, ensuring he asks informed questions during limited consultation time. This preparation transforms ten-minute doctor visits into focused discussions about specific treatment options rather than basic education sessions. The approach requires patients to become experts in their specific disease, enabling them to advocate for tests, treatments, and monitoring protocols doctors might not proactively suggest.
- ✓Treatment Optimization Details: Brown identified that his prescribed medication required high-fat food for proper absorption, a detail buried on page ten of prescription documentation that pharmacists summarized as take with food. After his cancer marker reduction plateaued, he consulted AI agents about potential resistance or dosing issues. Switching from low-fat meals to high-fat dinners with medication immediately restored downward marker trends. These granular treatment variables significantly impact outcomes but often go unaddressed in standard patient education and monitoring protocols.
What It Covers
Steven Brown, former chief AI officer at Abundance360, develops an AI-powered cancer management platform after his own diagnosis with a rare blood cancer. He creates a multi-agent system using multiple LLMs to analyze medical records, simulate specialist consultations, and surface treatment options that standard care protocols might miss, demonstrating how AI can empower patient-directed precision medicine.
Key Questions Answered
- •Multi-Agent Medical Analysis: Brown built a system using multiple AI agents modeled as different medical specialists (oncologist, hematologist, cardiologist, gastroenterologist) that analyze patient medical records from diverse perspectives. When agents converge on recommendations despite different viewpoints, confidence increases dramatically. The probability of multiple agents sharing the same hallucination approaches zero, creating a more reliable diagnostic framework than single-model queries. This methodology surfaces tests and treatment pathways that individual doctors might miss due to time constraints or specialty blind spots.
- •Context Window Medical Records: Modern LLMs with million-token context windows can process 750,000 words or hundreds of pages of medical documentation in a single prompt. Brown organizes patient medical records by categorizing recent relevant data (labs, imaging, genomics) rather than dumping entire electronic health records. This structured approach mimics how specialists prepare patient summaries for referrals, focusing on disease-relevant information while excluding outdated or irrelevant data. The system uses retrieval augmented generation to pull organized medical data into prompts without fine-tuning foundation models.
- •Precision Medicine Gap: Cancer treatments with thirty percent response rates mean seventy percent of patients receive no benefit from standard care protocols. Genetic mutations in cancer cells create vulnerabilities to specific treatments not included in standard protocols. Brown discovered his cancer had genetic markers making it less responsive to standard therapy but highly sensitive to an off-label treatment. Patients must actively request genomic testing and research mutation-specific therapies because oncologists managing diverse cancer types cannot track every precision medicine development for rare genetic variants.
- •Shared Decision Making Outcomes: Patient outcomes improve measurably when patients actively participate in treatment decisions rather than passively following doctor directives. Brown rehearses upcoming medical appointments by conversing with specialist AI agents, ensuring he asks informed questions during limited consultation time. This preparation transforms ten-minute doctor visits into focused discussions about specific treatment options rather than basic education sessions. The approach requires patients to become experts in their specific disease, enabling them to advocate for tests, treatments, and monitoring protocols doctors might not proactively suggest.
- •Treatment Optimization Details: Brown identified that his prescribed medication required high-fat food for proper absorption, a detail buried on page ten of prescription documentation that pharmacists summarized as take with food. After his cancer marker reduction plateaued, he consulted AI agents about potential resistance or dosing issues. Switching from low-fat meals to high-fat dinners with medication immediately restored downward marker trends. These granular treatment variables significantly impact outcomes but often go unaddressed in standard patient education and monitoring protocols.
- •Insurance Authorization Strategy: Academic medical centers can prescribe off-label precision medicines by writing appeal letters to insurance companies when genomic evidence supports treatment efficacy. Brown's specialized hematologist at a center of excellence agreed his AI-researched treatment approach was optimal but required insurance authorization because it was approved for different conditions. The appeal succeeded based on genetic mutation evidence. Patients at community oncology practices may never access these options because general oncologists stick to standard care protocols and lack resources to navigate off-label authorization processes.
Notable Moment
Brown's house burning down in the Los Angeles fires accidentally saved his life by displacing him from his regular healthcare system. Staying near Palm Springs with friends, he experienced severe abdominal pain and went to a new emergency room for a CT scan. This scan revealed lymph nodes and abnormalities that a colonoscopy, endoscopy, and CT scan just two weeks prior had missed, leading to his cancer diagnosis just in time to prevent organ damage.
Episode Transcript
What I'd been doing in AI was a concept of using a mixture of agents and models to try to create different pathways and through the knowledge that's compressed into these large language models. But when all of this happened to me, I repurposed what I was doing, took some of the softs I've been working on related to working with multiple agents and multiple points of view and multiple models, and I started having them all look at my medical record because I had been feeling like there was something going on and feeling like I was ill for some time. I'm Steve Brown. I've been an entrepreneur in much of that time in medical technology, working on things like chronic care management and patient monitoring and, kind of left health care for a while to become a documentary filmmaker. But, after the pandemic, it got back into tech and especially with AI because it was so, such an exciting time to be in tech. I didn't think I was gonna go back into health care, but then I actually had a health issue myself personally. About a year ago, I was diagnosed with a rare blood cancer, and, that dragged me back into health care. So I started taking what I was doing in AI and applying it to my own medical record, to my own situation. And what I've been doing in AI was a a concept of, using a mixture of agents and models to try to create different pathways and through the knowledge that's compressed into these large language models. And I was doing a lot of that, in the kind of educational field, a lot of things with Peter Diamandis and Abundance three sixty, and for that community. And, thought I was gonna be not doing health care. But when all of this happened to me, I I repurposed what I was doing, took some of the software I had been working on or the concepts I've been working on related to working with multiple agents and multiple points of view and multiple models. And I started having them all look at my medical record because I had been feeling like there was something going on and feeling like I was, ill for some time. And, but I wasn't really being diagnosed with anything. My doctors were thought it was a fishing expedition. But then, things got a little worse after our well, this is kind of a crazy story, I know, but but it's like our house burned down in the big fires in LA that displaced me from the health care system where I was and the doctors where I was, and I ended up in, near Palm Springs, staying with friends. And that's where I ended up having a severe abdominal pain and, all kinds of things that's led me to the emergency room, thinking that I was obstructed from a steak dinner. So I went into the emergency room, and …
Get the full transcript (11,001 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 57-minute episode.
Get Eye on AI summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Eye on AI
86% of What Coding Agents Do Is Just Reading — Not Solving | Alexander Whedon of Subquadratic
Sep 8 · 54 min
NVIDIA AI Podcast
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
Jun 24
More from Eye on AI
From 10 Drones a Month to Nearly 100,000 — Inside Ukraine's Largest Drone Manufacturer | Marko Kushnir, General Cherry
Sep 3 · 38 min
The Diary of a CEO
Tech Whistleblower: You Only Have 3 Years Left Before This Hits! - Mo Gawdat
Jun 1
More from Eye on AI
We summarize every new episode. Want them in your inbox?
86% of What Coding Agents Do Is Just Reading — Not Solving | Alexander Whedon of Subquadratic
From 10 Drones a Month to Nearly 100,000 — Inside Ukraine's Largest Drone Manufacturer | Marko Kushnir, General Cherry
In 5 to 10 Years, Using Weapons Without AI Will Be Considered Unethical | Yaroslav Azhnyuk, The Fourth Law
Inside Ukraine's Azov Drone R&D: The Engineer Building AI Weapons 18 km From the Front Line | Alexander Palamarchuk
95% of AI Agent Projects Fail to Reach Production. Here's Why | Manoj Saxena, TrustWise
Similar Episodes
Related episodes from other podcasts
NVIDIA AI Podcast
Jun 24
Inside Instacart's AI-Powered Smart Shopping Cart | NVIDIA AI Podcast Ep. 302
The Diary of a CEO
Jun 1
Tech Whistleblower: You Only Have 3 Years Left Before This Hits! - Mo Gawdat
Lenny's Podcast
Dec 28
10 contrarian leadership truths every leader needs to hear | Matt MacInnis (Rippling)
Equity
Dec 17
Eclipse's Jiten Behl thinks the next unicorns won't be built in software
SaaStr Podcast
Nov 21
SaaStr 830: 6 Months Later, How Our AI SDRs Actually Work as AI Runs GTM with SaaStr's CEO and Chief AI Officer
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Health & Longevity Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Eye on AI.
Every Monday, we deliver AI summaries of the latest episodes from Eye on AI and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime