Why Every Brain Metaphor in History Has Been Wrong [SPECIAL EDITION]
Episode
42 min
Read time
2 min
Topics
Artificial Intelligence, Software Development, Product & Tech Trends
AI-Generated Summary
Key Takeaways
- ✓Misplaced Concreteness: Scientists throughout history have modeled brains using their era's most advanced technology—Descartes used hydraulic automata, later generations used telegraph networks and telephone switchboards, now computation. Each generation believed their metaphor captured literal truth, but these are useful simplifications, not reality itself. Recognizing models as tools rather than truth prevents overconfidence in current frameworks.
- ✓Prediction vs Understanding: Prediction means forecasting outcomes, control means achieving desired results, but understanding requires compressing knowledge into facts that fit on an index card and can be communicated between humans. Current AI systems like LLMs and AlphaFold excel at prediction and control but cannot perform the act of understanding—humans must derive understanding by experimenting on these artifacts.
- ✓Haptic Realism: Scientific knowledge resembles touch more than vision—researchers actively manipulate, stimulate, and change what they study rather than passively observing from distance. Neuroscientists poke and prod brains during investigation, meaning discovered patterns are partially created by the investigative process itself. This challenges the notion of purely objective, observer-independent scientific knowledge about cognition.
- ✓Perspectival Knowledge: Knowledge cannot exist as universal, perspective-free information floating in repositories like the Internet or LLMs. Communities and teams possess knowledge through specific socialization, limitations, and contexts. LLMs lack reliability precisely because they blend all perspectives without particular socialization into finite communities, preventing them from offering honest, trustworthy viewpoints on any topic.
- ✓Cognitive Horizons: Organic creatures possess bounded cognitive capacities—rats cannot learn prime number mazes regardless of training. Humans likely face similar limits where theories bump against walls of cognitive horizons. Recognizing these boundaries prevents mistaking framework elegance for fundamental truth, as with free energy principle's claim to explain all behavior through minimizing one mathematical quantity.
What It Covers
Philosopher Mazviita Chiramuta challenges neuroscience's computational metaphors for the brain, arguing scientists mistake elegant simplifications for literal truth. The episode examines how every era models the mind using contemporary technology—from hydraulic pumps to computers—and questions whether Karl Friston's free energy principle and AI's inevitability represent genuine understanding or another historical illusion.
Key Questions Answered
- •Misplaced Concreteness: Scientists throughout history have modeled brains using their era's most advanced technology—Descartes used hydraulic automata, later generations used telegraph networks and telephone switchboards, now computation. Each generation believed their metaphor captured literal truth, but these are useful simplifications, not reality itself. Recognizing models as tools rather than truth prevents overconfidence in current frameworks.
- •Prediction vs Understanding: Prediction means forecasting outcomes, control means achieving desired results, but understanding requires compressing knowledge into facts that fit on an index card and can be communicated between humans. Current AI systems like LLMs and AlphaFold excel at prediction and control but cannot perform the act of understanding—humans must derive understanding by experimenting on these artifacts.
- •Haptic Realism: Scientific knowledge resembles touch more than vision—researchers actively manipulate, stimulate, and change what they study rather than passively observing from distance. Neuroscientists poke and prod brains during investigation, meaning discovered patterns are partially created by the investigative process itself. This challenges the notion of purely objective, observer-independent scientific knowledge about cognition.
- •Perspectival Knowledge: Knowledge cannot exist as universal, perspective-free information floating in repositories like the Internet or LLMs. Communities and teams possess knowledge through specific socialization, limitations, and contexts. LLMs lack reliability precisely because they blend all perspectives without particular socialization into finite communities, preventing them from offering honest, trustworthy viewpoints on any topic.
- •Cognitive Horizons: Organic creatures possess bounded cognitive capacities—rats cannot learn prime number mazes regardless of training. Humans likely face similar limits where theories bump against walls of cognitive horizons. Recognizing these boundaries prevents mistaking framework elegance for fundamental truth, as with free energy principle's claim to explain all behavior through minimizing one mathematical quantity.
Notable Moment
John Jumper distinguishes three scientific goals: predict future values, control outcomes to reach specific targets, and understand by compressing facts into human-communicable form. He notes current AI systems enable prediction and control but cannot perform understanding—humans must derive that themselves by experimenting on the 200 million predicted protein structures rather than just 200,000 experimental ones.
Episode Transcript
Let me tell you a little story. Nineteen sixties, in the summer, a little kid named Carl was playing around in the back of his garden, and he noticed all of these wood lice crawling around, you know, the little insects that can curl up into a ball. And what he noticed was that depending on whether they were in the sun or in the shade, they would move faster or slower. They behaved differently. And that's it. Paul grew up to be professor Carl Friston, one of the most cited neuroscientists alive. He's been on this channel before, more times than I can count. And that childhood observation about wood lice, it never left him. He spent decades developing what he calls the free energy principle, which tries to explain all of behavior with one equation. Perception, action, learning, why you scratch your nose, all of it, Friston claims, comes down to minimizing a single mathematical quantity. There's an old physics joke, assume that we can model a spherical cow in a vacuum. The joke is about how scientists grotesquely simplify messy reality to tame it. The free energy principle might be the ultimate spherical cow. It promises to explain self organization, this bewilderingly complicated phenomenon with something so emaciated, we might as well call it tautological. Even Preston himself agrees with this, by the way. This is what he said to us last time we spoke with him. The free energy principle is not meant to be complicated or difficult to understand. It's actually, you know, almost tautologically simple. So the the, you know, the whole free energy principle is just basically a principle of least action pertaining to density dynamics, like the the the dynamics or the evolution of not densities, but conditional densities. That's just it. Mhmm. This is before thermodynamics. This is before quantum mechanics. It's just about conditional probability distributions. So what do we do with this? Has Friston actually found some deep truth about how minds work? Or is he doing what many scientists do, which is mistaking the simplification for the actual thing? Well, it turns out there's a philosopher who has spent an incredible amount of time thinking about this exact problem. Professor Marvita Chiramuta teaches at Edinburgh University. Her book, The Brain Abstracted, is basically about what happens when neuroscientists simplify brains to study them. What gets captured? What gets lost? One of the answers that might seem obvious to people is that we pursue science because we're curious. We just want to know how the world works. We want to reveal, discover the underlying principles of the universe which apply in all cases. Switching off the idea that you're just interested in nature for its own sake out of curiosity and saying, okay. How can we engineer these systems to actually do things that we want? Getting them to behave in artificial ways, if those simplifications sort of allow you to achieve your technological goals, there's no in principle …
Get the full transcript (7,256 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 39-minute episode.
Get Machine Learning Street Talk summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Machine Learning Street Talk
AI 2040: Plan A report - Daniel Kokotajlo & Thomas Larsen
Sep 8 · 89 min
Sean Carroll's Mindscape
339 | Ned Block on Whether Consciousness Requires Biology
Jan 5
More from Machine Learning Street Talk
Designing How AI Grows — Tom McGrath
Sep 2 · 100 min
Modern Wisdom
Couples Therapist: “The One Rule Every Relationship Must Live By” - Stan Tatkin -#1146
Sep 5
More from Machine Learning Street Talk
We summarize every new episode. Want them in your inbox?
AI 2040: Plan A report - Daniel Kokotajlo & Thomas Larsen
Designing How AI Grows — Tom McGrath
Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov
Every Exponential Ends — Silicon Valley Forgot — Adam Becker
AI Is Learning at the Wrong Level of Abstraction — Matthieu Wyart
Similar Episodes
Related episodes from other podcasts
Sean Carroll's Mindscape
Jan 5
339 | Ned Block on Whether Consciousness Requires Biology
Modern Wisdom
Sep 5
Couples Therapist: “The One Rule Every Relationship Must Live By” - Stan Tatkin -#1146
Huberman Lab
Aug 24
How to Improve Motivation & Overcome Procrastination | Dr. Masud Husain
No Priors: Artificial Intelligence | Technology | Startups
Aug 20
From Restoring Sight to Reimagining the Brain, with Max Hodak
Huberman Lab
Aug 17
Neuroscience of Emotions & Tools for Improving Emotion Regulation | Dr. Ralph Adolphs
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Machine Learning Street Talk.
Every Monday, we deliver AI summaries of the latest episodes from Machine Learning Street Talk and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime