333 | Gordon Pennycook on Unthinkingness, Conspiracies, and What to Do About Them
Episode
70 min
Read time
2 min
Topics
Artificial Intelligence, Crypto & Web3, Psychology & Behavior
AI-Generated Summary
Key Takeaways
- ✓Pseudo-profound bullshit receptivity: People who rely on intuitive System 1 thinking rather than effortful System 2 deliberation rate randomly generated statements like "hidden meaning transforms unparalleled abstract beauty" as profound, correlating with belief in pseudoscience and alternative medicine across multiple studies.
- ✓Overconfidence measurement: Conspiracy believers demonstrate general overconfidence on novel tasks where they guess content in fuzzy images with random accuracy but report high confidence. This overconfidence predicts conspiracy belief better than domain-specific knowledge, suggesting a fundamental thinking disposition rather than information deficit.
- ✓False consensus effect: Conspiracy believers massively overestimate agreement with their views. Sandy Hook false flag believers (8% of sample) estimated 61% public agreement. This occurs because social interactions rarely produce direct disagreement, creating illusion of widespread support for fringe beliefs.
- ✓AI intervention effectiveness: Eight-minute conversations with AI chatbots providing personalized counter-evidence reduced conspiracy belief confidence by 20%, with 25% of believers abandoning their conspiracy theory entirely. Effects persisted unchanged at two-month follow-up, showing genuine belief change rather than temporary compliance.
- ✓Evidence primacy over persuasion: Removing factual content from AI responses eliminated belief change effects, while removing polite language maintained effectiveness. Facts matter more than sweet-talking for changing conspiracy beliefs, contradicting theories that motivated reasoning makes evidence irrelevant to conspiracy theorists.
What It Covers
Psychologist Gordon Pennycook explains how "unthinkingness" rather than motivated reasoning drives susceptibility to misinformation and conspiracy theories, and presents research showing AI chatbots successfully reduce conspiracy beliefs through patient, evidence-based conversations.
Key Questions Answered
- •Pseudo-profound bullshit receptivity: People who rely on intuitive System 1 thinking rather than effortful System 2 deliberation rate randomly generated statements like "hidden meaning transforms unparalleled abstract beauty" as profound, correlating with belief in pseudoscience and alternative medicine across multiple studies.
- •Overconfidence measurement: Conspiracy believers demonstrate general overconfidence on novel tasks where they guess content in fuzzy images with random accuracy but report high confidence. This overconfidence predicts conspiracy belief better than domain-specific knowledge, suggesting a fundamental thinking disposition rather than information deficit.
- •False consensus effect: Conspiracy believers massively overestimate agreement with their views. Sandy Hook false flag believers (8% of sample) estimated 61% public agreement. This occurs because social interactions rarely produce direct disagreement, creating illusion of widespread support for fringe beliefs.
- •AI intervention effectiveness: Eight-minute conversations with AI chatbots providing personalized counter-evidence reduced conspiracy belief confidence by 20%, with 25% of believers abandoning their conspiracy theory entirely. Effects persisted unchanged at two-month follow-up, showing genuine belief change rather than temporary compliance.
- •Evidence primacy over persuasion: Removing factual content from AI responses eliminated belief change effects, while removing polite language maintained effectiveness. Facts matter more than sweet-talking for changing conspiracy beliefs, contradicting theories that motivated reasoning makes evidence irrelevant to conspiracy theorists.
Notable Moment
Pennycook discovered conspiracy theorists want substantive dialogue about their beliefs rather than seeking validation. When given opportunity to discuss conspiracies with AI, participants engaged earnestly and appreciated receiving detailed counter-evidence, contradicting assumptions that conspiracy believers deliberately avoid information challenging their worldview.
Episode Transcript
Hello everyone and welcome to the Mindscape podcast. I'm your host Sean Carroll. I don't know about you, but doesn't it bug you when other people are wrong about things? Like, I know you and I generally are correct about all of our beliefs, but out there on the Internet or even in society, it seems that there's more and more people who have false beliefs about things, and they even sort of nurture those false beliefs by hanging out with other people who have false beliefs. What is up with that, and what can we do about it? Now of course, all of us have some false beliefs, and famously, there's this idea that we have biases that nudge us towards one set of false beliefs or another. Then some of us are going to say there's a whole group of people who have more biases than we do and we can have that argument. There's motivated reasoning. There's reason that people, either for wishful thinking purposes or for identification with some tribe or other kind of group want to have some beliefs because it's part of their identity. Okay, but is that really the reason why people have these false beliefs? Either susceptibility to, just as our guest Gordon Pennycook will put it today, pseudo profound bullshit or susceptibility to misinformation or conspiracy theories? And what Gordon is gonna tell us is it's actually not quite about cognitive biases and motivated reasoning so much as it's about what he calls unthinkingness. That is to say, when you're faced with a claim, whether it's a claim you see on the Internet or, you know, someone's giving you a fortune cookie, you evaluate that claim. And you can evaluate it either instantly, like, oh, it feels right to me, right, or it feels wrong, or that fits in with my views, or you can evaluate it in a more careful, reflective, cognitive way, like, how do I know that this claim is on the right track? What are the sources? What are the reasons to believe it? The same thing goes true for not just a proposition about truth in the world, but a saying or an aphorism. Right? Like, if something feels kind of profound, we might, just accept it without thinking very much, without even thinking whether or not it makes sense. And so, Gordon's gonna argue that if we just sit down and think about things, all of us can be better at understanding the difference between profundity and nonsense, the difference between a conspiracy theory and something that is more accurate. And this goes very broadly, and he has some wonderful results with very high statistical significance by psychology experiment standards. And also, what is really fascinating and we'll see whether this holds up because it's all very new and of course any such claim needs to be further investigated. But there's even a suggested mechanism for talking people out of their conspiracy theorizing by having …
Get the full transcript (13,756 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 67-minute episode.
Get Sean Carroll's Mindscape summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Sean Carroll's Mindscape
367 | Jared Diamond on the Course of History and the Role of leaders
Sep 7 · 77 min
Latent Space
🔬Scaling Past Informal AI - Carina Hong, Axiom Math
Jun 3
More from Sean Carroll's Mindscape
366 | Jim Al-Khalili on Time, Quantum, Biology, and Cosmology
Aug 31 · 75 min
Hidden Brain
Do You Feel Invisible?
Feb 23
More from Sean Carroll's Mindscape
We summarize every new episode. Want them in your inbox?
367 | Jared Diamond on the Course of History and the Role of leaders
366 | Jim Al-Khalili on Time, Quantum, Biology, and Cosmology
365 | Vitor Cardoso on Why Black Holes Are Special
364 | Stuart Firestein on How Science Relies on Ignorance and Failure
363 | Chandra Sripada on How LLMs and Humans are Cognitive Cousins
Similar Episodes
Related episodes from other podcasts
Latent Space
Jun 3
🔬Scaling Past Informal AI - Carina Hong, Axiom Math
Hidden Brain
Feb 23
Do You Feel Invisible?
The Learning Leader Show
Feb 9
674: PJ Fleck - Building Elite Culture, Nekton Mindset, Selecting >Recruiting, Intrinsic Motivation, Row The Boat, and Transformational Coaching
Cognitive Revolution
Feb 8
AGI-Pilled Cyber Defense: Automating Digital Forensics w/ Asymmetric Security CEO Alexis Carlier
Hidden Brain
Oct 27
Reframing the Battle of Wills
Explore Related Topics
This podcast is featured in Best Science Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Sean Carroll's Mindscape.
Every Monday, we deliver AI summaries of the latest episodes from Sean Carroll's Mindscape and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime