Skip to main content
Sean Carroll's Mindscape

333 | Gordon Pennycook on Unthinkingness, Conspiracies, and What to Do About Them

70 min episode · 2 min read
·
Gordon Pennycook

Episode

70 min

Read time

2 min

Topics

Artificial Intelligence, Crypto & Web3, Psychology & Behavior

AI-Generated Summary

Key Takeaways

  • Pseudo-profound bullshit receptivity: People who rely on intuitive System 1 thinking rather than effortful System 2 deliberation rate randomly generated statements like "hidden meaning transforms unparalleled abstract beauty" as profound, correlating with belief in pseudoscience and alternative medicine across multiple studies.
  • Overconfidence measurement: Conspiracy believers demonstrate general overconfidence on novel tasks where they guess content in fuzzy images with random accuracy but report high confidence. This overconfidence predicts conspiracy belief better than domain-specific knowledge, suggesting a fundamental thinking disposition rather than information deficit.
  • False consensus effect: Conspiracy believers massively overestimate agreement with their views. Sandy Hook false flag believers (8% of sample) estimated 61% public agreement. This occurs because social interactions rarely produce direct disagreement, creating illusion of widespread support for fringe beliefs.
  • AI intervention effectiveness: Eight-minute conversations with AI chatbots providing personalized counter-evidence reduced conspiracy belief confidence by 20%, with 25% of believers abandoning their conspiracy theory entirely. Effects persisted unchanged at two-month follow-up, showing genuine belief change rather than temporary compliance.
  • Evidence primacy over persuasion: Removing factual content from AI responses eliminated belief change effects, while removing polite language maintained effectiveness. Facts matter more than sweet-talking for changing conspiracy beliefs, contradicting theories that motivated reasoning makes evidence irrelevant to conspiracy theorists.

What It Covers

Psychologist Gordon Pennycook explains how "unthinkingness" rather than motivated reasoning drives susceptibility to misinformation and conspiracy theories, and presents research showing AI chatbots successfully reduce conspiracy beliefs through patient, evidence-based conversations.

Key Questions Answered

  • Pseudo-profound bullshit receptivity: People who rely on intuitive System 1 thinking rather than effortful System 2 deliberation rate randomly generated statements like "hidden meaning transforms unparalleled abstract beauty" as profound, correlating with belief in pseudoscience and alternative medicine across multiple studies.
  • Overconfidence measurement: Conspiracy believers demonstrate general overconfidence on novel tasks where they guess content in fuzzy images with random accuracy but report high confidence. This overconfidence predicts conspiracy belief better than domain-specific knowledge, suggesting a fundamental thinking disposition rather than information deficit.
  • False consensus effect: Conspiracy believers massively overestimate agreement with their views. Sandy Hook false flag believers (8% of sample) estimated 61% public agreement. This occurs because social interactions rarely produce direct disagreement, creating illusion of widespread support for fringe beliefs.
  • AI intervention effectiveness: Eight-minute conversations with AI chatbots providing personalized counter-evidence reduced conspiracy belief confidence by 20%, with 25% of believers abandoning their conspiracy theory entirely. Effects persisted unchanged at two-month follow-up, showing genuine belief change rather than temporary compliance.
  • Evidence primacy over persuasion: Removing factual content from AI responses eliminated belief change effects, while removing polite language maintained effectiveness. Facts matter more than sweet-talking for changing conspiracy beliefs, contradicting theories that motivated reasoning makes evidence irrelevant to conspiracy theorists.

Notable Moment

Pennycook discovered conspiracy theorists want substantive dialogue about their beliefs rather than seeking validation. When given opportunity to discuss conspiracies with AI, participants engaged earnestly and appreciated receiving detailed counter-evidence, contradicting assumptions that conspiracy believers deliberately avoid information challenging their worldview.

Know someone who'd find this useful?

Episode Transcript

Hello everyone and welcome to the Mindscape podcast. I'm your host Sean Carroll. I don't know about you, but doesn't it bug you when other people are wrong about things? Like, I know you and I generally are correct about all of our beliefs, but out there on the Internet or even in society, it seems that there's more and more people who have false beliefs about things, and they even sort of nurture those false beliefs by hanging out with other people who have false beliefs. What is up with that, and what can we do about it? Now of course, all of us have some false beliefs, and famously, there's this idea that we have biases that nudge us towards one set of false beliefs or another. Then some of us are going to say there's a whole group of people who have more biases than we do and we can have that argument. There's motivated reasoning. There's reason that people, either for wishful thinking purposes or for identification with some tribe or other kind of group want to have some beliefs because it's part of their identity. Okay, but is that really the reason why people have these false beliefs? Either susceptibility to, just as our guest Gordon Pennycook will put it today, pseudo profound bullshit or susceptibility to misinformation or conspiracy theories? And what Gordon is gonna tell us is it's actually not quite about cognitive biases and motivated reasoning so much as it's about what he calls unthinkingness. That is to say, when you're faced with a claim, whether it's a claim you see on the Internet or, you know, someone's giving you a fortune cookie, you evaluate that claim. And you can evaluate it either instantly, like, oh, it feels right to me, right, or it feels wrong, or that fits in with my views, or you can evaluate it in a more careful, reflective, cognitive way, like, how do I know that this claim is on the right track? What are the sources? What are the reasons to believe it? The same thing goes true for not just a proposition about truth in the world, but a saying or an aphorism. Right? Like, if something feels kind of profound, we might, just accept it without thinking very much, without even thinking whether or not it makes sense. And so, Gordon's gonna argue that if we just sit down and think about things, all of us can be better at understanding the difference between profundity and nonsense, the difference between a conspiracy theory and something that is more accurate. And this goes very broadly, and he has some wonderful results with very high statistical significance by psychology experiment standards. And also, what is really fascinating and we'll see whether this holds up because it's all very new and of course any such claim needs to be further investigated. But there's even a suggested mechanism for talking people out of their conspiracy theorizing by having …

Get the full transcript (13,756 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Sean Carroll's Mindscape transcripts →

You just read a 3-minute summary of a 67-minute episode.

Get Sean Carroll's Mindscape summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

More from Sean Carroll's Mindscape

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best Science Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into Sean Carroll's Mindscape.

Every Monday, we deliver AI summaries of the latest episodes from Sean Carroll's Mindscape and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime