Skip to main content
Sean Carroll's Mindscape

330 | Petter Törnberg on the Dynamics of (Mis)Information

72 min episode · 2 min read
·
Petter Törnberg

Episode

72 min

Read time

2 min

Topics

Design & UX, Marketing, Artificial Intelligence

AI-Generated Summary

Key Takeaways

  • Schelling Segregation Online: Törnberg adapted Thomas Schelling's 1969 checkerboard model to digital communities, finding segregation emerges even stronger online than spatially. Users who tolerate 70-80% different-minded neighbors still create near-complete echo chambers through cascading moves, making integrated states fundamentally unstable.
  • LLM Social Simulation: Using 500 large language model agents with personas from American National Election Survey data, researchers created a bare-bones social network. Without engagement algorithms, three problematic outcomes emerged automatically: political echo chambers, power-law attention distributions, and amplification of extreme voices through sharing dynamics.
  • Retweet Feedback Loop: Emotional, reactive sharing creates a structural feedback effect where polarized users gain more followers. This mechanism operates independently of algorithmic curation, suggesting platform architecture itself drives polarization. The sharing behavior shapes network formation, not just content visibility, creating self-reinforcing attention inequality.
  • Intervention Failure: Testing solutions like chronological timelines, hiding user biographies, and bridging-based content ranking failed to fix emergent problems. Some interventions worsened outcomes—chronological feeds increased extreme user attention. The robustness of these negative patterns suggests fundamental platform structure redesign is necessary, not cosmetic algorithm changes.
  • Political Misinformation Strategy: Cross-country analysis of politicians' Twitter posts over five-six years shows radical right populist parties specifically drive misinformation spread. Social media incentives for attention-gaining become intertwined with political movements, making misinformation a deliberate competitive strategy rather than random information quality degradation.

What It Covers

Petter Törnberg presents research using agent-based models and large language models to simulate social media dynamics, revealing how echo chambers, attention inequality, and polarization emerge naturally from platform structures rather than algorithms alone.

Key Questions Answered

  • Schelling Segregation Online: Törnberg adapted Thomas Schelling's 1969 checkerboard model to digital communities, finding segregation emerges even stronger online than spatially. Users who tolerate 70-80% different-minded neighbors still create near-complete echo chambers through cascading moves, making integrated states fundamentally unstable.
  • LLM Social Simulation: Using 500 large language model agents with personas from American National Election Survey data, researchers created a bare-bones social network. Without engagement algorithms, three problematic outcomes emerged automatically: political echo chambers, power-law attention distributions, and amplification of extreme voices through sharing dynamics.
  • Retweet Feedback Loop: Emotional, reactive sharing creates a structural feedback effect where polarized users gain more followers. This mechanism operates independently of algorithmic curation, suggesting platform architecture itself drives polarization. The sharing behavior shapes network formation, not just content visibility, creating self-reinforcing attention inequality.
  • Intervention Failure: Testing solutions like chronological timelines, hiding user biographies, and bridging-based content ranking failed to fix emergent problems. Some interventions worsened outcomes—chronological feeds increased extreme user attention. The robustness of these negative patterns suggests fundamental platform structure redesign is necessary, not cosmetic algorithm changes.
  • Political Misinformation Strategy: Cross-country analysis of politicians' Twitter posts over five-six years shows radical right populist parties specifically drive misinformation spread. Social media incentives for attention-gaining become intertwined with political movements, making misinformation a deliberate competitive strategy rather than random information quality degradation.

Notable Moment

Törnberg expected producing negative social media outcomes would require extensive manipulation of his simulation. Instead, the bare-bones platform with no engagement algorithms immediately generated echo chambers, attention inequality, and amplification of extreme voices, suggesting these problems stem from basic network structure itself.

Know someone who'd find this useful?

Episode Transcript

Hello, everyone, and welcome to the Mindscape podcast. I'm your host, Sean Carroll. There's a idea in social science circles called physics envy. Economics, especially, is, susceptible to this idea. It's not supposed to be a good thing. You're not actually supposed to be envious of physics, but social science is hard. People are messy. There's a lot of variables going on. Physics is able to make enormous progress by simplifying things a great deal. In part that's because the fundamental ingredients that we study but there aren't a lot of moving parts. The basic things that we're looking at are are sufficiently simple. You can describe them using relatively few variables and you can isolate all the interesting things that are going on in these systems with small numbers of variables. As a result of this, you can make tremendous progress. You can prove theorems. You can do experiments that test your theories to many, many decimal places. It's a lot of fun. Of course people would be envious of this. But it's a disease or at least something to be avoided to therefore try to make your social scientific research too much like physics. When you do social science, you should admit that there are complications there that cannot be abstracted away in the same way that we abstract away air resistance or friction when we're doing physics. Nevertheless, I'm sure that everyone who listens to Mindscape on a regular basis knows, I do think that there are contexts in which physics like reasoning can be helpful or even interesting in the social science. There can be contexts in which physics type of reasoning and concepts borrowed from physics can be really useful, very interesting, in the social scientific contexts. Ideas like equilibrium, ideas of emergence in general, ideas of what is collective behavior like when it arises from the sort of mindless, nondirected interaction of many small things. These are things that physicists think about all the time and are very, very relevant to the social sciences. So today's guest is Petter Thurnberg, who, is a professor of computational social science. I promise I didn't know this, but he admits on the podcast that he actually has a physics background, so this makes some sense. But he uses models, agent based models that we've talked about recently, with Doan Farmer and others, as ways to study the behavior of social systems. Can you make a little model where the individual pieces are either simple agents that always act in some way, or maybe there's a little bit of stochasticity in there, or maybe they're even very complicated. We'll talk about an example where Better used LLMs, large language models, to model human interactions in social media landscapes. And then you can ask, what is the robust behavior? Do you get things that we observe in the real world? Do you get polarization? Do you get sort of an accumulation of influence in certain people rather than having …

Get the full transcript (12,720 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Sean Carroll's Mindscape transcripts →

You just read a 3-minute summary of a 69-minute episode.

Get Sean Carroll's Mindscape summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links.

other

More from Sean Carroll's Mindscape

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best Science Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into Sean Carroll's Mindscape.

Every Monday, we deliver AI summaries of the latest episodes from Sean Carroll's Mindscape and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime