From Hacker News to TikTok - How Algorithms Learned to Hook Us
Episode
41 min
Read time
2 min
Topics
Investing, Fundraising & VC, Leadership
AI-Generated Summary
Key Takeaways
- ✓Hacker News Gravity Algorithm: The original 1005 Hacker News ranking system, written in Arc Lisp, works like Flappy Bird: upvotes push content up, time decay pulls it down. No machine learning, no personalization. This "gravity" model creates shared community front pages where everyone sees the same consensus content, making it structurally incapable of personalized rabbit holes.
- ✓Facebook's MSI Trap: In 2017, Facebook introduced Meaningful Social Interactions as its core engagement metric, optimizing for comments, shares, and reactions. This inadvertently replicated "sort by controversial" at 2 billion-user scale. Internal Haugen documents, now court evidence in 1,700+ lawsuits, show researchers identified the anger-amplification effect but leadership declined fixes that would reduce growth numbers.
- ✓YouTube's Collaborative Filtering Model: YouTube's Covington-Adams-Sargon paper reveals the system takes a user's last 50 watched videos, maps them into vector space, finds users with similar coordinates, then recommends what those users watched next. This batch-processing model updates nightly, meaning preference shifts take weeks to register, producing broader, slower-moving recommendation drift.
- ✓TikTok's 30-Minute Real-Time Model: TikTok's leaked ByteDance engineering document confirms the system uses only the last 30 minutes of viewing behavior as its primary signal, updating via a streaming Kafka-Flink pipeline after every swipe or pause. The Wall Street Journal's bot test found 93 of 224 videos served to a "sad" profile within 36 minutes were about depression or self-harm.
- ✓Algorithm Reset as Practical Intervention: Meta provides a documented reset function under Instagram's content preferences labeled "reset suggested content," which clears recommendation history across Explore, Reels, and Feed simultaneously. For users over-indexed into a narrow content category through concentrated interaction, this is the fastest available mechanism to force the algorithm to rebuild its behavioral model from scratch.
What It Covers
A developer named Corey gets trapped in Instagram's AI cat video loop, prompting a deep investigation into how social media ranking systems evolved from Hacker News's simple gravity-based upvote algorithm through Facebook's engagement optimization and YouTube's collaborative filtering to TikTok's real-time 30-minute behavioral modeling.
Key Questions Answered
- •Hacker News Gravity Algorithm: The original 1005 Hacker News ranking system, written in Arc Lisp, works like Flappy Bird: upvotes push content up, time decay pulls it down. No machine learning, no personalization. This "gravity" model creates shared community front pages where everyone sees the same consensus content, making it structurally incapable of personalized rabbit holes.
- •Facebook's MSI Trap: In 2017, Facebook introduced Meaningful Social Interactions as its core engagement metric, optimizing for comments, shares, and reactions. This inadvertently replicated "sort by controversial" at 2 billion-user scale. Internal Haugen documents, now court evidence in 1,700+ lawsuits, show researchers identified the anger-amplification effect but leadership declined fixes that would reduce growth numbers.
- •YouTube's Collaborative Filtering Model: YouTube's Covington-Adams-Sargon paper reveals the system takes a user's last 50 watched videos, maps them into vector space, finds users with similar coordinates, then recommends what those users watched next. This batch-processing model updates nightly, meaning preference shifts take weeks to register, producing broader, slower-moving recommendation drift.
- •TikTok's 30-Minute Real-Time Model: TikTok's leaked ByteDance engineering document confirms the system uses only the last 30 minutes of viewing behavior as its primary signal, updating via a streaming Kafka-Flink pipeline after every swipe or pause. The Wall Street Journal's bot test found 93 of 224 videos served to a "sad" profile within 36 minutes were about depression or self-harm.
- •Algorithm Reset as Practical Intervention: Meta provides a documented reset function under Instagram's content preferences labeled "reset suggested content," which clears recommendation history across Explore, Reels, and Feed simultaneously. For users over-indexed into a narrow content category through concentrated interaction, this is the fastest available mechanism to force the algorithm to rebuild its behavioral model from scratch.
Notable Moment
The Wall Street Journal built automated accounts with assigned emotional profiles to test TikTok's speed. A profile configured to show mild interest in sadness received 224 videos within 36 minutes, with 93 focused on depression or self-harm — demonstrating how the 30-minute model accelerates psychological narrowing faster than users consciously register.
You just read a 3-minute summary of a 38-minute episode.
Get CoRecursive summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.
other
“YouTube's Covington-Adams-Sargon paper reveals the system takes a user's last 50 watched videos, maps them into vector space, finds users with similar coordinates, then recommends what those users watched next.”
“The original 1005 Hacker News ranking system, written in Arc Lisp, works like Flappy Bird: upvotes push content up, time decay pulls it down.”
“TikTok's leaked ByteDance engineering document confirms the system uses only the last 30 minutes of viewing behavior as its primary signal, updating via a streaming Kafka-Flink pipeline after every swipe or pause.”
“The Wall Street Journal's bot test found 93 of 224 videos served to a "sad" profile within 36 minutes were about depression or self-harm.”
More from CoRecursive
We summarize every new episode. Want them in your inbox?
The Pre-Training Wall and the Treadmill After It
Story: The Aging Programmer
Notes: The Universal Paperclip Clicker
Story: Inside Early Google - Race Conditions, Java Pain, and the Birth of AdWords
Story: The Bug He Couldn't Name - A 15-Year Fight Inside One Developer's Mind
Similar Episodes
Related episodes from other podcasts
Decoder
Feb 5
Reality is losing the deepfake war
Latent Space
May 20
Railway: The Agent-Native Cloud — Jake Cooper
Latent Space
Apr 22
Shopify’s AI Phase Transition: 2026 Usage Explosion, Unlimited Opus-4.6 Token Budget, Tangle, Tangent, SimGym — with Mikhail Parakhin, Shopify CTO
The Startup Ideas Podcast
Mar 9
I let OpenClaw run my organic marketing (while I sleep)
Latent Space
Mar 6
Cursor's Third Era: Cloud Agents
Explore Related Topics
This podcast is featured in Best Cybersecurity Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Investing & Markets Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into CoRecursive.
Every Monday, we deliver AI summaries of the latest episodes from CoRecursive and 192+ other podcasts. Free for up to 3 shows.
Start My Monday DigestNo credit card · Unsubscribe anytime