The one AI detector people actually trust
Episode
37 min
Read time
2 min
Topics
Leadership, Artificial Intelligence, Crypto & Web3
AI-Generated Summary
Key Takeaways
- ✓Active Learning Methodology: Pangram achieves its 0.01% false positive rate by scanning large human-written corpora, identifying edge cases near the human/AI boundary, generating AI "synthetic mirrors" of those exact documents, then training the model on paired examples. This approach forces the detector to learn subtle micro-decision patterns rather than surface-level stylistic signals.
- ✓Perplexity Detectors and Their Failure Mode: Earlier AI detectors measure linguistic "perplexity" — how surprising each word is to a language model. This produces systematic false positives for two groups: English language learners who write in simple, predictable sentences, and any text an AI has memorized, such as historical documents like the Declaration of Independence.
- ✓Document Length Calibrates Confidence: Pangram's reliability scales directly with text length. A 50-word flagged tweet carries wider error margins than an 80,000-word novel scored at 90% AI. Educators and publishers should weight Pangram results more heavily on longer submissions and treat short-form flags as a prompt for conversation rather than definitive proof.
- ✓Humanizer Arms Race Requires Adversarial Training: A commercial category of tools called "humanizers" paraphrases AI-generated text specifically to evade detectors. Pangram counters this by running bulk data collection from these tools, building internal humanizer replicas to scale training data, then retraining the model. Pangram's next model release targets significantly improved humanizer detection and AI-assistance degree measurement.
- ✓Pre-2022 Internet as Trusted Human Data Source: Pangram sources clean human training data primarily from pre-ChatGPT internet content, where AI contamination is negligible. For current human data, the team identifies prolific authors with established pre-2022 publishing histories and avoids sources showing sudden high-volume self-publishing patterns beginning around 2024 as likely AI-contaminated.
What It Covers
Pangram CEO Max Spiro explains how his AI text detector achieved a one-in-ten-thousand false positive rate using active learning and synthetic mirrors, why older perplexity-based detectors fail, and how the tool is being deployed across education, publishing, and AI data-cleaning industries to verify human authorship.
Key Questions Answered
- •Active Learning Methodology: Pangram achieves its 0.01% false positive rate by scanning large human-written corpora, identifying edge cases near the human/AI boundary, generating AI "synthetic mirrors" of those exact documents, then training the model on paired examples. This approach forces the detector to learn subtle micro-decision patterns rather than surface-level stylistic signals.
- •Perplexity Detectors and Their Failure Mode: Earlier AI detectors measure linguistic "perplexity" — how surprising each word is to a language model. This produces systematic false positives for two groups: English language learners who write in simple, predictable sentences, and any text an AI has memorized, such as historical documents like the Declaration of Independence.
- •Document Length Calibrates Confidence: Pangram's reliability scales directly with text length. A 50-word flagged tweet carries wider error margins than an 80,000-word novel scored at 90% AI. Educators and publishers should weight Pangram results more heavily on longer submissions and treat short-form flags as a prompt for conversation rather than definitive proof.
- •Humanizer Arms Race Requires Adversarial Training: A commercial category of tools called "humanizers" paraphrases AI-generated text specifically to evade detectors. Pangram counters this by running bulk data collection from these tools, building internal humanizer replicas to scale training data, then retraining the model. Pangram's next model release targets significantly improved humanizer detection and AI-assistance degree measurement.
- •Pre-2022 Internet as Trusted Human Data Source: Pangram sources clean human training data primarily from pre-ChatGPT internet content, where AI contamination is negligible. For current human data, the team identifies prolific authors with established pre-2022 publishing histories and avoids sources showing sudden high-volume self-publishing patterns beginning around 2024 as likely AI-contaminated.
Notable Moment
Spiro revealed that Pangram has seriously discussed running supervised essay contests — physically watching participants write by hand — just to obtain guaranteed uncontaminated human training data, illustrating how severely AI-generated content has polluted available text datasets since 2022.
Episode Transcript
Hello, and welcome to The Vergecast, the flagship podcast of homegrown human writing. I'm Jake Kastronakis, executive editor of The Verge. And today, we're talking about AI detection and the one system that might actually work. I have been on the hunt for a reliable AI text detector for a while now, and I know I'm not alone. Here's a call we recently got from a listener. Hey. My name is Aiden. What do AI plagiarism or AI text detectors measure? Are they reliable? Can they reliably detect AI generated text? Recently, there was an article, at my college newspaper, and it's 100% AI generated according to fat GBT. I told the publication, and they refused to take it down stating that AI detectors are not reliable. Thank you. Bye. For the longest time, this has been the refrain. AI detectors aren't reliable. So maybe a student's paper or an executive's LinkedIn post looked like AI, but there wasn't a surefire way of knowing. That might be changing because now the thing I keep hearing is AI detectors aren't very reliable, but PanGram says it might be AI. So today, we're talking to Max Spiro, the CEO of PanGram, which makes what might be the first trusted AI text detector on the market. We're going to talk about how it works, how much we can trust it, and what we should do with its findings. But first, here's what's happening on The Verge today. This is 90 on The Verge for Thursday, 07/16/2026. OnePlus is exiting The US and Europe. The company made the announcement today, twelve years after first making a splash with the OnePlus one. This is a real bummer for smartphone fans. OnePlus had its ups and downs, but the company genuinely was a pioneer in low cost high spec devices that could go head to head with the big flagships. David Amell has a great piece on The Verge today about how The US carrier system is a big part of what killed OnePlus. Its prices may have been great, but they never looked that great beside an iPhone that only cost $4 a month on contract. Next, the EU is forcing Google to make Android open up more in Europe. The European Commission said today that competing AI assistants need to get the same level of access as Gemini. That means letting them be activated by voice commands and giving them the ability to control apps. Google argues that this presents security and privacy risks, but as of now, it's on the hook to make it happen by July 2027. The EU is also updating rules requiring Google to share search data with competitors in Europe. That now has to include AI chat chatbots. Finally, do you want a couple companies to be able to dominate US airwaves? FCC chairman Brendan Carr does. He's planning a vote to end the national ownership cap, which currently prevents broadcasters from reaching more than 39% of US households. …
Get the full transcript (6,970 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 34-minute episode.
Get The Vergecast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from The Vergecast
The iPhone Fold could make concerts even worse
Aug 28 · 93 min
Odd Lots
This Is How to Tell if Writing Was Made by AI
Apr 2
More from The Vergecast
How to buy a laptop when everything’s expensive
Aug 27 · 31 min
Latent Space
🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
Aug 26
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
by Pangram
“Pangram CEO Max Spiro explains how his AI text detector achieved a one-in-ten-thousand false positive rate using active learning and synthetic mirrors”
More from The Vergecast
We summarize every new episode. Want them in your inbox?
The iPhone Fold could make concerts even worse
How to buy a laptop when everything’s expensive
Meta will cut teens off of Instagram after two hours
Does smart home tech work in a college dorm?
We play a brutal quiz of our gadget memories
Similar Episodes
Related episodes from other podcasts
Odd Lots
Apr 2
This Is How to Tell if Writing Was Made by AI
Latent Space
Aug 26
🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
Software Engineering Daily
Jul 21
NanoClaw and the Rise of Personal AI Agents
Software Engineering Daily
Jul 14
AURA and Open-Source Agents for Production Operations
Odd Lots
Jun 26
Rory Johnston on Why His $200 Oil Prediction Didn't Turn Out Right
Explore Related Topics
This podcast is featured in Best Tech Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into The Vergecast.
Every Monday, we deliver AI summaries of the latest episodes from The Vergecast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime