1288: Test Prep | Skeptical Sunday

February 22, 2026

80 min episode · 3 min read

Jessica Wynne

Episode

80 min

Read time

3 min

AI-Generated Summary

Published Feb 22, 2026

Key Takeaways

✓Score gap reality: Wealthier students consistently outperform peers not because of raw ability but because money purchases structured support. Kids born in the top 1% of income have a 1-in-4 chance of entering elite schools; those in the bottom 20% face 1-in-300 odds. Test prep is one mechanism driving this chasm, not the only one.
✓GPA vs. SAT predictive validity: Multiple studies show high school GPA is a stronger predictor of college success than SAT scores, regardless of which high school a student attended. COVID-era test-optional admissions confirmed this: over 1,800 four-year colleges dropped score requirements and found freshman class quality remained consistent, suggesting standardized tests were never as essential as claimed.
✓Effective study methods: Three evidence-backed techniques outperform cramming. Spaced repetition and active recall build retention. The Feynman Technique — explaining a concept as if teaching a child — exposes knowledge gaps precisely. The Pomodoro Technique uses 25-minute focused work blocks with 5-minute breaks to prevent burnout. Interleaving subjects (10 math, 10 reading, 10 science, repeat) strengthens concept differentiation better than block studying.
✓Prep material selection: Start with official practice tests from the College Board or LSAC — these use real retired questions and are the highest-fidelity preparation available. Khan Academy offers free SAT prep built in partnership with the College Board. One well-used book or course outperforms five mediocre ones left unopened. Avoid materials promising specific point gains or proprietary "secret strategies."
✓Red flags in test prep marketing: No governing body vets prep company claims, making the industry functionally unregulated — comparable to nutritional supplements. Warning signs include guaranteed score increases, "new edition" books with unchanged content at higher prices, left-brain/right-brain study systems, and bundled upsells where the book is merely a funnel to expensive online courses. Always guess c myths are false; answer choices distribute evenly by design.

What It Covers

Jordan Harbinger and researcher Jessica Wynne examine the multibillion-dollar test prep industry across SAT, LSAT, MCAT, GRE, and bar exam preparation. They analyze whether prep materials deliver genuine score improvements, how structural inequality shapes outcomes, why high school GPA predicts college success better than standardized tests, and what study methods actually work.

Key Questions Answered

•Score gap reality: Wealthier students consistently outperform peers not because of raw ability but because money purchases structured support. Kids born in the top 1% of income have a 1-in-4 chance of entering elite schools; those in the bottom 20% face 1-in-300 odds. Test prep is one mechanism driving this chasm, not the only one.
•GPA vs. SAT predictive validity: Multiple studies show high school GPA is a stronger predictor of college success than SAT scores, regardless of which high school a student attended. COVID-era test-optional admissions confirmed this: over 1,800 four-year colleges dropped score requirements and found freshman class quality remained consistent, suggesting standardized tests were never as essential as claimed.
•Effective study methods: Three evidence-backed techniques outperform cramming. Spaced repetition and active recall build retention. The Feynman Technique — explaining a concept as if teaching a child — exposes knowledge gaps precisely. The Pomodoro Technique uses 25-minute focused work blocks with 5-minute breaks to prevent burnout. Interleaving subjects (10 math, 10 reading, 10 science, repeat) strengthens concept differentiation better than block studying.
•Prep material selection: Start with official practice tests from the College Board or LSAC — these use real retired questions and are the highest-fidelity preparation available. Khan Academy offers free SAT prep built in partnership with the College Board. One well-used book or course outperforms five mediocre ones left unopened. Avoid materials promising specific point gains or proprietary "secret strategies."
•Red flags in test prep marketing: No governing body vets prep company claims, making the industry functionally unregulated — comparable to nutritional supplements. Warning signs include guaranteed score increases, "new edition" books with unchanged content at higher prices, left-brain/right-brain study systems, and bundled upsells where the book is merely a funnel to expensive online courses. Always guess c myths are false; answer choices distribute evenly by design.
•AI and ChatGPT limitations: Using general AI tools like ChatGPT as primary bar or standardized test prep carries documented risks: hallucinated facts, outdated information, format misunderstanding, and confidently wrong answers. Established prep companies are building AI trained specifically on test format and scoring logic. AI can supplement preparation but cannot replace structured, test-specific practice under timed, realistic conditions.

Notable Moment

During the New York bar exam, a young woman went into cardiac arrest mid-test. According to witnesses, the exam was not stopped — students continued answering questions while CPR was administered nearby. The incident triggered calls for reform and forced the New York State Board of Law Examiners to review its emergency procedures.

Know someone who'd find this useful?