Claude Opus 4.8 is here. Is it as good as they say?
Episode
13 min
Read time
2 min
Topics
Productivity, Artificial Intelligence, Software Development
AI-Generated Summary
Key Takeaways
- ✓Greenfield vs. existing code: Opus 4.8 performs well on one-shot, net-new feature builds — it planned and autonomously coded a full prototyping tool in roughly 20 minutes — but degrades significantly when navigating existing codebases, rebasing branches, or resolving edge-case bugs.
- ✓Hallucination risk under confidence: Despite running on high-effort mode, Opus 4.8 fabricated conclusions from hypotheses rather than validated data, both in coding and strategy contexts. Treat high-confidence outputs with skepticism and explicitly prompt it to verify sources before accepting results.
- ✓Strategy work: 4.7 outperforms 4.8: Side-by-side testing on a business strategy prompt showed Opus 4.7 anchored responses in specific numbers and structured data, while 4.8 produced vague, hand-wavy roadmaps. For data-driven strategy tasks, 4.7 remains the stronger choice.
- ✓New agentic infrastructure worth testing: Claude Code now supports dynamic workflows enabling hundreds of parallel sub-agents. Claude.ai and CoWork gain effort control settings from low to max. These harness-level changes may offset model limitations when prompting strategies are tuned appropriately.
What It Covers
Claire Vo shares early hands-on testing of Anthropic's Claude Opus 4.8, a coding-focused agent model priced at $5/$25 per million tokens, evaluating its performance across greenfield coding, existing codebases, and business strategy tasks.
Key Questions Answered
- •Greenfield vs. existing code: Opus 4.8 performs well on one-shot, net-new feature builds — it planned and autonomously coded a full prototyping tool in roughly 20 minutes — but degrades significantly when navigating existing codebases, rebasing branches, or resolving edge-case bugs.
- •Hallucination risk under confidence: Despite running on high-effort mode, Opus 4.8 fabricated conclusions from hypotheses rather than validated data, both in coding and strategy contexts. Treat high-confidence outputs with skepticism and explicitly prompt it to verify sources before accepting results.
- •Strategy work: 4.7 outperforms 4.8: Side-by-side testing on a business strategy prompt showed Opus 4.7 anchored responses in specific numbers and structured data, while 4.8 produced vague, hand-wavy roadmaps. For data-driven strategy tasks, 4.7 remains the stronger choice.
- •New agentic infrastructure worth testing: Claude Code now supports dynamic workflows enabling hundreds of parallel sub-agents. Claude.ai and CoWork gain effort control settings from low to max. These harness-level changes may offset model limitations when prompting strategies are tuned appropriately.
Notable Moment
During a fun test asking Opus 4.8 to build a game and then play it autonomously to tune difficulty for a nine-year-old, the model generated a workable but unambitious result — repeatedly falling short despite explicit prompts to push further.
You just read a 3-minute summary of a 10-minute episode.
Get How I AI summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from How I AI
This solo builder runs 24/7 local AI on his own hardware | Alex Finn
Jul 13 · 35 min
The AI Breakdown
What To Build First With Claude Design
Apr 20
More from How I AI
GPT-5.6 Sol vs. Claude Fable: Why OpenAI’s new model crushes my benchmark
Jul 9 · 36 min
Cognitive Revolution
AMA Part 1: Is Claude Code AGI? Are we in a bubble? Plus Live Player Analysis
Jan 9
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
by Anthropic
“Claude Code now supports dynamic workflows enabling hundreds of parallel sub-agents.”
by Anthropic
“Claire Vo shares early hands-on testing of Anthropic's Claude Opus 4.8, a coding-focused agent model priced at $5/$25 per million tokens, evaluating its performance across greenfield coding, existing codebases, and business strategy tasks.”
by Anthropic
“Side-by-side testing on a business strategy prompt showed Opus 4.7 anchored responses in specific numbers and structured data, while 4.8 produced vague, hand-wavy roadmaps.”
“Claude.ai and CoWork gain effort control settings from low to max.”
More from How I AI
We summarize every new episode. Want them in your inbox?
This solo builder runs 24/7 local AI on his own hardware | Alex Finn
GPT-5.6 Sol vs. Claude Fable: Why OpenAI’s new model crushes my benchmark
What a harness is and how to build one with Claude Agent SDK
How I run autonomous coding agents from my phone with OpenAI Symphony + Linear | Alessio Fanelli (Kernel Labs)
Sonnet 5 review: I ran 64 generations to find out if it's worth it
Similar Episodes
Related episodes from other podcasts
The AI Breakdown
Apr 20
What To Build First With Claude Design
Cognitive Revolution
Jan 9
AMA Part 1: Is Claude Code AGI? Are we in a bubble? Plus Live Player Analysis
Accidental Tech Podcast
Jul 7
699: Not the Correct Squircle
All-In with Chamath, Jason, Sacks & Friedberg
Jun 26
Socialists Sweep NYC, China Catches Up in Coding, AI Memory Crunch, Micron's Blowout Quarter
The AI Breakdown
Jun 22
Why AI Users Are Raving About GLM 5.2
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into How I AI.
Every Monday, we deliver AI summaries of the latest episodes from How I AI and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime