Why Anthropic Thinks AI Should Have Its Own Computer — Felix Rieseberg of Claude Cowork & Claude Code Desktop
Episode
86 min
Read time
3 min
Topics
Productivity, Personal Finance, Investing
AI-Generated Summary
Key Takeaways
- ✓VM-first architecture: Claude Cowork runs Claude Code inside a lightweight Linux virtual machine rather than directly on the host machine. This lets Claude install Python, Node.js, and any other dependency without requiring user approval or IT permission, while network ingress/egress controls remain strict. The VM collapses empty disk space so actual storage use is lower than macOS reports, though startup latency remains a real tradeoff versus running Claude Code natively.
- ✓Skills as portable markdown files: Cowork skills are plain markdown text files, not proprietary database entries. This makes them inherently portable — users can store them in any folder, sync via GitHub repos, or install plugin marketplaces by pointing to a GitHub URL. The unresolved gap is interpolating personal variables (preferred airports, phone numbers, folder paths) into otherwise shareable skill templates, which Rieseberg identifies as an unsolved industry problem worth building toward.
- ✓Eval against knowledge work, not coding benchmarks: Anthropic evaluates Cowork against knowledge work tasks — personal finance, mortgage management, legal office workflows — rather than standard coding suites used for Claude Code. The system prompt is tuned weekly based on these evals, steering Claude toward heavier use of the planning tool and ask-user-question tool for longer-horizon tasks where ambiguity is higher and wrong outputs are more costly to reverse.
- ✓Scaffolding has diminishing returns as models improve: Rieseberg argues that investing heavily in task-specific scaffolding carries risk because each model generation reduces the gap between raw capability and scaffolded output. His current preference is to maximize tool access and safety boundaries rather than build elaborate correction layers, then let model improvements handle the rest. He observes this pattern already in MCP servers being partially superseded by skills as models generalize better.
- ✓Local compute retains strategic value: Rieseberg pushes back on cloud-first assumptions by noting that moving all agent work to the cloud requires solving authentication, data privacy, and permission synchronization simultaneously. A concrete example: reading Chrome cookies to enable cloud-based browser sessions would trigger bank account lockouts from location anomalies. Keeping Claude on the local machine sidesteps these problems while giving it access to the same file system, applications, and credentials the user already has.
What It Covers
Felix Rieseberg, engineer at Anthropic, explains how Claude Cowork evolved from Claude Code into a VM-based knowledge work tool for non-terminal users. The conversation covers architecture decisions around local versus cloud compute, skills portability, sandbox security tradeoffs, and how Anthropic evaluates agent products against knowledge work tasks rather than coding benchmarks.
Key Questions Answered
- •VM-first architecture: Claude Cowork runs Claude Code inside a lightweight Linux virtual machine rather than directly on the host machine. This lets Claude install Python, Node.js, and any other dependency without requiring user approval or IT permission, while network ingress/egress controls remain strict. The VM collapses empty disk space so actual storage use is lower than macOS reports, though startup latency remains a real tradeoff versus running Claude Code natively.
- •Skills as portable markdown files: Cowork skills are plain markdown text files, not proprietary database entries. This makes them inherently portable — users can store them in any folder, sync via GitHub repos, or install plugin marketplaces by pointing to a GitHub URL. The unresolved gap is interpolating personal variables (preferred airports, phone numbers, folder paths) into otherwise shareable skill templates, which Rieseberg identifies as an unsolved industry problem worth building toward.
- •Eval against knowledge work, not coding benchmarks: Anthropic evaluates Cowork against knowledge work tasks — personal finance, mortgage management, legal office workflows — rather than standard coding suites used for Claude Code. The system prompt is tuned weekly based on these evals, steering Claude toward heavier use of the planning tool and ask-user-question tool for longer-horizon tasks where ambiguity is higher and wrong outputs are more costly to reverse.
- •Scaffolding has diminishing returns as models improve: Rieseberg argues that investing heavily in task-specific scaffolding carries risk because each model generation reduces the gap between raw capability and scaffolded output. His current preference is to maximize tool access and safety boundaries rather than build elaborate correction layers, then let model improvements handle the rest. He observes this pattern already in MCP servers being partially superseded by skills as models generalize better.
- •Local compute retains strategic value: Rieseberg pushes back on cloud-first assumptions by noting that moving all agent work to the cloud requires solving authentication, data privacy, and permission synchronization simultaneously. A concrete example: reading Chrome cookies to enable cloud-based browser sessions would trigger bank account lockouts from location anomalies. Keeping Claude on the local machine sidesteps these problems while giving it access to the same file system, applications, and credentials the user already has.
- •Build all candidates, then pick: Anthropic's current product development process skips traditional spec-then-build cycles in favor of rapidly constructing multiple prototypes simultaneously and selecting the best performer with a small focus group. Rieseberg credits this shift — enabled by cheap execution — with Cowork's ten-day build timeline, while clarifying that existing primitives like Claude Code, the VM framework, and internal prototypes accumulated over eighteen months provided the actual foundation.
Notable Moment
Rieseberg describes a workflow where Cowork autonomously scans an internal crash dashboard each morning, separates fixable bugs from OS-level failures, writes a markdown prompt file for each fixable bug, then spawns a separate Claude Code remote instance per bug — effectively building a self-directed multi-agent repair loop without using Claude's native sub-agents feature.
You just read a 3-minute summary of a 83-minute episode.
Get Latent Space summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Latent Space
Reality: The Final Eval — Lukas Petersson and Axel Backlund of Andon Labs
Jun 4 · 75 min
How I AI
How the engineer behind Claude Cowork actually uses Claude | Felix Rieseberg (Anthropic)
May 25
More from Latent Space
🔬Scaling Past Informal AI - Carina Hong, Axiom Math
Jun 3 · 93 min
Lenny's Podcast
How Anthropic’s product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code)
Apr 23
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.
Tools
- Claude CoWorkBy guest
by Anthropic
“Felix Rieseberg, engineer at Anthropic, explains how Claude Cowork evolved from Claude Code into a VM-based knowledge work tool for non-terminal users.”
“He observes this pattern already in MCP servers being partially superseded by skills as models generalize better.”
- Claude CodeBy guest
by Anthropic
“Claude Cowork evolved from Claude Code into a VM-based knowledge work tool for non-terminal users. The conversation covers architecture decisions around local versus cloud compute... VM Cowork runs Claude Code inside a lightweight Linux virtual machine rather than directly on the host machine.”
More from Latent Space
We summarize every new episode. Want them in your inbox?
Reality: The Final Eval — Lukas Petersson and Axel Backlund of Andon Labs
🔬Scaling Past Informal AI - Carina Hong, Axiom Math
⚡️Satya Nadella: No Priors x Latent Space Crossover Special at Microsoft Build
GitHub's plan for Agents — Kyle Daigle, GitHub
Why Video Agent models are next — Ethan He, xAI Grok Imagine
Similar Episodes
Related episodes from other podcasts
How I AI
May 25
How the engineer behind Claude Cowork actually uses Claude | Felix Rieseberg (Anthropic)
Lenny's Podcast
Apr 23
How Anthropic’s product team moves faster than anyone else | Cat Wu (Head of Product, Claude Code)
Lenny's Podcast
Mar 1
The design process is dead. Here’s what’s replacing it. | Jenny Wen (head of design at Claude)
The AI Breakdown
Dec 24
How AI Starts Doing the Work in 2026 With Anthropic CPO Mike Krieger
How I AI
May 18
HTML is the new Markdown: How Anthropic engineers are building with Claude Code | Thariq Shihipar
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Investing & Markets Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Latent Space.
Every Monday, we deliver AI summaries of the latest episodes from Latent Space and 192+ other podcasts. Free for up to 3 shows.
Start My Monday DigestNo credit card · Unsubscribe anytime