VS Code and Agentic Development with Kai Maetzel

What It Covers

Kai Maetzel, engineering manager of VS Code at Microsoft, explains how the editor evolved from 0 to 44 million users and now integrates AI-powered coding through completions, chat, and agentic workflows.

Key Questions Answered

• •Next Edit Suggestions tuning: VS Code balances completion frequency, acceptance rates, and explicit dismissals (around 3% escape key hits) through continuous A/B testing with 5% user flights, adjusting timing based on typing speed and model responsiveness to maintain developer flow without annoyance.
• •Model-specific prompt engineering: Different AI models require customized tool descriptions and instructions—GPT models prefer apply patch tools while Sonnet uses string replace. VS Code maintains separate prompt paths for each model family, with plans to implement model-specific tool descriptions by December.
• •Tool categorization for token efficiency: When MCP servers provide dozens of tools, VS Code creates virtual tool categories presented to models initially. Upon selection, these expand to actual tools, trading off KV cache invalidation against prompt size optimization based on cache hit rates around 87%.
• •Foreground versus background agent design: Foreground agents in VS Code access UI-integrated tools like test runners and terminal views for quick interactive work, while background agents receive restricted toolsets without UI manipulation capabilities to prevent disrupting user workflow during longer autonomous tasks.
• •AI-ready codebase architecture: Development teams must designate core abstractions as untouchable by agents while marking peripheral code as modifiable. Test-driven development serves this model well, with tests functioning as prompts that constrain agent behavior and prevent unintended architectural changes across large codebases.