
AI Summary
→ WHAT IT COVERS A16Z general partner Martin Casado interviews MakerMaker.ai cofounders Daval Ajita and Owen He on true Recursive Self-Improvement (RSI), distinguishing it from autocatalytic AI development. They cover closed-loop system design, measuring genuine capability gains versus resource costs, and early empirical evidence that self-improving systems can simultaneously improve performance and efficiency. → KEY INSIGHTS - **Defining True RSI:** Genuine RSI requires the system being improved to also be the system doing the improving — a closed loop. When humans use AI tools to build better AI, the optimizer remains human cognition, making it autocatalytic, not RSI. The critical test: ask what is the optimizer and what is the optimizee in any claimed RSI system. - **Numerator/Denominator Framework:** Evaluate RSI claims by splitting progress into a numerator (raw capability gains) and denominator (compute, capital, and human labor hours expended). Many companies show faster model releases but fail when capital raised is factored into the denominator. Genuine RSI must show capability improving while the denominator holds flat or shrinks. - **Stack-Level Co-Optimization:** RSI applied only to model weights or only to inference harnesses creates bottlenecks, because weights and harnesses interact. MakerMaker targets co-optimization across prompts, harnesses, weights, and eventually chips simultaneously. Amdahl's Law applies: optimizing one component that represents 20% of total cost yields at most a 20% system-level gain. - **Inference as the Proving Ground:** Improving AI inference efficiency is the domain MakerMaker uses to validate RSI because faster inference directly reduces the denominator while enabling more rollouts, which improves model training — compounding both sides simultaneously. The NanoGPT benchmark illustrates algorithmic progress: GPT-2 retraining dropped from weeks on multiple GPUs to hours on one GPU using identical hardware. - **Variance Control as Core Discipline:** Reward hacking propagates invisibly through multi-agent RSI stacks — an agent built by an agent built by an agent can embed subtle hacks that surface as false positive results. MakerMaker assigns a dedicated engineer (internally called the Viceroy of Variance) whose sole role is to invalidate experimental results and identify noise before any finding is accepted. → NOTABLE MOMENT When pressed on whether improvement without asymptoting was theoretically possible, Ajita stated it was not merely possible but already occurring — that their system was producing better results with less energy over time. Casado noted this was the first time he had heard that claim stated so directly. 💼 SPONSORS None detected 🏷️ Recursive Self-Improvement, AI Systems Architecture, Inference Optimization, Multi-Agent AI, AI Benchmarking
