Ilya Sutskever – We're moving from the age of scaling to the age of research

What It Covers

Ilya Sutskever explains why AI development shifts from scaling compute to fundamental research, discussing model generalization failures, the path to human-like continual learning, and how superintelligent systems might be safely deployed through incremental releases and alignment to sentient life.

Key Questions Answered

• •RL Training Limitations: Current reinforcement learning creates models that excel on specific evals but fail basic tasks because researchers inadvertently reward hack by designing RL environments inspired by benchmarks, combined with inadequate generalization. Models become like students who memorize ten thousand competitive programming problems rather than developing fundamental understanding.
• •Pretraining vs Human Learning: Models require vastly more data than humans despite inferior generalization because pretraining captures the entire world projected onto text, while humans leverage evolutionary priors and deeper understanding from minimal experience. A five-year-old child already possesses vision capabilities sufficient for autonomous driving despite limited data diversity.
• •Value Functions as Emotions: Human emotions function as hardcoded value functions that enable rapid decision-making and learning without external rewards. Evolution mysteriously encoded high-level social desires into the genome, allowing humans to care about abstract concepts like social standing, which remains unexplained by current machine learning frameworks.
• •Deployment Strategy Shift: Superintelligent systems should be deployed as continual learners similar to eager fifteen-year-olds who learn specific jobs on deployment, rather than pre-trained AGI that knows everything. This approach enables gradual societal adaptation, allows multiple specialized AI companies to compete through differentiation, and prevents single-minded optimization of potentially misaligned objectives.
• •Research Era Returns: With compute now sufficiently large and pretraining data finite, AI progress returns to requiring fundamental research breakthroughs rather than scaling existing recipes. The bottleneck shifts from compute availability to discovering principles of reliable generalization that match human learning efficiency, requiring five to twenty years to achieve human-like learners.