The Startup Powering The Data Behind AGI

What It Covers

Edwin Chen built Surge into a billion-dollar human data collection business serving AGI labs, focusing on high-complexity tasks over commodity labeling.

Key Questions Answered

• •Quality over scale: Focus on sophisticated human intelligence tasks rather than commodity labeling like bounding boxes - hire for expertise, not volume of workers.
• •RLHF superiority: Reinforcement learning with human feedback proves more effective than supervised fine tuning for training advanced models according to multiple research teams.
• •Technology-first approach: Build sophisticated quality control algorithms and automated systems rather than operating as manual body shops to achieve billion-dollar scale with 100 employees.
• •Benchmark limitations: Popular leaderboards like LMSYS reward superficial formatting and emojis over actual capability, misleading researchers and setting back industry progress significantly.