[State of Evals] LMArena's $100M Vision — Anastasios Angelopoulos, LMArena

What It Covers

Anastasios Angelopoulos explains LMArena's $100M raise, platform economics serving tens of millions monthly conversations, response to the Leaderboard Illusion controversy, and expansion plans into specialized arenas for code, video, and expert domains.

Key Questions Answered

• •Platform Scale Economics: Arena funds all inference costs for 250M+ total conversations and mid-tens of millions monthly, paying standard enterprise rates to model providers. This free usage model requires substantial capital to maintain as one of the largest consumer LLM platforms.
• •Leaderboard Integrity Principle: The public leaderboard operates as a charity loss-leader that model providers cannot pay to join, improve rankings on, or remove from. Every released model gets evaluated by millions of organic user votes, ensuring statistically sound performance metrics independent of commercial relationships.
• •User Retention Mechanism: Implementing persistent chat history for signed-in users drove significant retention improvements. Half of Arena's users now authenticate, enabling demographic analysis showing 25% work in software and single-digit percentages across medicine, legal, finance, and creative fields for vertical-specific benchmarking.
• •Prerelease Testing Strategy: Arena conducts undisclosed prerelease model testing with code names like NanoBanana, which generated global sensation and measurably moved Google's stock price. This community-loved practice provides early performance signals while maintaining public leaderboard integrity for official releases only.