[State of Evals] LMArena's $100M Vision — Anastasios Angelopoulos, LMArena
Read time
2 min
Topics
Relationships, Fundraising & VC, Artificial Intelligence
AI-Generated Summary
Key Takeaways
- ✓Platform Scale Economics: Arena funds all inference costs for 250M+ total conversations and mid-tens of millions monthly, paying standard enterprise rates to model providers. This free usage model requires substantial capital to maintain as one of the largest consumer LLM platforms.
- ✓Leaderboard Integrity Principle: The public leaderboard operates as a charity loss-leader that model providers cannot pay to join, improve rankings on, or remove from. Every released model gets evaluated by millions of organic user votes, ensuring statistically sound performance metrics independent of commercial relationships.
- ✓User Retention Mechanism: Implementing persistent chat history for signed-in users drove significant retention improvements. Half of Arena's users now authenticate, enabling demographic analysis showing 25% work in software and single-digit percentages across medicine, legal, finance, and creative fields for vertical-specific benchmarking.
- ✓Prerelease Testing Strategy: Arena conducts undisclosed prerelease model testing with code names like NanoBanana, which generated global sensation and measurably moved Google's stock price. This community-loved practice provides early performance signals while maintaining public leaderboard integrity for official releases only.
What It Covers
Anastasios Angelopoulos explains LMArena's $100M raise, platform economics serving tens of millions monthly conversations, response to the Leaderboard Illusion controversy, and expansion plans into specialized arenas for code, video, and expert domains.
Key Questions Answered
- •Platform Scale Economics: Arena funds all inference costs for 250M+ total conversations and mid-tens of millions monthly, paying standard enterprise rates to model providers. This free usage model requires substantial capital to maintain as one of the largest consumer LLM platforms.
- •Leaderboard Integrity Principle: The public leaderboard operates as a charity loss-leader that model providers cannot pay to join, improve rankings on, or remove from. Every released model gets evaluated by millions of organic user votes, ensuring statistically sound performance metrics independent of commercial relationships.
- •User Retention Mechanism: Implementing persistent chat history for signed-in users drove significant retention improvements. Half of Arena's users now authenticate, enabling demographic analysis showing 25% work in software and single-digit percentages across medicine, legal, finance, and creative fields for vertical-specific benchmarking.
- •Prerelease Testing Strategy: Arena conducts undisclosed prerelease model testing with code names like NanoBanana, which generated global sensation and measurably moved Google's stock price. This community-loved practice provides early performance signals while maintaining public leaderboard integrity for official releases only.
Notable Moment
The NanoBanana image model preview became such a viral sensation that it demonstrably impacted Google's market capitalization by billions of dollars and triggered an OpenAI code red, showing how Arena's platform can shift competitive dynamics across major AI companies.
Episode Transcript
Alright. We're here with Anastasios from Arena. I actually don't actually know your stars of an a, it's like very Angelopoulos. Yeah. Very good. There you go. Congrats on all the success. You got the Arena handle. Yeah. We did. We got the Arena handle. Thank you. Big branding moment. I mean, I I think x is, like, being more commercial, so obviously you bought it. But, like, at at least you, like, have a place to go to where you can be, like, hey, like, we really like this. But I do think, like, dropping l m Yeah. Has changed the the the the the feel of it. I don't understand how you feel. Yeah. I don't know. I mean, the reason we kept the l m at the beginning is because we were, like we started as LMSIS. Right? Out of the LMSIS sort of, you know, conglomerate at Berkeley. So we decided those language models. Yeah. Exactly. So So we wanted to maybe broaden a little bit. Yeah. And and we were the first arena, so we feel like let's kinda try to own that. Yeah. Last time you we had you guys on, you hadn't really spun out yet. And we I did a call with Alessio, and I was like, these guys are gonna start a company. And I didn't know I think you actually were already started at the time. I don't I don't remember. Maybe. Because Anj I had a I I chatted with Anj. Mhmm. And he said he was your founding CEO. He was indeed. Which, like, people don't know. Yeah. The the Anj Anj is a very interesting character. We we have a podcast schedule with him. Yeah. Yeah. He does a lot more than normal VCs. He does. He's been incredible to us. You you wanna shout out some stuff that you did? Yeah. Absolutely. So, you know, the way the company started was as an incubation by Ansh. Yeah. So what he did is he kinda, like, found us at Berkeley and picked us out of the basement and and was like, hey. These guys seem like they're onto something and started working with us really early. Gave, you know, gave us some grants. He was not you know, a 16 was not the only one to do this. We also had a great grant from Sequoia, but, Anz was, in particular, quite quite supportive of us and, you know, gave us some resources in order to continue building out arena before we even were committed to to starting a business. And in that capacity, he sorta, like, you know, formed an entity for us and this and that. And, you know, he was like, hey. You guys can walk away at any time if you guys don't wanna start a business. I mean, it was really incredible. Very aggressive investment move by him. Right? Because, of course, any money that he spent business. Yeah. At the end …
Get the full transcript (5,067 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
Get Latent Space summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Latent Space
🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
Aug 26 · 83 min
David Senra
Mati Staniszewski on ElevenLabs, Voice AI & Building the Communication Layer for AI
Sep 9
More from Latent Space
Simulation: the new Scaling Law — Joon Sung Park, Simile AI
Aug 21 · 69 min
How I AI
Build your own company brain: the enterprise AI playbook from Stripe’s engineering team | Sharadh Krishnamurthy
Sep 7
More from Latent Space
We summarize every new episode. Want them in your inbox?
🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
Simulation: the new Scaling Law — Joon Sung Park, Simile AI
🔬The BioAI Phase Shift - Matthew McPartlon & Neil Patil, Chai Discovery
The Inference Engineering Masterclass — Philip Kiely & Ali Taha, Baseten
Codex from 0 to 10M Users: Building ChatGPT Work — Akshay Nathan, OpenAI
Similar Episodes
Related episodes from other podcasts
David Senra
Sep 9
Mati Staniszewski on ElevenLabs, Voice AI & Building the Communication Layer for AI
How I AI
Sep 7
Build your own company brain: the enterprise AI playbook from Stripe’s engineering team | Sharadh Krishnamurthy
20VC (20 Minute VC)
Aug 3
20VC: 70% of Neolabs Will Die | There Will be a $100BN US Open-Source Model | Data is a Trillion $ Market | Governments Cannot Regulate Models: It is Too Late | The Cyber Attacks to Come Will be Insane with Anastasios Angelopoulos @ Arena
Masters of Scale
Jul 14
The quiet reinvention of a $42b business, with Canva’s Cameron Adams
Masters of Scale
Jun 25
How to balance a two-sided marketplace, with Care.com CEO Brad Wilson
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Latent Space.
Every Monday, we deliver AI summaries of the latest episodes from Latent Space and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime