Building Search for AI Agents with Exa CEO Will Bryk
Episode
49 min
Read time
2 min
Topics
Productivity, Leadership, Design & UX
AI-Generated Summary
Key Takeaways
- ✓Agentic vs. Human Search Architecture: Agents require fundamentally different search infrastructure than humans — they need thousands to 10,000 results per query rather than 10, tolerate variable latency, and submit complex semantic queries without keyword compression. Building for agents means exposing granular toggles like domain filters, keyword controls, and semantic switches that human-facing search engines deliberately hide.
- ✓Token Efficiency via Retrieval: Pairing smaller language models with high-quality retrieval cuts inference costs by up to 20x compared to running large models alone. Exa extracts only the most relevant document segments before passing content to models, dramatically reducing input token consumption. The practical architecture: a large model orchestrates tasks, small models execute them using retrieval to compensate for reduced parameter counts.
- ✓Google's Click Data Advantage Doesn't Transfer: Two decades of human click-signal data — Google's core ranking moat — provides minimal advantage when serving AI agents. Agents don't click, don't browse casually, and don't benefit from popularity-weighted results. This levels the competitive playing field, allowing a sub-100-person team to build retrieval quality that outperforms Google on deep, complex, business-critical queries.
- ✓RL Training on Search Tools Yields Measurable Gains: Exa's research applying reinforcement learning directly to search tool selection — comparing Google SERP wrapping against Exa — showed that agents trained on Exa made fewer total search calls while achieving higher task performance. The mechanism: Exa's architecture accepts complex natural-language queries, so agents don't waste calls reformulating needs into keyword approximations.
- ✓Go-to-Market and Recruiting as Unsolved Search Problems: Company and people search remains a genuinely unsolved problem — no current tool reliably surfaces every competitor across global markets or every qualified candidate matching specific criteria. Exa is building go-to-market intelligence products targeting this gap, using it internally as a live testbed, treating comprehensive entity retrieval as the core technical challenge rather than a UI or workflow problem.
What It Covers
Exa CEO Will Bryk explains how his company builds search infrastructure specifically for AI agents, which require deeper context, comprehensive results, and complex query handling that Google's consumer-oriented, click-data-driven architecture was never designed to deliver, positioning agentic search to surpass Google Ads revenue by the 2030s.
Key Questions Answered
- •Agentic vs. Human Search Architecture: Agents require fundamentally different search infrastructure than humans — they need thousands to 10,000 results per query rather than 10, tolerate variable latency, and submit complex semantic queries without keyword compression. Building for agents means exposing granular toggles like domain filters, keyword controls, and semantic switches that human-facing search engines deliberately hide.
- •Token Efficiency via Retrieval: Pairing smaller language models with high-quality retrieval cuts inference costs by up to 20x compared to running large models alone. Exa extracts only the most relevant document segments before passing content to models, dramatically reducing input token consumption. The practical architecture: a large model orchestrates tasks, small models execute them using retrieval to compensate for reduced parameter counts.
- •Google's Click Data Advantage Doesn't Transfer: Two decades of human click-signal data — Google's core ranking moat — provides minimal advantage when serving AI agents. Agents don't click, don't browse casually, and don't benefit from popularity-weighted results. This levels the competitive playing field, allowing a sub-100-person team to build retrieval quality that outperforms Google on deep, complex, business-critical queries.
- •RL Training on Search Tools Yields Measurable Gains: Exa's research applying reinforcement learning directly to search tool selection — comparing Google SERP wrapping against Exa — showed that agents trained on Exa made fewer total search calls while achieving higher task performance. The mechanism: Exa's architecture accepts complex natural-language queries, so agents don't waste calls reformulating needs into keyword approximations.
- •Go-to-Market and Recruiting as Unsolved Search Problems: Company and people search remains a genuinely unsolved problem — no current tool reliably surfaces every competitor across global markets or every qualified candidate matching specific criteria. Exa is building go-to-market intelligence products targeting this gap, using it internally as a live testbed, treating comprehensive entity retrieval as the core technical challenge rather than a UI or workflow problem.
Notable Moment
Bryk argues that political polarization is fundamentally a search problem — most people want accurate information but receive misleading or incomplete content, causing otherwise reasonable people to hold unreasonable views. He includes himself, acknowledging his own beliefs are likely distorted by imperfect information access.
You just read a 3-minute summary of a 46-minute episode.
Get a16z Podcast summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from a16z Podcast
Why Physical AI Is the Next Frontier | Applied Intuition
Jul 21 · 80 min
Latent Space
Why AI Infrastructure must evolve for Agent Experience — Akshat Bubna, Modal CTO
Jul 8
More from a16z Podcast
Hugging Face's CEO on Open Source AI, Model Routing, and the Future of Competition
Jul 20 · 28 min
Cognitive Revolution
Intelligence on the Edge: Liquid AI's Ramin Hasani on the Search for Device-Native Foundation Models
Jul 4
More from a16z Podcast
We summarize every new episode. Want them in your inbox?
Why Physical AI Is the Next Frontier | Applied Intuition
Hugging Face's CEO on Open Source AI, Model Routing, and the Future of Competition
Amjad Masad on Going Direct, Building Replit, and the Future of Software
Replay 2025: David Sacks on AI, Crypto, and America's Technology Future
Can Anyone Catch NVIDIA? | The Future of Chips and Infrastructure
Similar Episodes
Related episodes from other podcasts
Latent Space
Jul 8
Why AI Infrastructure must evolve for Agent Experience — Akshat Bubna, Modal CTO
Cognitive Revolution
Jul 4
Intelligence on the Edge: Liquid AI's Ramin Hasani on the Search for Device-Native Foundation Models
Odd Lots
Jun 29
Baidu's CFO on How It Became a Full-Stack AI Player
Equity
Feb 11
Glean’s fight to own the AI layer inside every company
Cognitive Revolution
Jan 25
The Internet Computer: Caffeine.ai CEO Dominic Williams on Unstoppable, Self-Writing Software
Explore Related Topics
This podcast is featured in Best Business Podcasts (2026) — ranked and reviewed with AI summaries.
You're clearly into a16z Podcast.
Every Monday, we deliver AI summaries of the latest episodes from a16z Podcast and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime