Shopify’s AI Phase Transition: 2026 Usage Explosion, Unlimited Opus-4.6 Token Budget, Tangle, Tangent, SimGym — with Mikhail Parakhin, Shopify CTO
Episode
72 min
Read time
3 min
Topics
Productivity, Artificial Intelligence, Software Development
AI-Generated Summary
Key Takeaways
- ✓AI Adoption Phase Transition: Shopify hit near 100% daily active AI tool usage across all employees, with a clear inflection point in December 2025 when model quality crossed a threshold. CLI-based tools like Claude Code and Codex are growing faster than IDE-integrated tools like Cursor and GitHub Copilot, signaling a shift toward non-visual, agent-driven workflows. Token consumption distribution is increasingly skewed toward top 10% users.
- ✓Token Budget Strategy: Rather than capping token usage, Shopify funds unlimited tokens per employee with a floor requirement — staff are discouraged from using anything below Opus 4.6 or GPT-5.4 Pro. The productive pattern is fewer agents in a structured critique loop (one agent generates, a different model critiques, the first revises), not many parallel agents. This increases latency but measurably improves output quality.
- ✓PR Review as the Agentic Bottleneck: AI-generated code volume has increased PR merge rates by 30% month-on-month, but CICD pipelines are creaking under the load. The key metric to track is the ratio of tokens spent during code generation versus expensive model tokens spent on PR review. Shopify uses pro-level models for review rather than lightweight tools, accepting longer review times to prevent downstream deployment rollbacks.
- ✓Tangle and Auto-Research (Tangent): Tangle is a content-hash-based ML experiment orchestration system where unchanged outputs are never recomputed, even across different teams — creating automatic cross-team efficiency gains. Tangent runs autonomous multi-experiment research loops on top of Tangle. Shopify improved search throughput from 800 QPS to 4,200 QPS on identical hardware using Tangent's automated code optimization loop, with no manual engineering intervention.
- ✓SimGym Customer Simulation: SimGym achieves 0.7+ correlation with real add-to-cart conversion events by training simulated buyer agents on decades of Shopify merchant behavioral data. New merchants without historical data get generic simulations; merchants with prior customer data get personalized agent distributions replicating their specific buyer mix. The system runs in headless browsers using multimodal models to capture visual layout effects that pure HTML analysis misses.
What It Covers
Shopify CTO Mikhail Parakhin details the company's AI adoption explosion in 2026, covering internal tooling including Tangle (ML experiment orchestration), Tangent (auto-research loops), and SimGym (customer behavior simulation), alongside infrastructure decisions around token budgets, PR review bottlenecks, and Liquid AI model deployment for sub-30ms search latency.
Key Questions Answered
- •AI Adoption Phase Transition: Shopify hit near 100% daily active AI tool usage across all employees, with a clear inflection point in December 2025 when model quality crossed a threshold. CLI-based tools like Claude Code and Codex are growing faster than IDE-integrated tools like Cursor and GitHub Copilot, signaling a shift toward non-visual, agent-driven workflows. Token consumption distribution is increasingly skewed toward top 10% users.
- •Token Budget Strategy: Rather than capping token usage, Shopify funds unlimited tokens per employee with a floor requirement — staff are discouraged from using anything below Opus 4.6 or GPT-5.4 Pro. The productive pattern is fewer agents in a structured critique loop (one agent generates, a different model critiques, the first revises), not many parallel agents. This increases latency but measurably improves output quality.
- •PR Review as the Agentic Bottleneck: AI-generated code volume has increased PR merge rates by 30% month-on-month, but CICD pipelines are creaking under the load. The key metric to track is the ratio of tokens spent during code generation versus expensive model tokens spent on PR review. Shopify uses pro-level models for review rather than lightweight tools, accepting longer review times to prevent downstream deployment rollbacks.
- •Tangle and Auto-Research (Tangent): Tangle is a content-hash-based ML experiment orchestration system where unchanged outputs are never recomputed, even across different teams — creating automatic cross-team efficiency gains. Tangent runs autonomous multi-experiment research loops on top of Tangle. Shopify improved search throughput from 800 QPS to 4,200 QPS on identical hardware using Tangent's automated code optimization loop, with no manual engineering intervention.
- •SimGym Customer Simulation: SimGym achieves 0.7+ correlation with real add-to-cart conversion events by training simulated buyer agents on decades of Shopify merchant behavioral data. New merchants without historical data get generic simulations; merchants with prior customer data get personalized agent distributions replicating their specific buyer mix. The system runs in headless browsers using multimodal models to capture visual layout effects that pure HTML analysis misses.
- •Liquid AI for Production Inference: Shopify runs Liquid AI models at 30ms end-to-end latency for real-time search query understanding using a 300-million-parameter model — a use case where standard transformer serving stacks and quantization tools like QServe don't perform adequately. For high-throughput offline tasks like product taxonomy classification, Shopify distills large frontier models into Liquid's architecture, where it consistently outperforms Qwen at equivalent parameter counts.
Notable Moment
Parakhin ran an auto-research experiment on a problem he considered fully optimized after years of manual tuning — expecting to prove the approach had limits. After 400 automated experiments over several weeks, one yielded a genuine improvement. He abandoned his skepticism and became an advocate, crediting Andrej Karpathy for popularizing the method.
Episode Transcript
Okay. We're here in the studio, a remote studio with Michal Parikhin, CTO of Shopify. Welcome. Thank you. Welcome. I don't even know if I should introduce you as CTO of Shopify. I feel like you have many identities. You led sort of the the the Bing ML team, I guess, or ads team. I I don't know. I don't know, you know, is people variously refer you as, like, CEO or or, I don't know what that that that that that previous role at Microsoft was. That was yeah. My previous role at Microsoft was the I actually was the CEO of one of Microsoft's business units, which included, as I you know, as we discussed, all the things that people like to laugh about, including Windows and Edge and Bing and ads and everything. Yeah. Yeah. What a what a what a wild time. You've obviously, done a lot since you landed at Shopify. One of the reasons I reached out was because you started promoting more sort of internal tooling, primarily Tangle, but also a lot of people have seen and adopted Toby's QMD. And obviously, I think, Shopify has always been sort of leading in terms of engineering. I think more it's just more recent that you guys have been more vocal about your sort of AI adoption. Is that is that true? Well, I think AI tools in general are fairly recent development, and we've Shopify, you know, at this stage of its development, we're developing AI in in house and, building tools that use AI and, you know, interfacing with the wider AI community, you know, are on a sort of the, runaway trajectory. So it just a by sort of natural byproduct. We we talk about it more also. We just, just even yesterday, Andre Karpathy was famous in tweeting about, oh, there's some, ways, that that you can organize your agents to store the data and then, look up the data so that you don't have to research or or lose context every time. And a little bit tongue in cheek, I tweeted that, hey. We've we've done it much earlier, and we even have different approaches to it. I told you, of course, is a big fan of QMD, and I'm more of a SQL SQL lite fan. But, yeah, very similar things that we already done here. The point is, yeah, we're very dynamic, you know, explosively growing company, and we have to be at the forefront of AI adoption, obviously. Yeah. Yeah. You your team kindly prepared some slides, actually, that we were gonna bring up on to, the screen. I think I can I can screen share, and then we can kinda go through some of the shocking stats? That PP maybe put some numbers to what exactly is going on. So here we have, an internal AI tool adoption chart. What are we looking at here? Yeah. This is very interesting statistics. This is number of daily …
Get the full transcript (12,393 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 69-minute episode.
Get Latent Space summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Latent Space
🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
Aug 26 · 83 min
Eye on AI
From 10 Drones a Month to Nearly 100,000 — Inside Ukraine's Largest Drone Manufacturer | Marko Kushnir, General Cherry
Sep 3
More from Latent Space
Simulation: the new Scaling Law — Joon Sung Park, Simile AI
Aug 21 · 69 min
Software Engineering Daily
Autonomous Drone Delivery at Scale
May 28
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
“Shopify runs Liquid AI models at 30ms end-to-end latency for real-time search query understanding using a 300-million-parameter model — a use case where standard transformer serving stacks and quantization tools like QServe don't perform adequately.”
by Anthropic
“CLI-based tools like Claude Code and Codex are growing faster than IDE-integrated tools like Cursor and GitHub Copilot, signaling a shift toward non-visual, agent-driven workflows.”
“CLI-based tools like Claude Code and Codex are growing faster than IDE-integrated tools like Cursor and GitHub Copilot, signaling a shift toward non-visual, agent-driven workflows.”
by GitHub
“CLI-based tools like Claude Code and Codex are growing faster than IDE-integrated tools like Cursor and GitHub Copilot, signaling a shift toward non-visual, agent-driven workflows.”
More from Latent Space
We summarize every new episode. Want them in your inbox?
🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
Simulation: the new Scaling Law — Joon Sung Park, Simile AI
🔬The BioAI Phase Shift - Matthew McPartlon & Neil Patil, Chai Discovery
The Inference Engineering Masterclass — Philip Kiely & Ali Taha, Baseten
Codex from 0 to 10M Users: Building ChatGPT Work — Akshay Nathan, OpenAI
Similar Episodes
Related episodes from other podcasts
Eye on AI
Sep 3
From 10 Drones a Month to Nearly 100,000 — Inside Ukraine's Largest Drone Manufacturer | Marko Kushnir, General Cherry
Software Engineering Daily
May 28
Autonomous Drone Delivery at Scale
My First Million
May 7
How Replit Agent made $1M on day one (then $250M in a year)
Beyond Biotech
Mar 27
HaemaLogiX - precision immunotherapy for multiple myeloma
Invest Like the Best with Patrick O'Shaughnessy
Mar 24
Mitchell Green - Lessons from Cold Calling 10,000 Companies - [Invest Like the Best, EP.464]
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Latent Space.
Every Monday, we deliver AI summaries of the latest episodes from Latent Space and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime