Computer & browser use in Codex (5 real examples)
Episode
27 min
Read time
2 min
Topics
Career Growth, Leadership, Design & UX
AI-Generated Summary
Key Takeaways
- ✓Browser Use Setup: Enabling AI computer control requires two components installed simultaneously — the ChatGPT or Claude desktop app plus the official Chrome browser extension. Together, these allow the AI to control your full computer environment, navigate websites, click elements, fill forms, and manage Chrome tabs without further manual input from you.
- ✓Underprompting Frontier Models: With GPT-5.6 and similar frontier models, giving minimal instructions produces better browser use results than detailed step-by-step prompts. Telling Codex simply to "QA the onboarding flow" yields more thorough, organized testing than listing 25 specific test cases, because the model generates its own comprehensive plan autonomously.
- ✓Automated QA with Spreadsheet Output: Directing Codex to test a web app via browser use, screenshot issues as it goes, and output findings into a Google Sheet creates a structured, reproducible bug tracker. In one session, Codex found 11 issues including one high-severity navigation blocker — a bug missed by months of manual human testing.
- ✓Persona-Based UX Research: Instructing Codex to inhabit specific user personas (product manager, engineer, team lead) and navigate your app as each one, then produce a research-style critique, surfaces friction points that standard testing misses. This method identified a structural document-referencing gap in the app that conventional QA had not flagged.
- ✓iPhone Mirroring + Computer Use: On Mac, Codex can control the iPhone Mirroring app to operate your phone remotely. One practical application involved using this chain — Codex controlling Mac controlling iPhone — to update home router firewall settings, SSH into remote MacBooks, and close network ports afterward, all without physical access to any device.
What It Covers
Browser and computer use in Codex (ChatGPT desktop app) enables AI to control your mouse, keyboard, and Chrome browser to complete digital tasks autonomously. Five real-world examples span QA testing, persona-based UX research, LinkedIn inbox management, remote device control via iPhone mirroring, and personal online shopping.
Key Questions Answered
- •Browser Use Setup: Enabling AI computer control requires two components installed simultaneously — the ChatGPT or Claude desktop app plus the official Chrome browser extension. Together, these allow the AI to control your full computer environment, navigate websites, click elements, fill forms, and manage Chrome tabs without further manual input from you.
- •Underprompting Frontier Models: With GPT-5.6 and similar frontier models, giving minimal instructions produces better browser use results than detailed step-by-step prompts. Telling Codex simply to "QA the onboarding flow" yields more thorough, organized testing than listing 25 specific test cases, because the model generates its own comprehensive plan autonomously.
- •Automated QA with Spreadsheet Output: Directing Codex to test a web app via browser use, screenshot issues as it goes, and output findings into a Google Sheet creates a structured, reproducible bug tracker. In one session, Codex found 11 issues including one high-severity navigation blocker — a bug missed by months of manual human testing.
- •Persona-Based UX Research: Instructing Codex to inhabit specific user personas (product manager, engineer, team lead) and navigate your app as each one, then produce a research-style critique, surfaces friction points that standard testing misses. This method identified a structural document-referencing gap in the app that conventional QA had not flagged.
- •iPhone Mirroring + Computer Use: On Mac, Codex can control the iPhone Mirroring app to operate your phone remotely. One practical application involved using this chain — Codex controlling Mac controlling iPhone — to update home router firewall settings, SSH into remote MacBooks, and close network ports afterward, all without physical access to any device.
Notable Moment
While running persona-based browser testing, Codex acting as an engineer attempting to hand off a product requirements document discovered a core structural limitation in the app — documents cannot cross-reference each other across threads — a real architectural gap the developer had not yet fully confronted.
Episode Transcript
One of my favorite guests ever, Jessie Janae, said that AI was great for moms because moms' hands are always busy. We're always doing something with our hands, and we do not have time to talk. Now in that episode, she was talking about the benefits of chatting with AI. But in this episode, which I'm gonna lovingly call, Look Ma, No Hands, I'm gonna talk about browser and computer use, the way that you can let AI navigate your computer and navigate websites to get work done on your behalf. Browser and computer use have gotten exceptionally good recently, especially in my experience with codecs and the GPT 5.6 models. And I'm gonna show you a builder use case, a productivity use case, and a personal fun use case that I found super useful in using computer and browser use. Let's get to it. This episode is brought to you by Runway, a new kind of creative platform that has everything you need to generate any image, video, or piece of content you want all in one place. With Runway, it's now possible to go from initial idea to a finished deliverable in a matter of minutes. From turning low fidelity product shots into campaign ready imagery all the way through putting together big brand films, Runway can help your team scale your creative ambitions while keeping your budgets and timelines from doing the same. Runway brings together the world's most advanced AI models, which is why enterprises like Microsoft, Robinhood, Amazon, and Adobe, along with studios like Lionsgate and Legendary, all use Runway to ship real work every day. Try it yourself at runwayml.com/howiai, Promo code howiai. Okay. Before we dive into how I use computer use, just a refresher for anybody who's new. In case you missed it, these LLMs, your AI chatbot, can control your computer and can control your browser. Now there have been a class of AI native browsers that have come out in the last year, thinking about Perplexity's Comet or ChatGPT's Atlas. But I like to use browser and computer use directly through Quad or, in this instance, Codex. Why have I used Codex, specifically the Codex desktop app, or I guess we're calling it the ChatGPT desktop app these days. Well, it is just the best at controlling my computer. And if you didn't know, it can control the mouse, it can control the keyboard, it can do all sorts of things. So imagine you have a virtual coworker and that coworker can put hands on your keyboard and get stuff done on your computer. That is what browser and computer use can do. Now this sounds really scary, but in fact, it has been one of the most life changing features of AI. Certainly professionally changing, but has also reduced so much personal toil and personal digital toil that I had to tell you about a couple of the use cases that I use because I literally use this every …
Get the full transcript (4,830 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 24-minute episode.
Get How I AI summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links.
Tools
by Anthropic
“Enabling AI computer control requires two components installed simultaneously — the ChatGPT or Claude desktop app plus the official Chrome browser extension.”
by Google
“Directing Codex to test a web app via browser use, screenshot issues as it goes, and output findings into a Google Sheet creates a structured, reproducible bug tracker.”
by Apple
“On Mac, Codex can control the iPhone Mirroring app to operate your phone remotely.”
“Enabling AI computer control requires two components installed simultaneously — the ChatGPT or Claude desktop app plus the official Chrome browser extension.”
by OpenAI
“Browser and computer use in Codex (ChatGPT desktop app) enables AI to control your mouse, keyboard, and Chrome browser to complete digital tasks autonomously.”
More from How I AI
We summarize every new episode. Want them in your inbox?
GPT-6 Astra is a banger - here’s everything I’ve built
Grok Bot vs. OpenClaw: How I replaced my entire agent stack
How I turned Claude into a self-improving PM assistant | Daniel Blum (PM, Melio)
I spent $20,000 on Devin in a month. Here’s what I learned | Ryan Carson (solo founder)
I tested Grok Bot, Grok 4.6, and Cursor Origin - here’s my honest take
Similar Episodes
Related episodes from other podcasts
The AI Breakdown
Aug 28
The Most Useful New AI Features and Tools to Try
The AI Breakdown
Mar 6
GPT 5.4 First Test Results
The Startup Ideas Podcast
Jan 23
Claude Code's Creator Reveals "Claude Cowork"'s Setup
10% Happier with Dan Harris
Sep 2
When Life's Not Working, Don't Try Harder. Change Your Situation Instead. | Angela Duckworth
Lenny's Podcast
Aug 30
AI’s third era: the rise of persistent AI coworkers | Tara Seshan (OpenAI’s product lead)
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
You're clearly into How I AI.
Every Monday, we deliver AI summaries of the latest episodes from How I AI and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime