Skip to main content
How I AI

Computer & browser use in Codex (5 real examples)

27 min episode · 2 min read

Episode

27 min

Read time

2 min

Topics

Career Growth, Leadership, Design & UX

AI-Generated Summary

Key Takeaways

  • Browser Use Setup: Enabling AI computer control requires two components installed simultaneously — the ChatGPT or Claude desktop app plus the official Chrome browser extension. Together, these allow the AI to control your full computer environment, navigate websites, click elements, fill forms, and manage Chrome tabs without further manual input from you.
  • Underprompting Frontier Models: With GPT-5.6 and similar frontier models, giving minimal instructions produces better browser use results than detailed step-by-step prompts. Telling Codex simply to "QA the onboarding flow" yields more thorough, organized testing than listing 25 specific test cases, because the model generates its own comprehensive plan autonomously.
  • Automated QA with Spreadsheet Output: Directing Codex to test a web app via browser use, screenshot issues as it goes, and output findings into a Google Sheet creates a structured, reproducible bug tracker. In one session, Codex found 11 issues including one high-severity navigation blocker — a bug missed by months of manual human testing.
  • Persona-Based UX Research: Instructing Codex to inhabit specific user personas (product manager, engineer, team lead) and navigate your app as each one, then produce a research-style critique, surfaces friction points that standard testing misses. This method identified a structural document-referencing gap in the app that conventional QA had not flagged.
  • iPhone Mirroring + Computer Use: On Mac, Codex can control the iPhone Mirroring app to operate your phone remotely. One practical application involved using this chain — Codex controlling Mac controlling iPhone — to update home router firewall settings, SSH into remote MacBooks, and close network ports afterward, all without physical access to any device.

What It Covers

Browser and computer use in Codex (ChatGPT desktop app) enables AI to control your mouse, keyboard, and Chrome browser to complete digital tasks autonomously. Five real-world examples span QA testing, persona-based UX research, LinkedIn inbox management, remote device control via iPhone mirroring, and personal online shopping.

Key Questions Answered

  • Browser Use Setup: Enabling AI computer control requires two components installed simultaneously — the ChatGPT or Claude desktop app plus the official Chrome browser extension. Together, these allow the AI to control your full computer environment, navigate websites, click elements, fill forms, and manage Chrome tabs without further manual input from you.
  • Underprompting Frontier Models: With GPT-5.6 and similar frontier models, giving minimal instructions produces better browser use results than detailed step-by-step prompts. Telling Codex simply to "QA the onboarding flow" yields more thorough, organized testing than listing 25 specific test cases, because the model generates its own comprehensive plan autonomously.
  • Automated QA with Spreadsheet Output: Directing Codex to test a web app via browser use, screenshot issues as it goes, and output findings into a Google Sheet creates a structured, reproducible bug tracker. In one session, Codex found 11 issues including one high-severity navigation blocker — a bug missed by months of manual human testing.
  • Persona-Based UX Research: Instructing Codex to inhabit specific user personas (product manager, engineer, team lead) and navigate your app as each one, then produce a research-style critique, surfaces friction points that standard testing misses. This method identified a structural document-referencing gap in the app that conventional QA had not flagged.
  • iPhone Mirroring + Computer Use: On Mac, Codex can control the iPhone Mirroring app to operate your phone remotely. One practical application involved using this chain — Codex controlling Mac controlling iPhone — to update home router firewall settings, SSH into remote MacBooks, and close network ports afterward, all without physical access to any device.

Notable Moment

While running persona-based browser testing, Codex acting as an engineer attempting to hand off a product requirements document discovered a core structural limitation in the app — documents cannot cross-reference each other across threads — a real architectural gap the developer had not yet fully confronted.

Know someone who'd find this useful?

Episode Transcript

One of my favorite guests ever, Jessie Janae, said that AI was great for moms because moms' hands are always busy. We're always doing something with our hands, and we do not have time to talk. Now in that episode, she was talking about the benefits of chatting with AI. But in this episode, which I'm gonna lovingly call, Look Ma, No Hands, I'm gonna talk about browser and computer use, the way that you can let AI navigate your computer and navigate websites to get work done on your behalf. Browser and computer use have gotten exceptionally good recently, especially in my experience with codecs and the GPT 5.6 models. And I'm gonna show you a builder use case, a productivity use case, and a personal fun use case that I found super useful in using computer and browser use. Let's get to it. This episode is brought to you by Runway, a new kind of creative platform that has everything you need to generate any image, video, or piece of content you want all in one place. With Runway, it's now possible to go from initial idea to a finished deliverable in a matter of minutes. From turning low fidelity product shots into campaign ready imagery all the way through putting together big brand films, Runway can help your team scale your creative ambitions while keeping your budgets and timelines from doing the same. Runway brings together the world's most advanced AI models, which is why enterprises like Microsoft, Robinhood, Amazon, and Adobe, along with studios like Lionsgate and Legendary, all use Runway to ship real work every day. Try it yourself at runwayml.com/howiai, Promo code howiai. Okay. Before we dive into how I use computer use, just a refresher for anybody who's new. In case you missed it, these LLMs, your AI chatbot, can control your computer and can control your browser. Now there have been a class of AI native browsers that have come out in the last year, thinking about Perplexity's Comet or ChatGPT's Atlas. But I like to use browser and computer use directly through Quad or, in this instance, Codex. Why have I used Codex, specifically the Codex desktop app, or I guess we're calling it the ChatGPT desktop app these days. Well, it is just the best at controlling my computer. And if you didn't know, it can control the mouse, it can control the keyboard, it can do all sorts of things. So imagine you have a virtual coworker and that coworker can put hands on your keyboard and get stuff done on your computer. That is what browser and computer use can do. Now this sounds really scary, but in fact, it has been one of the most life changing features of AI. Certainly professionally changing, but has also reduced so much personal toil and personal digital toil that I had to tell you about a couple of the use cases that I use because I literally use this every …

Get the full transcript (4,830 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all How I AI transcripts →

You just read a 3-minute summary of a 24-minute episode.

Get How I AI summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links.

Tools

  • by Anthropic

    Enabling AI computer control requires two components installed simultaneously — the ChatGPT or Claude desktop app plus the official Chrome browser extension.
  • by Google

    Directing Codex to test a web app via browser use, screenshot issues as it goes, and output findings into a Google Sheet creates a structured, reproducible bug tracker.
  • by Apple

    On Mac, Codex can control the iPhone Mirroring app to operate your phone remotely.
  • by Runway

    SPONSORS: Runway at https://runwayml.com/howiai
  • by HyperAgent

    SPONSORS: HyperAgent at https://hyperagent.com/howiai
  • Enabling AI computer control requires two components installed simultaneously — the ChatGPT or Claude desktop app plus the official Chrome browser extension.
  • by OpenAI

    Browser and computer use in Codex (ChatGPT desktop app) enables AI to control your mouse, keyboard, and Chrome browser to complete digital tasks autonomously.

More from How I AI

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

You're clearly into How I AI.

Every Monday, we deliver AI summaries of the latest episodes from How I AI and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime