ChatGPT Just Became a Work Agent

Today on the AI Daily Brief, more new models plus a big harness update from OpenAI. And before that in the headlines, Cursor also appears to be developing a harness to go after the larger knowledge work sector. The AI Daily Brief is a daily podcast and video about the most important news and discussions in AI. Alright, friends. Quick announcements before we dive in. First of all, thank you to today's sponsors, KPMG, Rackspace, Blitsy, and Airtable. To To get an ad free version of the show, go to patreon.com/aidailybrief, or you can subscribe on all the podcasts. And, of course, to learn more about sponsoring the show, head on over to aidailybrief.ai/sponsors or send us a note at sponsors@aidailybrief.ai. Quite appropriately, given that our main episode is about a big harness update, we kick off our headlines with news that Cursor is planning a general purpose agent to compete with Claude Cowork. The information reports that work began on the project in April, shortly after Cursor signed their deal with SpaceX. The agent is expected to use GROC 4.5 and will be Cursor's first project aimed at anyone other than professional coders. Called SAND, it's designed to function as a personal assistant performing standard office tasks like dealing with email or working with spreadsheets. It sounds like it could also eventually become a unified platform, with the information's reporting suggesting that the agent will also be functional at AI coding. Sources said the platform was rolled out internally in June, however, it's still unclear whether it will get the green light for a public release or when that would happen. Certainly, the product suggests that Cursor, now a part of SpaceX AI, is looking to grow beyond their traditional user base of software engineers. This makes sense, as we'll see a huge theme of all of the announcements today with OpenAI are all about taking what has been working in coding bringing it to a broader set of knowledge work. Now speaking of what's working with coding, and what's not working, OpenAI has captured the zeitgeist and declared that the leading coding benchmark is bunk. In a new report, OpenAI audited SuiteBench Pro and found the benchmark to be sorely lacking. In their testing, they found that 30 of the tasks on the benchmark were broken and are now formally retracting their support of the benchmark. Many of the issues stem from some of the tasks being public, which can distort results, by having those specific problems be included in training data. Others had hidden requirements, contradictory instructions, overly strict tests, or incomplete grading criteria. Their conclusion was that Sweebench Pro no longer reliably measures frontier coding capability. And to be clear, the shift away from Sweebench was already well underway. Cursor has been using their own proprietary benchmark for months, while Cognition and Databricks also launched their own benchmarks this week. I think we're officially at the point where there's gonna be lots of introduction of new …