The AI Rankings Just Got Reshuffled

So frequently on this show, you will hear me ramble off a bunch of numbers that are supposed to tell you something significant about a new model that has just come out. And more often than not, those benchmark numbers are in some ways related to artificial analysis, the company that has become the leading provider of the overarching benchmark that people use to judge AI models. And as AI models become more significant, the benchmarks that tell us how they perform relative to one another, consequently, get more important. Today, we are looking at a major update to artificial analysis' intelligence index, as well as a new leader for the benchmark, which comes, believe it or not, from Google. The AI Daily Brief is a daily podcast and video about the most important news and discussions in AI. Alright, friends. Quick announcements before we dive in. First of all, thank you to today's sponsors, KPMG, C Data, Granola, and Blitzy. To get an ad free version of the show, go to patreon.com/aideallybrief, or you can subscribe to Novel Podcasts. And if you wanna learn more about sponsoring the show, send us a note at sponsors@aideallybrief.ai. On aideallybrief.ai, you can also find links to everything else going on in the ecosystem, free trainings, paid trainings like our new Champions Program at Super Intelligent, or of course, the new How We Got Here podcast, and the first episode out this week called How Tech Lost America. Again, you can find all of those links from aidailybrief.ai. Welcome back to the AI Daily Brief headlines edition all the daily AI news you need in around five minutes. We kick off today with a story that could have easily been the main, and honestly probably would have been if more people had had their chance to get their hands on this model. Google has unveiled their next frontier model, Gemini four Carbon, just two weeks after the release of Gemini four Argon. As I've mentioned on this show a number of times since Argon arrived, having a new base model means Google can iterate quickly with reinforcement learning, rather than needing to complete a lengthy pre training run to put out a new model. And this is definitely a quick pace one of the shortest gaps we've seen between versions of ultra large models. CEO Sundar Pichai even suggested the pace would increase from here commenting on Wednesday night's earnings call: This rapid progress underscores our incredible model momentum. We are at the point where AI is helping us increase our training and launch velocity. I would expect the next twelve months to see continued acceleration because of RSI. So Google is iterating at a record pace, but I'm sure you are sitting there asking yourself the same question that everyone is which is is the model any good? In particular, is it a significant improvement on the underwhelming release of Argon? Certainly, when it comes to the benchmarks, the answer is a …