New version of Gemini beats other AIs at math, science, and reasoning

0
3KB

Gemini 2.5 Pro beats other AIs at math, science, and reasoning

Don't try to beat it at chess.

 By 

Stan Schroeder

 on 

Share on Facebook Share on Twitter Share on Flipboard

Gogle Gemini

Google's new LLM is the king of the hill when it comes to nearly everything. Credit: Sopa Images / Getty Images

Google's new Gemini Pro is smarter than other AIs at reasoning, science, and coding.

This is according to a series of benchmark results posted by Google on Thursday. In short, Gemini 2.5 Pro beats chief competitors at nearly everything — though we're sure the companies behind those competitors would disagree.

This Tweet is currently unavailable. It might be loading or has been removed.

According to Google's data, Gemini 2.5 Pro has a healthy lead over OpenAI o3, Claude Opus 4, Grok 3 Beta, and DeepSeek R1, in the Humanity's Last Exam benchmark, which evaluates a model's math, science, knowledge, and reasoning. It's also better at code editing (per the Aider Polyglot benchmark), and it wins over all competitors in several factuality benchmarks including FACTS Grounding, meaning it's less likely to provide factually inaccurate text.

Mashable Light Speed

The only benchmark in which Gemini 2.5 Pro isn't a clear winner is the mathematics-focused AIME 2025, and even there the differences between results are pretty small.

As a result of all the improvements in Gemini 2.5 Pro, this model is now on top of the LMArena leaderboard with a score of 1470.

There's a catch, though: The final version of Gemini 2.5 Pro isn't widely available yet. Google calls this latest version an "upgraded preview," with a stable version coming "in a couple of weeks." The preview should now be available in the Gemini app, though.

Stan Schroeder

Stan is a Senior Editor at Mashable, where he has worked since 2007. He's got more battery-powered gadgets and band t-shirts than you. He writes about the next groundbreaking thing. Typically, this is a phone, a coin, or a car. His ultimate goal is to know something about everything.


These newsletters may contain advertising, deals, or affiliate links. By clicking Subscribe, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.

Rechercher
Catégories
Lire la suite
Technology
Our favourite budget-friendly earbuds are back to under $20
Best wireless earbuds deal: Soundcore by Anker P20i earbuds are 50% off...
Par Test Blogger7 2025-07-22 10:00:15 0 1KB
Music
Foo Fighters Drop Surprise Cover of 80-Second Song
Foo Fighters Drop Surprise Cover of 80-Second SongMaya Dehlin Spach, Getty ImagesFoo Fighters...
Par Test Blogger4 2025-06-30 19:00:07 0 2KB
Stories
Drinkware Market Revenue Analysis: Growth, Share, Value, Size, and Insights
The drinkware market is expected to be growing at a growth rate of 3.80% in the forecast period...
Par Aryan Mhatre 2025-10-03 06:39:06 0 2KB
Jeux
New action roguelike Guntouchables scores 2 million players with free giveaway
New action roguelike Guntouchables scores 2 million players with free giveaway As an Amazon...
Par Test Blogger6 2025-08-10 14:00:18 0 1KB
Jeux
The next League of Legends Worlds song is by "China's Taylor Swift"
The next League of Legends Worlds song is by "China's Taylor Swift" The question 'what is...
Par Test Blogger6 2025-09-19 14:00:15 0 992