Google AI Overviews still struggles to answer basic questions and count

0
1K

Google AI Overviews still struggles to answer basic questions

Questions like, "Is it 2025?"

 By 

Tim Marcin

 on 

Share on Facebook Share on Twitter Share on Flipboard

google logo on a phone

Credit: CFOTO/Future Publishing via Getty Images

Remember those old school sports and actions movies — think Billy Bob in Varsity Blues — where they'd ask dazed people simple questions to see if they're concussed? How many fingers am I holding up? Or, what year is it?

Well, even by that low, low standard, Google's AI overviews may not pass concussion protocol. This week, folks noticed that Google's AI overviews couldn't reliably discern that the year was, in fact, 2025. (To be clear, we are now about halfway through 2025.)

There were a number of posts about it online.

This Tweet is currently unavailable. It might be loading or has been removed.
This Tweet is currently unavailable. It might be loading or has been removed.

TechCrunch spotted the issue and noted that Google fixed this particular bug, if not the underlying problem.

"As with all Search features, we rigorously make improvements and use examples like this to update our systems. The vast majority of AI Overviews provide helpful, factual information, and we’re actively working on an update to address this type of issue," a Google spokesperson told the tech outlet.

Mashable Light Speed

The whole what year is it debacle is far from the only time Google's AI overviews have tripped up over simple questions. Two staff members at Mashable asked Google other simple questions: "Is it Friday?" and "How many r's are in blueberry?" It answered both simple questions incorrectly, spitting out that it was Thursday and there was only one r in blueberry, respectively. It's worth noting that Google's AI tools previously went viral for answering a similar question incorrectly ("how many r's are in the word strawberry?"). It seems the underlying issue — that issue would be counting — still has not been remedied.

Google Search expert Lily Ray has called this approach to fixing AI bugs the "whack-a-mole approach." In other words, Google fixes bugs one-by-one instead of making a wholesale improvement.

Google showing an incorrect answer about the date

Credit: Screenshot: Google

google getting the number of r's in blueberry incorrect

Credit: Screenshot: Google

The accuracy problem has been a longstanding one for Google's AI overviews. Mashable tested the overviews' accuracy six months after launch — December of actual 2024 — and found there were still major problems, even if it was improving.

Overviews can prove especially faulty when working with incorrect or incomplete queries. The Google tool often makes stuff up or confidently gets info wrong when it doesn't have a clear answer. It became a trend, for instance, to have Google's AI overviews create meaning for nonsensical, invented idioms. Or remember when Google's AI overviews first launched and it confidently told folks that a dog played in the NBA and that you should add glue to pizza?

Despite these persistent issues and incorrect answers, Google still pushed forward in rolling out AI Mode for all U.S. searchers. And at Google I/O 2025, the company bragged that its AI Overviews were reaching 1.5 billion people per month.

So when you're out there Googling, just be careful — and be sure to know what year it is.

close-up of man's face

Associate Editor, Culture

Tim Marcin is an Associate Editor on the culture team at Mashable, where he mostly digs into the weird parts of the internet. You'll also see some coverage of memes, tech, sports, trends, and the occasional hot take. You can find him on Bluesky (sometimes), Instagram (infrequently), or eating Buffalo wings (as often as possible).


These newsletters may contain advertising, deals, or affiliate links. By clicking Subscribe, you confirm you are 16+ and agree to our Terms of Use and Privacy Policy.

Search
Categories
Read More
Games
Huge update turns Steam sandbox game into a mix of Roadcraft and State of Decay
Huge update turns Steam sandbox game into a mix of Roadcraft and State of Decay As an Amazon...
By Test Blogger6 2025-07-14 21:00:13 0 187
Games
A mysterious "future" AMD Ryzen gaming CPU is on the way, according to MSI
A mysterious "future" AMD Ryzen gaming CPU is on the way, according to MSI As an Amazon...
By Test Blogger6 2025-06-11 17:00:18 0 1K
Games
Minecraft snapshots - testing new features in 25w21a
Minecraft snapshots - testing new features in 25w21a As an Amazon Associate, we earn from...
By Test Blogger6 2025-06-11 16:00:19 0 911
Games
Vampires Bloodlord Rising lets you transform into a bat and rip people in two
Vampires Bloodlord Rising lets you transform into a bat and rip people in two As an Amazon...
By Test Blogger6 2025-06-16 15:00:12 0 779
Games
You can get 4X royalty Civilization 6 with both expansions for free right now
You can get 4X royalty Civilization 6 with both expansions for free right now As an Amazon...
By Test Blogger6 2025-07-17 16:00:10 0 101