How Accurate Are Google’s A.I. Overviews?
The New York Times • • technology
Key Points:
- In late 2023, Stephen Punwasi discovered conflicting information about wrestler Hulk Hogan's death when Google's AI-generated summary denied his death, while a news article suggested otherwise.
- Google's AI Overviews, introduced in 2024, place AI-generated answers at the top of search results, shifting Google’s role from information curator to publisher.
- An analysis found AI Overviews are accurate about 90% of the time, but given Google's massive search volume, this still results in tens of millions of incorrect answers every hour.
- The discrepancy highlights challenges in relying on AI for accurate information, as users may encounter conflicting or erroneous data from prominent search features.
