Skip to content
Menu
Menu

Google Removes Some AI Health Summaries After Investigation Finds Misleading Information

Google disabled certain AI-generated health overviews in search results that produced incorrect medical details.

 

Google said it removed some of its AI-generated summary responses for specific health-related search queries after an investigation carried out by The Guardian found the summaries were inaccurate and potentially harmful.

The AI Overviews feature uses generative AI to create short summaries at the top of Google Search results. In response to searches such as “what is the normal range for liver blood tests” and “what is the normal range for liver function tests,” the summaries delivered sets of numbers without context, such as age, sex, nationality, or ethnicity, according to the investigation, potentially misleading users with serious health conditions.

Google’s action affects the AI Overviews that appeared for those and similar health queries. The company has not provided a full list of all content removed, but said it does not comment on individual search result changes. The removal applies only to specific queries and does not represent a broader shutdown of the AI Overviews feature across all health or other topics.

A Google spokesperson said, “We do not comment on individual removals within Search. In cases where AI Overviews miss some context, we work to make broad improvements, and we also take action under our policies where appropriate.”

The removal is a response to the Guardian investigation, not a regulatory requirement or legislative mandate. The Guardian found that the summaries in question sometimes failed to provide sufficient context to interpret medical information and could lead users to an incorrect understanding of serious health topics.

Health advocates welcomed the removals for those queries but noted that slightly different search terms could still trigger AI Overviews. Vanessa Hebditch, director of communications and policy at the British Liver Trust, said, “This is excellent news, and we’re pleased to see the removal of the Google AI Overviews in these instances. However, if the question is asked in a different way, a potentially misleading AI Overview may still be given and we remain concerned other AI-produced health information can be inaccurate and confusing.”

Clayton Rifkind

Clayton Rifkind is the Founder and Senior Editor of AI Risk Today. He also advises on business development for ESG Today, a leading source of ESG investment news and research for institutional investors and corporate leaders. He has 20+ years of experience in B2B technology, leading strategy and execution of go-to-market plans across software, enterprise platforms, and mobile applications. He founded two consultancies advising startups and Fortune 1000 companies, including Autodesk, Intel, and Microsoft. He began his career in the San Francisco advertising scene working with brands such as Hewlett-Packard, Intel, Microsoft, Symantec, and Wells Fargo. Clayton launched AI Risk Today in 2025 after two decades of watching enterprises adopt transformative technologies, and seeing how often risk, governance, and compliance considerations lagged behind. His reporting draws on primary sources including regulatory filings, court documents, and official announcements, with a focus on what AI developments mean for the executives accountable for managing them. Reach him at Reach him at [email protected] or on LinkedIn.

Essential AI Risk Intelligence

Daily insights on AI governance, regulation, and enterprise risk management. Trusted by Chief Risk Officers and compliance leaders globally.

By subscribing, you agree to receive our daily newsletter. Unsubscribe anytime.

Advertise with AI RIsk Today, Today!