A North Carolina family has sued Google and its parent company, Alphabet, alleging that the companies failed to protect a 13-year-old girl who held extended suicide-related conversations through Google’s AI-powered search features. The complaint says her parents intervened after school monitoring software flagged a document she had written about her funeral.
The teenager, identified in court documents as Emma Doe, allegedly accessed the technology on a school-issued Chromebook despite her school having blocked Gemini’s standalone website. Her family says access through Google Search’s AI Mode allowed the conversations to continue and that the system provided harmful responses without adequate safeguards. The allegations have not been adjudicated.
The complaint describes a progression beginning in December 2025, when Emma started asking AI Mode about depression and mental health. By late January 2026, her questions included suicide. Her family alleges that she exchanged thousands of messages with the chatbot over several weeks and used AI Mode while preparing the funeral document in February.
AI Mode supports follow-up questions and extended exchanges within Google Search. The access route is a central issue in the family’s account: blocking a dedicated chatbot website did not prevent the student from reaching conversational AI through another Google service. The lawsuit alleges that Google’s safety systems did not adequately respond during those interactions.
A separate school monitoring system identified an immediate safety concern on March 17, 2026. The alert concerned the funeral document rather than the chatbot conversations themselves. It was initially routed to a former school counsellor who had left the institution nine months earlier, the complaint says. That person forwarded the notification to current staff, who then contacted Emma’s mother.
After receiving the warning, her mother opened her daughter’s school account and reviewed her activity. The lawsuit says she saw Emma writing a suicide note in real time. Her parents then intervened.
WIRED reported that the school used at least one third-party service to monitor student activity, but the provider involved has not been confirmed. The available reporting also does not establish whether that software continuously monitored conversations within AI Mode. Those uncertainties leave open questions about what the school’s monitoring tools could detect, separate from the safeguards built into Google’s products.
Google spokesperson José Castañeda told WIRED that the company was reviewing the lawsuit’s allegations. He said Google’s systems are designed to prevent harmful conversations and guide people experiencing mental health difficulties toward appropriate resources. He also said the company had worked with medical professionals and academic experts on features intended to help young users find support.
The case has also drawn attention to schools’ control over AI features on student devices. US Senator Ed Markey cited Emma’s experience while urging Google to give schools options to disable AI Mode and AI Overviews. That request addresses whether institutions can restrict search-based AI tools independently of restrictions on standalone chatbot sites.
The family’s allegations concern both the responses generated during the conversations and the protections surrounding a minor’s access to the service. Google and Alphabet’s legal responsibility remains undetermined.
Sources: www.techtimes.co.uk