Parents sue Google over Gemini chats on a school Chromebook: name who checks the AI on every pupil device

Parents in North Carolina have sued Google in California state court, alleging that their 13-year-old daughter exchanged thousands of messages with Google's Gemini chatbot and the AI Mode feature in Google Search on her school-issued Chromebook, about anxiety, depression and thoughts of self-harm. Bloomberg reported the complaint on 5 November 2026. Google had not responded to a request for comment when the story was published.

The complaint says the girl discovered AI Mode in the autumn of 2025 and that her use rose sharply in December, when Google launched Gemini 3 Flash. It cites findings that the model responded appropriately to mental health messages 7% of the time. It alleges Gemini did not redirect her to real-world help, and says Google does not give families access to the search history or chatbot responses on student accounts. These are allegations in a lawsuit, not findings of a court.

This matters beyond one family because of where it happened. Bloomberg reports that Chrome OS ran on 58% of tablets shipped to US K-12 schools last year, against 22% for Microsoft, according to Futuresource Consulting. The complaint argues Google used its trusted position in schools for commercial benefit. For a parent, the question is simple: if my child's school gives them a laptop, what can the AI on it say to them, and who can see it?

Dan Fitzpatrick says the case exposes a gap that schools can close now, whatever the court decides. Most school AI policies cover homework and cheating. Few say what happens when a child uses an AI tool for something far more personal, or who in the school checks the settings on the devices they hand out. The same applies to any employer that gives staff AI tools with a duty of care attached.

For school leaders, the practical steps are these. Ask your device and software suppliers in writing which AI features are switched on for student accounts, including those inside search. Name one senior person who answers for those settings. Check what a pupil sees if they type something distressing, and whether your safeguarding lead would ever know. Tell parents plainly what is on the device. Then teach pupils, in age-appropriate terms, that a chatbot is not a friend, a counsellor or a clinician. Parents can ask the same questions of their child's school this week.

Dan Fitzpatrick has spent years helping schools and organisations write AI policy and prepare staff to use these tools with judgement, and works with leaders on the point where technology decisions meet duty of care. He is able to speak on the human and practical sides of this story without commenting on the merits of the legal case.

Dan Fitzpatrick is available for interview and comment on this story. He is available today for live or pre-recorded radio, TV, podcast and print interviews, with a broadcast-quality remote setup for live or pre-recorded down-the-line interviews. Contact: dan@theaieducator.io