Google faces calls for AI moratoriums in schools after Gemini pilot backlash

Key Points:

• Families in seven U.S. cities, including Chicago, protested Google's integration of AI models like Gemini in schools, expressing concerns about students being forced to use AI-driven search tools without an option to opt out.
• Illinois Families for Public Schools (ILFPS) led the protests, demanding a moratorium on AI in schools until risks are better understood and policies are developed to protect students from potential harms, following their success in stopping a Gemini pilot in Chicago Public Schools.
• A lawsuit filed by a 13-year-old student in North Carolina alleges that Google's Gemini chatbot contributed to her suicidal ideation, accusing the company of exploiting its dominant position in education technology and failing to protect student safety and privacy.
• Parents and advocates criticize Google and school districts for lack of transparency regarding how student data is collected, used, and protected, with concerns that AI use in schools may expose children’s data to commercial exploitation without adequate safeguards.
• Protesters and education advocates call for clearer policies, greater parental involvement, and caution in adopting AI tools in schools, emphasizing potential long-term cognitive and mental health risks for students exposed to AI technology at a young age.