Google Restricts AI Features in School Accounts After Criticism from Parents and Teachers

Google is reining in artificial intelligence in school accounts within Google Workspace for Education. After sustained criticism from parents, teachers and schools over privacy, safety and control, the tech company is turning off AI features by default for younger students and giving IT administrators more control over what students can and can't do with AI tools.

Google is restricting artificial intelligence in school accounts after parents, teachers and school boards spent weeks criticizing the way AI features such as Gemini were rolled out in education. The company announced that default settings will be tightened and that schools will now be able to determine much more precisely which AI capabilities students are allowed to use. With this move, Google is responding to concerns that extend well beyond its own products, a theme that is also current in the Netherlands, where the House of Representatives is pushing for a national AI strategy for education.

What went wrong with Google Workspace for Education

Over the past period, Google has steadily built more AI functionality into Google Workspace for Education, the suite millions of schools worldwide use for Gmail, Docs, Classroom and more. Through their school accounts, students gained access to generative AI tools, often without schools having explicitly opted in beforehand or having sufficient controls in place. That led to unease on multiple fronts. Parents and teachers feared that young students would be exposed to inappropriate or inaccurate AI-generated content. Schools worried about the consequences for academic integrity, since students could use AI for homework and tests in ways that were difficult to detect or regulate. Privacy issues also came into play: what data of minor students gets processed the moment they interact with a chatbot, and who actually has oversight of that?

The changes Google is making

In response to the backlash, Google has announced a series of measures to bring AI in school accounts back down to a manageable level:

• AI features will be turned off by default for younger students, rather than on by default.
• School administrators get expanded settings to switch AI access on or off per age group, class or account.
• There will be more transparency about which AI tools are active within a school environment, so IT departments and school leaders aren't caught off guard by new features.
• Google promises clearer communication before new AI functionality is added to education accounts.

This step fits a broader pattern: tech companies are rolling out AI at a rapid pace, but increasingly run into the limits of what institutions, regulators and users find acceptable. In a sensitive environment like education, where minors are involved, the bar for care is higher than for a consumer product.

Why this is more than an American issue

Although the criticism of Google mostly originates in the United States, the topic is also relevant in the Netherlands. Schools here widely use Google Workspace for Education, and the debate over how much room AI should get in the classroom plays out on several levels at once. The Dutch House of Representatives, for instance, is calling for a national AI strategy for vocational and higher education, precisely to prevent every institution from having to reinvent the wheel when it comes to policy, guidance and technology around AI use by pupils and students. Google's case shows that tech companies and educational institutions are still very much searching for the right balance: AI can support students in learning and understanding, but without proper safeguards it creates risks around privacy, reliability and learning outcomes. That last risk has become especially visible now that even official texts, such as a recent example of a university speech that a detector flagged as almost entirely AI-written, are sparking debate about what "your own work" still means in a world full of language models.

Looking ahead

Google's tightened settings for school accounts are unlikely to be the last chapter in this discussion. As AI models grow more powerful and accessible, schools, regulators and tech companies will need to keep talking about responsible use. For those who want to know more about how we got here, the history of artificial intelligence offers valuable context, while an overview of AI applications shows just how broadly the technology is now being deployed, including well beyond education. Curious about more developments around big tech and AI? Check out more AI news or dive deeper via our knowledge base.

The Wall Street Journal

---

Source: The Wall Street Journal