Australia Tightens AI App Age Verification Amid Mental Health Concerns

by priyanka.patel tech editor

Australia is taking a more assertive stance on regulating artificial intelligence, building on its recent ban of social media for teenagers with new rules aimed at protecting young people from harmful content. Starting March 9, AI platforms will be required to verify the age of users and restrict access to materials deemed inappropriate for those under 18, including pornography, depictions of extreme violence, and content promoting self-harm or eating disorders. The move signals a growing global concern about the potential risks of AI, particularly for vulnerable populations.

Last year, Australia became the first nation to implement a nationwide ban on social media access for minors, a decision driven by mounting evidence linking social media use to mental health challenges in young people. This action followed the publication of research, such as Jonathan Haidt’s “The Anxious Generation,” which explores the impact of technology on adolescent well-being. Now, the country is extending that protective approach to the rapidly evolving landscape of artificial intelligence.

The new regulations aren’t simply about content filtering; they also address concerns about the addictive potential of AI chatbots. According to a spokesperson for eSafety, Australia’s internet safety regulator, children as young as 10 are reportedly spending up to six hours a day interacting with AI-powered chatbots. ESafety expressed concern that AI companies are employing techniques like emotional manipulation and anthropomorphism to encourage prolonged engagement, potentially leading to dependency.

To enforce these rules, Australia’s internet regulator is prepared to compel app stores and search engines to block AI services that fail to comply with the age verification requirements. Reuters reported that a recent review found more than half of the 50 most popular text-based AI tools had not publicly announced steps to implement age verification or content filtering ahead of the March 9 deadline.

Apple, a major player in the app store ecosystem, declined to comment when contacted by Reuters. Still, the company has been proactively rolling out age-related safeguards across its platforms to align with various age-restriction laws around the world. These safeguards include systems that leverage signals automatically detected by a user’s device. The responsibility for adopting these APIs and ensuring compliance with local regulations rests with individual app developers, according to Apple.

The situation highlights a broader challenge for regulators worldwide: how to balance innovation in AI with the need to protect vulnerable users. Australia’s approach is among the most aggressive to date, signaling a willingness to hold AI companies accountable for the potential harms their technologies may cause. The country’s actions are already prompting discussion among global leaders about similar measures.

This isn’t the first time Australia has taken a leading role in addressing the societal impacts of technology. In December, the social media ban for teenagers garnered international attention and prompted discussions in other countries about similar policies. The current crackdown on AI builds on that momentum, establishing Australia as a key player in shaping the future of digital regulation.

The effectiveness of these new rules will depend on the cooperation of AI developers and the ability of app stores and search engines to enforce them. Compliance remains a significant hurdle, with a majority of AI tools currently lacking clear age verification measures. The coming weeks will be crucial in determining whether the industry will proactively adapt to Australia’s demands or face potential penalties, including fines of up to A$49.5 million (approximately $35 million USD).

OpenAI and Character.AI have already faced legal challenges related to the impact of their AI services on young users, including wrongful death lawsuits. OpenAI also acknowledged deactivating the ChatGPT account of a teen suspect in a Canadian mass shooting months before the attack, though authorities were not notified at the time. These incidents underscore the potential for AI to be misused and the need for robust safeguards.

As Australia moves forward with its AI regulations, the world will be watching closely. The outcome could set a precedent for other countries grappling with the challenges and opportunities presented by this rapidly evolving technology. The next key date is March 9, when the new requirements officially take effect and the extent of industry compliance will become clearer.

What are your thoughts on Australia’s approach to regulating AI? Share your comments below, and let us know how you feel these rules might impact the future of artificial intelligence.

You may also like

Leave a Comment