AI Therapy Apps: Risks, Regulation & New Safety Guidelines | Cornell Research

by Grace Chen

Millions are turning to artificial intelligence for mental health support, seeking solace and guidance from apps powered by large language models like ChatGPT. But as the use of these tools surges, a critical question arises: are these AI-driven mental well-being apps akin to trusted doctors, supportive yogis, effective drugs, or simply supplements? The answer, according to fresh research, is complex and hinges on how reliably these apps deliver benefits—and whether they deliver them at all. The rapid proliferation of these apps is outpacing regulation, raising concerns about potential harm and the need for clear guidelines.

A recent study by Cornell researchers highlights the need for a nuanced understanding of these technologies. They propose a framework for categorizing mental health apps based on the guarantees they offer and the consistency with which they deliver results. This framework, they argue, is crucial for both developers and users navigating this rapidly evolving landscape. The researchers are advocating for consulting relevant experts and reviewing existing state and federal regulations to develop safe and responsible LLM-based mental well-being apps.

The core of the Cornell team’s analysis centers around four distinct ways to conceptualize these apps. The first, and most rigorous, would be to view them as akin to doctors – offering guaranteed benefits delivered with high reliability. This would necessitate rigorous testing, validation, and ongoing monitoring, akin to the standards applied to medical treatments. The second category resembles drugs, where benefits are guaranteed but come with known, potential side effects. The third, likened to yogis, offers potential benefits but without firm guarantees, relying on individual experience and response. Finally, the fourth category mirrors supplements – offering no guaranteed benefits and minimal oversight.

The Rise of AI-Powered Mental Health Support

The appeal of AI mental health apps is understandable. Access to traditional mental healthcare can be limited by cost, geographic location, and stigma. These apps offer a convenient, affordable, and often anonymous alternative. However, the lack of regulation means that the quality and effectiveness of these apps vary widely. Some may offer evidence-based techniques, whereas others rely on unproven methods or even potentially harmful advice. The potential for cognitive “debt” – a phenomenon where reliance on AI tools diminishes critical thinking skills – is also a growing concern, as highlighted in a study from the Massachusetts Institute of Technology exploring the neural and behavioral consequences of LLM-assisted essay writing.

The Cornell study, published in December 2025, found that the use of large language models can give scientists a boost, but at the cost of producing a large number of mediocre papers according to Cornell News. While this research focused on scientific writing, the researchers suggest similar patterns could emerge in mental health applications, where reliance on AI-generated responses might hinder the development of genuine self-awareness and coping mechanisms.

Categorizing the Apps: A Framework for Understanding

The Cornell researchers’ proposed framework offers a practical way to assess the risks and benefits of different mental health apps. Apps that claim to diagnose conditions or provide specific treatments would fall into the “doctor” or “drug” categories, requiring the highest level of scrutiny and validation. Those offering general wellness advice or mindfulness exercises might be more appropriately categorized as “yogis” or “supplements,” with a greater emphasis on user discretion and informed consent.

This categorization isn’t simply academic. It has significant implications for regulation and liability. If an app is marketed as a diagnostic tool, it should be subject to the same standards as any other medical device. If it provides therapeutic advice, it should be overseen by qualified mental health professionals. And if it makes unsubstantiated claims, it should be held accountable for any harm it causes.

The Role of Regulation and Oversight

Currently, the regulatory landscape for mental health apps is fragmented and unclear. The Food and Drug Administration (FDA) has begun to address the issue, but its authority is limited. State laws vary widely, and many apps operate with little or no oversight. This lack of regulation creates a Wild West environment, where unscrupulous developers can exploit vulnerable individuals.

The Cornell researchers emphasize the need for a collaborative approach, involving regulators, developers, mental health professionals, and ethicists. They recommend developing clear guidelines for data privacy, algorithmic transparency, and clinical validation. They also suggest establishing a system for reporting adverse events and holding developers accountable for harmful outcomes.

What Does This Mean for Users?

For individuals considering using an AI-powered mental health app, the researchers offer several key recommendations. First, be skeptical of any app that makes unrealistic promises or guarantees. Second, look for apps that are developed by reputable organizations and backed by scientific evidence. Third, be aware of the potential risks and limitations of these tools. And finally, remember that AI is not a substitute for human connection and professional mental healthcare.

The question of whether mental health apps are like doctors, yogis, drugs, or supplements isn’t a simple one. The answer depends on the specific app, its claims, and its level of oversight. As these technologies continue to evolve, it’s crucial to approach them with caution, critical thinking, and a healthy dose of skepticism. The ongoing debate about the appropriate role of AI in mental healthcare is likely to intensify as more people turn to these tools for support.

The FDA is expected to release updated guidance on regulating digital mental health tools in the spring of 2026, a development that could significantly shape the future of this rapidly growing field. Further research is also planned to investigate the long-term effects of AI-assisted therapy and to identify best practices for ensuring user safety and well-being.

What are your thoughts on the use of AI in mental healthcare? Share your experiences and opinions in the comments below.

You may also like

Leave a Comment