Mental Health Apps: Regulation and Validation Are Needed
Esther Howard
Bezyl
I

n the ever-evolving universe of mental health, a revolution is afoot. Mental health applications are proliferating. In the last five years, these have more than doubled in number. This explosion of digital solutions offers a beacon of hope as the world grapples with a worsening mental health crisis. But any new frontier has its perils, too. The 2022 World Mental Health Report by the World Health Organization shows that one in eight people globally deal with various mental disorders, but a staggering 70% of these people receive no treatment. As these apps proliferate, they race ahead of clinical validation and oversight from regulators, creating a “Wild West” that clamors for attention and action.

This article sets out to chart a course through this digital wilderness. It explains the current landscape of mental health apps, sheds light on existing regulatory frameworks, and proposes innovative approaches to ensure clinical validation. The goal is a fine balance that stimulates the much-needed innovation in this field while also ensuring the safety and efficacy of such digital tools, by bringing consistency and the right regulation into the clinical validation process.

The Regulatory Landscape: A Foundation in Flux

Standing at the intersection of technology and mental health, the current regulatory framework resembles a patchwork quilt: functional but fragmented. In the United States, the Food and Drug Administration (FDA) is minding the regulatory gate, requiring clearance for apps that act as medical devices in mental health. Mobile apps fall under the Software as a Medical Device (SaMD) category for the FDA, and they follow the same regulatory pathways as other medical devices with three risk classification levels for patients and users as Class I (low to moderate risk, generally exempt from clearance), II (moderate risk, typically require FDA clearance), and III (high risk, usually require FDA approval). The Class I biofeedback devices manufactured by Mind Media USA Inc. help individuals learn to control physiological functions by providing real-time feedback on bodily processes such as heart rate, muscle tension, and skin temperature. Biofeedback devices are often used to assist in managing conditions like anxiety and stress. A computerized behavioral therapy Class II device for psychiatric disorders regulated under 21 CFR 882.5801 is a prescription-only device intended to provide a computerized version of condition-specific behavioral therapy as an adjunct to clinician-supervised outpatient treatment to patients with psychiatric conditions. The Class III VNS Therapy System manufactured by LivaNova PLC is designed for the treatment of refractory epilepsy and treatment-resistant depression. It involves the implantation of a device that sends electrical impulses to the vagus nerve, which can help reduce the frequency and severity of seizures and improve mood in patients with depression.

At the same time, the FDA has taken a “hands-off” approach to the regulation of low-risk, general wellness apps, and they have introduced a Software Precertification (Pre-Cert) Pilot Program that provides streamlined regulatory oversight of software-based medical devices developed by certain manufacturers that have consistently demonstrated quality and organizational excellence. By certifying organizations instead of specific products, the program aims to reduce burdensome regulatory oversight for these organizations as they develop high-quality SaMD products.

Across the Atlantic, the European Union unfurls the banner of CE marking, emphasizing safety and performance. Meanwhile, the American Psychological Association supplies some sense of direction through guidelines for clinicians attempting to navigate this new digital landscape.

These steps are important, but they are akin to taking a paper map from the 20th century and trying to travel the digital highways of today. They are a good beginning, but the road to the future is going to require a much more global journey.

The Validation Conundrum: Charting Uncharted Waters

The new frontier faces the reality that standardized clinical validation processes have not been created or applied. There are currently more than 20,000 mental health and wellness apps in the App Store and Google Play. They range from tools for mindfulness and meditation to managing anxiety and depression to peer support networks and at-home diagnostic solutions that include guidance on stress and depression. A paper released by the National Library of Medicine reported that only 5 of the 20,000 apps have FDA approval.

Every explorer cuts their own path, using different stars for navigation. For the most part, private companies are devising their own validation plans devoid of objectivity and the required statistical rigor to support scientific credibility of efficacy and safety. Some report app improvements when the evidence is sparse, akin to claiming a medical breakthrough based on a handful of cases. For example, apps that are created to provide mental health support to employees are reporting “efficacy” metrics of user-reported feedback, engagement metrics from the app stores, and basic employer reports. Many of these are not conducting validation studies with robust clinical endpoints, and there are very few clinical trials conducted by any of the apps.

Moreover, the long-term efficacy of many of these apps remains a mystery. It’s like setting sail without knowing whether the ship will last the entire journey. The lack of long-term data not only makes the basis of these digital tools equivocal but also places the user in a sea of uncertainty.

Innovative Approaches

Taming this Wild West takes a multifaceted effort as dynamic as the technology it tries to regulate. Envision a global roundtable of app developers and mental health professionals working arm in arm to inform and evolve standards. That could be the collaboration: a North Star leading the industry towards best practices and uniform ways.

The International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH) and Good Clinical Practices (GCP) already apply to apps that are considered prescribed therapeutics or diagnostics, but because the majority of apps are released outside of these guidelines, proper education and oversight should be provided to ensure they are all following the same standards.

A proposed solution is to form a global central committee to create the standards to determine which apps need regulatory approvals, ensure those requirements are clear and enforced, and provide validation guidelines and educational updates to all digital mental health tools, including those who are not required to secure regulatory approval:

  1. The committee should be comprised of key global stakeholders (psychiatric leaders, digital creators, AI and other tech experts, regulators, legal, etc.).
  2. Membership will offer all mental health app creators and others in the industry a place to be educated on the standards and receive guidance for their innovations.

Let research be the wind that fills the sails to drive development, but more so, long-term studies of these digital tools. Picture a partnership-driving collaboration with innovators from around the world, where all stakeholders partner and launch rigorous longitudinal studies that stand the test of time and scrutiny.

What we need is a flexible framework of standards, one that can evolve at least at the pace of the technology it regulates. It needs to be nuanced, distinguishing between, say, a meditation app and a diagnostic tool, yet holding each to appropriate but rigorous standards.

The Biomarker Revolution: A New Compass

Emerging biomarker research provides a compass of objectivity in the general subjective realm of assessment in mental health. Consider the power of neuroimaging alone, whereby MRI and EEG scans provide a window into the inner workings of the brain, or the potential for blood-based markers offering biological insight into the mind.

Table 1. Examples of biomarkers used in mental health disorders.

BIOMARKERS
DESCRIPTION
EXAMPLES
Neuroimaging
(MRI, EEG, and PET)
Offers a deeper understanding of the brain’s role in mental health, leading to earlier diagnosis and more personalized treatments.

MRI: Detects structural changes in the brain.
EEG: Tracks electrical activity in the brain.
PET: Provides detailed imaging of brain metabolism and function.

CereHealth specializes in using advanced brain imaging, including PET and qSPECT, to diagnose mental health conditions such as depression, anxiety, bipolar disorder, and traumatic brain injury (TBI).

BrainScope, developed by Monclarity, combines EEG technology with machine learning to evaluate brain health in individuals suffering from concussions, PTSD, and depression.

Blood-Based Biomarkers for Inflammation
(C-reactive protein (CRP), cytokines (like IL-6, TNF-α), and cortisol levels)
Are often elevated in individuals experiencing chronic stress.

Studies have shown that chronic stress—such as job-related stress, caregiving, or financial strain—can lead to heightened inflammatory responses.

The use of inflammation as a biomarker for stress provides an objective method to evaluate how stress affects the body over time.

Everlywell offers at-home testing kits, testing for inflammatory biomarkers linked to stress and overall health. The results are delivered directly to users with insights on how inflammation may be related to stress, diet, and other lifestyle factors.

Labcorp provides clinical diagnostic testing, including blood tests for inflammatory markers that can be used to monitor the physiological effects of chronic stress, allowing for early intervention and management of stress-related health issues.

Behavior and Digital Biomarkers Combined
(Speech, Sleep, Activity, Gait, Movement, Facial Expressions, Heart Rate Variability (HRV), Electrodermal Activity (EDA), Respiratory Rate, Pupil Dilation, Eye Movement, Typing Speed, Keystroke Dynamics)
Can indicate changes in health, such as cognitive decline, mental health issues, or chronic disease progression.

Generated through digital technologies, including wearable devices, smartphones, and health apps, that monitor physiological data and behaviors.

Many are being used in other settings and have a potential to be repurposed for use to diagnose depression, anxiety, PTSD, and cognitive decline.

Koa Health combines AI and digital biomarkers to develop personalized mental health interventions. Their platform uses data from wearables and smartphone sensors to monitor physical activity, sleep patterns, and emotional responses as markers of mental health.

Eye-Minders specializes in eye-based analytics to assess cognitive and emotional states. Their proprietary AI analyzes eye movements and responses to detect deception and identify threats. They are now researching the benefits to accurately measure stress.

Revealense evaluates speech patterns, facial expressions, body language, and other microbehaviors to gauge cognitive and emotional responses. Their technology is used by companies to make more informed, objective decisions about hiring and talent management, and detect security threats. It is now merging to provide objective evaluations in therapy sessions, reducing the subjectiveness by a therapist.

Neuroimaging
(MRI, EEG, and PET)
DESCRIPTION
Offers a deeper understanding of the brain’s role in mental health, leading to earlier diagnosis and more personalized treatments.

MRI: Detects structural changes in the brain.
EEG: Tracks electrical activity in the brain.
PET: Provides detailed imaging of brain metabolism and function.

EXAMPLES
CereHealth specializes in using advanced brain imaging, including PET and qSPECT, to diagnose mental health conditions such as depression, anxiety, bipolar disorder, and traumatic brain injury (TBI).

BrainScope, developed by Monclarity, combines EEG technology with machine learning to evaluate brain health in individuals suffering from concussions, PTSD, and depression.

Blood-Based Biomarkers for Inflammation
(C-reactive protein (CRP), cytokines (like IL-6, TNF-α), and cortisol levels)
DESCRIPTION
Are often elevated in individuals experiencing chronic stress.

Studies have shown that chronic stress—such as job-related stress, caregiving, or financial strain—can lead to heightened inflammatory responses.

The use of inflammation as a biomarker for stress provides an objective method to evaluate how stress affects the body over time.

EXAMPLES
Everlywell offers at-home testing kits, testing for inflammatory biomarkers linked to stress and overall health. The results are delivered directly to users with insights on how inflammation may be related to stress, diet, and other lifestyle factors.

Labcorp provides clinical diagnostic testing, including blood tests for inflammatory markers that can be used to monitor the physiological effects of chronic stress, allowing for early intervention and management of stress-related health issues.

Behavior and Digital Biomarkers Combined
(Speech, Sleep, Activity, Gait, Movement, Facial Expressions, Heart Rate Variability (HRV), Electrodermal Activity (EDA), Respiratory Rate, Pupil Dilation, Eye Movement, Typing Speed, Keystroke Dynamics)
DESCRIPTION
Can indicate changes in health, such as cognitive decline, mental health issues, or chronic disease progression.

Generated through digital technologies, including wearable devices, smartphones, and health apps, that monitor physiological data and behaviors.

Many are being used in other settings and have a potential to be repurposed for use to diagnose depression, anxiety, PTSD, and cognitive decline.

EXAMPLES
Koa Health combines AI and digital biomarkers to develop personalized mental health interventions. Their platform uses data from wearables and smartphone sensors to monitor physical activity, sleep patterns, and emotional responses as markers of mental health.

Eye-Minders specializes in eye-based analytics to assess cognitive and emotional states. Their proprietary AI analyzes eye movements and responses to detect deception and identify threats. They are now researching the benefits to accurately measure stress.

Revealense evaluates speech patterns, facial expressions, body language, and other microbehaviors to gauge cognitive and emotional responses. Their technology is used by companies to make more informed, objective decisions about hiring and talent management, and detect security threats. It is now merging to provide objective evaluations in therapy sessions, reducing the subjectiveness by a therapist.

The digital space may turn into a source of data. Aggregated data captured through smartphones on sleep patterns, physical activity, and even modulation of voice may provide a comprehensive picture about mental well-being. Our very eyes may give us a way into the inside: pupil dilatation and movement of the eye provide unfiltered insight into stress and depression.

Regulatory Innovation: Rethinking Rules of Engagement

To be sure, this would require that regulatory bodies be as quick and responsive to change as the rapidly changing technologies they regulate. Adaptive licensing pathways could allow phased approvals that would enable iterative improvements with real-world data. Regulation developed in collaboration with agencies, developers, and mental health professionals might result in guidelines that are both relevant and responsive, providing the right amount of throttle to accelerate research even further, but bringing the standards in place to ensure true efficacy and safety.

Where mental health knows no borders, neither should our regulatory approach. International harmonization of standards could ensure that effective mental health apps can more easily scale globally. In this increasingly data-driven age, developing frameworks for secure, anonymized data sharing could exponentially accelerate research and validation efforts.

Conclusion: Charting a Course for the Future

Standing at the threshold of this digital frontier, the path ahead both inspires and terrifies. By embracing new approaches to clinical validation and regulatory oversight, we can transform what has been up till now the Wild West of mental health apps into a shining beacon of hope and healing for millions around the world.

The path forward is one of delicate balance between the rigors of validation and the urgent needs of a solution to the global mental health crisis. But with science guiding, technology enabling, and compassion motivating, we can develop a digital ecosystem that not only meets regulatory standards but truly improves lives.

Imagine a future where effective, validated mental health support is only a tap away, not just for a privileged few, but for anyone in need, anywhere in the world. This is the promise of our digital frontier, and it’s one that we can fulfill together. As we forge ahead, let us be bold in our innovation, thorough in our validation, and unrelenting in our commitment to mental health for all. Indeed, the Wild West of mental health apps can be tamed, shifting it from a landscape of uncertainty toward an ecosystem of thriving, hope, healing, and human potential.