Around the Globe
n December 2018, FDA published a Framework for its real world evidence (RWE) program. As articulated in the Framework, three central considerations will drive FDA’s evaluation of RWE: whether the real world data (RWD) are fit for use; whether the trial or study design used to generate RWE can provide adequate scientific evidence to answer or help answer the regulatory question; and whether the study conduct meets FDA regulatory requirements. To inform this evaluation, FDA is engaging external and internal stakeholders, funding demonstration projects, and developing guidance for industry.
What is the RWE Program?
Stakeholder Engagement
FDA is also engaging regularly with regulators, including the EMA, to share knowledge and provide updates on current activities with respect to RWE policy development.
Engagement of internal stakeholders is another critical part of FDA’s RWE program. Recognizing the importance of this initiative and the need to facilitate consistent practices, leadership from CDER and CBER created a steering committee of Center leadership and subject matter experts to oversee policy development and to provide resources and guidance to review divisions evaluating novel applications for use of RWE. This committee not only supports reviewers in their assessment of proposals but also oversees policy development and demonstration projects and has benefited from various presentations by groups exploring new methodologies to collect and curate RWD that address data quality and relevance challenges.
Demonstration Projects
In addition, FDA is supporting the University of California in San Francisco’s Carol Franc Buck Breast Care Center on their development of a system to both improve the capture of structured data in the EHR and to enable such data to be seamlessly used as part of an FDA-regulated clinical trial — eliminating the need for duplicate entry, and potentially saving time, money, and improving care.
Within the FDA Catalyst Program, FDA developed the MyStudies mobile application, a tool that can collect data directly from participants outside of the healthcare system and at their convenience. To examine the role of patient-generated data using mobile technologies for real world trials and registries, FDA MyStudies has been re-branded and configured to support the Childhood Arthritis and Rheumatology Research Alliance Limit Juvenile Idiopathic Arthritis Trial and the Crohn’s and Colitis Foundation Inflammatory Bowel Disease (IDB) Plexus Platform. The app will collect the uveitis endpoint as well as questions regarding medication administration in Limit JIA, and collect patient reported outcomes within IBD Plexus.
Understanding methods for generating RWE will be critical for its use in regulatory decisions. Use of RWD to generate evidence on product effectiveness does not mean abandoning tools and methods of traditional trials to obtain valid results and minimize bias. Random treatment assignment and other methods to control bias will likely remain critical to generation of reliable evidence of effectiveness. Integration of RWD into clinical trials, which may lead to greater integration of research in clinical practice settings, presents new research opportunities but new challenges as well.
To increase our understanding of such trials, FDA is supporting demonstration projects under the FDA-Catalyst program. IMPACT AFib, the first FDA-Catalyst randomized trial, is evaluating whether an educational intervention can improve appropriate use of oral anticoagulants and lead to improved clinical outcomes. FDA has also partnered with PCORI to support the RELIANCE trial, a real world clinical trial enrolling patients with chronic obstructive pulmonary disease in which participating sites will capture the endpoints (all-cause hospitalization and all-cause mortality) through a call center, portal, and EHRs. For eligible trial participants, FDA-Catalyst will also link Medicare claims data to augment the assessment of trial endpoints.
FDA understands that great interest exists in exploring whether non-interventional designs (designs where treatment is assigned during clinical practice, and analytic techniques are then used to assemble “comparable” populations and control for potential confounders that may drive clinical treatment selection) can support a finding of product effectiveness. Examples exist wherein non-interventional studies produce the same causal inference as randomized trials, whereas conclusions in other examples have differed. For FDA, the key issue is understanding when concordance can be expected or when bias from unmeasured confounding could lead to false conclusions. A series of demonstration projects are being supported—most notably the Duplicate project by researchers at Harvard Medical School and the Brigham and Women’s Hospital—who, in close consultation with FDA staff, are attempting to replicate the results of 30 completed randomized controlled trials (RCTs) and also to conduct seven additional non-interventional studies in advance of the results from corresponding RCTs. FDA has also recently expanded this work to an additional sample of prospective replications through its Yale-Mayo CERSI. Preliminary results from these efforts are expected by summer of 2020. In addition, FDA is supporting efforts to inventory existing sensitivity analysis methods that might be useful for assessing uncontrolled confounding in non-interventional (observational) RWE studies and use clinical trial data to evaluate these methods. FDA intends to engage stakeholders in discussions of the results of these projects.
Moving Forward: RWE Guidance for Industry
References available upon request.