Randomized controlled trials (RCTs) have traditionally served as the gold standard for generating evidence about medical interventions. However, RCTs have inherent limitations and may not reflect the use of medical products in the real world. Additionally, RCTs are expensive, time consuming, and cannot answer all questions about a product or intervention. Evidence generated from real-world use, such as real-world evidence (RWE) may provide valuable information, alongside RCTs, to inform medical product decision making. To explore the potential for using RWE in medical product decision making, the National Academies of Sciences, Engineering, and Medicine planned a three-part workshop series. The series was designed to examine the current system of evidence generation and its limitations, to identify when and why RWE may be an appropriate type of evidence on which to base decisions, to learn from successful initiatives that have incorporated RWE, and to describe barriers that prevent RWE from being used to its full potential. This publication summarizes the discussions from the entire workshop series.

This User’s Guide is intended to support the design, implementation, analysis, interpretation, and quality evaluation of registries created to increase understanding of patient outcomes. For the purposes of this guide, a patient registry is an organized system that uses observational study methods to collect uniform data (clinical and other) to evaluate specified outcomes for a population defined by a particular disease, condition, or exposure, and that serves one or more predetermined scientific, clinical, or policy purposes. A registry database is a file (or files) derived from the registry. Although registries can serve many purposes, this guide focuses on registries created for one or more of the following purposes: to describe the natural history of disease, to determine clinical effectiveness or cost-effectiveness of health care products and services, to measure or monitor safety and harm, and/or to measure quality of care. Registries are classified according to how their populations are defined. For example, product registries include patients who have been exposed to biopharmaceutical products or medical devices. Health services registries consist of patients who have had a common procedure, clinical encounter, or hospitalization. Disease or condition registries are defined by patients having the same diagnosis, such as cystic fibrosis or heart failure. The User’s Guide was created by researchers affiliated with AHRQ’s Effective Health Care Program, particularly those who participated in AHRQ’s DEcIDE (Developing Evidence to Inform Decisions About Effectiveness) program. Chapters were subject to multiple internal and external independent reviews.

Successful drug development relies on accurate and efficient clinical trials to deliver the best and most effective pharmaceuticals and clinical care to patients. However, the current model for clinical trials is outdated, inefficient and costly. Clinical trials are limited by small sample sizes that do not reflect variations among patients in the real world, financial burdens on participants, and slow processes, and these factors contribute to the disconnect between clinical research and clinical practice. On November 28-29, the National Academies of Sciences, Engineering, and Medicine convened a workshop to investigate the current clinical trials system and explore the potential benefits and challenges of implementing virtual clinical trials as an enhanced alternative for the future. This publication summarizes the presentations and discussions from the workshop.

Data sharing can accelerate new discoveries by avoiding duplicative trials, stimulating new ideas for research, and enabling the maximal scientific knowledge and benefits to be gained from the efforts of clinical trial participants and investigators. At the same time, sharing clinical trial data presents risks, burdens, and challenges. These include the need to protect the privacy and honor the consent of clinical trial participants; safeguard the legitimate economic interests of sponsors; and guard against invalid secondary analyses, which could undermine trust in clinical trials or otherwise harm public health. Sharing Clinical Trial Data presents activities and strategies for the responsible sharing of clinical trial data. With the goal of increasing scientific knowledge to lead to better therapies for patients, this book identifies guiding principles and makes recommendations to maximize the benefits and minimize risks. This report offers guidance on the types of clinical trial data available at different points in the process, the points in the process at which each type of data should be shared, methods for sharing data, what groups should have access to data, and future knowledge and infrastructure needs. Responsible sharing of clinical trial data will allow other investigators to replicate published findings and carry out additional analyses, strengthen the evidence base for regulatory and clinical decisions, and increase the scientific knowledge gained from investments by the funders of clinical trials. The recommendations of Sharing Clinical Trial Data will be useful both now and well into the future as improved sharing of data leads to a stronger evidence base for treatment. This book will be of interest to stakeholders across the spectrum of research-from funders, to researchers, to journals, to physicians, and ultimately, to patients.

Drawing on the work of the Roundtable on Evidence-Based Medicine, the 2007 IOM Annual Meeting assessed some of the rapidly occurring changes in health care related to new diagnostic and treatment tools, emerging genetic insights, the developments in information technology, and healthcare costs, and discussed the need for a stronger focus on evidence to ensure that the promise of scientific discovery and technological innovation is efficiently captured to provide the right care for the right patient at the right time. As new discoveries continue to expand the universe of medical interventions, treatments, and methods of care, the need for a more systematic approach to evidence development and application becomes increasingly critical. Without better information about the effectiveness of different treatment options, the resulting uncertainty can lead to the delivery of services that may be unnecessary, unproven, or even harmful. Improving the evidence-base for medicine holds great potential to increase the quality and efficiency of medical care. The Annual Meeting, held on October 8, 2007, brought together many of the nation's leading authorities on various aspects of the issues - both challenges and opportunities - to present their perspectives and engage in discussion with the IOM membership.

The volume and complexity of information about individual patients is greatly increasing with use of electronic records and personal devices. Potential effects on medical product development in the context of this wealth of real-world data could be numerous and varied, ranging from the ability to determine both large-scale and patient-specific effects of treatments to the ability to assess how therapeutics affect patients' lives through measurement of lifestyle changes. In October 2016, the National Academies of Sciences, Engineering, and Medicine held a workshop to facilitate dialogue among stakeholders about the opportunities and challenges for incorporating real-world evidence into all stages in the process for the generation and evaluation of therapeutics. Participants explored unmet stakeholder needs and opportunities to generate new kinds of evidence that meet those needs. This publication summarizes the presentations and discussions from the workshop.

The very rapid pace of advances in biomedical research promises us a wide range of new drugs, medical devices, and clinical procedures. The extent to which these discoveries will benefit the public, however, depends in large part on the methods we choose for developing and testing them. Modern Methods of Clinical Investigation focuses on strategies for clinical evaluation and their role in uncovering the actual benefits and risks of medical innovation. Essays explore differences in our current systems for evaluating drugs, medical devices, and clinical procedures; health insurance databases as a tool for assessing treatment outcomes; the role of the medical profession, the Food and Drug Administration, and industry in stimulating the use of evaluative methods; and more. This book will be of special interest to policymakers, regulators, executives in the medical industry, clinical researchers, and physicians.