Evidence-Based Medicine is a relatively new movement that seeks to put clinical med- icine on a firmer scientific footing. I take it as uncontroversial that medical practice should be based on best evidence-the interesting questions concern the details. This paper tries to move towards a coherent and unified account of best evidence in medicine, by exploring in particular the EBM position on RCTs (randomized controlled trials).

Philosophers of experiment have acknowledged that experiments are often more than mere hypothesis-tests, once thought to be an experiment's exclusive calling. Drawing on examples from contemporary biology, I make an additional amendment to our understanding of experiment by examining the way that `wide' instrumentation can, for reasons of efficiency, lead scientists away from traditional hypothesis-directed methods of experimentation and towards exploratory methods.

Philosophers’ traditional emphasis on theories, theoretical modeling, and explanation misguides research in philosophy of science. Articulating and applying core theories is part of scientific practice, but it is not the essence of scientific practice. Insofar as science has an essence, it is to systematically investigate and learn about what is not yet understood. This lecture analyzes genetics to articulate a broad-practice-centered approach to philosophy of science. It concludes by arguing that this approach can lead to richer, deeper, and more useful (...) philosophies of science, philosophies that can better inform science policy and the public’s understanding of science. (shrink)

This 1983 book is a lively and clearly written introduction to the philosophy of natural science, organized around the central theme of scientific realism. It has two parts. 'Representing' deals with the different philosophical accounts of scientific objectivity and the reality of scientific entities. The views of Kuhn, Feyerabend, Lakatos, Putnam, van Fraassen, and others, are all considered. 'Intervening' presents the first sustained treatment of experimental science for many years and uses it to give a new direction to debates about (...) realism. Hacking illustrates how experimentation often has a life independent of theory. He argues that although the philosophical problems of scientific realism can not be resolved when put in terms of theory alone, a sound philosophy of experiment provides compelling grounds for a realistic attitude. A great many scientific examples are described in both parts of the book, which also includes lucid expositions of recent high energy physics and a remarkable chapter on the microscope in cell biology. (shrink)

Harms of medical interventions are systematically underestimated in clinical research. Numerous factors—conceptual, methodological, and social—contribute to this underestimation. I articulate the depth of such underestimation by describing these factors at the various stages of clinical research. Before any evidence is gathered, the ways harms are operationalized in clinical research contributes to their underestimation. Medical interventions are first tested in phase 1 ‘first in human’ trials, but evidence from these trials is rarely published, despite the fact that such trials provide the (...) foundation for assessing the harm profile of medical interventions. If a medical intervention is deemed safe in a phase 1 trial, it is tested in larger phase 2 and 3 clinical trials. One way to think about the problem of underestimating harms is in terms of the statistical ‘power’ of a clinical trial—the ability of a trial to detect a difference of a certain effect size between the experimental group and the control group. Power is normally thought to be pertinent to detecting benefits of medical interventions. It is important, though, to distinguish between the ability of a trial to detect benefits and the ability of a trial to detect harms. I refer to the former as power-B and the latter as power-H. I identify several factors that maximize power-B by sacrificing powerH in phase 3 clinical trials. If a medical intervention is approved for general use, it is evaluated by phase 4 post-market surveillance. Phase 4 surveillance of harms further contributes to underestimating the harm profile of medical interventions. At every stage of clinical research the hunt for harms is shrouded in secrecy, which further contributes to the underestimation of the harm profiles of medical interventions. (shrink)

The claims of randomized controlled trials to be the gold standard rest on the fact that the ideal RCT is a deductive method: if the assumptions of the test are met, a positive result implies the appropriate causal conclusion. This is a feature that RCTs share with a variety of other methods, which thus have equal claim to being a gold standard. This article describes some of these other deductive methods and also some useful non-deductive methods, including the hypothetico-deductive method. (...) It argues that with all deductive methods, the benefit that the conclusions follow deductively in the ideal case comes with a great cost: narrowness of scope. This is an instance of the familiar trade-off between internal and external validity. RCTs have high internal validity but the formal methodology puts severe constraints on the assumptions a target population must meet to justify exporting a conclusion from the test population to the target. The article reviews one such set of assumptions to show the kind of knowledge required. The overall conclusion is that to draw causal inferences about a target population, which method is best depends case-by-case on what background knowledge we have or can come to obtain. There is no gold standard. (shrink)

My aim in this article is to introduce readers to the topic of exploratory experimentation and briefly explain how the three articles that follow, by Richard Burian, Kevin Elliott, and Maureen O'Malley, advance our understanding of the nature and significance of exploratory research. I suggest that the distinction between exploratory and theory-driven experimentation is multidimensional and that some of the dimensions are continuums. I point out that exploratory experiments are typically theory-informed even if they are not theory-driven. I also distinguish (...) between research programs and experiments. Research programs that are largely exploratory, such as the ones discussed in these case studies, can involve both exploratory and theory-driven experimentation. (shrink)

There has been relatively little effort to provide a systematic overview of different forms of exploratory experimentation (EE). The present paper examines the growing subdiscipline of nanotoxicology and suggests that it illustrates at least four ways that researchers can engage in EE: searching for regularities; developing new techniques, simulation models, and instrumentation; collecting and analyzing large swaths of data using new experimental strategies (e.g., computer-based simulation and "high-throughput" instrumentation); and structuring an entire disciplinary field around exploratory research agendas. In order (...) to distinguish these and other activities more effectively, the paper proposes a taxonomy that includes three dimensions along which types of EE vary: (1) the aim of the experimental activity, (2) the role of theory in the activity, and (3) the methods or strategies employed for varying experimental parameters. (shrink)

Starting with some illustrative examples, I develop a systematic account of a specific type of experimentation--an experimentation which is not, as in the "standard view", driven by specific theories. It is typically practiced in periods in which no theory or--even more fundamentally--no conceptual framework is readily available. I call it exploratory experimentation and I explicate its systematic guidelines. From the historical examples I argue furthermore that exploratory experimentation may have an immense, but hitherto widely neglected, epistemic significance.

Institutional corruption is a normative concept of growing importance that embodies the systemic dependencies and informal practices that distort an institution’s societal mission. An extensive range of studies and lawsuits already documents strategies by which pharmaceutical companies hide, ignore, or misrepresent evidence about new drugs; distort the medical literature; and misrepresent products to prescribing physicians. We focus on the consequences for patients: millions of adverse reactions. After defining institutional corruption, we focus on evidence that it lies behind the epidemic of (...) harms and the paucity of benefits. (shrink)

Philosophical discussions have critically analysed the methodological pitfalls and epistemological implications of evidence assessment in medicine, however they have mainly focused on evidence of treatment efficacy. Most of this work is devoted to statistical methods of causal inference with a special attention to the privileged role assigned to randomized controlled trials (RCTs) in evidence based medicine. Regardless of whether the RCT’s privilege holds for efficacy assessment, it is nevertheless important to make a distinction between causal inference of intended and unintended (...) effects, in that the unknowns at stake are heterogonous in the two contexts. However, although “lower level” evidence is increasingly acknowledged to be a valid source of information contributory to assessing the risk profile of medications on theoretical or empirical grounds, current practices have difficulty in assigning a precise epistemic status to this kind of evidence because they are more or less implicitly parasitic on the (statistical) methods developed to test drug efficacy. My thesis is that (1) “lower level” evidence is justified on distinct grounds and at different conditions depending on the different epistemologies which one wishes to endorse, in that each impose different constraints on the methods we adopt to collect and evaluate evidence; (2) such constraints ought to be understood to be different in the case of evidence for risk versus benefit assessment for a series of reasons which I will illustrate on the basis of the recent debate on the causal association between acetaminophen (a.k.a. paracetamol) and asthma. (shrink)

The problem of collecting, analyzing and evaluating evidence on adverse drug reactions (ADRs) is an example of the more general class of epistemological problems related to scientific inference and prediction, as well as a central problem of the health-care practice. Philosophical discussions have critically analysed the methodological pitfalls and epistemological implications of evidence assessment in medicine, however they have mainly focused on evidence of treatment efficacy. Most of this work is devoted to statistical methods of causal inference with a special (...) attention to the privileged role assigned to randomized controlled trials in Evidence Based Medicine. Regardless of whether the RCT’s privilege holds for efficacy assessment, it is nevertheless important to make a distinction between causal inference of intended and unintended effects, in that the unknowns at stake are heterogonous in the two contexts. This point has been emphasized by epidemiologists in the last decade. Their main focus is methodological, and regards the fact that bias and confounding do not affect studies on intended and unintended effects in the same way. However, deeper concerns ground the intuition for such a distinction; these are related to the constraints which we impose on evidence and their epistemological justification. My thesis is that such constraints ought to be understood to be different in the case of evidence for risk vs. benefit assessment. I present the recent debate on the causal association between acetaminophen and asthma in order to illustrate the point at issue. (shrink)

Evidence-Based Medicine is a relatively new movement that seeks to put clinical medicine on a firmer scientific footing. I take it as uncontroversial that medical practice should be based on best evidence—the interesting questions concern the details. This paper tries to move towards a coherent and unified account of best evidence in medicine, by exploring in particular the EBM position on RCTs.

Evidence-based medicine (EBM) makes use of explicit procedures for grading evidence for causal claims. Normally, these procedures categorise evidence of correlation produced by statistical trials as better evidence for a causal claim than evidence of mechanisms produced by other methods. We argue, in contrast, that evidence of mechanisms needs to be viewed as complementary to, rather than inferior to, evidence of correlation. In this paper we first set out the case for treating evidence of mechanisms alongside evidence of correlation in (...) explicit protocols for evaluating evidence. Next we provide case studies which exemplify the ways in which evidence of mechanisms complements evidence of correlation in practice. Finally, we put forward some general considerations as to how the two sorts of evidence can be more closely integrated by EBM. (shrink)

To explain their role in discovery and contrast them with theory-driven research, philosophers of science have characterized exploratory experiments in terms of what they lack: namely, that they lack direction from what have been called “local theories” of the target system or object under investigation. I argue that this is incorrect: it’s not whether or not there is direction from a local theory that matters, but instead how such a theory is used to direct an experiment that matters. Appealing to (...) contemporary exploratory experiments that involve the use of experimental techniques—specifically, examples where scientists explore the interaction of neural activity and human behavior by magnetically stimulating brains—I argue that local theories of a target system can inform auxiliary hypotheses in exploratory experiments, which direct these experiments. These examples illustrate how local theories can direct the exploration of target systems where researchers do not aim to evaluate these theories. (shrink)

Philosophers of science have insisted that evidence of underlying mechanisms is required to support claims about the effects of medical interventions. Yet evidence about mechanisms does not feature on dominant evidence-based medicine “hierarchies.” After arguing that only inferences from mechanisms (“mechanistic reasoning”)—not mechanisms themselves—count as evidence, I argue for a middle ground. Mechanistic reasoning is not required to establish causation when we have high-quality controlled studies; moreover, mechanistic reasoning is more problematic than has been assumed. Yet where the problems can (...) be overcome, mechanistic reasoning can and should be used as evidence. (shrink)

For observers of pharmaceutical regulation and the Food and Drug Administration, these are uncertain times. Events in late 2016 raised concerns that the FDA's evidentiary standards were being weakened, compromising the agency's ability to adequately perform its regulatory and public health responsibilities. Two developments most directly contributed to these fears—the approval of eteplirsen, a treatment for Duchenne muscular dystrophy, against the recommendations of both FDA staff and an advisory committee and the December 2016 signing of the 21st Century Cures Act, (...) which encouraged greater use by the FDA of “real-world” evidence not obtained through randomized controlled trials. The arrival of the Trump administration—with its deregulatory, industry-friendly approach—has only amplified concerns over the future of the FDA. It is too early to know whether the recent developments are truly harbingers of an FDA less likely to prevent unsafe or ineffective products from reaching the market. But elements in the two events—the role of patient narratives in deliberations regarding eteplirsen and the enthusiasm for real-world evidence in the 21st Century Cures Act—raise critical issues for the future of evidence in the FDA's work. The rigorous, inclusive approach under way to consider issues related to real-world evidence provides a model for a similarly needed inquiry regarding public participation in FDA decision-making. (shrink)

For evidence-based practice and policy, randomised controlled trials (RCTs) are the current gold standard. But exactly why? We know that RCTs do not, without a series of strong assumptions, warrant predictions about what happens in practice. But just what are these assumptions? I maintain that, from a philosophical stance, answers to both questions are obscured because we don't attend to what causal claims say. Causal claims entering evidence-based medicine at different points say different things and, I would suggest, failure to (...) attend to these differences makes much current guidance about evidence for medical and social policy misleading. (shrink)

BackgroundIn this manuscript, we argue that within the context of phase IV, physician-researchers retain their fiduciary obligation to treat the patient-participants.DiscussionWe first clarify why the perspective that research ethics ought to be differentiated from clinical ethics is not applicable in phase IV, and therefore, why therapeutic orientation is most convivial in this phase. Next, assuming that ethics guidelines may be representative of common morality, we show that ethics guidelines see physician-researchers primarily as physicians and only secondarily as researchers. We then (...) elaborate on what a fiduciary obligation is and how some of the obligations are default duties. Lastly, we look at the fiduciary obligation of the physician-researcher in phase IV interventional trials.ConclusionThe fiduciary obligation to treat is not as easily waived as in earlier trials. Assuming the entwinement of research and practice in phase IV, physician-researchers, in collaboration with other researchers, investigators, and research ethics committees, should ensure that in terms of study design, methodology, and research practice, the therapeutic value of the research to the patient-participants is not diminished. (shrink)

Over the past 35 years, patients have suffered from a largely hidden epidemic of side effects from drugs that usually have few offsetting benefits. The pharmaceutical industry has corrupted the practice of medicine through its influence over what drugs are developed, how they are tested, and how medical knowledge is created. Since 1906, heavy commercial influence has compromised congressional legislation to protect the public from unsafe drugs. The authorization of user fees in 1992 has turned drug companies into the FDA's (...) prime clients, deepening the regulatory and cultural capture of the agency. Industry has demanded shorter average review times and, with less time to thoroughly review evidence, increased hospitalizations and deaths have resulted. Meeting the needs of the drug companies has taken priority over meeting the needs of patients. Unless this corruption of regulatory intent is reversed, the situation will continue to deteriorate. We offer practical suggestions including: separating the funding of clinical trials from their conduct, analysis, and publication; independent FDA leadership; full public funding for all FDA activities; measures to discourage R&D on drugs with few, if any, new clinical benefits; and the creation of a National Drug Safety Board. (shrink)