Evidence hierarchies are lists of investigative strategies ordered with regard to the claimed strength of evidence. They have been used for a couple of decades within EBM, particularly for the assessment of evidence for treatment recommendations, but they remain controversial. An under-investigated question, from critics and adherents of evidence hierarchies alike, is what the order in the hierarchy means. Four interpretations of the order are distinguished and discussed. The two most credible ones are, roughly expressed, "typically stronger" or "ideally stronger". (...) The well-known GRADE framework seems to assume some "typically stronger" reading. Unfortunately, even if the interpretation of an evidence hierarchy were established, hierarchies appear to be rather unhelpful for the task of evidence aggregation. Nevertheless, a specification of the intended order relation may be helpful in sorting out disagreements in debates on evidence hierarchies. Therefore, proponents and adversaries of evidence hierarchies are equally obliged to specify the order interpretations they are assuming in their arguments. (shrink)

We explore an unsolved challenge in the era of evidence-based medicine (EBM): the recognition of the patient as an epistemic agent or ‘knower’. While patients are increasingly acknowledged as carriers of values and preferences, it seems more challenging to acknowledge them as carriers of important causal information. In contrast, the science of pharmacovigilance depends on patient testimonies as valuable sources of causal evidence. This incompatibility can give rise to cases of what has been called participatory epistemic injustice. We analyse the (...) testimony of a chronic pain patient and co-author of this article, Christine. Christine gives an auto-ethnographic account of her interactions with healthcare professionals trying to find the right pharmacological treatment for her condition. Through the analysis of her own story, she identifies some relevant themes for the epistemic interaction between healthcare professionals and chronic pain patients. We argue that such epistemic interactions are increasingly shaped by EBM and its conception of causality, which devalues patient subjective testimonies and emphasises statistical evidence. We conclude that outlier patients face an inherent risk of being left vulnerable to participatory epistemic injustice, particularly regarding the discovery of novel, rare adverse effects of medicines. (shrink)

The underreporting of suspected adverse drug reactions remains a primary issue for contemporary post-market drug surveillance or ‘pharmacovigilance.’ Pharmacovigilance pioneer W.H.W. Inman argued that ‘deadly sins’ committed by clinicians are to blame for underreporting. Of these ‘sins,’ ignorance and lethargy are the most obvious and impactful in causing underreporting. However, recent analyses show that diffidence, insecurity, and indifference additionally play a major role. I aim to augment our understanding of diffidence, insecurity, and indifference by arguing these sins are underwritten by (...) value judgments arising via epistemic risk. I contend that ‘evidence-based’ medicine codifies these sins. (shrink)

Exploratory experiments are widely characterized as experiments that do not test hypotheses. Experiments that do test hypotheses are characterized as confirmatory experiments. Philosophers have pointed out that research programmes can be both confirmatory and exploratory. However, these definitions preclude single experiments being characterized as both exploratory and confirmatory; how can an experiment test and not test a hypothesis? Given the intuition that some experiments are exploratory, some are confirmatory, and some are both, a recharacterization of the relationship between exploratory and (...) confirmatory experimentation is needed. I discuss ‘phase IV’ trials to show what this recharacterization could look like. Phase IV trials can be exploratory and confirmatory insofar as they concurrently test hypotheses and explore for unforeseen phenomena. Even if it is uncontroversial that a single experiment can have multiple aims, the recharacterization of the relationship between exploratory and confirmatory experimentation is still required for these aims to be held together coherently. I offer an alternative characterization of the relationship between exploratory and confirmatory experimentation where the former remains a distinct kind of experimentation but is not characterized as non-hypothesis-testing. (shrink)

Side effects are ubiquitous in medicine and they often play a role in treatment decisions for patients and clinicians alike. Philosophers and health researchers often use side effects to illustrate issues with contemporary medical research and practice. However, technical definitions of ‘side effect’ differ among health authorities. Thus, determining the side effects of an intervention can differ depending on whose definition we assume. Here I review some of the common definitions of side effect and highlight their issues. In response, I (...) offer an account of side effects as jointly (i) unintended and (ii) effects due to the causal capacities or invariances of an intervention. I discuss (i) by examining the intentions or reasons behind therapeutic interventions, and I discuss (ii) by appealing to a manipulationist model of causation. The analysis here highlights that side effects are conceptually distinct from related outcomes like adverse events, adverse drug reactions, and placebo effects. The analysis also allows for reflection on the utility of ‘side effect’ as a technical term in medical research and practice. (shrink)

The thesis consists of an introduction and two papers. In the introduction a brief historical survey of empirical investigations into the effectiveness of medicinal interventions is given. Also, the main ideas of the EBM movement are presented. Both included papers can be viewed as investigations into the reasonableness of EBM and its hierarchies of evidence. Paper I: Typically, in a clinical trial patients with specified symptoms are given either of two or more predetermined treatments. Health endpoints in these groups are (...) then compared using statistical methods. Concerns have been raised, not least from adherents of so-called alternative medicine, that clinical trials do not offer reliable evidence for some types of treatment, in particular for highly individualized treatments, for example traditional homeopathy. It is argued that such concerns are unfounded. There are two minimal conditions related to the nature of the treatments that must be fulfilled for evaluability in a clinical trial, namely the proper distinction of the two treatment groups and the elimination of confounding variables or variations. These are delineated, and a few misunderstandings are corrected. It is concluded that the conditions do not preclude the testing of alternative medicine, whether individualized or not. Paper II: Traditionally, mechanistic reasoning has been assigned a negligible role in standard EBM literature, although some recent authors have argued for an upgrading. Even so, mechanistic reasoning that has received attention has almost exclusively been positive -- both in an epistemic sense of claiming that there is a mechanistic chain and in a health-related sense of there being claimed benefits for the patient. Negative mechanistic reasoning has been neglected, both in the epistemic and in the health-related sense. I distinguish three main types of negative mechanistic reasoning and subsume them under a new definition of mechanistic reasoning in the context of assessing medical interventions. Although this definition is wider than a previous suggestion in the literature, there are still other instances of reasoning that concern mechanisms but do not count as mechanistic reasoning. One of the three distinguished types, which is negative only in the health-related sense, has a corresponding positive counterpart, whereas the other two, which are epistemically negative, do not have such counterparts, at least not that are particularly interesting as evidence. Accounting for negative mechanistic reasoning in EBM is therefore partly different from accounting for positive mechanistic reasoning. Each negative type corresponds to a range of evidential strengths, and it is argued that there are differences with respect to the typical strengths. The variety of negative mechanistic reasoning should be acknowledged in EBM, and presents a serious challenge to proponents of so-called medical hierarchies of evidence. (shrink)

In this opening chapter, we review the literature on information quality. Our major aim is to introduce the issues, and trace some of the history of the debates, with a view to situating the chapters in this volume – whose authors come from different disciplines – to help make them accessible to readers with different backgrounds and expertise. We begin in this section by tracing some influential analyses of IQ in computer science. This is a useful basis for examining some (...) examples of developing work on IQ in section two. We look at some cases for applying IQ in section three, and conclude with some discussion points in section four. (shrink)

If well-designed, the results of a Randomised Clinical Trial can justify a causal claim between treatment and effect in the study population; however, additional information might be needed to carry over this result to another population. RCTs have been criticized exactly on grounds of failing to provide this sort of information Evidence, inference and enquiry. Oxford University Press, New York, 2011), as well as to black-box important details regarding the mechanisms underpinning the causal law instantiated by the RCT result. On (...) the other side, so-called In Silico Clinical Trials face the same criticisms addressed against standard modelling and simulation techniques, and cannot be equated to experiments Philosophy of molecular medicine: foundational issues in research and practice, Routledge, New York, 2017; Parker in Synthese 169:483–496, 2009; Parke in Philos Sci 81:516–536, 2014; Diez Roux in Am J Epidemiol 181:100–102, 2015 and related discussions in Frigg and Reiss in Synthese 169:593–613, 2009; Winsberg in Synthese 169:575–592, 2009; Beisbart and Norton in Int Stud Philos Sci 26:403–422, 2012). We undertake a formal analysis of both methods in order to identify their distinct contribution to causal inference in the clinical setting. Britton et al.’s study :E2098–E2105, 2013) on the impact of ion current variability on cardiac electrophysiology is used for illustrative purposes. We deduce that, by predicting variability through interpolation, ISCTs aid with problems regarding extrapolation of RCTs results, and therefore in assessing their external validity. Furthermore, ISCTs can be said to encode “thick” causal knowledge —as opposed to “thin” difference-making information inferred from RCTs. Hence, ISCTs and RCTs cannot replace one another but rather, they are complementary in that the former provide information about the determinants of variability of causal effects, while the latter can, under certain conditions, establish causality in the first place. (shrink)

Philosophical discussions on causal inference in medicine are stuck in dyadic camps, each defending one kind of evidence or method rather than another as best support for causal hypotheses. Whereas Evidence Based Medicine advocates the use of Randomised Controlled Trials and systematic reviews of RCTs as gold standard, philosophers of science emphasise the importance of mechanisms and their distinctive informational contribution to causal inference and assessment. Some have suggested the adoption of a pluralistic approach to causal inference, and an inductive (...) rather than hypothetico-deductive inferential paradigm. However, these proposals deliver no clear guidelines about how such plurality of evidence sources should jointly justify hypotheses of causal associations. We here develop such guidelines by first giving a philosophical analysis of the underpinnings of Hill’s viewpoints on causality. We then put forward an evidence-amalgamation framework adopting a Bayesian net approach to model causal inference in pharmacology for the assessment of harms. Our framework accommodates a number of intuitions already expressed in the literature concerning the EBM vs. pluralist debate on causal inference, evidence hierarchies, causal holism, relevance, and reliability. (shrink)

Background: Evidence suggesting adverse drug reactions often emerges unsystematically and unpredictably in form of anecdotal reports, case series and survey data. Safety trials and observational studies also provide crucial information regarding the (un-)safety of drugs. Hence, integrating multiple types of pharmacovigilance evidence is key to minimising the risks of harm. Methods: In previous work, we began the development of a Bayesian framework for aggregating multiple types of evidence to assess the probability of a putative causal link between drugs and side (...) effects. This framework arose out of a philosophical analysis of the Bradford Hill Guidelines. In this article, we expand the Bayesian framework and add “evidential modulators,” which bear on the assessment of the reliability of incoming study results. The overall framework for evidence synthesis, “E-Synthesis”, is then applied to a case study. Results: Theoretically and computationally, E-Synthesis exploits coherence of partly or fully independent evidence converging towards the hypothesis of interest (or of conflicting evidence with respect to it), in order to update its posterior probability. With respect to other frameworks for evidence synthesis, our Bayesian model has the unique feature of grounding its inferential machinery on a consolidated theory of hypothesis confirmation (Bayesian epistemology), and in allowing any data from heterogeneous sources (cell-data, clinical trials, epidemiological studies), and methods (e.g., frequentist hypothesis testing, Bayesian adaptive trials, etc.) to be quantitatively integrated into the same inferential framework. Conclusions: E-Synthesis is highly flexible concerning the allowed input, while at the same time relying on a consistent computational system, that is philosophically and statistically grounded. Furthermore, by introducing evidential modulators, and thereby breaking up the different dimensions of evidence (strength, relevance, reliability), E-Synthesis allows them to be explicitly tracked in updating causal hypotheses. (shrink)

This chapter addresses the problem of ranking available drugs in guideline development to support clinicians in their work. Based on a pragmatic approach to the notion of evidence and a hierarchical view on different kinds of evidence this chapter introduces a decision aid, HiDAD, which draws on the multi criteria decision making literature. This decision aid implements the wide-spread intuition that there are different kinds of evidence with varying degrees of importance by relying on a strict ordinal ordering of kinds (...) of evidence. In order to construct a ranking every pair of drugs is first compared separately on all kinds of evidence. Next, these quantitative comparisons are then aggregated into an overall comparison between drugs based on all the available evidence in a way which avoids that evidence of less importance is trumped by evidence of the higher levels. Finally, these overall comparisons are used to determine the final ranking of drugs which then informs the process of guideline writing. Properties, modifications and applicability of the decision aid HiDAD are discussed and assessed. (shrink)

In this paper we identify six theses that constitute core results of philosophical investigation into the nature of mechanisms, and of the role that the search for and identification of mechanisms play in the sciences. These theses represent the fruits of the body of research that is now often called New Mechanism. We concisely present the main arguments for these theses. In the literature, these arguments are scattered and often implicit. Our analysis can guide future research in many ways: it (...) provides critics of New Mechanism with clear targets, it can reduce misunderstandings, it can clarify differences of opinion among New Mechanists and it helps to define a research agenda for New Mechanists. (shrink)

Evidence-based policy has support in many areas of government and in public affairs more generally. In this paper we outline what evidence-based policy is, then we discuss its strengths and weaknesses. In particular, we argue that it faces a serious challenge to provide a plausible, over-arching account of evidence. We contrast evidence-based policy with evidence-based medicine, especially the role of evidence in assessing the effectiveness of medicines. The evidence required for policy decisions does not easily lend itself to randomized controlled (...) trials, nor, for that matter, being listed in a single all-purpose hierarchy. (shrink)

Traditionally, mechanistic reasoning has been assigned a negligible role in standard EBM literature, although some recent authors have argued for an upgrade. Even so, the mechanistic reasoning that has received attention has almost exclusively been positive—both in an epistemic sense of claiming that there is a mechanistic chain and in a health-related sense of there being claimed benefits for the patient. Negative mechanistic reasoning has been neglected, both in the epistemic and in the health-related sense. I distinguish three main types (...) of negative mechanistic reasoning and subsume them under a new definition of mechanistic reasoning in the context of assessing medical interventions. This definition is wider than a previous suggestion in the literature. Each negative type corresponds to a range of evidential strengths, and it is argued that there are differences with respect to typical evidential strengths. The variety of negative mechanistic reasoning should be acknowledged in EBM, and it presents a serious challenge to proponents of so-called medical hierarchies of evidence. (shrink)