Evidence-Based Medicine is a relatively new movement that seeks to put clinical med- icine on a firmer scientific footing. I take it as uncontroversial that medical practice should be based on best evidence-the interesting questions concern the details. This paper tries to move towards a coherent and unified account of best evidence in medicine, by exploring in particular the EBM position on RCTs (randomized controlled trials).

Causal pluralism can be defended not only in respect to causal concepts and methodological guidelines, but also at the finer-grained level of causal inference from a particular source of evidence for causation. An argument for this last variety of pluralism is made based on an analysis of causal inference from randomized experiments (RCTs). Here, the causal interpretation of a statistically significant association can be established via multiple paths of reasoning, each relying on different assumptions and providing distinct elements of information (...) in favour of a causal interpretation. (shrink)

Theory of illness causation is an important issue in all biomedical sciences, and solid etiological explanations are needed in order to develop therapeutic approaches in medicine and preventive interventions in public health. Until now, the literature about the theoretical underpinnings of illness causation research has been scarce and fragmented, and lacking a convenient summary. This interdisciplinary book provides a convenient and accessible distillation of the current status of research into this developing field, and adds a personal flavor to the discussion (...) by proposing the etiological stance as a comprehensive approach to identify modifiable causes of illness. (shrink)

Current debates surrounding the virtues and shortcomings of randomization are symptomatic of a lack of appreciation of the fact that causation can be inferred by two distinct inference methods, each requiring its own, specific experimental design. There is a non-statistical type of inference associated with controlled experiments in basic biomedical research; and a statistical variety associated with randomized controlled trials in clinical research. I argue that the main difference between the two hinges on the satisfaction of the comparability requirement, which (...) is in turn dictated by the nature of the objects of study, namely homogeneous or heterogeneous populations of biological systems. Among other things, this entails that the objection according to which randomized experiments fail to provide better evidence for causation because randomization cannot guarantee comparability is mistaken. (shrink)

The replication crisis has caused researchers to distinguish between exact replications, which duplicate all aspects of a study that could potentially affect the results, and direct replications, which duplicate only those aspects of the study that are thought to be theoretically essential to reproduce the original effect. The replication crisis has also prompted researchers to think more carefully about the possibility of making Type I errors when rejecting null hypotheses. In this context, the present article considers the utility of two (...) types of Type I error probability: the Neyman–Pearson long run Type I error rate and the Fisherian sample-specific Type I error probability. It is argued that the Neyman–Pearson Type I error rate is inapplicable in social science because it refers to a long run of exact replications, and social science deals with irreversible units that make exact replications impossible. Instead, the Fisherian sample-specific Type I error probability is recommended as a more meaningful way to conceptualize false positive results in social science because it can be applied to each sample-specific decision about rejecting the same substantive null hypothesis in a series of direct replications. It is concluded that the replication crisis may be partly due to researchers’ unrealistic expectations about replicability based on their consideration of the Neyman–Pearson Type I error rate across a long run of exact replications. (shrink)

"Correlation is not causation" is one of the mantras of the sciences—a cautionary warning especially to fields like epidemiology and pharmacology where the seduction of compelling correlations naturally leads to causal hypotheses. The standard view from the epistemology of causation is that to tell whether one correlated variable is causing the other, one needs to intervene on the system—the best sort of intervention being a trial that is both randomized and controlled. In this paper, we argue that some purely correlational (...) data contains information that allows us to draw causal inferences: statistical noise. Methods for extracting causal knowledge from noise provide us with an alternative to randomized controlled trials that allows us to reach causal conclusions from purely correlational data. (shrink)

Experimental design is one aspect of a scientific method. A well-designed, properly conducted experiment aims to control variables in order to isolate and manipulate causal effects and thereby maximize internal validity, support causal inferences, and guarantee reliable results. Traditionally employed in the natural sciences, experimental design has become an important part of research in the social and behavioral sciences. Experimental methods are also endorsed as the most reliable guides to policy effectiveness. Through a discussion of some of the central concepts (...) associated with experimental design, including controlled variation and randomization, this chapter will provide a summary of key ethical issues that tend to arise in experimental contexts. In addition, by exploring assumptions about the nature of causation and by analyzing features of causal relationships, systems, and inferences in social contexts, this chapter will summarize the ways in which experimental design can undermine the integrity of not only social and behavioral research but policies implemented on the basis of such research. (shrink)

It is sometimes thought that randomized study group allocation is uniquely proficient at producing comparison groups that are evenly balanced for all confounding causes. Philosophers have argued that in real randomized controlled trials this balance assumption typically fails. But is the balance assumption an important ideal? I run a thought experiment, the CONFOUND study, to answer this question. I then suggest a new account of causal inference in ideal and real comparative group studies that helps clarify the roles of confounding (...) variables and randomization. 1Confounders and Causes2The Balance Assumption3The CONFOUND Study 3.1CONFOUND 13.2CONFOUND 24Disjunction C and the Ideal Study 4.1The ultimate ‘other cause’: C4.2The ideal comparative group study4.3Required conditions for causal inference5Confounders as Causes, Confounders as Correlates6Summary. (shrink)

Cancer research is experiencing ‘paradigm instability’, since there are two rival theories of carcinogenesis which confront themselves, namely the somatic mutation theory and the tissue organization field theory. Despite this theoretical uncertainty, a huge quantity of data is available thanks to the improvement of genome sequencing techniques. Some authors think that the development of new statistical tools will be able to overcome the lack of a shared theoretical perspective on cancer by amalgamating as many data as possible. We think instead (...) that a deeper understanding of cancer can be achieved by means of more theoretical work, rather than by merely accumulating more data. To support our thesis, we introduce the analytic view of theory development, which rests on the concept of plausibility, and make clear in what sense plausibility and probability are distinct concepts. Then, the concept of plausibility is used to point out the ineliminable role played by the epistemic subject in the development of statistical tools and in the process of theory assessment. We then move to address a central issue in cancer research, namely the relevance of computational tools developed by bioinformaticists to detect driver mutations in the debate between the two main rival theories of carcinogenesis. Finally, we briefly extend our considerations on the role that plausibility plays in evidence amalgamation from cancer research to the more general issue of the divergences between frequentists and Bayesians in the philosophy of medicine and statistics. We argue that taking into account plausibility-based considerations can lead to clarify some epistemological shortcomings that afflict both these perspectives. (shrink)

The standardised randomised clinical trial (RCT) has been exceedingly popular in medical research, economics, and practical policy making. Recently, RCTs have faced criticism. First, it has been argued by John Worrall that we cannot be certain that our sample is not atypical with regard to possible confounding factors. I will argue that at least in the case of medical research, we know enough about the relevant causal mechanisms to be justified to ignore a number of factors we have good reason (...) not to expect to be disruptive. I will also argue against an argument provided by Nancy Cartwright and Eileen Munro that RCTs should not be taken to deductively infer probabilistic causal claims, but ampliatively. The paper will end on a discussion of evidence hierarchies and a defence of the stance of evidence-based medicine that RCTs are the best available method to assess a treatment’s efficacy. (shrink)

We show that the common claim that internal validity should be understood as prior to external validity has, at least, three epistemologically problematic aspects: experimental artefacts, the implications of causal relations, and how the mechanism is measured. Each aspect demonstrates how important external validity is for the internal validity of the experimental result.

The present paper deals with the problem of evaluating empirical evidence for therapeutic decisions in medicine. The article discusses the views of Nancy Cartwright and John Worrall on the function that randomization plays in ascertaining causal relations with reference to the therapies applied. The main purpose of the paper is to present a general idea of alternative method of evaluating empirical evidence. The method builds on data analysis that makes use of rough set theory. The first attempts to apply the (...) method show that it is an interesting alternative to randomized controlled trials. (shrink)

These preprints were automatically compiled into a PDF from the collection of papers deposited in PhilSci-Archive in conjunction with the PSA 2012.

It is surely obvious that medicine, like any other rational activity, must be based on evidence. The interest is in the details: how exactly are the general principles of the logic of evidence to be applied in medicine? Focussing on the development, and current claims of the ‘Evidence-Based Medicine’ movement, this article raises a number of difficulties with the rationales that have been supplied in particular for the ‘evidence hierarchy’ and for the very special role within that hierarchy of randomized (...) controlled trials (and meta-analyses of the results of randomized controlled trials). The point is not at all to question the application of a scientific approach to evidence in medicine, but, on the contrary, to indicate a number of areas where philosophers of science can contribute to a proper implementation of exactly that scientific-evidential approach. (shrink)

Despite the consensus promoted by the evidence-based medicine framework, many authors continue to express doubts about the superiority of randomized controlled trials. This paper evaluates four objections targeting the legitimacy, feasibility, and extrapolation problems linked to the experimental practice of random allocation. I argue that random allocation is a methodologically sound and feasible practice contributing to the internal validity of controlled experiments dealing with heterogeneous populations. I emphasize, however, that random allocation is solely designed to ensure the validity of causal (...) inferences at the level of groups. By itself, random allocation cannot enhance test precision, doesn’t contribute to external validity, and limits the applicability of causal claims to individuals. (shrink)

The paper addresses charges of risk and loss aversion as well as of irrationality directed against the precautionary principle (PP), by providing an epistemic analysis of its specific role in the safety law system. In particular, I contend that: 1) risk aversion is not a form of irrational or biased behaviour; 2) both risk and loss aversion regard the form of the utility function, whereas PP rather regards the information on which to base the decision; 3) thus PP has formally (...) nothing to do with risk or loss aversion but rather with risk awareness; 4) PP removes a fictional construct in the legal system, according to which any hazard should be ignored and denied until it is scientifically proven; 5) the quandary originates in the tension between current methods of evidence evaluation, and the logic underlying PP which demands for a probabilistic epistemology. (shrink)

The problem of collecting, analyzing and evaluating evidence on adverse drug reactions (ADRs) is an example of the more general class of epistemological problems related to scientific inference and prediction, as well as a central problem of the health-care practice. Philosophical discussions have critically analysed the methodological pitfalls and epistemological implications of evidence assessment in medicine, however they have mainly focused on evidence of treatment efficacy. Most of this work is devoted to statistical methods of causal inference with a special (...) attention to the privileged role assigned to randomized controlled trials in Evidence Based Medicine. Regardless of whether the RCT’s privilege holds for efficacy assessment, it is nevertheless important to make a distinction between causal inference of intended and unintended effects, in that the unknowns at stake are heterogonous in the two contexts. This point has been emphasized by epidemiologists in the last decade. Their main focus is methodological, and regards the fact that bias and confounding do not affect studies on intended and unintended effects in the same way. However, deeper concerns ground the intuition for such a distinction; these are related to the constraints which we impose on evidence and their epistemological justification. My thesis is that such constraints ought to be understood to be different in the case of evidence for risk vs. benefit assessment. I present the recent debate on the causal association between acetaminophen and asthma in order to illustrate the point at issue. (shrink)

There are two important traditions in the philosophy of induction. According to one tradition, which has dominated for the last couple of centuries, inductive arguments are warranted by rules. Bayesianism is the most popular view within this tradition. Rules of induction provide functional accounts of inductive support, but no rule is universal; hence, no rule is by itself an accurate model of inductive support. According to another tradition, inductive arguments are not warranted by rules but by matters of fact. Norton’s (...) material theory of induction (MTI) is an influential view within this tradition. Norton’s MTI fails to provide an account of inductive support, but it provides a good account of inductive warrant that can help us define the domain of validity of each rule of induction. Despite their limitations, both approaches to induction are illuminating important aspects of how relations of inductive support work. In this article I present a hybrid theory of induction (HTI), in which I acknowledge and articulate the role of both rules and matters of fact in our understanding of inductive support. According to the HTI, rules of induction accurately describe relations of inductive support when they are warranted, and a rule of induction is warranted if the right facts about the matter of the induction obtain. Crucially, the HTI allows us to address the main challenges that each tradition faces while retaining their strengths, thus obtaining a functional and accurate account of inductive support. The HTI also provides a useful general framework to examine and understand induction, to make sense of how different rules of induction can coexist and to tackle some problems in epistemology. Moreover, the HTI allows us to clarify and resolve some current debates on induction, like the apparent divide between Norton and rule-based theorists. (shrink)

Philosophical discussions on causal inference in medicine are stuck in dyadic camps, each defending one kind of evidence or method rather than another as best support for causal hypotheses. Whereas Evidence Based Medicine advocates the use of Randomised Controlled Trials and systematic reviews of RCTs as gold standard, philosophers of science emphasise the importance of mechanisms and their distinctive informational contribution to causal inference and assessment. Some have suggested the adoption of a pluralistic approach to causal inference, and an inductive (...) rather than hypothetico-deductive inferential paradigm. However, these proposals deliver no clear guidelines about how such plurality of evidence sources should jointly justify hypotheses of causal associations. We here develop such guidelines by first giving a philosophical analysis of the underpinnings of Hill’s viewpoints on causality. We then put forward an evidence-amalgamation framework adopting a Bayesian net approach to model causal inference in pharmacology for the assessment of harms. Our framework accommodates a number of intuitions already expressed in the literature concerning the EBM vs. pluralist debate on causal inference, evidence hierarchies, causal holism, relevance, and reliability. (shrink)

In this paper I look at causality in the context of intervention research, and discuss some problems faced in the evaluation of causal hypotheses via interventions. I draw attention to a simple problem for evaluations that employ randomized controlled trials. The common alternative to randomized trials, the observational study, is shown to face problems of a similar nature. I then argue that these problems become especially acute in cases where the intervention is complex (i.e. that involves intervening in a complex (...) system). Finally, I consider and reject a possible resolution of the problem involving the simulation of complex interventions. The conclusion I draw from this is that we need to radically reframe the way we think about causal inference in complex intervention research. (shrink)

The evidence from randomized controlled trials (RCTs) is widely regarded as supplying the ‘gold standard’ in medicine—we may sometimes have to settle for other forms of evidence, but this is always epistemically second-best. But how well justified is the epistemic claim about the superiority of RCTs? This paper adds to my earlier (predominantly negative) analyses of the claims produced in favour of the idea that randomization plays a uniquely privileged epistemic role, by closely inspecting three related arguments from leading contributors (...) to the burgeoning field of probabilistic causality—Papineau, Cartwright and Pearl. It concludes that none of these further arguments supplies any practical reason for thinking of randomization as having unique epistemic power. IntroductionWhy the issue is of great practical importance—the ECMO casePapineau on the ‘virtues of randomization’Cartwright on causality and the ‘ideal’ randomized experimentPearl on randomization, nets and causesConclusion. (shrink)

This thesis analyses the use of 'Evidence-Based' methodologies of evidence assessment and intervention and policy design from medicine, and their use in sport and exercise science. It argues that problems exist with the application of Evidence-Based methodologies in sports science, meaning that the quality of evidence used to inform decision-making is lower than is often assumed. This thesis also offers realistic solutions to these problems, broadly arguing for the importance of taking evidence from mechanistic studies seriously, in addition to evidence (...) from RCTs. (shrink)

Evidence-Based Medicine is a relatively new movement that seeks to put clinical medicine on a firmer scientific footing. I take it as uncontroversial that medical practice should be based on best evidence—the interesting questions concern the details. This paper tries to move towards a coherent and unified account of best evidence in medicine, by exploring in particular the EBM position on RCTs.

In the biomedical, behavioural and social sciences, the leading method used to estimate causal effects is commonly randomised controlled trials (RCTs) that are generally viewed as both the source and justification of the most valid evidence. In studying the foundation and theory behind RCTs, the existing literature analyses important single issues and biases in isolation that influence causal outcomes in trials (such as randomisation, statistical probabilities and placebos). The common account of biased causal inference is described in a general way (...) in terms of probabilistic imbalances between trial groups. This paper expands the common account of causal bias by distinguishing between the range of biases arising between trial groups but also within one of the groups or across the entire sample during trial design, implementation and analysis. This is done by providing concrete examples from highly influential RCT studies. In going beyond the existing RCT literature, the paper provides a broader, practice-based account of causal bias that specifies the between-group, within-group and across-group biases that affect the estimated causal results of trials – impacting both the effect size and statistical significance. Within this expanded framework, we can better identify the range of different types of biases we face in practice and address the central question about the overall validity of the RCT method and its causal claims. A study can face several smaller biases (related simultaneously to a smaller sample, smaller estimated effect, greater unblinding etc.) that generally add up to greater aggregate bias. Though difficult to measure precisely, it is important to assess and provide information in studies on how much different sources of bias, combined, can explain the estimated causal effect. The RCT method is thereby often the best we have to inform our policy decisions – and the evidence is strengthened when combined with multiple studies and other methods. Yet there is room for continually improving trials and identifying ways to reduce biases they face and to increase their overall validity. Implications are discussed. (shrink)

Hierarchies of evidence are an important and influential tool for appraising evidence in medicine. In recent years, hierarchies have been formally adopted by organizations including the Cochrane Collaboration [1], NICE [2,3], the WHO [4], the US Preventive Services Task Force [5], and the Australian NHMRC [6,7]. The development of such hierarchies has been regarded as a central part of Evidence-Based Medicine, a movement within healthcare which prioritises the use of epidemiological evidence such as that provided by Randomised Controlled Trials. Philosophical (...) work on the methodology of medicine has so far mostly focused on claims about the superiority of RCTs, and hence has largely neglected the questions of what hierarchies are, what assumptions they require, and how they affect clinical practice. This thesis shows that there is great variation in the hierarchies defended and in the interpretations they are, and can be, given. The interpretative assumptions made in using hierarchies are crucial to the content and defensibility of the underlying philosophical commitments concerning evidence and medical practice. Once this variation is been identified, it becomes clear that the little philosophical work that has been done so far affects only some hierarchies, under some interpretations. Modest interpretations offered by La Caze [11], conditional hierarchies like GRADE [12-14], and heuristic approaches such as that defended by Howick et al. [15,16] all survive previous philosophical criticism. This thesis extends previous criticisms by arguing that modest interpretations are so weak as to be unhelpful for clinical practice; that GRADE and similar conditional models omit clinically relevant information, such as information about variation in treatments’ effects and the causes of different responses to therapy; and that heuristic approaches lack the necessary empirical support. The conclusion is that hierarchies in general embed untenable philosophical assumptions: principally that information about average treatment effects backed by high-quality evidence can justify strong recommendations, and that the impact of evidence from individual studies can and should be appraised in isolation. Hierarchies are a poor basis for the application of evidence in clinical practice. The Evidence-Based Medicine movement should move beyond them and explore alternative tools for appraising the overall evidence for therapeutic claims. (shrink)

The problem of collecting, analyzing and evaluating evidence on adverse drug reactions (ADRs) is an example of the more general class of epistemological problems related to scientific inference and prediction, as well as a central problem of the health-care practice. Philosophical discussions have critically analysed the methodological pitfalls and epistemological implications of evidence assessment in medicine, however they have mainly focused on evidence of treatment efficacy. Most of this work is devoted to statistical methods of causal inference with a special (...) attention to the privileged role assigned to randomized controlled trials in Evidence Based Medicine. Regardless of whether the RCT’s privilege holds for efficacy assessment, it is nevertheless important to make a distinction between causal inference of intended and unintended effects, in that the unknowns at stake are heterogonous in the two contexts. This point has been emphasized by epidemiologists in the last decade. Their main focus is methodological, and regards the fact that bias and confounding do not affect studies on intended and unintended effects in the same way. However, deeper concerns ground the intuition for such a distinction; these are related to the constraints which we impose on evidence and their epistemological justification. My thesis is that such constraints ought to be understood to be different in the case of evidence for risk vs. benefit assessment. I present the recent debate on the causal association between acetaminophen and asthma in order to illustrate the point at issue. (shrink)

Semmelweis’s work predates the discovery of the power of randomization in medicine by almost a century. Although Semmelweis would not have consciously used a randomized controlled trial (RCT), some features of his material—the allocation of patients to the first and second clinics—did involve what was in fact a randomization, though this was not realised at the time. This article begins by explaining why Semmelweis’s methodology, nevertheless, did not amount to the use of a RCT. It then shows why it is (...) descriptively and normatively interesting to compare what he did with the modern approach using RCTs. The argumentation centres on causal inferences and the contrast between Semmelweis’s causal concept and that deployed by many advocates of RCTs. It is argued that Semmelweis’s approach has implications for matters of explanation and medical practice. (shrink)

Philosophical discussions have critically analysed the methodological pitfalls and epistemological implications of evidence assessment in medicine, however they have mainly focused on evidence of treatment efficacy. Most of this work is devoted to statistical methods of causal inference with a special attention to the privileged role assigned to randomized controlled trials (RCTs) in evidence based medicine. Regardless of whether the RCT’s privilege holds for efficacy assessment, it is nevertheless important to make a distinction between causal inference of intended and unintended (...) effects, in that the unknowns at stake are heterogonous in the two contexts. However, although “lower level” evidence is increasingly acknowledged to be a valid source of information contributory to assessing the risk profile of medications on theoretical or empirical grounds, current practices have difficulty in assigning a precise epistemic status to this kind of evidence because they are more or less implicitly parasitic on the (statistical) methods developed to test drug efficacy. My thesis is that (1) “lower level” evidence is justified on distinct grounds and at different conditions depending on the different epistemologies which one wishes to endorse, in that each impose different constraints on the methods we adopt to collect and evaluate evidence; (2) such constraints ought to be understood to be different in the case of evidence for risk versus benefit assessment for a series of reasons which I will illustrate on the basis of the recent debate on the causal association between acetaminophen (a.k.a. paracetamol) and asthma. (shrink)

The paper addresses charges of risk and loss aversion as well as of irrationality directed against the precautionary principle, by providing an epistemic analysis of its specific role in the safety law system. In particular, I contend that: 1) risk aversion is not a form of irrational or biased behaviour; 2) both risk and loss aversion regard the form of the utility function, whereas PP rather regards the information on which to base the decision; 3) thus PP has formally nothing (...) to do with risk or loss aversion but rather with risk awareness; 4) PP removes a fictional construct in the legal system, according to which any hazard should be ignored and denied until it is scientifically proven; 5) the quandary originates in the tension between current methods of evidence evaluation, and the logic underlying PP which demands for a probabilistic epistemology. (shrink)

Resumen En este artículo propongo un análisis crítico de varias tendencias filosóficas contrarias al uso de la noción de verdad en el ámbito epistemológico, especialmente la de Rorty. En particular, sostengo que la verdad es un concepto clave para el estudio del conocimiento, especialmente el científico, en cuanto toma una forma concisa en los procedimientos experimentales de carácter probatorio-empírico. Gracias a este enfoque, busco socavar varias tesis de los enfoques de la ‘posverdad’ por medio del uso de un conjunto de (...) procedimientos científicos de obtención de evidencias en varios campos vinculados a la disciplina práctica de la medicina.In thispaper, I present a critical analysis of several philosophical tendencies that go against the use of the notion of truth in epistemology, especially Rorty’s one. Particularly, I claim that truth is a key conceptfor the study of knowledge, especially the scientific knowledge, as it takes a concise form through the experimentalprocedures for eliciting evidences. With the help of this analysis, I seek to undermine some ‘post-truth’ theses by means of analyying some scientific procedures to get evidences in severalfields related to the practical discipline of medicine. (shrink)

Evidence, as viewed through the lens of statistical significance, is not always as it appears! In the investigation of clinical research findings arising from statistical analyses, a fundamental initial step for the emerging fraud detective is to retrieve the source data for cross-examination with the study data. Recognizing that source data are not always forthcoming and that, realistically speaking, the investigator may be uninitiated in fraud detection and investigation, this paper will highlight some key methodological procedures for providing a sounder (...) evidence base for withdrawing from a study on grounds of integrity. The promotion of patient safety is paramount. However, there is a broader rationale for disseminating these ideas. This includes empowering researchers to optimize their personal integrity, make informed choices regarding membership of future research collaborations and successfully voice their concerns to journal editors, particularly where a conflict of interests can render such dialogues particularly difficult. Recommendations will be supported by topical case studies and practical steps involving data exploration, testing of baseline data and application of Benford’s Law. While this paper has a clinical focus, the advice provided is transferrable to a wide range of multidisciplinary research settings outside of Medicine. (shrink)

Why do classic biostatistical studies, alleged to provide causal explanations of effects, often fail? This article argues that in statistics-relevant areas of biology—such as epidemiology, population biology, toxicology, and vector ecology—scientists often misunderstand epistemic constraints on use of the statistical-significance rule (SSR). As a result, biologists often make faulty causal inferences. The paper (1) provides several examples of faulty causal inferences that rely on tests of statistical significance; (2) uncovers the flawed theoretical assumptions, especially those related to randomization, that likely (...) contribute to flawed biostatistics; (3) re-assesses the three classic (SSR-warrant, avoiding-selection-bias, and avoiding-confounders) arguments for using SSR only with randomization; and (4) offers five new reasons for biologists to use SSR only with randomized experiments. (shrink)