WE AIM HERE to outline a theory of evidence for use. More specifically we lay foundations for a guide for the use of evidence in predicting policy effectiveness in situ, a more comprehensive guide than current standard offerings, such as the Maryland rules in criminology, the weight of evidence scheme of the International Agency for Research on Cancer (IARC), or the US ‘What Works Clearinghouse’. The guide itself is meant to be well-grounded but at the same time to give practicable (...) advice, that is, advice that can be used by policy-makers not expert in the natural and social sciences, assuming they are well-intentioned and have a reasonable but limited amount of time and resources available for searching out evidence and deliberating. (shrink)

The claims of randomized controlled trials to be the gold standard rest on the fact that the ideal RCT is a deductive method: if the assumptions of the test are met, a positive result implies the appropriate causal conclusion. This is a feature that RCTs share with a variety of other methods, which thus have equal claim to being a gold standard. This article describes some of these other deductive methods and also some useful non-deductive methods, including the hypothetico-deductive method. (...) It argues that with all deductive methods, the benefit that the conclusions follow deductively in the ideal case comes with a great cost: narrowness of scope. This is an instance of the familiar trade-off between internal and external validity. RCTs have high internal validity but the formal methodology puts severe constraints on the assumptions a target population must meet to justify exporting a conclusion from the test population to the target. The article reviews one such set of assumptions to show the kind of knowledge required. The overall conclusion is that to draw causal inferences about a target population, which method is best depends case-by-case on what background knowledge we have or can come to obtain. There is no gold standard. (shrink)

Degrees of belief; Dempster's rule of combination; Simple and separable support functions; The weights of evidence; Compatible frames of discernment; Support functions; The discernment of evidence; Quasi support functions; Consonance; Statistical evidence; The dual nature of probable reasoning.

Dr Edwards' stimulating and provocative book advances the thesis that the appropriate axiomatic basis for inductive inference is not that of probability, with its addition axiom, but rather likelihood - the concept introduced by Fisher as a measure of relative support amongst different hypotheses. Starting from the simplest considerations and assuming no more than a modest acquaintance with probability theory, the author sets out to reconstruct nothing less than a consistent theory of statistical inference in science.

What is required for something to be evidence for a hypothesis? In this fascinating, elegantly written work, distinguished philosopher of science Peter Achinstein explores this question, rejecting typical philosophical and statistical theories of evidence. He claims these theories are much too weak to give scientists what they want--a good reason to believe--and, in some cases, they furnish concepts that mistakenly make all evidential claims a priori. Achinstein introduces four concepts of evidence, defines three of them by reference to "potential" evidence, (...) and characterizes the latter using a novel epistemic interpretation of probability. The resulting theory is then applied to philosophical and historical issues. Solutions are provided to the "grue," "ravens," "lottery," and "old-evidence" paradoxes, and to a series of questions. These include whether explanations or predictions furnish more evidential weight, whether individual hypotheses or entire theoretical systems can receive evidential support, what counts as a scientific discovery, and what sort of evidence is required for it. The historical questions include whether Jean Perrin had non-circular evidence for the existence of molecules, what type of evidence J. J. Thomson offered for the existence of the electron, and whether, as is usually supposed, he really discovered the electron. Achinstein proposes answers in terms of the concepts of evidence introduced. As the premier book in the fabulous new series Oxford Studies in Philosophy of Science, this volume is essential for philosophers of science and historians of science, as well as for statisticians, scientists with philosophical interests, and anyone curious about scientific reasoning. (shrink)

The claims of RCTs to be the gold standard rest on the fact that the ideal RCT is a deductive method: if the assumptions of the test are met, a positive result implies the appropriate causal conclusion. This is a feature that RCTs share with a variety of other methods, which thus have equal claim to being a gold standard. This paper describes some of these other deductive methods and also some useful non-deductive methods, including the hypothetico-deductive method. It argues (...) that with all deductive methods, the benefit that the conclusions follow deductively in the ideal case comes with a great cost: narrowness of scope. This is an instance of the familiar trade-off between internal and external validity. RCTs have high internal validity but the formal methodology puts severe constraints on the assumptions a target population must meet to justify exporting a conclusion from the test population to the target. The paper reviews one such set of assumptions to show the kind of knowledge required. The overall conclusion is that to draw causal inferences about a target population, which method is best depends case-by-case on what background knowledge we have or can come to obtain. There is no gold standard. (shrink)

How should the concept of evidence be understood? And how does the concept of evidence apply to the controversy about creationism as well as to work in evolutionary biology about natural selection and common ancestry? In this rich and wide-ranging book, Elliott Sober investigates general questions about probability and evidence and shows how the answers he develops to those questions apply to the specifics of evolutionary biology. Drawing on a set of fascinating examples, he analyzes whether claims about intelligent design (...) are untestable; whether they are discredited by the fact that many adaptations are imperfect; how evidence bears on whether present species trace back to common ancestors; how hypotheses about natural selection can be tested, and many other issues. His book will interest all readers who want to understand philosophical questions about evidence and evolution, as they arise both in Darwin's work and in contemporary biological research. (shrink)

An astonishing volume and diversity of evidence is available for many hypotheses in the biomedical and social sciences. Some of this evidence—usually from randomized controlled trials (RCTs)—is amalgamated by meta-analysis. Despite the ongoing debate regarding whether or not RCTs are the ‘gold-standard’ of evidence, it is usually meta-analysis which is considered the best source of evidence: meta-analysis is thought by many to be the platinum standard of evidence. However, I argue that meta-analysis falls far short of that standard. Different meta-analyses (...) of the same evidence can reach contradictory conclusions. Meta-analysis fails to provide objective grounds for intersubjective assessments of hypotheses because numerous decisions must be made when performing a meta-analysis which allow wide latitude for subjective idiosyncrasies to influence its outcome. I end by suggesting that an older tradition of evidence in medicine—the plurality of reasoning strategies appealed to by the epidemiologist Sir Bradford Hill—is a superior strategy for assessing a large volume and diversity of evidence. (shrink)

This text provides a critique of the subjective Bayesian view of statistical inference, and proposes the author's own error-statistical approach as an alternative framework for the epistemology of experiment. It seeks to address the needs of researchers who work with statistical analysis.

One of Ian Hacking's earliest publications, this book showcases his early ideas on the central concepts and questions surrounding statistical reasoning. He explores the basic principles of statistical reasoning and tests them, both at a philosophical level and in terms of their practical consequences for statisticians. Presented in a fresh twenty-first-century series livery, and including a specially commissioned preface written by Jan-Willem Romeijn, illuminating its enduring importance and relevance to philosophical enquiry, Hacking's influential and original work has been revived for (...) a new generation of readers. (shrink)

Philosophical discussions on causal inference in medicine are stuck in dyadic camps, each defending one kind of evidence or method rather than another as best support for causal hypotheses. Whereas Evidence Based Medicine advocates the use of Randomised Controlled Trials and systematic reviews of RCTs as gold standard, philosophers of science emphasise the importance of mechanisms and their distinctive informational contribution to causal inference and assessment. Some have suggested the adoption of a pluralistic approach to causal inference, and an inductive (...) rather than hypothetico-deductive inferential paradigm. However, these proposals deliver no clear guidelines about how such plurality of evidence sources should jointly justify hypotheses of causal associations. We here develop such guidelines by first giving a philosophical analysis of the underpinnings of Hill’s viewpoints on causality. We then put forward an evidence-amalgamation framework adopting a Bayesian net approach to model causal inference in pharmacology for the assessment of harms. Our framework accommodates a number of intuitions already expressed in the literature concerning the EBM vs. pluralist debate on causal inference, evidence hierarchies, causal holism, relevance, and reliability. (shrink)

This chapter advances a contextual view of evidence, through a reconsideration of Hempel's paradox of confirmation. The initial view regarding Hempel's paradox is that a non-black non-raven does confirm ‘All ravens are black’, but only in certain contexts. The chapter begins by reformulating the paradox as a puzzle about how the same entity can have variable evidential values for a given proposition. It then offers a three-stage solution to the reformulated paradox. The situation makes better sense when we reach a (...) deeper propositional understanding of evidence, recognising that each entity can be represented in multiple observational propositions. Some anti-contextualist intuitions can be defused by distinguishing two different senses of the word ‘evidence’, one applying to objects or events and the other applying to propositions; only the latter is relevant to inference. A fuller understanding comes from analysing the constitution and use of evidence in terms of epistemic action. These reflections on the ravens paradox suggest a general philosophical framework more suitable for understanding the function of evidence in scientific and everyday practices. (shrink)

The claims of RCTs to be the gold standard rest on the fact that the ideal RCT is a deductive method: if the assumptions of the test are met, a positive result implies the appropriate causal conclusion. This is a feature that RCTs share with a variety of other methods, which thus have equal claim to being a gold standard. This paper describes some of these other deductive methods and also some useful non-deductive methods, including the hypothetico-deductive method. It argues (...) that with all deductive methods, the benefit that the conclusions follow deductively in the ideal case comes with a great cost: narrowness of scope. This is an instance of the familiar trade-off between internal and external validity. RCTs have high internal validity but the formal methodology puts severe constraints on the assumptions a target population must meet to justify exporting a conclusion from the test population to the target. The paper reviews one such set of assumptions to show the kind of knowledge required. The overall conclusion is that to draw causal inferences about a target population, which method is best depends case-by-case on what background knowledge we have or can come to obtain. There is no gold standard. (shrink)