This work has been selected by scholars as being culturally important and is part of the knowledge base of civilization as we know it. This work is in the public domain in the United States of America, and possibly other nations. Within the United States, you may freely copy and distribute this work, as no entity has a copyright on the body of the work. Scholars believe, and we concur, that this work is important enough to be preserved, reproduced, and (...) made generally available to the public. To ensure a quality reading experience, this work has been proofread and republished using a format that seamlessly blends the original graphical elements with text in an easy-to-read typeface. We appreciate your support of the preservation process, and thank you for being an important part of keeping this knowledge alive and relevant. (shrink)

This text provides a critique of the subjective Bayesian view of statistical inference, and proposes the author's own error-statistical approach as an alternative framework for the epistemology of experiment. It seeks to address the needs of researchers who work with statistical analysis.

Critics of the ideal of value‐free science often assume that they must reject the distinction between epistemic and nonepistemic values. I argue that this assumption is mistaken and that the distinction can be used to clarify and defend the argument from inductive risk, which challenges the value‐free ideal. I develop the idea that the characteristic feature of epistemic values is that they promote, either intrinsically or extrinsically, the attainment of truths. This proposal is shown to answer common objections to the (...) distinction and provide a principled basis for separating legitimate from illegitimate influences of nonepistemic values in scientific inference. *Received June 2009; revised September 2009. †To contact the author, please write to: 503 S. Kedzie Hall, Michigan State University, East Lansing, MI 48824‐1032; e‐mail: [email protected]. (shrink)

The interpretation of tests of a point null hypothesis against an unspecified alternative is a classical and yet unresolved issue in statistical methodology. This paper approaches the problem from the perspective of Lindley's Paradox: the divergence of Bayesian and frequentist inference in hypothesis tests with large sample size. I contend that the standard approaches in both frameworks fail to resolve the paradox. As an alternative, I suggest the Bayesian Reference Criterion: it targets the predictive performance of the null hypothesis in (...) future experiments; it provides a proper decision-theoretic model for testing a point null hypothesis and it convincingly accounts for Lindley's Paradox. (shrink)

Perfected science is but an idealization that provides a useful contrast to highlight the limited character of what we do and can attain. This lies at the core of various debates in the philosophy of science and Rescher’s discussion focuses on the question: how far could science go in principle—what are the theoretical limits on science? He concentrates on what science can discover, not what it should discover. He explores in detail the existence of limits or limitations on scientific inquiry, (...) especially those that, in principle, preclude the full realization of the aims of science, as opposed to those that relate to economic obstacles to scientific progress. Rescher also places his argument within the politics of the day, where "strident calls of ideological extremes surround us," ranging from the exaggeration that "science can do anything"—to the antiscientism that views science as a costly diversion we would be well advised to abandon. Rescher offers a middle path between these two extremes and provides an appreciation of the actual powers and limitations of science, not only to philosophers of science but also to a larger, less specialized audience. (shrink)

Despite the widespread use of key concepts of the Neyman–Pearson (N–P) statistical paradigm—type I and II errors, significance levels, power, confidence levels—they have been the subject of philosophical controversy and debate for over 60 years. Both current and long-standing problems of N–P tests stem from unclarity and confusion, even among N–P adherents, as to how a test's (pre-data) error probabilities are to be used for (post-data) inductive inference as opposed to inductive behavior. We argue that the relevance of error probabilities (...) is to ensure that only statistical hypotheses that have passed severe or probative tests are inferred from the data. The severity criterion supplies a meta-statistical principle for evaluating proposed statistical inferences, avoiding classic fallacies from tests that are overly sensitive, as well as those not sensitive enough to particular errors and discrepancies. Introduction and overview 1.1 Behavioristic and inferential rationales for Neyman–Pearson (N–P) tests 1.2 Severity rationale: induction as severe testing 1.3 Severity as a meta-statistical concept: three required restrictions on the N–P paradigm Error statistical tests from the severity perspective 2.1 N–P test T(): type I, II error probabilities and power 2.2 Specifying test T() using p-values Neyman's post-data use of power 3.1 Neyman: does failure to reject H warrant confirming H? Severe testing as a basic concept for an adequate post-data inference 4.1 The severity interpretation of acceptance (SIA) for test T() 4.2 The fallacy of acceptance (i.e., an insignificant difference): Ms Rosy 4.3 Severity and power Fallacy of rejection: statistical vs. substantive significance 5.1 Taking a rejection of H0 as evidence for a substantive claim or theory 5.2 A statistically significant difference from H0 may fail to indicate a substantively important magnitude 5.3 Principle for the severity interpretation of a rejection (SIR) 5.4 Comparing significant results with different sample sizes in T(): large n problem 5.5 General testing rules for T(), using the severe testing concept The severe testing concept and confidence intervals 6.1 Dualities between one and two-sided intervals and tests 6.2 Avoiding shortcomings of confidence intervals Beyond the N–P paradigm: pure significance, and misspecification tests Concluding comments: have we shown severity to be a basic concept in a N–P philosophy of induction? (shrink)

Published research findings are sometimes refuted by subsequent evidence, says Ioannidis, with ensuing confusion and disappointment.

This book brings together eleven case studies of inductive risk-the chance that scientific inference is incorrect-that range over a wide variety of scientific contexts and fields. The chapters are designed to illustrate the pervasiveness of inductive risk, assist scientists and policymakers in responding to it, and productively move theoretical discussions of the topic forward.

This book offers a philosophy for error-prone humans trying to understand messy systems in the real world.

It has been claimed that if statistical power and p-values are both used to measure the strength of our evidence for the null-hypothesis when the results of our tests are not significant, then they can also be used to derive inconsistent epistemic judgements as we compare two different experiments. Those problematic derivations are known as power approach paradoxes. The consensus is that we can avoid them if we abandon the idea that statistical power can measure the strength of our evidence. (...) In this paper however, I put forward a different solution. I argue that every power approach paradox rests on an equivocation on "strong evidence". The main idea is that we need to make a careful distinction between the evidence provided by the quality of the test and the evidence provided by the outcome of the test. Both provide different types of evidence and their respective strength are to be evaluated differently. (shrink)