This text provides a critique of the subjective Bayesian view of statistical inference, and proposes the author's own error-statistical approach as an alternative framework for the epistemology of experiment. It seeks to address the needs of researchers who work with statistical analysis.

The text is the Russian translation of W. Whewell’s work “Novum Organon Renovatum” (Preface and Book I Aphorisms concerning ideas), which is the third edition of the second volume of his major work “The philosophy of the Inductive Sciences founded upon their History”. In the text, W. Whewell proposes his theory of scientific method and classification of the necessary scientific ideas as a basis, from where every particular scientific discipline derives. By adopting the structure of the notorious Francis Bacon’s “Novum (...) Organon”, Whewell reverses the order of scientific genesis, opposing himself to inductivism – the most influential philosophical theory of his time. (shrink)

Theorizing in ecology and evolution often proceeds via the construction of multiple idealized models. To determine whether a theoretical result actually depends on core features of the models and is not an artifact of simplifying assumptions, theorists have developed the technique of robustness analysis, the examination of multiple models looking for common predictions. A striking example of robustness analysis in ecology is the discovery of the Volterra Principle, which describes the effect of general biocides in predator-prey systems. This paper details (...) the discovery of the Volterra Principle and the demonstration of its robustness. It considers the classical ecology literature on robustness and introduces two individual-based models of predation, which are used to further analyze the Volterra Principle. The paper also introduces a distinction between parameter robustness, structural robustness, and representational robustness, and demonstrates that the Volterra Principle exhibits all three kinds of robustness. *Received September 2006; revised May 2007. ‡Earlier versions of this paper were presented at the Australasian Association of Philosophy, the London School of Economics, and the University of Bristol. The authors wish to thank those audiences as well as Patrick Forber, Ken Waters, Deena Skolnick Weisberg, Uri Wilensky, and Bill Wimsatt for many helpful comments. Special thanks to Giacomo Sillari for his assistance in translating Volterra's original paper and his insightful thoughts about Volterra's aims and methods. Some of the research in this paper was supported by NSF grant SES-0620887 to MW. †To contact the authors, please write to: Michael Weisberg, Department of Philosophy, University of Pennsylvania, 433 Logan Hall, Philadelphia, PA 19104; e-mail: [email protected]; Kenneth Reisman, Pluribo, Inc., 100 Park Avenue, Suite 1600, New York, NY 10017; e-mail: [email protected]. (shrink)

Some accounts of evidence regard it as an objective relationship holding between data and hypotheses, perhaps mediated by a testing procedure. Mayo’s error-statistical theory of evidence is an example of such an approach. Such a view leaves open the question of when an epistemic agent is justified in drawing an inference from such data to a hypothesis. Using Mayo’s account as an illustration, I propose a framework for addressing the justification question via a relativized notion, which I designate security , (...) meant to conceptualize practices aimed at the justification of inferences from evidence. I then show how the notion of security can be put to use by showing how two quite different theoretical approaches to model criticism in statistics can both be viewed as strategies for securing claims about statistical evidence. (shrink)

Many philosophers have claimed that evidence for a theory is better when multiple independent tests yield the same result, i.e., when experimental results are robust. Little has been said about the grounds on which such a claim rests, however. The present essay presents an analysis of the evidential value of robustness that rests on the fallibility of assumptions about the reliability of testing procedures and a distinction between the strength of evidence and the security of an evidence claim. Robustness can (...) enhance the security of an evidence claim either by providing what I call second-order evidence, or by providing back-up evidence for a hypothesis. (shrink)

This article identifies conditions under which robust predictive modeling results have special epistemic significance---related to truth, confidence, and security---and considers whether those conditions hold in the context of present-day climate modeling. The findings are disappointing. When today’s climate models agree that an interesting hypothesis about future climate change is true, it cannot be inferred---via the arguments considered here anyway---that the hypothesis is likely to be true or that scientists’ confidence in the hypothesis should be significantly increased or that a claim (...) to have evidence for the hypothesis is now more secure. (shrink)

To study Earth’s climate, scientists now use a variety of computer simulation models. These models disagree in some of their assumptions about the climate system, yet they are used together as complementary resources for investigating future climatic change. This paper examines and defends this use of incompatible models. I argue that climate model pluralism results both from uncertainty concerning how to best represent the climate system and from difficulties faced in evaluating the relative merits of complex models. I describe how (...) incompatible climate models are used together in ‘multi-model ensembles’ and explain why this practice is reasonable, given scientists’ inability to identify a ‘best’ model for predicting future climate. Finally, I characterize climate model pluralism as involving both an ontic competitive pluralism and a pragmatic integrative pluralism. (shrink)

Climate change fingerprint studies investigate the causes of recent climate change. I argue that these studies have much in common with Steel’s (2008) streamlined comparative process tracing, illustrating a mechanisms-based approach to extrapolation in which the mechanisms of interest are simulated rather than physically instantiated. I then explain why robustness and variety-of-evidence considerations turn out to be important for understanding the evidential value of climate change fingerprint studies.

Modelers often rely on robustness analysis, the search for predictions common to several independent models. Robustness analysis has been characterized and championed by Richard Levins and William Wimsatt, who see it as central to modern theoretical practice. The practice has also been severely criticized by Steven Orzack and Elliott Sober, who claim that it is a nonempirical form of confirmation, effective only under unusual circumstances. This paper addresses Orzack and Sober's criticisms by giving a new account of robustness analysis and (...) showing how the practice can identify robust theorems. Once the structure of robust theorems is clearly articulated, it can be shown that such theorems have a degree of confirmation, despite the lack of direct empirical evidence for their truth. (shrink)

Today's climate models are supported in a couple of ways that receive little attention from philosophers or climate scientists. In addition to standard 'model fit', wherein a model's simulation is compared to observational data, there is an additional type of confirmation available through the variety of instances of model fit. When a model performs well at fitting first one variable and then another, the probability of the model under some standard confirmation function, say, likelihood, goes up more than under each (...) individual case of fit alone. Thus, two instances of fit of distinct variables of a global climate model using distinct data sets considered collectively will provide stronger evidence for a model than either one of the instances considered individually. This has consequences for model robustness. Sets of models that produce robust results will, if their assumptions vary enough and they each are observationally sound, provide reasons to endorse common structures found in those models. Finally, independent empirical support for aspects and assumptions of the model provides an additional confirmational virtue for climate models, contrary to what is implied by some current philosophical writing on this topic. (shrink)

Recent philosophical attention to climate models has highlighted their weaknesses and uncertainties. Here I address the ways that models gain support through observational data. I review examples of model fit, variety of evidence, and independent support for aspects of the models, contrasting my analysis with that of other philosophers. I also investigate model robustness, which often emerges when comparing climate models simulating the same time period or set of conditions. Starting from Michael Weisberg’s analysis of robustness, I conclude that his (...) approach involves a version of reasoning from variety of evidence, enabling this robustness to be a confirmatory virtue.. (shrink)

The United Kingdom Climate Impacts Program’s UKCP09 project makes high-resolution forecasts of climate during the 21st century using state of the art global climate models. The aim of this paper is to introduce and analyze the methodology used and then urge some caution. Given the acknowledged systematic errors in all current climate models, treating model outputs as decision relevant probabilistic forecasts can be seriously misleading. This casts doubt on our ability, today, to make trustworthy, high-resolution predictions out to the end (...) of this century. (shrink)

This review of Wimsatt’s book Re-engineering Philosophy for Limited Beings focuses on analysing his use of robustness, a central theme in the book. I outline a family of three distinct conceptions of robustness that appear in the book, and look at the different roles they play. I briefly examine what underwrites robustness, and suggest that further work is needed to clarify both the structure of robustness and the relation between it various conceptions.