When scientists seek further confirmation of their results, they often attempt to duplicate the results using diverse means. To the extent that they are successful in doing so, their results are said to be robust. This paper investigates the logic of such "robustness analysis" [RA]. The most important and challenging question an account of RA can answer is what sense of evidential diversity is involved in RAs. I argue that prevailing formal explications of such diversity are unsatisfactory. I propose a (...) unified, explanatory account of diversity in RAs. The resulting account is, I argue, truer to actual cases of RA in science; moreover, this account affords us a helpful, new foothold on the logic undergirding RAs. (shrink)

In robustness analysis, hypotheses are supported to the extent that a result proves robust, and a result is robust to the extent that we detect it in diverse ways. But what precise sense of diversity is at work here? In this paper, I show that the formal explications of evidential diversity most often appealed to in work on robustness – which all draw in one way or another on probabilistic independence – fail to shed light on the notion of diversity (...) relevant to robustness analysis. I close by briefly outlining a promising alternative approach inspired by Horwich’s (1982) eliminative account of evidential diversity. (shrink)

I propose a distinct type of robustness, which I suggest can support a confirmatory role in scientific reasoning, contrary to the usual philosophical claims. In model robustness, repeated production of the empirically successful model prediction or retrodiction against a background of independentlysupported and varying model constructions, within a group of models containing a shared causal factor, may suggest how confident we can be in the causal factor and predictions/retrodictions, especially once supported by a variety of evidence framework. I present climate (...) models of greenhouse gas global warming of the 20th Century as an example, and emphasize climate scientists’ discussions of robust models and causal aspects. The account is intended as applicable to a broad array of sciences that use complex modeling techniques. (shrink)

climate scientists have been engaged in a decades-long debate over the standing of satellite measurements of the temperature trends of the atmosphere above the surface of the earth. This is especially significant because skeptics of global warming and the greenhouse effect have utilized this debate to spread doubt about global climate models used to predict future states of climate. I use this case from an under-studied science to illustrate two distinct philosophical approaches to the relation among data, scientists, measurement, models, (...) and theory. I argue that distinguishing between 'direct' empiricist and 'complex' empiricist approaches helps us understand and analyze this important scientific episode. I also introduce a complex empiricist account of testing and evaluation, and contrast it with the basic Hypothetico-Deductive approach to the climate models used by the direct empiricists. This more developed complex empiricist apporach will serve philosophy of science well, as computational models become more wide-spread in the sciences. (shrink)

This contribution provides an assessment of the epistemological role of scientific models. The prevalent view that all scientific models are representations of the world is rejected. This view points to a unified way of resolving epistemic issues for scientific models. The emerging consensus in philosophy of science that models have many different epistemic roles in science is presented and defended.

Recent philosophical attention to climate models has highlighted their weaknesses and uncertainties. Here I address the ways that models gain support through observational data. I review examples of model fit, variety of evidence, and independent support for aspects of the models, contrasting my analysis with that of other philosophers. I also investigate model robustness, which often emerges when comparing climate models simulating the same time period or set of conditions. Starting from Michael Weisberg’s analysis of robustness, I conclude that his (...) approach involves a version of reasoning from variety of evidence, enabling this robustness to be a confirmatory virtue.. (shrink)

Philosophers of science have offered various accounts of climate model evaluation which have largely centered on model-fit assessment. However, despite the wide-spread prevalence of process-based evaluation in climate science practice, this sort of model evaluation has been undertheorized by philosophers of science. In this paper, I aim to expand this narrow philosophical view of climate model evaluation by providing a philosophical account of process evaluation that is rooted in a close examination of scientific practice. I propose dynamical adequacy as a (...) metric by which scientists test and evaluate models that represent and produce key regional climate processes and features. I argue that process-based evaluation confirms the adequacy of a regional climate model for simulating and predicting future changes of a specific regional climate feature. I offer a case study of how, in practice, scientists establish the reliability of model projections by assessing the dynamical adequacy of such models. I also show how process-based evaluation mitigates some well-known shortcomings of model-fit assessment and supports the adequacy and reliability of climate model projections against philosophical objections, like confirmational holism. Such adequacy is especially important for decision makers who need reliable regional model projections to guide their climate change mitigation and adaptation policies. (shrink)

What methodological approaches do research programs use to investigate the world? Elisabeth Lloyd’s Logic of Research Questions (LRQ) characterizes such approaches in terms of the questions that the researchers ask and causal factors they consider. She uses the Logic of Research Questions Framework to criticize adaptationist programs in evolutionary biology for dogmatically assuming selection explanations of the traits of organisms. I argue that Lloyd’s general criticism of methodological adaptationism is an artefact of the impoverished LRQ. My Ordered Factors Proposal extends (...) the LRQ to characterize approaches with sequences of questions and factors. I highlight the importance that ordering one’s investigation plays in approaches at the level of adaptationism by analyzing two research programs in community ecology: competitionists and neutralists. Competitionists and neutralists take opposed starting points and use explanatory and developmental heuristics to consider more factors in due time. On the Ordered Factors Proposal, these approaches are not only the ecological factors they are open to considering but also the order in which they will consider them. My disagreement with Lloyd’s over how to characterize methodological approaches reflects different views about methodological monism and pluralism. (shrink)

It is important to have an adequate model of uncertainty, since decisions must be made before the uncertainty can be resolved. For instance, flood defenses must be designed before we know the future distribution of flood events. It is standardly assumed that probability theory offers the best model of uncertain information. I think there are reasons to be sceptical of this claim. I criticise some arguments for the claim that probability theory is the only adequate model of uncertainty. In particular (...) I critique Dutch book arguments, representation theorems, and accuracy based arguments. Then I put forward my preferred model: imprecise probabilities. These are sets of probability measures. I offer several motivations for this model of uncertain belief, and suggest a number of interpretations of the framework. I also defend the model against some criticisms, including the so-called problem of dilation. I apply this framework to decision problems in the abstract. I discuss some decision rules from the literature including Levi’s E-admissibility and the more permissive rule favoured by Walley, among others. I then point towards some applications to climate decisions. My conclusions are largely negative: decision making under such severe uncertainty is inevitably difficult. I finish with a case study of scientific uncertainty. Climate modellers attempt to offer probabilistic forecasts of future climate change. There is reason to be sceptical that the model probabilities offered really do reflect the chances of future climate change, at least at regional scales and long lead times. Indeed, scientific uncertainty is multi-dimensional, and difficult to quantify. I argue that probability theory is not an adequate representation of the kinds of severe uncertainty that arise in some areas in science. I claim that this requires that we look for a better framework for modelling uncertainty. (shrink)

Computer simulations are nowadays often directly involved in the generation of experimental results. Given this dependency of experiments on computer simulations, that of simulations on models, and that of the models on free parameters, how do researchers establish trust in their experimental results? Using high-energy physics (HEP) as a case study, I will identify three different types of robustness that I call conceptual, methodological, and parametric robustness, and show how they can sanction this trust. However, as I will also show, (...) simulation models in HEP themselves fail to exhibit a type of robustness I call inverse parametric robustness. This combination of robustness and failures thereof is best understood by distinguishing different epistemic capacities of simulations and different senses of trust: Trusting simulations in their capacity to facilitate credible experimental results can mean accepting them as means for generating belief in these results, while this need not imply believing the models themselves in their capacity to represent an underlying reality. (shrink)

This paper presents an account of how to evaluate formal models of science: models and simulations in social epistemology designed to draw normative conclusions about the social structure of scientific research. I argue that such models should be evaluated according to their representational and predictive accuracy. Using these criteria and comparisons with familiar models from science, I argue that most formal models of science are incapable of supporting normative conclusions.

Robustness arguments hold that hypotheses are more likely to be true when they are confirmed by diverse kinds of evidence. Robustness arguments require the confirming evidence to be independent. We identify two kinds of independence appealed to in robustness arguments: ontic independence —when the multiple lines of evidence depend on different materials, assumptions, or theories—and probabilistic independence. Many assume that OI is sufficient for a robustness argument to be warranted. However, we argue that, as typically construed, OI is not a (...) sufficient independence condition for warranting robustness arguments. We show that OI evidence can collectively confirm a hypothesis to a lower degree than individual lines of evidence, contrary to the standard assumption undergirding usual robustness arguments. We employ Bayesian networks to represent the ideal empirical scenario for a robustness argument and a variety of ways in which empirical scenarios can fall short of this ideal. (shrink)

A central component to scientific practice is the construction and use of scientific models. Scientists believe that the success of a model justifies making claims that go beyond the model itself. However, philosophical analysis of models suggests that drawing inferences about the world from successful models is more complex. In this dissertation I develop a framework that can help disentangle the related strands of evaluation of model success, model extendibility, and the ability to draw ampliative inferences about the world from (...) models. I present and critically assess two leading accounts of model assessment, arguing that neither is sufficient to provide a complete understanding of model evaluation. I introduce a more powerful framework incorporating elements of the two views, which can help answer these three questions: What is the target of evaluation in model assessment? How does that evaluation proceed? What licenses us in making inferences about the real world, based on the evaluation of our models as successful? The framework identifies two distinct targets of model evaluation: representational similarity between the model and target system, and the adequacy of the model as a tool to answer questions. Both assessments must be relativized to a purpose, of which there are three general kinds: descriptive, predictive, and explanatory. These purposes differ in the way they inform the similarity relation, which is relevant for the similarity assessment, and the output they produce, which is relevant for the adequacy assessment. Any model can be assessed relative to any purpose, however a model encodes certain decisions made during the model’s construction, which impact its ability to be applied to a new purpose or new domain. My framework shows that extending a model, and drawing inferences from it, depends on its representational similarity. I apply this framework to several examples taken from astrophysics showing in detail how it can help illuminate the structure of the models, as well as make the justification for inferences made from them clear. The final chapter is a detailed analysis of a contemporary debate surrounding the use of models in astrophysics, between proponents of MOND and the standard ΛCDM model. (shrink)

Lloyd (2009) contends that climate models are confirmed by various instances of fit between their output and observational data. The present paper argues that what these instances of fit might confirm are not climate models themselves, but rather hypotheses about the adequacy of climate models for particular purposes. This required shift in thinking—from confirming climate models to confirming their adequacy-for-purpose—may sound trivial, but it is shown to complicate the evaluation of climate models considerably, both in principle and in practice.

Using past episodes of climate change as a source of evidence to inform our projections about contemporary climate change requires establishing the extent to which episodes in the deep past are analogous to the current crisis. However, many scientists claim that contemporary rates of climate change (e.g., rates of carbon emissions or temperature change) are unprecedented, including compared to episodes in the deep past. If so, this would limit the utility of paleoclimate analogues. In this paper, I show how a (...) data adjustment procedure called “temporal scaling,” which must be applied to both contemporary and past rate data, complicates the claim that contemporary rates are truly unprecedented. On top of giving actionable recommendations to scientists, this paper advances the philosophical literature concerning the use of models that are known to be somewhat disanalogous to their target systems. (shrink)

An important epistemic issue in climate modelling concerns structural uncertainty: uncertainty about whether the mathematical structure of a model accurately represents its target. How does structural uncertainty affect our knowledge and predictions about the climate? How can we identify sources of structural uncertainty? Can we manage the effect of structural uncertainty on our knowledge claims? These are some of the questions that an epistemology of structural uncertainty faces, and these questions are also important for climate scientists and policymakers. I develop (...) three desiderata for an epistemological account of structural uncertainty. In my view, an account of structural uncertainty should identify sources of structural uncertainty, explain how these sources limit the applicability of a model, and show how the severity of structural uncertainty depends on the questions that can be asked of a model. I argue that analyzing structural uncertainty by paying attention to the details of model building can satisfy these desiderata. I focus on parametrizations, which are representations of important processes occurring at scales that are not resolved by climate models. Parametrizations are often thought to be ad-hoc, but I show that some important parametrizations are theoretically justified by explicit or implicit scale separation assumptions. These assumptions can also be supported empirically. Analyzing these theoretical and empirical justificatory roles of the scale separation assumptions can provide insights into how parametrizations contribute to structural uncertainty. I conclude by sketching how my approach can satisfy the desiderata I set out at the beginning, highlighting its importance for policy-relevant scientific statements about the climate. (shrink)

I develop an account of productive surprise as an epistemic virtue of scientific investigations which does not turn on psychology alone. On my account, a scientific investigation is potentially productively surprising when results can conflict with epistemic expectations, those expectations pertain to a wide set of subjects. I argue that there are two sources of such surprise in science. One source, often identified with experiments, involves bringing our theoretical ideas in contact with new empirical observations. Another, often identified with simulations, (...) involves articulating and bringing together different parts of our knowledge. Both experiments and simulations, then, can surprise. (shrink)

Derivational robustness may increase the degree to which various pieces of evidence indirectly confirm a robust result. There are two ways in which this increase may come about. First, if one can show that a result is robust, and that the various individual models used to derive it also have other confirmed results, these other results may indirectly confirm the robust result. Confirmation derives from the fact that data not known to bear on a result are shown to be relevant (...) when it is shown to be robust. Second, robustness may increase the degree to which the robust result is indirectly confirmed if it increases the weight with which existing evidence indirectly confirms it. This may happen when it strengthens the connection between the core and the robust result by showing that auxiliaries are not responsible for the result. (shrink)

Robustness concepts are often invoked to manage two obstacles confronting models of ecological systems: complexity and uncertainty. The intuitive idea is that any result derived from many idealized but credible models is thereby made more reliable or is better confirmed. An appropriate basis for this inference has proven elusive. Here, several representations of robustness analysis are vetted, paying particular attention to complex models of ecosystems and the global climate. The claim that robustness is itself confirmatory because robustness analysis employs a (...) Bayesian variety-of-evidence argument is criticized, but recent overwhelming pessimism about robustness may have a silver lining. (shrink)

There are a variety of topics in the philosophy of science that need to be rethought, in varying degrees, after one pays careful attention to the ways in which computer simulations are used in the sciences. There are a number of conceptual issues internal to the practice of computer simulation that can benefit from the attention of philosophers. This essay surveys some of the recent literature on simulation from the perspective of the philosophy of science and argues that philosophers have (...) a lot to learn by paying closer attention to the practice of simulation. (shrink)

Convergence of model projections is often considered by climate scientists to be an important objective in so far as it may indicate the robustness of the models’ core hypotheses. Consequently, the range of climate projections from a multi-model ensemble, called “model spread”, is often expected to reduce as climate research moves forward. However, the successive Assessment Reports of the Intergovernmental Panel on Climate Change indicate no reduction in model spread, whereas it is indisputable that climate science has made improvements in (...) its modelling. In this paper, after providing a detailed explanation of the situation, we describe an epistemological setting in which a steady model spread is not doomed to be seen as negative, and is indeed compatible with a desirable evolution of climate models taken individually. We further argue that, from the perspective of collective progress, as far as the improvement of the products of a multi-model ensemble is concerned, reduction of model spread is of lower priority than model independence. (shrink)

Here I critically assess an argument put forward by Kuorikoski et al. (Br J Philos Sci, 61(3):541–567, 2010) for the epistemic import of model-based robustness analysis. I show that this argument is not sound since the sort of probabilistic independence on which it relies is unfeasible. By revising the notion of probabilistic independence imposed on the models’ results, I introduce a prima-facie more plausible argument. However, despite this prima-facie plausibility, I show that even this new argument is unsound in most (...) if not all cases of model-based robustness analysis. This I do to demonstrate that the epistemic import of model-based robust analysis cannot be satisfactorily defended on the basis of probabilistic independence. (shrink)

. In this paper I present two ways in which climate modelers use general circulation models for exploratory purposes. The complexity of Earth’s climate system makes it difficult to predict precisely how lower-order climate dynamics will interact over time to drive higher-order dynamics. The same issues arise for complex models built to simulate climate behavior like the Community Earth Systems Model. I argue that as a result of system complexity, climate modelers use general circulation models to perform model dynamic exploration (...) and climate dynamic exploration. MDE and CDE help climate modelers to better understand the dynamic structure of the general circulation model system and the actual climate system, respectively. (shrink)

I bring out the limitations of four important views of what the target of useful climate model assessment is. Three of these views are drawn from philosophy. They include the views of Elisabeth Lloyd and Wendy Parker, and an application of Bayesian confirmation theory. The fourth view I criticise is based on the actual practice of climate model assessment. In bringing out the limitations of these four views, I argue that an approach to climate model assessment that neither demands too (...) much of such assessment nor threatens to be unreliable will, in typical cases, have to aim at something other than the confirmation of claims about how the climate system actually is. This means, I suggest, that the Intergovernmental Panel on Climate Change ’s focus on establishing confidence in climate model explanations and predictions is misguided. So too, it means that standard epistemologies of science with pretensions to generality, e.g., Bayesian epistemologies, fail to illuminate the assessment of climate models. I go on to outline a view that neither demands too much nor threatens to be unreliable, a view according to which useful climate model assessment typically aims to show that certain climatic scenarios are real possibilities and, when the scenarios are determined to be real possibilities, partially to determine how remote they are. (shrink)

In the philosophy of climate science, debate surrounding the issue of variety of evidence has mostly taken the form of attempting to connect these issues in climate science and climate modeling with philosophical accounts of what has come to be known as “robustness analysis.” I argue that an “explanatory” conception of robustness is the best candidate for understanding variety of evidence in climate science. I apply the analysis to both examples of model agreement, as well at to the convergence of (...) evidence from both model and non-model sources. (shrink)

The epistemology of studies addressing questions about historical and prehistorical phenomena is a subject of increasing discussion among philosophers of science. A related field of inquiry that has yet to be connected to this topic is the epistemology of climate science. Branching these areas of research, I show how variety-of-evidence reasoning accounts for scientific inferences about the past by detailing a case study in paleoclimate reconstruction. This analysis aims to clarify the logic of historical inquiry in general and, by focusing (...) on a case study about climate change, it offers an epistemic account of a particular discipline that is of environmental and social importance. (shrink)

The goal of this dissertation is to contribute to the epistemology of science by addressing a set of related questions arising from current discussions in the philosophy and science of climate change: (1) Given the imperfection of computer models, how do they provide information about large and complex target systems? (2) What is the relationship between consilient reasoning and robust evidential support in the production of scientific knowledge? (3) Does taking the mean of a set of model outputs provide epistemic (...) advantages over using the output of a single ‘best model’? Synthesizing research in philosophy and science, the thesis analyzes connections among consilient inductions, robustness analysis, and the aggregation of various sources of evidence, including computer simulations, by investigating case studies of climate change that exemplify the strength of consilient reasoning and the security of robust evidential support. It also explains the rationale and epistemic conditions for improving estimates by averaging multiple estimates, comparing a simple case of averaging estimates to practices in multi-model ensemble studies. I argue: (A) the concepts of consilience and robustness account for the strength and security of inferences that rely on imperfect computer modelling methods, (B) consilient reasoning is conducive to attaining robust evidential support, and (C) an analogy can explain why averaging the outputs of multiple models can improve estimates of a target system, given that conditions of model independence, skill and unequal weighting are taken into account. (shrink)