In 2012, the Geological Time Scale, which sets the temporal framework for studying the timing and tempo of all major geological, biological, and climatic events in Earth’s history, had one-quarter of its boundaries moved in a widespread revision of radiometric dates. The philosophy of metrology helps us understand this episode, and it, in turn, elucidates the notions of calibration, coherence, and consilience. I argue that coherence testing is a distinct activity preceding calibration and consilience, and I highlight the value of (...) discordant evidence and trade-offs scientists face in calibration. The iterative nature of calibration, moreover, raises the problem of legacy data. (shrink)

Climate models don’t give us probabilistic forecasts. To interpret their results, alternatively, as serious possibilities seems problematic inasmuch as climate models rely on contrary-to-fact assumptions: why should we consider their implications as possible if their assumptions are known to be false? The paper explores a way to address this possibilistic challenge. It introduces the concepts of a perfect and of an imperfect credible world, and discusses whether climate models can be interpreted as imperfect credible worlds. That would allow one to (...) use models for possibilistic prediction and salvage widespread scientific practice. (shrink)

Introduction -- Sanctioning models : theories and their scope -- Methodology for a virtual world -- A tale of two methods -- When theories shake hands -- Models of climate : values and uncertainties -- Reliability without truth -- Conclusion.

The social sciences face a problem of sample non-representation, where the majority of samples consist of undergraduate students from Euro-American institutions. The problem has been identified for decades with little trend of improvement. In this paper, I trace the history of sampling theory. The dominant framework, called the design-based approach, takes random sampling as the gold standard. The idea is that a sampling procedure that is maximally uninformative prevents samplers from introducing arbitrary bias, thus preserving sample representation. I show how (...) this framework, while good in theory, faces many challenges in application. Instead, I advocate for an alternative framework, called the model-based approach to sampling, where representative samples are those balanced in composition, however they were drawn. I argue that the model-based framework is more appropriate in the social sciences because it allows for systematic assessment of imperfect samples and methodical improvement in resource-limited scientific contexts. I end with practical proposals of improving sample quality in the social sciences. (shrink)

We give an overview of the practice of developing and using complex climate models, as seen from experiences in a major climate modelling center and through participation in the Coupled Model Intercomparison Project. We discuss the construction and calibration of models; their evaluation, especially through use of out-of-sample tests; and their exploitation in multi-model ensembles to identify biases and make predictions. We stress that adequacy or utility of climate models is best assessed via their skill against more naïve predictions. The (...) framework we use for making inferences about reality using simulations is naturally Bayesian, and has many points of contact with more familiar examples of scientific epistemology. While the use of complex simulations in science is a development that changes much in how science is done in practice, we argue that the concepts being applied fit very much into traditional practices of the scientific method, albeit those more often associated with laboratory work. (shrink)

We call attention to an underappreciated way in which non-epistemic values influence evidence evaluation in science. Our argument draws upon some well-known features of scientific modeling. We show that, when scientific models stand in for background knowledge in Bayesian and other probabilistic methods for evidence evaluation, conclusions can be influenced by the non-epistemic values that shaped the setting of priorities in model development. Moreover, it is often infeasible to correct for this influence. We further suggest that, while this value influence (...) is not particularly prone to the problem of wishful thinking, it could have problematic non-epistemic consequences in some cases. (shrink)

A number of recent discussions comparing computer simulation and traditional experimentation have focused on the significance of “materiality.” I challenge several claims emerging from this work and suggest that computer simulation studies are material experiments in a straightforward sense. After discussing some of the implications of this material status for the epistemology of computer simulation, I consider the extent to which materiality (in a particular sense) is important when it comes to making justified inferences about target systems on the basis (...) of experimental results. (shrink)

In an attempt to determine the epistemic status of computer simulation results, philosophers of science have recently explored the similarities and differences between computer simulations and experiments. One question that arises is whether and, if so, when, simulation results constitute novel empirical data. It is often supposed that computer simulation results could never be empirical or novel because simulations never interact with their targets, and cannot go beyond their programming. This paper argues against this position by examining whether, and under (...) what conditions, the features of empiricality and novelty could be displayed by computer simulation data. I show that, to the extent that certain familiar measurement results have these features, so can some computer simulation results. (shrink)

climate scientists have been engaged in a decades-long debate over the standing of satellite measurements of the temperature trends of the atmosphere above the surface of the earth. This is especially significant because skeptics of global warming and the greenhouse effect have utilized this debate to spread doubt about global climate models used to predict future states of climate. I use this case from an under-studied science to illustrate two distinct philosophical approaches to the relation among data, scientists, measurement, models, (...) and theory. I argue that distinguishing between 'direct' empiricist and 'complex' empiricist approaches helps us understand and analyze this important scientific episode. I also introduce a complex empiricist account of testing and evaluation, and contrast it with the basic Hypothetico-Deductive approach to the climate models used by the direct empiricists. This more developed complex empiricist apporach will serve philosophy of science well, as computational models become more wide-spread in the sciences. (shrink)

I bring out the limitations of four important views of what the target of useful climate model assessment is. Three of these views are drawn from philosophy. They include the views of Elisabeth Lloyd and Wendy Parker, and an application of Bayesian confirmation theory. The fourth view I criticise is based on the actual practice of climate model assessment. In bringing out the limitations of these four views, I argue that an approach to climate model assessment that neither demands too (...) much of such assessment nor threatens to be unreliable will, in typical cases, have to aim at something other than the confirmation of claims about how the climate system actually is. This means, I suggest, that the Intergovernmental Panel on Climate Change ’s focus on establishing confidence in climate model explanations and predictions is misguided. So too, it means that standard epistemologies of science with pretensions to generality, e.g., Bayesian epistemologies, fail to illuminate the assessment of climate models. I go on to outline a view that neither demands too much nor threatens to be unreliable, a view according to which useful climate model assessment typically aims to show that certain climatic scenarios are real possibilities and, when the scenarios are determined to be real possibilities, partially to determine how remote they are. (shrink)

In this paper we explore the constraints that our preferred account of scientific representation places on the ontology of scientific models. Pace the Direct Representation view associated with Arnon Levy and Adam Toon we argue that scientific models should be thought of as imagined systems, and clarify the relationship between imagination and representation.

Pierre Duhem’s influential argument for holism relies on a view of the role that background theory plays in testing: according to this still common account of “auxiliary hypotheses,” elements of background theory serve as truth-apt premises in arguments for or against a hypothesis. I argue that this view is mistaken. Rather than serving as truth-apt premises in arguments, auxiliary hypotheses are employed as “epistemic tools”: instruments that perform specific tasks in connecting our theoretical questions with the world but that are (...) not premises in arguments. On the resulting picture, the acceptability of an auxiliary hypothesis depends not on its truth but on contextual factors such as the task or purpose it is put to and the other tools employed alongside it. (shrink)

The book examines issues related to the way modeling and simulation enable us to reconstruct aspects of the world we are investigating. It also investigates the processes by which we extract concrete knowledge from those reconstructions and how that knowledge is legitimated.

Inferences like these are known as extrapolations.

Recently a number of scientists have proposed substantial changes to the practice of climate modeling, though they disagree over what those changes should be. We provide an overview and critical examination of three leading proposals: the unified approach, the hierarchy approach and the pluralist approach. The unified approach calls for an accelerated development of high-resolution models within a seamless prediction framework. The hierarchy approach calls for more attention to the development and systematic study of hierarchies of related models, with the (...) aim of advancing understanding. The pluralist approach calls for greater diversity in modeling efforts, including, on some of its variants, more attention to empirical modeling. After identifying some of the scientific and institutional challenges faced by these proposals, we consider their expected gains and costs, relative to a business-as-usual modeling scenario.We find the proposals to be complementary, having valuable synergies. But since resource limitations make it unlikely that all three will be pursued, we offer some reflections on more limited changes in climate modeling that seem well within reach and that can be expected to yield substantial benefits. (shrink)

An uncertainty report describes the extent of an agent’s uncertainty about some matter. We identify two basic requirements for uncertainty reports, which we call faithfulness and completeness. We then discuss two pitfalls of uncertainty assessment that often result in reports that fail to meet these requirements. The first involves adopting a one-size-fits-all approach to the representation of uncertainty, while the second involves failing to take account of the risk of surprises. In connection with the latter, we respond to the objection (...) that it is impossible to account for the risk of genuine surprises. After outlining some steps that both scientists and the bodies who commission uncertainty assessments can take to help avoid these pitfalls, we explain why striving for faithfulness and completeness is important. (shrink)