Philosophers of science have offered various accounts of climate model evaluation which have largely centered on model-fit assessment. However, despite the wide-spread prevalence of process-based evaluation in climate science practice, this sort of model evaluation has been undertheorized by philosophers of science. In this paper, I aim to expand this narrow philosophical view of climate model evaluation by providing a philosophical account of process evaluation that is rooted in a close examination of scientific practice. I propose dynamical adequacy as a (...) metric by which scientists test and evaluate models that represent and produce key regional climate processes and features. I argue that process-based evaluation confirms the adequacy of a regional climate model for simulating and predicting future changes of a specific regional climate feature. I offer a case study of how, in practice, scientists establish the reliability of model projections by assessing the dynamical adequacy of such models. I also show how process-based evaluation mitigates some well-known shortcomings of model-fit assessment and supports the adequacy and reliability of climate model projections against philosophical objections, like confirmational holism. Such adequacy is especially important for decision makers who need reliable regional model projections to guide their climate change mitigation and adaptation policies. (shrink)

Climate models don’t give us probabilistic forecasts. To interpret their results, alternatively, as serious possibilities seems problematic inasmuch as climate models rely on contrary-to-fact assumptions: why should we consider their implications as possible if their assumptions are known to be false? The paper explores a way to address this possibilistic challenge. It introduces the concepts of a perfect and of an imperfect credible world, and discusses whether climate models can be interpreted as imperfect credible worlds. That would allow one to (...) use models for possibilistic prediction and salvage widespread scientific practice. (shrink)

Integrated assessment models play a major role in the science and policy of climate change. Similarly to other widely used computational tools for addressing socially relevant problems, IAMs need to account for the key uncertainties characterizing processes and socio-economic responses. In the case of climate change, these are particularly complex given the very long-term nature of climate and the deep uncertainty characterizing technological and human systems. Here we draw from philosophical discussion of mathematical modeling of social problems and review the (...) role of uncertainty in climate-economic modeling. In agreement with the literature, we highlight the crucial role of epistemic uncertainty in IAMs. We posit that the normative components of models, more than the physical and socio-techno-economic ones, are the most fraught by uncertainty and yet the least understood. We suggest a research agenda to explore uncertainties of evaluation frameworks, transcending the current implicit normativity of IAMs. (shrink)

Recent years have seen a notable increase in the production of scientific expertise by large multidisciplinary groups. The issue we address is how reports may be written by such groups in spite of their size and of formidable obstacles: complexity of subject matter, uncertainty, and scientific disagreement. Our focus is on the International Panel on Climate Change, unquestionably the best-known case of such collective scientific expertise. What we show is that the organization of work within the IPCC aims to make (...) it possible to produce documents that are indeed expert reports. To do so, we first put forward the epistemic norms that apply to expert reports in general, that is, the properties that reports should have in order to be useful and to help decision-making. Section 2 claims that these properties are: intelligibility, relevance and accuracy. Based on this analysis, section 3 points to the difficulties of having IPCC reports indeed satisfying these norms. We then show how the organization of work within the IPCC aims at and to a large extent secures intelligibility, relevance and accuracy, with the result that IPCC reports can be relied on for decision-making. Section 4 focuses on the fundamentals of IPCC’s work organization--that is, division of labour within the IPCC--while section 5 investigates three frameworks that were introduced over the course of the functioning of the IPCC: the reviewing procedure of IPCC reports, the language that IPCC authors use to express uncertainty and the Coupled Model Intercomparison Project. Concluding remarks are offered in section 6. (shrink)

The paper discusses modelling uncertainties in climate models and how they can be addressed based on physical principles as well as based on how the models perform in light of empirical data. We ar...

Projections of future climate change cannot rely on a single model. It has become common to rely on multiple simulations generated by Multi-Model Ensembles (MMEs), especially to quantify the uncertainty about what would constitute an adequate model structure. But, as Parker points out (2018), one of the remaining philosophically interesting questions is: “How can ensemble studies be designed so that they probe uncertainty in desired ways?” This paper offers two interpretations of what General Circulation Models (GCMs) are and how MMEs (...) made of GCMs should be designed. In the first interpretation, models are combinations of modules and parameterisations; an MME is obtained by “plugging and playing” with interchangeable modules and parameterisations. In the second interpretation, models are aggregations of expert judgements that result from a history of epistemic decisions made by scientists about the choice of representations; an MME is a sampling of expert judgements from modelling teams. We argue that, while the two interpretations involve distinct domains from philosophy of science and social epistemology, they both could be used in a complementary manner in order to explore ways of designing better MMEs. (shrink)

We give an overview of the practice of developing and using complex climate models, as seen from experiences in a major climate modelling center and through participation in the Coupled Model Intercomparison Project. We discuss the construction and calibration of models; their evaluation, especially through use of out-of-sample tests; and their exploitation in multi-model ensembles to identify biases and make predictions. We stress that adequacy or utility of climate models is best assessed via their skill against more naïve predictions. The (...) framework we use for making inferences about reality using simulations is naturally Bayesian, and has many points of contact with more familiar examples of scientific epistemology. While the use of complex simulations in science is a development that changes much in how science is done in practice, we argue that the concepts being applied fit very much into traditional practices of the scientific method, albeit those more often associated with laboratory work. (shrink)