This paper deals with the question of whether uncertainty regarding model structure, especially in climate modeling, exhibits a kind of “chaos.” Do small changes in model structure, in other words, lead to large variations in ensemble predictions? More specifically, does model error destroy forecast skill faster than the ordinary or “classical” chaos inherent in the real-world attractor? In some cases, the answer to this question seems to be “yes.” But how common is this state of affairs? Are there precise mathematical (...) results that can help us answer this question? And is dependence on model structure “sensitive” in that arbitrarily small errors can destroy forecast skill? We examine some efforts in the literature to answer this last question in the affirmative and find them to be unconvincing. (shrink)

This paper provides the first systematic epistemological account of simulated data in empirical science. We focus on the epistemic issues modelers face when they generate simulated data to solve problems with empirical datasets, research tools, or experiments. We argue that for simulated data to count as epistemically reliable, a simulation model does not have to mimic its target. Instead, some models take empirical data as a target, and simulated data may successfully mimic such a target even if the model does (...) not. We show how to distinguish between simulated and empirical data, and we also offer a definition of simulation that can accommodate Monte Carlo models. We shed light on the epistemology of simulated data by providing a taxonomy of four different mimicking relations that differ concerning the nature of the relation or relata. We illustrate mimicking relations with examples from different sciences. Our main claim is that the epistemic evaluation of simulated data should start with recognizing the diversity of mimicking relations rather than presuming that only one relation existed. (shrink)

In recent publications we have drawn attention to the fact that if the dynamics of a model is structurally unstable, then the presence of structural model error places in-principle limits on the model’s ability to generate decision-relevant probability forecasts. Writing with a varying array of co-authors, Eric Winsberg has now produced at least four publications in which he dismisses our points as unfounded; the most recent of these appeared in this journal. In this paper we respond to the arguments of (...) Winsberg and his co-workers, and we point out that their criticisms fail. We take this as an opportunity to restate and explain our arguments, and to point to fruitful directions for future research. (shrink)

An important epistemic issue in climate modelling concerns structural uncertainty: uncertainty about whether the mathematical structure of a model accurately represents its target. How does structural uncertainty affect our knowledge and predictions about the climate? How can we identify sources of structural uncertainty? Can we manage the effect of structural uncertainty on our knowledge claims? These are some of the questions that an epistemology of structural uncertainty faces, and these questions are also important for climate scientists and policymakers. I develop (...) three desiderata for an epistemological account of structural uncertainty. In my view, an account of structural uncertainty should identify sources of structural uncertainty, explain how these sources limit the applicability of a model, and show how the severity of structural uncertainty depends on the questions that can be asked of a model. I argue that analyzing structural uncertainty by paying attention to the details of model building can satisfy these desiderata. I focus on parametrizations, which are representations of important processes occurring at scales that are not resolved by climate models. Parametrizations are often thought to be ad-hoc, but I show that some important parametrizations are theoretically justified by explicit or implicit scale separation assumptions. These assumptions can also be supported empirically. Analyzing these theoretical and empirical justificatory roles of the scale separation assumptions can provide insights into how parametrizations contribute to structural uncertainty. I conclude by sketching how my approach can satisfy the desiderata I set out at the beginning, highlighting its importance for policy-relevant scientific statements about the climate. (shrink)