Recent work in judgment and decisionmaking has stressed that institutions, like individuals, often rely on decisionmaking heuristics. But most of the institutional decisionmaking heuristics studied to date are highly firm- and industry-specific. This contrasts to the individual case, in which many heuristics are general-purpose rules suitable for a wide range of decision problems. Are there also general-purpose heuristics for institutional decisionmaking? In this paper, I argue that a number of methods recently developed for decisionmaking under deep uncertainty have a good (...) claim to be understood as general-purpose decisionmaking heuristics suitable for a broad range of institutional decision problems. (shrink)

For computer simulation models to usefully inform climate risk management, uncertainties in model projections must be explored and characterized. Because doing so requires running the model many ti...

This article examines initial-condition dependence and initial-condition uncertainty for climate projections and predictions. The first contribution is to provide a clear conceptual characterization of predictions and projections. Concerning initial-condition dependence, projections are often described as experiments that do not depend on initial conditions. Although prominent, this claim has not been scrutinized much and can be interpreted differently. If interpreted as the claim that projections are not based on estimates of the actual initial conditions of the world or that what makes (...) projections true are conditions in the world, this claim is true. However, it can also be interpreted as the claim that simulations used to obtain projections are independent of initial-condition ensembles. This article argues that evidence does not support this claim. Concerning initial-condition uncertainty, three kinds of initial-condition uncertainty are identified. The first is the uncertainty associated with the spread of the ensemble simulations. The second arises because the theoretical initial ensemble cannot be used in calculations and has to be approximated by finitely many initial states. The third uncertainty arises because it is unclear how long the model should be run to obtain potential initial conditions at pre-industrial times. Overall, the discussion shows that initial-condition dependence and uncertainty in climate science are more complex and important issues than usually acknowledged. 1Introduction2Projections and Predictions 2.1Predictions2.2Projections3Initial-Condition Dependence 3.1Projections 3.1.1Dynamical conditions justifying independence of initial conditions?3.1.2What projections can and cannot provide3.2Predictions4Initial-Condition Uncertainty 4.1Projections4.2Predictions5ConclusionAppendix. (shrink)

Climate modelling plays a crucial role for understanding and addressing the climate challenge, in terms of both mitigation and adaptation. It is therefore of central importance to understand to what extent climate models are adequate for relevant purposes, such as providing certain kinds of climate change projections in view of decision-making. In this perspective, the issue of the stability of climate models under small relevant perturbations in their structure seems particularly important. Within this framework, a debate has emerged in the (...) philosophy of science literature about the relevance for climate modelling of the mathematical notion of structural stability. This paper adresses several important foundational and epistemological questions that arise in this context, in particular about the the role of abstract mathematical considerations of a qualitative nature for concrete modelling projects with mainly quantitative purposes. (shrink)

Policy-makers face an uncertain world. One way of getting a handle on decision-making in such an environment is to rely on evidence. Despite the recent increase in post-fact figures in politics, evidence-based policymaking takes centre stage in policy-setting institutions. Often, however, policy-makers face large volumes of evidence from different sources. Robustness analysis can, prima facie, handle this evidential diversity. Roughly, a hypothesis is supported by robust evidence if the different evidential sources are in agreement. In this thesis, I strengthen the (...) case for the use of robustness analysis in evidence-based policymaking by answering open research questions about this inference technique. First, I argue that existing taxonomies miss a fruitful category of robustness reasoning, that is predictive stability. Second, I claim that derivational robustness analysis – the investigation of whether the results of different models are in agreement – can yield interesting insights even if not the entire relevant model space is covered by available models or if the model results are only partially in agreement. Third, I claim that expert knowledge is necessary to address questions that arise when one applies measurement robustness analysis – the investigation into whether multiple means of measurement yield the same result. Finally, I argue that, in situations where evidence from different measurements is not in agreement, it can be advisable to no longer take all of the evidence into account. This can be done in a rationally defensible way by choosing the most adequate theory or model underlying parts of the evidence set. I discuss examples from climate, medical, and economic policy-making to establish my claims. (shrink)

Many philosophers and statisticians argue that risk assessors are morally obligated to evaluate the probabilities and consequences of methodological error, and to base their decisions of whether to adopt a given parameter value, model, or hypothesis on those considerations. This argument is couched within the rubric of null hypothesis testing, which I suggest is a poor descriptive and normative model for risk assessment. Risk regulation is not primarily concerned with evaluating the probability of data conditional upon the null hypothesis, but (...) rather with measuring risks, estimating the consequences of available courses of action and inaction, formally characterising uncertainty, and deciding what to do based upon explicit values and decision criteria. In turn, I defend an ideal of value-neutrality, whereby the core inferential tasks of risk assessment – such as weighing evidence, estimating parameters, and model selection – should be guided by the aim of correspondence to reality. This is not to say that value-judgments be damned, but rather that they should be accounted for within a structured approach to decision analysis, rather than embedded within risk assessment in an informal manner. (shrink)

Convergence of model projections is often considered by climate scientists to be an important objective in so far as it may indicate the robustness of the models’ core hypotheses. Consequently, the range of climate projections from a multi-model ensemble, called “model spread”, is often expected to reduce as climate research moves forward. However, the successive Assessment Reports of the Intergovernmental Panel on Climate Change indicate no reduction in model spread, whereas it is indisputable that climate science has made improvements in (...) its modelling. In this paper, after providing a detailed explanation of the situation, we describe an epistemological setting in which a steady model spread is not doomed to be seen as negative, and is indeed compatible with a desirable evolution of climate models taken individually. We further argue that, from the perspective of collective progress, as far as the improvement of the products of a multi-model ensemble is concerned, reduction of model spread is of lower priority than model independence. (shrink)

Reports of the Intergovernmental Panel on Climate Change (IPCC) employ an evolving framework of calibrated language for assessing and communicating degrees of certainty in findings. A persistent challenge for this framework has been ambiguity in the relationship between multiple degree-of-certainty metrics. We aim to clarify the relationship between the likelihood and confidence metrics used in the Fifth Assessment Report (2013), with benefits for mathematical consistency among multiple findings and for usability in downstream modeling and decision analysis. We discuss how our (...) proposal meshes with current and proposed practice in IPCC uncertainty assessment. (shrink)

In recent publications we have drawn attention to the fact that if the dynamics of a model is structurally unstable, then the presence of structural model error places in-principle limits on the model’s ability to generate decision-relevant probability forecasts. Writing with a varying array of co-authors, Eric Winsberg has now produced at least four publications in which he dismisses our points as unfounded; the most recent of these appeared in this journal. In this paper we respond to the arguments of (...) Winsberg and his co-workers, and we point out that their criticisms fail. We take this as an opportunity to restate and explain our arguments, and to point to fruitful directions for future research. (shrink)