Nick Bostrom and others have suggested treating decision-making under moral uncertainty as analogous to parliamentary decision-making. The core suggestion of this “parliamentary approach” is that the competing moral theories function like delegates to the parliament, and that these delegates then make decisions by some combination of bargaining and voting. There seems some reason to hope that such an approach might avoid standard objections to existing approaches (for example, the “maximise expected choiceworthiness” (MEC) and “my favourite theory” approaches). However, the parliamentary (...) approach is so far extremely underspecified, making it largely indeterminate how such a model will in fact behave in the respects that those concerned with moral uncertainty care about. This paper explores one way of making it precise. We treat predicaments of moral uncertainty as analogous to bargaining situations alone (setting aside voting), and apply a version of the Nash solution that is standard in bargaining theory. The resulting model does indeed perform in many of the hoped-for ways. However, so also does a version of MEC that employs a structural approach to intertheoretic comparisons. It seems to us an open question which, regarding this version of MEC and the bargaining-theoretic approach, is superior to the other. We identify the key points on which the two differ. (shrink)

How ought you to evaluate your options if you're uncertain about what's fundamentally valuable? A prominent response is Expected Value Maximisation (EVM)—the view that under axiological uncertainty, an option is better than another if and only if it has the greater expected value across axiologies. But the expected value of an option depends on quantitative probability and value facts, and in particular on value comparisons across axiologies. We need to explain what it is for such facts to hold. Also, EVM (...) is by no means self-evident. We need an argument to defend that it’s true. This book introduces an axiomatic approach to answer these worries. It provides an explication of what EVM means by use of representation theorems: intertheoretic comparisons can be understood in terms of facts about which options are better than which, and mutatis mutandis for intratheoretic comparisons and axiological probabilities. And it provides a systematic argument to the effect that EVM is true: the theory can be vindicated through simple axioms. The result is a formally cogent and philosophically compelling extension of standard decision theory, and original take on the problem of axiological or normative uncertainty. (shrink)

This paper explores the idea that it is instrumentally valuable to learn normative truths. We consider an argument for "normative hedging" based on this principle, and examine the structure of decision-making under moral uncertainty that arises from it. But it also turns out that the value of normative information is inconsistent with the principle that learning *empirical* truths is instrumentally valuable. We conclude with a brief comment on "metanormative regress.".

While ordinary decision theory focuses on empirical uncertainty, real decision-makers also face normative uncertainty: uncertainty about value itself. From a purely formal perspective, normative uncertainty is comparable to (Harsanyian or Rawlsian) identity uncertainty in the 'original position', where one's future values are unknown. A comprehensive decision theory must address twofold uncertainty -- normative and empirical. We present a simple model of twofold uncertainty, and show that the most popular decision principle -- maximising expected value (`Expectationalism') -- has different formulations, namely (...) Ex-Ante Expectationalism, Ex-Post Expectationalism, and hybrid theories. These alternative theories recommend different decisions, reasoning modes, and attitudes to risk. But they converge under an interesting (necessary and sufficient) condition. (shrink)

Decision-making under normative uncertainty requires an agent to aggregate the assessments of options given by rival normative theories into a single assessment that tells her what to do in light of her uncertainty. But what if the assessments of rival theories differ not just in their content but in their structure -- e.g., some are merely ordinal while others are cardinal? This paper describes and evaluates three general approaches to this "problem of structural diversity": structural enrichment, structural depletion, and multi-stage (...) aggregation. All three approaches have notable drawbacks, but I tentatively defend multi-stage aggregation as least bad of the three. (shrink)

Rohana faces a choice where she can produce either a better outcome by lying or a worse outcome by telling the truth. She justifiably, but falsely, believes in.

In this paper, I enter the debate between those who hold that our normative uncertainty matters for what we ought to do, and those who hold that only our descriptive uncertainty matters. I argue that existing views in both camps have unacceptable implications in cases where our descriptive beliefs depend on our normative beliefs. I go on to propose a fix which is available only to those who hold that normative uncertainty matters, ultimately leaving the challenge as a threat to (...) recent skepticism about such views. (shrink)

How should you decide what to do when you're uncertain about basic normative principles (e.g., Kantianism vs. utilitarianism)? A natural suggestion is to follow some "second-order" norm: e.g., "comply with the first-order norm you regard as most probable" or "maximize expected choiceworthiness". But what if you're uncertain about second-order norms too -- must you then invoke some third-order norm? If so, it seems that any norm-guided response to normative uncertainty is doomed to a vicious regress. In this paper, I aim (...) to rescue second-order norms from this threat of regress. I first elaborate and defend the suggestion some philosophers have entertained that the regress problem forces us to accept normative externalism, the view that at least one norm is incumbent on agents regardless of their beliefs or evidence concerning that norm. But, I then argue, we need not accept externalism about first-order (e.g., moral) norms, thus closing off any question of what an agent should do in light of her normative beliefs. Rather, it is more plausible to ascribe external force to a single, second-order rational norm: the enkratic principle, correctly formulated. This modest form of externalism, I argue, is both intrinsically well-motivated and sufficient to head off the threat of regress. (shrink)

The problem known as Buridan’s Ass says that a hungry donkey equipoised between two identical bales of hay will starve to death. Indecision kills the ass. Some philosophers worry about human analogs. Computer scientists since the 1960s have known about the computer versions of such cases. From what Leslie Lamport calls ‘Buridan’s Principle’—a discrete decision based on a continuous range of input-values cannot be made in a bounded time—it follows that the possibilities for human analogs of Buridan’s Ass are far (...) more wide-ranging and securely provable than has been acknowledged in philosophy. We are never necessarily decisive. This is mathematically provable. I explore four consequences: first, increased interest of the literature’s solutions to Buridan’s Ass; second, a new asymmetry between responsibility for omissions and responsibility for actions; third, clarification of the standard account of akrasia; and, fourth, clarification of the role of credences in normative decision-theory. (shrink)

Moral uncertainty and disagreement pervade our lives. Yet we still need to make decisions and act, both individually and politically. So, what should we do? Moral uncertainty theorists provide a theory of what individuals should do when they are uncertain about morality. Public reason liberals provide a theory of how societies should deal with reasonable disagreements about morality. They defend the public justification principle: state action is permissible only if it can be justified to all reasonable people. In this article, (...) we bring these two approaches together. Specifically, we investigate whether considerations of moral uncertainty support public reason liberalism: given moral uncertainty, should we favor public justification? We argue that while moral uncertainty theory cannot vindicate an exceptionless public justification principle, it supports adopting public justification as a pro tanto principle – albeit one that can be overridden when the moral stakes are high. It also provides new answers to some intramural debates among public reason liberals and new responses to some common objections. (shrink)

Integrated assessment models play a major role in the science and policy of climate change. Similarly to other widely used computational tools for addressing socially relevant problems, IAMs need to account for the key uncertainties characterizing processes and socio-economic responses. In the case of climate change, these are particularly complex given the very long-term nature of climate and the deep uncertainty characterizing technological and human systems. Here we draw from philosophical discussion of mathematical modeling of social problems and review the (...) role of uncertainty in climate-economic modeling. In agreement with the literature, we highlight the crucial role of epistemic uncertainty in IAMs. We posit that the normative components of models, more than the physical and socio-techno-economic ones, are the most fraught by uncertainty and yet the least understood. We suggest a research agenda to explore uncertainties of evaluation frameworks, transcending the current implicit normativity of IAMs. (shrink)