How should we make decisions when we're uncertain about what we ought, morally, to do? Decision-making in the face of fundamental moral uncertainty is underexplored terrain: MacAskill, Bykvist, and Ord argue that there are distinctive norms by which it is governed, and which depend on the nature of one's moral beliefs.

We typically have to act under uncertainty. We can be uncertain about the relevant descriptive facts, but also about the relevant normative facts. However, the search for a theory of decision-making under normative uncertainty is doomed to failure. First, the most natural proposal for what to do given normative uncertainty faces two devastating problems. Second, the motivations for wanting a theory of what to do given descriptive uncertainty do not carry over to normative uncertainty. Descriptive facts may be inaccessible even (...) in principle, and ignorance of them excuses one from blame, but normative facts are in principle accessible, and ignorance of them arguably is no excuse. Normative facts differ from descriptive facts: normative facts affect what we ought to do no matter what, while descriptive facts affect what we ought to do only insofar as we are aware of them. (shrink)

In this paper, I enter the debate between those who hold that our normative uncertainty matters for what we ought to do, and those who hold that only our descriptive uncertainty matters. I argue that existing views in both camps have unacceptable implications in cases where our descriptive beliefs depend on our normative beliefs. I go on to propose a fix which is available only to those who hold that normative uncertainty matters, ultimately leaving the challenge as a threat to (...) recent skepticism about such views. (shrink)

How ought you to evaluate your options if you’re uncertain about which axiology is true? One prominent response is Expected Moral Value Maximisation, the view that under axiological uncertainty, an option is better than another if and only if it has the greater expected moral value across axiologies. EMVM raises two fundamental questions. First, there’s a question about what it should even mean. In particular, it presupposes that we can compare moral value across axiologies. So to even understand EMVM, we (...) need to explain what it is for such comparisons to hold. Second, assuming that we understand it, there’s a question about whether EMVM is true. Since there are many plausible rivals, we need an argument to defend it. In this paper, I’ll introduce a representation theorem for axiological uncertainty to answer these two questions. Roughly, the theorem shows that if all our axiologies satisfy the von Neumann–Morgenstern axioms, and if the facts about which options are better than which in light of your uncertainty also satisfy these axioms as well as a Pareto condition, then these facts have a relevantly unique expected utility representation. If I’m right, this theorem at once affords us a compelling way to understand EMVM—and specifically intertheoretic comparisons—and a systematic argument for its truth. (shrink)

This paper argues in favor of a particular account of decision‐making under normative uncertainty: that, when it is possible to do so, one should maximize expected choice‐worthiness. Though this position has been often suggested in the literature and is often taken to be the ‘default’ view, it has so far received little in the way of positive argument in its favor. After dealing with some preliminaries and giving the basic motivation for taking normative uncertainty into account in our decision‐making, we (...) consider and provide new arguments against two rival accounts that have been offered—the accounts that we call ‘My Favorite Theory’ and ‘My Favorite Option’. We then give a novel argument for comparativism—the view that, under normative uncertainty, one should take into account both probabilities of different theories and magnitudes of choice‐worthiness. Finally, we further argue in favor of maximizing expected choice‐worthiness and consider and respond to five objections. (shrink)

How should an agent decide what to do when she is uncertain not just about morally relevant empirical matters, like the consequences of some course of action, but about the basic principles of morality itself? This question has only recently been taken up in a systematic way by philosophers. Advocates of moral hedging claim that an agent should weigh the reasons put forward by each moral theory in which she has positive credence, considering both the likelihood that that theory is (...) true and the strength of the reasons it posits. The view that it is sometimes rational to hedge for one's moral uncertainties, however, has recently come under attack both from those who believe that an agent should always be guided by the dictates of the single moral theory she deems most probable and from those who believe that an agent's moral beliefs are simply irrelevant to what she ought to do. Among the many objections to hedging that have been pressed in the recent literature is the worry that there is no non-arbitrary way of making the intertheoretic comparisons of moral value necessary to aggregate the value assignments of rival moral theories into a single ranking of an agent's options. -/- This dissertation has two principal objectives: First, I argue that, contra these recent objections, an agent's moral beliefs and uncertainties are relevant to what she rationally ought to do, and more particularly, that agents are at least sometimes rationally required to hedge for their moral uncertainties. My principal argument for these claims appeals to the enkratic conception of rationality, according to which the requirements of practical rationality derive from an agent's beliefs about the objective, desire-independent value or choiceworthiness of her options. Second, I outline a new general theory of rational choice under moral uncertainty. Central to this theory is the idea of content-based aggregation, that the principles according to which an agent should compare and aggregate rival moral theories are grounded in the content of those theories themselves, including not only their value assignments but also the metaethical and other non-surface-level propositions that underlie, justify, or explain those value assignments. (shrink)

We are often unsure about what we ought to do. This can be because we lack empirical knowledge, such as the extent to which future generations will be harmed by climate change. It can also be because we lack normative knowledge, such as the relative moral importance of the interests of present people and the interests of future people. However, though the question of how one ought to act under empirical uncertainty has been addressed extensively by both economists and philosophers---with (...) expected utility theory providing the standard formal framework---the question of how one ought to act under normative uncertainty is comparatively neglected. My thesis attempts to address this gap. -/- In my thesis I develop a view that I call metanormativism: that there are second-order norms that govern action that are relative to a decision-maker's uncertainty about first-order norms. -/- In the first part of the thesis, I defend one specific metanormative view: that under normative uncertainty decision-makers should maximise expected choice-worthiness, treating normative uncertainty analogously with empirical uncertainty. Drawing on the analogy between decision-making under normative uncertainty and social choice theory, I defend this view at length in response to the problem of merely ordinal theories and the problem of intertheoretic value comparisons. -/- In the second part of the thesis, I explore the implications of metanormativism for other philosophical issues. I argue that it has important consequences regarding the theory of rational action in the face of incomparable values, the causal/evidential debate in decision-theory, and our assessment of the value of moral philosophy. (shrink)

Some philosophers have recently argued that decision-makers ought to take normative uncertainty into account in their decisionmaking. These philosophers argue that, just as it is plausible that we should maximize expected value under empirical uncertainty, it is plausible that we should maximize expected choice-worthiness under normative uncertainty. However, such an approach faces two serious problems: how to deal with merely ordinal theories, which do not give sense to the idea of magnitudes of choice-worthiness; and how, even when theories do give (...) sense to magnitudes of choice-worthiness, to compare magnitudes of choice-worthiness across different theories. Some critics have suggested that these problems are fatal to the project of developing a normative account of decision-making under normative uncertainty. The primary purpose of this article is to show that this is not the case. To this end, I develop an analogy between decision-making under normative uncertainty and the problem of social choice, and then argue that the Borda Rule provides the best way of making decisions in the face of merely ordinal theories and intertheoretic incomparability. (shrink)

Esteemed philosopher John Broome avoids the familiar ideological stances on climate change policy and examines the issue through an invigorating new lens. As he considers the moral dimensions of climate change, he reasons clearly through what universal standards of goodness and justice require of us, both as citizens and as governments. His conclusions—some as demanding as they are logical—will challenge and enlighten. Eco-conscious readers may be surprised to hear they have a duty to offset all their carbon emissions, while policy (...) makers will grapple with Broome’s analysis of what if anything is owed to future generations. From the science of greenhouse gases to the intricate logic of cap and trade, Broome reveals how the principles that underlie everyday decision making also provide simple and effective ideas for confronting climate change. Climate Matters is an essential contribution to one of the paramount issues of our time. (shrink)

We are often uncertain how to behave morally in complex situations. In this controversial study, Ted Lockhart contends that moral philosophy has failed to address how we make such moral decisions. Adapting decision theory to the task of decision-making under moral uncertainly, he proposes that we should not always act how we feel we ought to act, and that sometimes we should act against what we feel to be morally right. Lockhart also discusses abortion extensively and proposes new ways to (...) deal with the ethical and moral issues which surround it. (shrink)

One might think that money pumps directed at agents with cyclic preferences can be avoided by foresight. This view was challenged two decades ago by the discovery of a money pump with foresight, which works against agents who use backward induction. But backward induction implausibly assumes that the agent would act rationally and retain her trust in her future rationality even at choice nodes that could only be reached if she were to act irrationally. This worry does not apply to (...) BI-terminating decision problems, where at each choice node backward induction prescribes a move that terminates further action. For BI-terminating decision problems, it is enough to assume that rationality and trust in rationality are retained at choice nodes reachable by rational moves. The old money pump with foresight was not BI-terminating. In this paper, we present a new money pump with foresight, one that is both BI-terminating and considerably simpler. (shrink)

Independence is the condition that, if X is preferred to Y, then a lottery between X and Z is preferred to a lottery between Y and Z given the same probability of Z. Is it rationally required that one’s preferences conform to Independence? The main objection to this requirement is that it would rule out the alleged rationality of Allais and Ellsberg Preferences. In this paper, I put forward a sequential dominance argument with fairly weak assumptions for a variant of (...) Independence (called Independence for Constant Prospects), which shows that Allais and Ellsberg Preferences are irrational. Hence this influential objection (that is, the alleged rationality of Allais and Ellsberg Preferences) can be rebutted. I also put forward a number of sequential dominance arguments that various versions of Independence are requirements of rationality. One of these arguments is based on very minimal assumptions, but the arguments for the versions of Independence which are strong enough to serve in the standard axiomatization of Expected Utility Theory need notably stronger assumptions. (shrink)

One of the principles on how to act under moral uncertainty, My Favourite Theory, says roughly that a morally conscientious agent chooses an option that is permitted by the most credible moral theory. In defence of this principle, we argue that it prescribes consistent choices over time, without relying on intertheoretic comparisons of value, while its main rivals are either plagued by moral analogues of money pumps or in need of a method for making non-arbitrary intertheoretic comparisons. We rebut the (...) arguments that have been levelled against My Favourite Theory and offer some arguments against intertheoretic comparisons of value. (shrink)

One of the perennial challenges of ethical theory has been to provide an answer to a number of views that appear to undermine the importance of ethical questions. We may refer to such views collectively as “deflationary ethical theories.” These include theories, such as nihilism, according to which no action is better than any other, as well as relativistic theories according to which no ethical theory is better than any other. In this article I present a new response to such (...) deflationary ethical views. Drawing a distinction between acceptance and rejection, on the one hand, and belief and disbelief, on the other, I argue that we have strong reason to reject these theories, even if we do not have reason to disbelieve them. In Section I, I clarify the question of what ethical theory we should accept, and I argue for the central importance of this question. In Section II, I discuss what I call “absolutely deflationary” ethical theories. These are theories according to which it matters not at all what we do or not at all what ethical theory we accept. I argue that it is generally rational to reject any theory of this kind. In Section III, I discuss what I call “relatively deflationary” ethical theories. These are theories according to which it matters little what we do or what ethical theory we accept. I argue that we have strong pro tanto reason to reject theories of this kind. And then, in Sections IV and V, I reply to some common objections to my arguments. Throughout, I will be arguing not that deflationary ethical theories are false but only that we should reject them from the practical point of view as a basis for guiding our actions. (shrink)

A major problem for interpersonal aggregation is how to compare utility across individuals; a major problem for decision-making under normative uncertainty is the formally analogous problem of how to compare choice-worthiness across theories. We introduce and study a class of methods, which we call statistical normalization methods, for making interpersonal comparisons of utility and intertheoretic comparisons of choice-worthiness. We argue against the statistical normalization methods that have been proposed in the literature. We argue, instead, in favor of normalization of variance: (...) we claim that this is the account that most plausibly gives all individuals or theories ‘equal say’. To this end, we provide two proofs that variance normalization has desirable properties that all other normalization methods lack, though we also show how different assumptions could lead one to axiomatize alternative statistical normalization methods. (shrink)

Probably many people have cyclic preferences: they prefer A to B, B to C and C to A for some objects of choice A, B and C. Recent work has resurrected the objection to cyclic preference that agents possessing them are open to exploitation by means of ‘money pumps’. The paper briefly reviews this work and proposes a general approach to problems of sequential choice that makes cyclic preference immune to exploitation by means of these new mechanisms.

This is a major contribution to the theory of rational choice which will be of particular interest to philosophers and economists. The author sets out the foundations of rational choice, and then sketches a dynamic choice framework in which principles of ordering and independence follow from a number of apparently plausible conditions. However, there is potential conflict among these conditions, and when they are weakened to avoid it the usual foundations of rational choice no longer prevail. The thrust of the (...) argument is to suggest that the theory of rational choice is less deterministic than many suppose. (shrink)

Nobody's going to object to the advice "Do the right thing", but that doesn't mean everyone's always going to follow it. Sometimes this is because of our volitional limitations; we cannot always bring ourselves to make the sacrifices that right action requires. But sometimes this is because of our cognitive limitations; we cannot always be sure of what is right. Sometimes we can't be sure of what's right because we don't know the non-normative facts. But sometimes, even if we were (...) to know all of the non-normative facts, we'd still not be sure about what's right, because we're uncertain about the normative reasons those facts give us. In this dissertation, I attempt to answer the question of what we're to do when we must act under fundamentally normative uncertainty. It's tempting to think that, in such circumstances, we should do what we regard as most probably right. I argue that this view is mistaken, for it is insensitive to how degrees of actions' values compare across different normative hypotheses; if an action is probably right, but, if wrong, is terribly, terribly, wrong, it may be rational not to do that action. A better answer is that we should do the action with the highest expected value. I spend the first part of the dissertation providing arguments for and rebutting arguments against this view of action under normative uncertainty. I spend the next part of the dissertation explaining what degrees of value are, and showing how they can be compared across normative hypotheses. In the remaining parts of the dissertation, I consider two questions related to our primary question -- first, what is one required, or obligated, to do under normative uncertainty; and second, what is it rational for one to do when one is not only normatively uncertain in the way we've been discussing, but also uncertain about what it is rational to do under this sort of normative uncertainty. (shrink)