What should we do when we are not certain about what we morally should do? There is a long history of theorizing about decision-making under empirical uncertainty, but surprisingly little has been written about the moral uncertainty expressed by this question. Only very recently have philosophers started to systematically address the nature of such uncertainty and its impacts on decision-making. This paper addresses the main problems raised by moral uncertainty and critically examines some proposed solutions.

What should a person do when, through no fault of her own, she ends up believing a false moral theory? Some suggest that she should act against what the false theory recommends; others argue that she should follow her rationally held moral beliefs. While the former view better accords with intuitions about cases, the latter one seems to enjoy a critical advantage: It seems better able to render moral requirements ‘followable’ or ‘action-guiding.’ But this tempting thought proves difficult to justify. (...) Indeed, whether it can be justified turns out to depend importantly on the rational status of epistemic akrasia. Furthermore, it can be argued, from premises all parties to the moral ignorance debate should accept, that rational epistemic akrasia is possible. If the argument proves successful, it follows that a person should sometimes act against her rationally held moral convictions. (shrink)

In the growing literature on decision-making under moral uncertainty, a number of skeptics have argued that there is an insuperable barrier to rational "hedging" for the risk of moral error, namely the apparent incomparability of moral reasons given by rival theories like Kantianism and utilitarianism. Various general theories of intertheoretic value comparison have been proposed to meet this objection, but each suffers from apparently fatal flaws. In this paper, I propose a more modest approach that aims to identify classes of (...) moral theories that share common principles strong enough to establish bases for intertheoretic comparison. I show that, contra the claims of skeptics, there are often rationally perspicuous grounds for precise, quantitative value comparisons within such classes. In light of this fact, I argue, the existence of some apparent incomparabilities between widely divergent moral theories cannot serve as a general argument against hedging for one's moral uncertainties. (shrink)

Defenders of deontological constraints in normative ethics face a challenge: how should an agent decide what to do when she is uncertain whether some course of action would violate a constraint? The most common response to this challenge has been to defend a threshold principle on which it is subjectively permissible to act iff the agent's credence that her action would be constraint-violating is below some threshold t. But the threshold approach seems arbitrary and unmotivated: what would possibly determine where (...) the threshold should be set, and why should there be any precise threshold at all? Threshold views also seem to violate ought agglomeration, since a pair of actions each of which is below the threshold for acceptable moral risk can, in combination, exceed that threshold. In this paper, I argue that stochastic dominance reasoning can vindicate and lend rigor to the threshold approach: given characteristically deontological assumptions about the moral value of acts, it turns out that morally safe options will stochastically dominate morally risky alternatives when and only when the likelihood that the risky option violates a moral constraint is greater than some precisely definable threshold (in the simplest case, .5). I also show how, in combination with the observation that deontological moral evaluation is relativized to particular choice situations, this approach can overcome the agglomeration problem. This allows the deontologist to give a precise and well-motivated response to the problem of uncertainty. (shrink)

How should deontologists concerned with the ethics of killing apply their moral theory when we don’t know all the facts relevant to the permissibility of our action? Though the stakes couldn’t be higher, and uncertainty is endemic where killing is concerned, few deontologists have an answer to this question. In this paper I canvass two possibilities: that we should apply a threshold standard, equivalent to the ‘beyond a reasonable doubt’ standard applied for criminal punishment; and that we should fit our (...) deontological ethical theory into the apparatus of decision theory. I show that the first approach faces insurmountable obstacles, while the second holds much more promise for deontologists than they might first have assumed. (shrink)

How ought you to evaluate your options if you’re uncertain about which axiology is true? One prominent response is Expected Moral Value Maximisation, the view that under axiological uncertainty, an option is better than another if and only if it has the greater expected moral value across axiologies. EMVM raises two fundamental questions. First, there’s a question about what it should even mean. In particular, it presupposes that we can compare moral value across axiologies. So to even understand EMVM, we (...) need to explain what it is for such comparisons to hold. Second, assuming that we understand it, there’s a question about whether EMVM is true. Since there are many plausible rivals, we need an argument to defend it. In this paper, I’ll introduce a representation theorem for axiological uncertainty to answer these two questions. Roughly, the theorem shows that if all our axiologies satisfy the von Neumann–Morgenstern axioms, and if the facts about which options are better than which in light of your uncertainty also satisfy these axioms as well as a Pareto condition, then these facts have a relevantly unique expected utility representation. If I’m right, this theorem at once affords us a compelling way to understand EMVM—and specifically intertheoretic comparisons—and a systematic argument for its truth. (shrink)

In ‘Normative Uncertainty as a Voting Problem’, William MacAskill argues that positive credence in ordinal-structured or intertheoretically incomparable normative theories does not prevent an agent from rationally accounting for her normative uncertainties in practical deliberation. Rather, such an agent can aggregate the theories in which she has positive credence by methods borrowed from voting theory—specifically, MacAskill suggests, by a kind of weighted Borda count. The appeal to voting methods opens up a promising new avenue for theories of rational choice under (...) normative uncertainty. The Borda rule, however, is open to at least two serious objections. First, it seems implicitly to ‘cardinalize’ ordinal theories, and so does not fully face up to the problem of merely ordinal theories. Second, the Borda rule faces a problem of option individuation. MacAskill attempts to solve this problem by invoking a measure on the set of practical options. But it is unclear that there is any natural way of defining such a measure that will not make the output of the Borda rule implausibly sensitive to irrelevant empirical features of decision-situations. After developing these objections, I suggest an alternative: the McKelvey uncovered set, a Condorcet method that selects all and only the maximal options under a strong pairwise defeat relation. This decision rule has several advantages over Borda and mostly avoids the force of MacAskill’s objection to Condorcet methods in general. (shrink)

According to ‘Excluders’, descriptive uncertainty – but not normative uncertainty – matters to what we ought to do. Recently, several authors have argued that those wishing to treat normative uncertainty differently from descriptive uncertainty face a dependence problem because one's descriptive uncertainty can depend on one's normative uncertainty. The aim of this paper is to determine whether the phenomenon of dependence poses a decisive problem for Excluders. I argue that existing arguments fail to show this, and that, while stronger ones (...) can be found, Excluders can escape them. (shrink)

A straightforward way to handle moral uncertainty is simply to follow the moral theory in which you have most credence. This approach is known as My Favourite Theory. In this paper, I argue that, in some cases, My Favourite Theory prescribes choices that are, sequentially, worse in expected moral value than the opposite choices according to each moral theory you have any credence in. In addition this, problem generalizes to other approaches that avoid intertheoretic comparisons of value, such as My (...) Favourite Option, the Borda Rule, Variance Normalization, and the Principle of Maximizing Expected Normalized Moral Value. (shrink)

This essay explores the following position: Ultimate moral principles are a priori truths; hence, it is irrational to assign a non-zero credence to any proposition that is incompatible with these ultimate moral principles ; and this sort of irrationality, if it could have been avoided, is in a sense inexcusable. So—at least if moral relativism is false—in any disagreement about ultimate moral principles, at least one party to the disagreement is inexcusably irrational. This position may seem extreme, but it is (...) argued that it is more plausible than it first appears. (shrink)

How should an agent decide what to do when she is uncertain not just about morally relevant empirical matters, like the consequences of some course of action, but about the basic principles of morality itself? This question has only recently been taken up in a systematic way by philosophers. Advocates of moral hedging claim that an agent should weigh the reasons put forward by each moral theory in which she has positive credence, considering both the likelihood that that theory is (...) true and the strength of the reasons it posits. The view that it is sometimes rational to hedge for one's moral uncertainties, however, has recently come under attack both from those who believe that an agent should always be guided by the dictates of the single moral theory she deems most probable and from those who believe that an agent's moral beliefs are simply irrelevant to what she ought to do. Among the many objections to hedging that have been pressed in the recent literature is the worry that there is no non-arbitrary way of making the intertheoretic comparisons of moral value necessary to aggregate the value assignments of rival moral theories into a single ranking of an agent's options. -/- This dissertation has two principal objectives: First, I argue that, contra these recent objections, an agent's moral beliefs and uncertainties are relevant to what she rationally ought to do, and more particularly, that agents are at least sometimes rationally required to hedge for their moral uncertainties. My principal argument for these claims appeals to the enkratic conception of rationality, according to which the requirements of practical rationality derive from an agent's beliefs about the objective, desire-independent value or choiceworthiness of her options. Second, I outline a new general theory of rational choice under moral uncertainty. Central to this theory is the idea of content-based aggregation, that the principles according to which an agent should compare and aggregate rival moral theories are grounded in the content of those theories themselves, including not only their value assignments but also the metaethical and other non-surface-level propositions that underlie, justify, or explain those value assignments. (shrink)

Suppose that an altruistic agent who is uncertain between evidential and causal decision theory finds herself in a situation where these theories give conflicting verdicts. We argue that even if she has significantly higher credence in CDT, she should nevertheless act in accordance with EDT. First, we claim that the appropriate response to normative uncertainty is to hedge one's bets. That is, if the stakes are much higher on one theory than another, and the credences you assign to each of (...) these theories are not very different, then it is appropriate to choose the option that performs best on the high-stakes theory. Second, we show that, given the assumption of altruism, the existence of correlated decision makers will increase the stakes for EDT but leave the stakes for CDT unaffected. Together these two claims imply that whenever there are sufficiently many correlated agents, the appropriate response is to act in accordance with EDT. (shrink)

In this paper, I argue that the fetishism objection to moral hedging fails. The objection rests on a reasons-responsiveness account of moral worth, according to which an action has moral worth only if the agent is responsive to moral reasons. However, by adopting a plausible theory of non-ideal moral reasons, one can endorse a reasons-responsiveness account of moral worth while maintaining that moral hedging is sometimes an appropriate response to moral uncertainty. Thus, the theory of moral worth upon which the (...) fetishism objection relies does not, in fact, support that objection. (shrink)

Metanormativists hold that moral uncertainty can affect how we ought, in some morally authoritative sense, to act. Many metanormativists aim to generalize expected utility theory for normative uncertainty. Such accounts face the “easy problem of intertheoretic comparisons”: the worry that distinct theories’ assessments of choiceworthiness are incomparable. The easy problem may well be resolvable, but another problem looms: while some moral theories assign cardinal degrees of choiceworthiness, other theories’ choiceworthiness assignments are merely ordinal. Expected choiceworthiness over such theories is undefined. (...) Call this the “hard problem of intertheoretic comparisons.” This paper argues that to solve the hard problem, we should model moral theories with imprecise choiceworthiness. Imprecise choiceworthiness assignments can model incomplete cardinal information about choiceworthiness, with precise cardinal choiceworthiness and merely ordinal choiceworthiness as limiting cases. Generalizing familiar decision theories for imprecise choiceworthiness to the case of moral uncertainty generates puzzles, however: natural generalizations seem to require reifying parts of the model that don’t correspond to anything in normative reality. I discuss three ways of addressing this problem: by demystifying the reified elements by using them as promiscuously as possible; by constructing alternative decision theories that don’t require the troublesome elements; and by employing an alternative model of metanormative decision problems, and of moral uncertainty generally. (shrink)

The aim of this paper is to examine whether it would be advantageous to introduce knowledge norms instead of the currently assumed rational credence norms into the debate about decision making under normative uncertainty. There is reason to think that this could help us better accommodate cases in which agents are rationally highly confident in false moral views. I show how Moss’ view of probabilistic knowledge can be fruitfully employed to develop a decision theory that delivers plausible verdicts in these (...) cases. I also argue that, for this new view to be better than existing alternatives, it must adopt a particular solution to the new evil demon problem, which asks whether agents and their BIV-counterparts are equally justified. In order to get an attractive decision theory for cases of moral uncertainty, we must reject the claim that agents and their BIV-counterparts are equally justified. Moreover, the resulting view must be supplemented with a moral epistemology that explains how it is possible to be rationally morally uncertain. This is especially challenging if we assume that moral truths are knowable a priori. (shrink)

How should you decide what to do when you're uncertain about basic normative principles (e.g., Kantianism vs. utilitarianism)? A natural suggestion is to follow some "second-order" norm: e.g., "comply with the first-order norm you regard as most probable" or "maximize expected choiceworthiness". But what if you're uncertain about second-order norms too -- must you then invoke some third-order norm? If so, it seems that any norm-guided response to normative uncertainty is doomed to a vicious regress. In this paper, I aim (...) to rescue second-order norms from this threat of regress. I first elaborate and defend the suggestion some philosophers have entertained that the regress problem forces us to accept normative externalism, the view that at least one norm is incumbent on agents regardless of their beliefs or evidence concerning that norm. But, I then argue, we need not accept externalism about first-order (e.g., moral) norms, thus closing off any question of what an agent should do in light of her normative beliefs. Rather, it is more plausible to ascribe external force to a single, second-order rational norm: the enkratic principle, correctly formulated. This modest form of externalism, I argue, is both intrinsically well-motivated and sufficient to head off the threat of regress. (shrink)

We sometimes seem to face fundamental moral uncertainty, i.e., uncertainty about what is morally good or morally right that cannot be reduced to ordinary descriptive uncertainty. This phenomenon raises a puzzle for noncognitivism, according to which moral judgments are desire-like attitudes as opposed to belief-like attitudes. Can a state of moral uncertainty really be a noncognitive state? So far, noncognitivists have not been able to offer a completely satisfactory account. Here, we argue that noncognitivists should exploit the formal analogy between (...) moral uncertainty and moral multi-objective decision problems. Our ‘multi-objective story’ enables noncognitivists to save our moral uncertainty thought and talk by explaining how the underlying phenomenon could be noncognitive. (shrink)

Harming other people is prima facie wrong. Unless we can be very certain that doing so is justified under the circumstances, we ought not to do it. In this paper, I argue that we ought to dismantle harsh retributivist criminal justice systems for this reason; we cannot be sufficiently certain that the harm is justified. Gregg Caruso, Ben Vilhauer and others have previously argued for the same conclusion; however, my own version sidesteps certain controversial premises of theirs. Harsh retributivist criminal (...) justice can only be morally right if the following three propositions are true: Moral responsibility exists, retributivism is right, and we can find out how much punishment offenders deserve for their crimes. Suppose that we initially assign a high credence to each of the three propositions; I assume for the sake of argument that there are good arguments in support of each. Nevertheless, these arguments ultimately depend on intuitions. Since we have philosophical peers whose intuitions differ from ours, we ought to downgrade our credence in each. However, even slightly less credence in each proposition means far less credence in a conjunction of all three. Since the stakes are high and there are morally safer options for a criminal justice system, we ought to dismantle harsh retributivist ones. (shrink)

This paper explores the idea that it is instrumentally valuable to learn normative truths. We consider an argument for "normative hedging" based on this principle, and examine the structure of decision-making under moral uncertainty that arises from it. But it also turns out that the value of normative information is inconsistent with the principle that learning *empirical* truths is instrumentally valuable. We conclude with a brief comment on "metanormative regress.".

I analyze recent discussions about making moral decisions under normative uncertainty. I discuss whether this kind of uncertainty should have practical consequences for decisions and whether there are reliable methods of reasoning that deal with the possibility that we are wrong about some moral issues. I defend a limited use of the decision theory model of reasoning in cases of normative uncertainty.