This paper presents some impossibility results for certain views about what you should do when you are uncertain about which moral theory is true. I show that under reasonable and extremely minimal ways of defining what a moral theory is, it follows that the concept of expected moral choiceworthiness is undefined, and more generally that any theory of decision-making under moral uncertainty must generate pathological results.

Desire is an important philosophical topic that deeply impacts everyday life. Philosophical practice is an emerging trend that uses philosophical theories and methods as a guide to living a eu‐ daimonic life. In this paper, we define desire philosophically and compare different theories of desire in specific Eastern and Western traditions. Based on the Lacanian conceptual–terminological triad of “Need‐Demand‐Desire”, the research of desire is further divided into three dimensions, namely, the subject of desire, the object of desire, and the desire (...) itself. The concept of desire is then an‐ alyzed from this triad and these three dimensions through different philosophical theories. This paper selects Buddhism as the representative of Eastern tradition, and Stoicism as the representative of the West, paying special attention to Stoicism’s “spiritual exercises” following Pierre Hadot. By exploring and comparing the Buddhist paths to liberation from suffering (i.e., the Four Noble Truths and the Noble Eightfold Path) and the two theoretical pillars in Stoicism (i.e., the notions of “living according to nature” and “the dichotomy of control”), practical guidance is then provided for un‐ derstanding and regulating desire in times of crisis. This understanding and regulation of desire constitutes a philosophical therapy for today’s troubles, particularly those caused by excessive or irrational desires. (shrink)

In this paper I present an account of a distinctive form of ‘practical’ or ‘deliberative’ uncertainty that has been central in debates in both ethics and metaethics. Many writers have assumed that such uncertainty concerns a special normative question, such as what we ought to do ‘all things considered.’ I argue against this assumption and instead endorse an alternative view of such uncertainty, which combines elements of both metaethical cognitivism and non-cognitivism. A notable consequence of this view is that even (...) if there are objective and irreducible truths about how we ought to act, all things considered, the ‘central deliberative question,’ as it’s sometimes called, doesn’t concern such truths. Instead, that question doesn’t have a true answer. (shrink)

Deontologists have been slow to address decision-making under risk and uncertainty, no doubt because the standard approaches to non-moral decision theory appear superficially similar to consequentialist moral reasoning. I identify some central tenets of simple decision theory and show that they should not put deontologists off, before showing where we should go next to develop a comprehensive deontological decision theory.

The topic of this thesis is axiological uncertainty – the question of how you should evaluate your options if you are uncertain about which axiology is true. As an answer, I defend Expected Value Maximisation (EVM), the view that one option is better than another if and only if it has the greater expected value across axiologies. More precisely, I explore the axiomatic foundations of this view. I employ results from state-dependent utility theory, extend them in various ways and interpret (...) them accordingly, and thus provide axiomatisations of EVM as a theory of axiological uncertainty. (shrink)

A number of philosophers have claimed that we should take not just empirical uncertainty but also fundamental moral uncertainty into account in our decision-making, and that, despite widespread moral disagreement, doing so would allow us to draw robust lessons for some issues in practical ethics. In this article, I argue that, so far, the implications for practical ethics have been drawn too simplistically. First, the implications of moral uncertainty for normative ethics are far more wide-ranging than has been noted so (...) far. Second, one can't straightforwardly argue from moral uncertainty to particular conclusions in practical ethics, both because of ‘interaction’ effects between moral issues, and because of the variety of different possible intertheoretic comparisons that one can reasonably endorse. (shrink)

In this paper, I argue that the fetishism objection to moral hedging fails. The objection rests on a reasons-responsiveness account of moral worth, according to which an action has moral worth only if the agent is responsive to moral reasons. However, by adopting a plausible theory of non-ideal moral reasons, one can endorse a reasons-responsiveness account of moral worth while maintaining that moral hedging is sometimes an appropriate response to moral uncertainty. Thus, the theory of moral worth upon which the (...) fetishism objection relies does not, in fact, support that objection. (shrink)

The principle that rational agents should maximize expected utility or choiceworthiness is intuitively plausible in many ordinary cases of decision-making under uncertainty. But it is less plausible in cases of extreme, low-probability risk (like Pascal's Mugging), and intolerably paradoxical in cases like the St. Petersburg and Pasadena games. In this paper I show that, under certain conditions, stochastic dominance reasoning can capture most of the plausible implications of expectational reasoning while avoiding most of its pitfalls. Specifically, given sufficient background uncertainty (...) about the choiceworthiness of one's options, many expectation-maximizing gambles that do not stochastically dominate their alternatives "in a vacuum" become stochastically dominant in virtue of that background uncertainty. But, even under these conditions, stochastic dominance will not require agents to accept options whose expectational superiority depends on sufficiently small probabilities of extreme payoffs. The sort of background uncertainty on which these results depend looks unavoidable for any agent who measures the choiceworthiness of her options in part by the total amount of value in the resulting world. At least for such agents, then, stochastic dominance offers a plausible general principle of choice under uncertainty that can explain more of the apparent rational constraints on such choices than has previously been recognized. (shrink)

In the growing literature on decision-making under moral uncertainty, a number of skeptics have argued that there is an insuperable barrier to rational "hedging" for the risk of moral error, namely the apparent incomparability of moral reasons given by rival theories like Kantianism and utilitarianism. Various general theories of intertheoretic value comparison have been proposed to meet this objection, but each suffers from apparently fatal flaws. In this paper, I propose a more modest approach that aims to identify classes of (...) moral theories that share common principles strong enough to establish bases for intertheoretic comparison. I show that, contra the claims of skeptics, there are often rationally perspicuous grounds for precise, quantitative value comparisons within such classes. In light of this fact, I argue, the existence of some apparent incomparabilities between widely divergent moral theories cannot serve as a general argument against hedging for one's moral uncertainties. (shrink)

How should an agent decide what to do when she is uncertain not just about morally relevant empirical matters, like the consequences of some course of action, but about the basic principles of morality itself? This question has only recently been taken up in a systematic way by philosophers. Advocates of moral hedging claim that an agent should weigh the reasons put forward by each moral theory in which she has positive credence, considering both the likelihood that that theory is (...) true and the strength of the reasons it posits. The view that it is sometimes rational to hedge for one's moral uncertainties, however, has recently come under attack both from those who believe that an agent should always be guided by the dictates of the single moral theory she deems most probable and from those who believe that an agent's moral beliefs are simply irrelevant to what she ought to do. Among the many objections to hedging that have been pressed in the recent literature is the worry that there is no non-arbitrary way of making the intertheoretic comparisons of moral value necessary to aggregate the value assignments of rival moral theories into a single ranking of an agent's options. -/- This dissertation has two principal objectives: First, I argue that, contra these recent objections, an agent's moral beliefs and uncertainties are relevant to what she rationally ought to do, and more particularly, that agents are at least sometimes rationally required to hedge for their moral uncertainties. My principal argument for these claims appeals to the enkratic conception of rationality, according to which the requirements of practical rationality derive from an agent's beliefs about the objective, desire-independent value or choiceworthiness of her options. Second, I outline a new general theory of rational choice under moral uncertainty. Central to this theory is the idea of content-based aggregation, that the principles according to which an agent should compare and aggregate rival moral theories are grounded in the content of those theories themselves, including not only their value assignments but also the metaethical and other non-surface-level propositions that underlie, justify, or explain those value assignments. (shrink)

Deontologists have long been upbraided for lacking an account of justified decision- making under risk and uncertainty. One response is to develop a deontological decision theory—a set of necessary and sufficient conditions for an act’s being permissible given an agent’s imperfect information. In this article, I show that deontologists can make more use of regular decision theory than some might have thought, but that we must adapt decision theory to accommodate agent- centered options—permissions to favor or sacrifice our own interests, (...) when doing so is overall morally worse. Accommodating options requires more than just amend- ing the decision-theoretic ‘value function’. We must change the decision rule as well. (shrink)

I analyze recent discussions about making moral decisions under normative uncertainty. I discuss whether this kind of uncertainty should have practical consequences for decisions and whether there are reliable methods of reasoning that deal with the possibility that we are wrong about some moral issues. I defend a limited use of the decision theory model of reasoning in cases of normative uncertainty.

In this article, I present a new interpretation of the pro-life view on the status of early human embryos. In my understanding, this position is based not on presumptions about the ontological status of embryos and their developmental capabilities but on the specific criteria of rational decisions under uncertainty and on a cautious response to the ambiguous status of embryos. This view, which uses the decision theory model of moral reasoning, promises to reconcile the uncertainty about the ontological status of (...) embryos with the certainty about normative obligations. I will demonstrate that my interpretation of the pro-life view, although seeming to be stronger than the standard one, has limited scope and cannot be used to limit destructive research on human embryos. (shrink)

I argue that many of the priority rankings that have been proposed by effective altruists seem to be in tension with apparently reasonable assumptions about the rational pursuit of our aims in the face of uncertainty. The particular issue on which I focus arises from recognition of the overwhelming importance and inscrutability of the indirect effects of our actions, conjoined with the plausibility of a permissive decision principle governing cases of deep uncertainty, known as the maximality rule. I conclude that (...) we lack a compelling decision theory that is consistent with a longtermist perspective and does not downplay the depth of our uncertainty, while also supporting orthodox effective altruist conclusions about cause prioritization. (shrink)

Even if I think it very likely that some morally good act is supererogatory rather than obligatory, I may nonetheless be rationally required to perform that act. This claim follows from an apparently straightforward dominance argument, which parallels Jacob Ross's argument for 'rejecting' moral nihilism. These arguments face analogous pairs of objections that illustrate general challenges for dominance reasoning under normative uncertainty, but (I argue) these objections can be largely overcome. This has practical consequences for the ethics of philanthropy -- (...) in particular, it means that donors are often rationally required to maximize the positive impact of their donations. (shrink)

What should we do when we are not certain about what we morally should do? There is a long history of theorizing about decision-making under empirical uncertainty, but surprisingly little has been written about the moral uncertainty expressed by this question. Only very recently have philosophers started to systematically address the nature of such uncertainty and its impacts on decision-making. This paper addresses the main problems raised by moral uncertainty and critically examines some proposed solutions.

Artificially intelligent systems will be used to make increasingly important decisions about us. Many of these decisions will have to be made without universal agreement about the relevant moral facts. For other kinds of disagreement, it is at least usually obvious what kind of solution is called for. What makes moral disagreement especially challenging is that there are three different ways of handling it. _Moral solutions_ apply a moral theory or related principles and largely ignore the details of the disagreement. (...) _Compromise solutions_ apply a method of finding a compromise and taking information about the disagreement as input. _Epistemic solutions_ apply an evidential rule that treats the details of the disagreement as evidence of moral truth. Proposals for all three kinds of solutions can be found in the AI ethics and value alignment literature, but little has been said to justify choosing one over the other. I argue that the choice is best framed in terms of _moral risk_. (shrink)

The development of artificial intelligence will require systems of ethical decision making to be adapted for automatic computation. However, projects to implement moral reasoning in artificial moral agents so far have failed to satisfactorily address the widespread disagreement between competing approaches to moral philosophy. In this paper I argue that the proper response to this situation is to design machines to be fundamentally uncertain about morality. I describe a computational framework for doing so and show that it efficiently resolves common (...) obstacles to the implementation of moral philosophy in intelligent machines. (shrink)

Nick Bostrom and others have suggested treating decision-making under moral uncertainty as analogous to parliamentary decision-making. The core suggestion of this “parliamentary approach” is that the competing moral theories function like delegates to the parliament, and that these delegates then make decisions by some combination of bargaining and voting. There seems some reason to hope that such an approach might avoid standard objections to existing approaches (for example, the “maximise expected choiceworthiness” (MEC) and “my favourite theory” approaches). However, the parliamentary (...) approach is so far extremely underspecified, making it largely indeterminate how such a model will in fact behave in the respects that those concerned with moral uncertainty care about. This paper explores one way of making it precise. We treat predicaments of moral uncertainty as analogous to bargaining situations alone (setting aside voting), and apply a version of the Nash solution that is standard in bargaining theory. The resulting model does indeed perform in many of the hoped-for ways. However, so also does a version of MEC that employs a structural approach to intertheoretic comparisons. It seems to us an open question which, regarding this version of MEC and the bargaining-theoretic approach, is superior to the other. We identify the key points on which the two differ. (shrink)

When we are faced with a choice among acts, but are uncertain about the true state of the world, we may be uncertain about the acts’ “choiceworthiness”. Decision theories guide our choice by making normative claims about how we should respond to this uncertainty. If we are unsure which decision theory is correct, however, we may remain unsure of what we ought to do. Given this decision-theoretic uncertainty, meta-theories attempt to resolve the conflicts between our decision theories...but we may be (...) unsure which meta-theory is correct as well. This reasoning can launch a regress of ever-higher-order uncertainty, which may leave one forever uncertain about what one ought to do. There is, fortunately, a class of circumstances under which this regress is not a problem. If one holds a cardinal understanding of subjective choiceworthiness, and accepts certain other criteria, one’s hierarchy of metanormative uncertainty ultimately converges to precise definitions of “subjective choiceworthiness” for any finite set of acts. If one allows the metanormative regress to extend to the transfinite ordinals, the convergence criteria can be weakened further. Finally, the structure of these results applies straightforwardly not just to decision-theoretic uncertainty, but also to other varieties of normative uncertainty, such as moral uncertainty. (shrink)

This paper argues in favor of a particular account of decision‐making under normative uncertainty: that, when it is possible to do so, one should maximize expected choice‐worthiness. Though this position has been often suggested in the literature and is often taken to be the ‘default’ view, it has so far received little in the way of positive argument in its favor. After dealing with some preliminaries and giving the basic motivation for taking normative uncertainty into account in our decision‐making, we (...) consider and provide new arguments against two rival accounts that have been offered—the accounts that we call ‘My Favorite Theory’ and ‘My Favorite Option’. We then give a novel argument for comparativism—the view that, under normative uncertainty, one should take into account both probabilities of different theories and magnitudes of choice‐worthiness. Finally, we further argue in favor of maximizing expected choice‐worthiness and consider and respond to five objections. (shrink)

Given the deep disagreement surrounding population axiology, one should remain uncertain about which theory is best. However, this uncertainty need not leave one neutral about which acts are better or worse. We show that, as the number of lives at stake grows, the Expected Moral Value approach to axiological uncertainty systematically pushes one toward choosing the option preferred by the Total View and critical-level views, even if one’s credence in those theories is low.