In this essay, we explore an issue of moral uncertainty: what we are permitted to do when we are unsure about which moral principles are correct. We develop a novel approach to this issue that incorporates important insights from previous work on moral uncertainty, while avoiding some of the difficulties that beset existing alternative approaches. Our approach is based on evaluating and choosing between option sets rather than particular conduct options. We show how our approach is particularly well-suited to address (...) this issue of moral uncertainty with respect to agents that have credence in moral theories that are not fully consequentialist. (shrink)

There is no question that Fichte's theory of conscience is central to his system of ethics. Yet his descriptions of its role in practical deliberation appear inconsistent, if not contradictory. Many scholars have claimed that for Fichte conscience plays a material role by providing the content of our moral obligations—the Material Function View. Some have denied this, however, claiming that conscience only plays a formal role by testing our moral convictions in any given case—the Formal Function View. My aim in (...) this paper is to offer a new contribution to this debate. I begin by supplying further evidence in support of the view that conscience only plays a formal function in Fichte's ethics. Then I call attention to a deeper problem this view faces, namely, that it invites an infinite regress by making one's conviction a matter of higher-order reflection. The key to overcoming this threat, I argue, lies in Fichte's doctrine of feeling, whereby the criterion of one's conviction lies, not in a cognitive state, but in an affective state. In closing, I discuss the relevance of Fichte's theory for current debates over the nature of moral error and moral deference. (shrink)

In this article, I present a new interpretation of the pro-life view on the status of early human embryos. In my understanding, this position is based not on presumptions about the ontological status of embryos and their developmental capabilities but on the specific criteria of rational decisions under uncertainty and on a cautious response to the ambiguous status of embryos. This view, which uses the decision theory model of moral reasoning, promises to reconcile the uncertainty about the ontological status of (...) embryos with the certainty about normative obligations. I will demonstrate that my interpretation of the pro-life view, although seeming to be stronger than the standard one, has limited scope and cannot be used to limit destructive research on human embryos. (shrink)

Nick Bostrom and others have suggested treating decision-making under moral uncertainty as analogous to parliamentary decision-making. The core suggestion of this “parliamentary approach” is that the competing moral theories function like delegates to the parliament, and that these delegates then make decisions by some combination of bargaining and voting. There seems some reason to hope that such an approach might avoid standard objections to existing approaches (for example, the “maximise expected choiceworthiness” (MEC) and “my favourite theory” approaches). However, the parliamentary (...) approach is so far extremely underspecified, making it largely indeterminate how such a model will in fact behave in the respects that those concerned with moral uncertainty care about. This paper explores one way of making it precise. We treat predicaments of moral uncertainty as analogous to bargaining situations alone (setting aside voting), and apply a version of the Nash solution that is standard in bargaining theory. The resulting model does indeed perform in many of the hoped-for ways. However, so also does a version of MEC that employs a structural approach to intertheoretic comparisons. It seems to us an open question which, regarding this version of MEC and the bargaining-theoretic approach, is superior to the other. We identify the key points on which the two differ. (shrink)

We are sometimes unsure of the moral status of our relationships with other entities. Recent case studies in this uncertainty include our relationships with artificial agents (robots, assistant AI, etc.), animals, and patients with “locked-in” syndrome. Do these entities have basic moral standing? Could they count as true friends or lovers? What should we do when we do not know the answer to these questions? An influential line of reasoning suggests that, in such cases of moral uncertainty, we need meta-moral (...) decision rules that allow us to either minimize the risks of moral wrongdoing or improve the choice-worthiness of our actions. One particular argument adopted in this literature is the “risk asymmetry argument,” which claims that the risks associated with accepting or rejecting some moral facts may be sufficiently asymmetrical as to warrant favoring a particular practical resolution of this uncertainty. Focusing on the case study of artificial beings, this article argues that this is best understood as an ethical-epistemic challenge. The article argues that taking potential risk asymmetries seriously can help resolve disputes about the status of human–AI relationships, at least in practical terms (philosophical debates will, no doubt, continue); however, the resolution depends on a proper, empirically grounded assessment of the risks involved. Being skeptical about basic moral status, but more open to the possibility of meaningful relationships with such entities, may be the most sensible approach to take. (shrink)

Many philosophers in the field of meta-ethics believe that rational degrees of confidence in moral judgments should have a probabilistic structure, in the same way as do rational degrees of belief. The current paper examines this position, termed “moral Bayesianism,” from an empirical point of view. To this end, we assessed the extent to which degrees of moral judgments obey the third axiom of the probability calculus, ifP(A∩B)=0thenP(A∪B)=P(A)+P(B), known as finite additivity, as compared to degrees of beliefs on the one (...) hand and degrees of desires on the other. Results generally converged to show that degrees of moral judgment are more similar to degrees of belief than to degrees of desire in this respect. This supports the adoption of a Bayesian approach to the study of moral judgments. To further support moral Bayesianism, we also demonstrated its predictive power. Finally, we discuss the relevancy of our results to the meta-ethical debate between moral cognitivists and moral non-cognitivists. (shrink)

If non-human animals have high moral status, then we commit a grave moral error by eating them. Eating animals is thus morally risky, while many agree that it is morally permissible to not eat animals. According to some philosophers, then, non-animal ethicists should err on the side of caution and refrain from eating animals. I argue that this precautionary argument assumes a false dichotomy of dietary options: a diet that includes farm-raised animals or a diet that does not include animals (...) of any kind. There is a third dietary option, namely, a diet of plants and non-traditional animal protein, and there is evidence that such a diet results in the least amount of harm to animals. It follows therefore that moral uncertainty does not support the adoption of a vegetarian diet. (shrink)

A straightforward way to handle moral uncertainty is simply to follow the moral theory in which you have most credence. This approach is known as My Favourite Theory. In this paper, I argue that, in some cases, My Favourite Theory prescribes choices that are, sequentially, worse in expected moral value than the opposite choices according to each moral theory you have any credence in. In addition this, problem generalizes to other approaches that avoid intertheoretic comparisons of value, such as My (...) Favourite Option, the Borda Rule, Variance Normalization, and the Principle of Maximizing Expected Normalized Moral Value. (shrink)

How ought you to evaluate your options if you're uncertain about what's fundamentally valuable? A prominent response is Expected Value Maximisation (EVM)—the view that under axiological uncertainty, an option is better than another if and only if it has the greater expected value across axiologies. But the expected value of an option depends on quantitative probability and value facts, and in particular on value comparisons across axiologies. We need to explain what it is for such facts to hold. Also, EVM (...) is by no means self-evident. We need an argument to defend that it’s true. This book introduces an axiomatic approach to answer these worries. It provides an explication of what EVM means by use of representation theorems: intertheoretic comparisons can be understood in terms of facts about which options are better than which, and mutatis mutandis for intratheoretic comparisons and axiological probabilities. And it provides a systematic argument to the effect that EVM is true: the theory can be vindicated through simple axioms. The result is a formally cogent and philosophically compelling extension of standard decision theory, and original take on the problem of axiological or normative uncertainty. (shrink)

– We offer a new motivation for imprecise probabilities. We argue that there are propositions to which precise probability cannot be assigned, but to which imprecise probability can be assigned. In such cases the alternative to imprecise probability is not precise probability, but no probability at all. And an imprecise probability is substantially better than no probability at all. Our argument is based on the mathematical phenomenon of non-measurable sets. Non-measurable propositions cannot receive precise probabilities, but there is a natural (...) way for them to receive imprecise probabilities. The mathematics of non-measurable sets is arcane, but its epistemological import is far-reaching; even apparently mundane propositions are liable to be affected by non-measurability. The phenomenon of non-measurability dramatically reshapes the dialectic between critics and proponents of imprecise credence. Non-measurability offers natural rejoinders to prominent critics of imprecise credence. Non-measurability even reverses some of the critics’ arguments—by the very lights that have been used to argue against imprecise credences, imprecise credences are better than precise credences. (shrink)

The topic of this thesis is axiological uncertainty – the question of how you should evaluate your options if you are uncertain about which axiology is true. As an answer, I defend Expected Value Maximisation (EVM), the view that one option is better than another if and only if it has the greater expected value across axiologies. More precisely, I explore the axiomatic foundations of this view. I employ results from state-dependent utility theory, extend them in various ways and interpret (...) them accordingly, and thus provide axiomatisations of EVM as a theory of axiological uncertainty. (shrink)

Etycy nie poświęcali dotąd wiele uwagi niepewności, koncentrując się często na skrajnie wyidealizowanych hipotetycznych sytuacjach, w których zarówno kwestie empiryczne (np. stan świata, spektrum możliwych decyzji oraz ich konsekwencje, związki przyczynowe między zdarzeniami), jak i normatywne (np. treść norm, skale wartości) były jasno określone i znane podmiotowi. W poniższym artykule – który jest rezultatem projektu dotyczącego różnych typów decyzji w sytuacjach niepewności związanej z postępem w naukach i technologiach biomedycznych – przedstawię analizę sytuacji niepewności normatywnej, czyli takich, w których podmiot (...) musi podjąć decyzję, nie mając pewności co do tego, jaka norma postępowania jest właściwa, np. dlatego, że ma sprzeczne intuicje normatywne na temat dopuszczalności danej decyzji. Stanowisko, które określa się niekiedy mianem komparatywizmu, głosi, że w tego typu sytuacjach należy uwzględniać nie tylko stopnie przekonań podmiotu w kwestii różnych norm, ale także to, na ile możliwe decyzje warte są podjęcia wedle tych norm. Przedstawię tu analizę kilku przypadków niepewności normatywnej, a także charakterystyczny argument przeciwko dotychczasowym wersjom komparatywizmu, wskazujący, że nie uwzględniają one różnych nastawień do ryzyka w sytuacjach niepewności normatywnej, choć dopuszczają jednocześnie różne nastawienia do ryzyka w sytuacjach niepewności empirycznej. Pokażę też, że zasada ostrożności dotycząca statusu moralnego w upraszczający sposób przedstawia sytuacje niepewności normatywnej. (shrink)

In this paper, I enter the debate between those who hold that our normative uncertainty matters for what we ought to do, and those who hold that only our descriptive uncertainty matters. I argue that existing views in both camps have unacceptable implications in cases where our descriptive beliefs depend on our normative beliefs. I go on to propose a fix which is available only to those who hold that normative uncertainty matters, ultimately leaving the challenge as a threat to (...) recent skepticism about such views. (shrink)

There has been little discussion about how to act when uncertain about the existence of moral reasons in general. In this paper I will argue that despite being uncertain about the existence of moral reasons, someone can still have a practical reason to act in a particular way. This practical reason is morally relevant because it will have an impact on whether we’re making the correct moral decision. This practical reason will result from a principle of decision-making that can be (...) used when someone is agnostic about the existence of moral reasons. The aims of this paper include explicitly beginning the discussion about this topic and advocating for a principle of moral decision-making that can be used despite being metaethically agnostic. (shrink)

In the growing literature on decision-making under moral uncertainty, a number of skeptics have argued that there is an insuperable barrier to rational "hedging" for the risk of moral error, namely the apparent incomparability of moral reasons given by rival theories like Kantianism and utilitarianism. Various general theories of intertheoretic value comparison have been proposed to meet this objection, but each suffers from apparently fatal flaws. In this paper, I propose a more modest approach that aims to identify classes of (...) moral theories that share common principles strong enough to establish bases for intertheoretic comparison. I show that, contra the claims of skeptics, there are often rationally perspicuous grounds for precise, quantitative value comparisons within such classes. In light of this fact, I argue, the existence of some apparent incomparabilities between widely divergent moral theories cannot serve as a general argument against hedging for one's moral uncertainties. (shrink)

This article is a critical survey of the debate over the value of the social discount rate, with a particular focus on climate change. The ma- jority of the material surveyed is from the economics rather than from the philosophy literature, but the emphasis of the survey itself is on founda- tions in ethical and other normative theory rather than highly technical details. I begin by locating the standard approach to discounting within the overall landscape of ethical theory, and explaining (...) the assumptions and simplifications that are needed in order to arrive at the model that is standard in the discounting literature. The article then covers the general theory of the Ramsey equation and its relationship to observed interest rates, arguments for and against a positive rate of pure time preference, the consumption elasticity of utility, and the effect of various sorts of uncertainty on the discount rate. Finally, it turns specifically to the ap- plication of this debate to the case of climate change, focussing on the recent controversy over the low discount rate used in the Stern Review of the Economics of Climate Change. (shrink)

How should an agent decide what to do when she is uncertain not just about morally relevant empirical matters, like the consequences of some course of action, but about the basic principles of morality itself? This question has only recently been taken up in a systematic way by philosophers. Advocates of moral hedging claim that an agent should weigh the reasons put forward by each moral theory in which she has positive credence, considering both the likelihood that that theory is (...) true and the strength of the reasons it posits. The view that it is sometimes rational to hedge for one's moral uncertainties, however, has recently come under attack both from those who believe that an agent should always be guided by the dictates of the single moral theory she deems most probable and from those who believe that an agent's moral beliefs are simply irrelevant to what she ought to do. Among the many objections to hedging that have been pressed in the recent literature is the worry that there is no non-arbitrary way of making the intertheoretic comparisons of moral value necessary to aggregate the value assignments of rival moral theories into a single ranking of an agent's options. -/- This dissertation has two principal objectives: First, I argue that, contra these recent objections, an agent's moral beliefs and uncertainties are relevant to what she rationally ought to do, and more particularly, that agents are at least sometimes rationally required to hedge for their moral uncertainties. My principal argument for these claims appeals to the enkratic conception of rationality, according to which the requirements of practical rationality derive from an agent's beliefs about the objective, desire-independent value or choiceworthiness of her options. Second, I outline a new general theory of rational choice under moral uncertainty. Central to this theory is the idea of content-based aggregation, that the principles according to which an agent should compare and aggregate rival moral theories are grounded in the content of those theories themselves, including not only their value assignments but also the metaethical and other non-surface-level propositions that underlie, justify, or explain those value assignments. (shrink)

Given the deep disagreement surrounding population axiology, one should remain uncertain about which theory is best. However, this uncertainty need not leave one neutral about which acts are better or worse. We show that as the number of lives at stake grows, the Expected Moral Value approach to axiological uncertainty systematically pushes one towards choosing the option preferred by the Total and Critical Level views, even if one’s credence in those theories is low.

What should we do when we are not certain about what we morally should do? There is a long history of theorizing about decision-making under empirical uncertainty, but surprisingly little has been written about the moral uncertainty expressed by this question. Only very recently have philosophers started to systematically address the nature of such uncertainty and its impacts on decision-making. This paper addresses the main problems raised by moral uncertainty and critically examines some proposed solutions.

Metanormativists hold that moral uncertainty can affect how we ought, in some morally authoritative sense, to act. Many metanormativists aim to generalize expected utility theory for normative uncertainty. Such accounts face the “easy problem of intertheoretic comparisons”: the worry that distinct theories’ assessments of choiceworthiness are incomparable. The easy problem may well be resolvable, but another problem looms: while some moral theories assign cardinal degrees of choiceworthiness, other theories’ choiceworthiness assignments are merely ordinal. Expected choiceworthiness over such theories is undefined. (...) Call this the “hard problem of intertheoretic comparisons.” This paper argues that to solve the hard problem, we should model moral theories with imprecise choiceworthiness. Imprecise choiceworthiness assignments can model incomplete cardinal information about choiceworthiness, with precise cardinal choiceworthiness and merely ordinal choiceworthiness as limiting cases. Generalizing familiar decision theories for imprecise choiceworthiness to the case of moral uncertainty generates puzzles, however: natural generalizations seem to require reifying parts of the model that don’t correspond to anything in normative reality. I discuss three ways of addressing this problem: by demystifying the reified elements by using them as promiscuously as possible; by constructing alternative decision theories that don’t require the troublesome elements; and by employing an alternative model of metanormative decision problems, and of moral uncertainty generally. (shrink)

Many people think that if you're uncertain about which moral theory is correct, you ought to maximize the expected choice-worthiness of your actions. This idea presupposes that the strengths of our moral reasons are comparable across theories – for instance, that our reasons to create new people, according to total utilitarianism, can be stronger than our reasons to benefit an existing person, according to a person-affecting view. But how can we make sense of such comparisons? In this article, I introduce (...) a constructivist account of intertheoretic comparisons. On this account, such comparisons don't hold independently of facts about morally uncertain agents. They're simply the result of an ideal deliberation in terms of certain epistemic norms about what you ought to do in light of your uncertainty. If I'm right, this account is metaphysically more parsimonious than some existing proposals, and yet has plausible and strong implications. (shrink)

It has been argued by several philosophers that a morally motivated rational agent who has to make decisions under conditions of moral uncertainty ought to maximize expected moral value in his choices, where the expectation is calculated relative to the agent's moral uncertainty. I present a counter-example to this thesis and to a larger family of decision rules for choice under conditions of moral uncertainty. Based on this counter-example, I argue against the thesis and suggest a reason for its failure (...) – that it is based on the false assumption that inter-theoretical comparisons of moral value are meaningful. (shrink)

One of the principles on how to act under moral uncertainty, My Favourite Theory, says roughly that a morally conscientious agent chooses an option that is permitted by the most credible moral theory. In defence of this principle, we argue that it prescribes consistent choices over time, without relying on intertheoretic comparisons of value, while its main rivals are either plagued by moral analogues of money pumps or in need of a method for making non-arbitrary intertheoretic comparisons. We rebut the (...) arguments that have been levelled against My Favourite Theory and offer some arguments against intertheoretic comparisons of value. (shrink)

This paper presents some impossibility results for certain views about what you should do when you are uncertain about which moral theory is true. I show that under reasonable and extremely minimal ways of defining what a moral theory is, it follows that the concept of expected moral choiceworthiness is undefined, and more generally that any theory of decision-making under moral uncertainty must generate pathological results.

How should an agent act under normative uncertainty? We might extend the orthodox theory of rational choice to the case of uncertainty between competing normative theories. But this requires that the values assigned by different normative theories be comparable. This paper defends a strategy for avoiding the need for intertheoretic value comparisons: instead of comparing competing moral theories, I argue that values can be represented in terms of a de dicto specification of value. I provide a decision theory for de (...) dicto values that generalises expected utility theory, and I compare the proposal with alternative strategies for avoiding the problem of intertheoretic comparisons. (shrink)

In Strategic Justice, Peter Vanderschraaf introduces a “Baseline Consistency” criterion for Justice as Mutual Advantage. This criterion requires assessing how well individuals fare under existing conventions with how well they would fare under hypothetical social conditions. However, this comparison requires the impossible. Under different social conditions, individuals would have different preferences and different interests. As such, we cannot make any direct comparison between how well an individual fares across the two social conditions. The standard of assessment would change from one (...) context to the other. In order to apply the Baseline Consistency criterion, Vanderschraaf would need to justify an interpersonally valid standard for individual welfare, but this is incompatible with his Neo-Hobbesian method. If he abandoned the Baseline Consistency criterion, however, Vanderschraaf faces the “too many equilibria” problem. Conventions that are clearly objectionable would be considered just. (shrink)

This Special Issue titled "Severe Uncertainty in Science, Medicine and Technology" aims to shed new light on the understanding of severe uncertainty and its multifaceted implications. The main idea of the papers of this collection is that, despite possible sophisticated statistical judgments towards future risks in science, medicine, and technology, severe forms of uncertainty still exist.While ignorance is usually assumed to be a total absence of knowledge, uncertainty often refers to the incompleteness of knowledge or information. In its extreme form, (...) this is called "severe uncertainty" but is also known as "fundamental," "radical," "deep," "great," or "genuine" uncertainty. A common characteristic of these... (shrink)

If an agent is unsure about which moral theory or principle should guide her action in a decision situation, she faces moral uncertainty. In recent years, various strategies have been explored to deal with this type of uncertainty. In this paper, we briefly mention two strategies from the literature that make use of credence distributions over moral theories, namely “my favourite theory” and “maximizing expected choice-worthiness”. As an alternative, we propose a two-step procedure which uses the concept of aggregation over (...) structural properties. It is standard in the theory of collective choice and has recently been applied to the Kuhnian problem of theory choice as well. The idea is to explore how a morally-motivated rational agent may assess different moral theories on the basis of fundamental properties. These properties are ranked on a common scale of qualitative verdicts. This method enables an outside observer to make comparisons across competing moral theories and then conclude to what degree these theories fulfil a set of postulated properties. By doing so, we try to render the reasons more transparent that lie behind different types of credence ascriptions. (shrink)

Jennifer Rose Carr’s (2020) article “Normative Uncertainty Without Theories” proposes a method to maximize expected value under normative uncertainty without Intertheoretic Value Comparison (hereafter IVC). Carr argues that this method avoids IVC because it avoids theories: the agent’s credence is distributed among normative hypotheses of a particular type, which don’t constitute theories. However, I argue that Carr’s method doesn’t avoid or help to solve what I consider as the justificatory problem of IVC, which isn’t specific to comparing theories as such. (...) This threatens the implementability of Carr’s method. Fortunately, I also show how Carr’s method can nevertheless be implemented. I identify a type of epistemic states where the justificatory problem of IVC is not a necessary obstacle to maximizing expected value. In such states, the uncertainty stems from indecisive normative intuitions, and the agent justifiably constructs each normative hypothesis on the basis of a consistent subset of her intuitions by reference to the same unit of value. This part of my argument complements not only Carr’s (2020) argument, but also some moderate defenses of IVC. The combination of Carr’s paper and mine helps to illuminate the conditions for maximizing expected value under normative uncertainty without unjustified value comparison. (shrink)