In this essay, we explore an issue of moral uncertainty: what we are permitted to do when we are unsure about which moral principles are correct. We develop a novel approach to this issue that incorporates important insights from previous work on moral uncertainty, while avoiding some of the difficulties that beset existing alternative approaches. Our approach is based on evaluating and choosing between option sets rather than particular conduct options. We show how our approach (...) is particularly well-suited to address this issue of moral uncertainty with respect to agents that have credence in moral theories that are not fully consequentialist. (shrink)

Sometimes it’s not certain which of several mutually exclusive moral views is correct. Like almost everyone, I think that there’s some sense in which what one should do depends on which of these theories is correct, plus the way the world is non-morally. But I also think there’s an important sense in which what one should do depends upon the probabilities of each of these views being correct. Call this second claim “moral uncertaintism”. In this paper, I want (...) to address an argument against moral uncertaintism offered in the pages of this journal by Brian Weatherson, and seconded elsewhere by Brian Hedden, the crucial premises of which are: that acting on moral uncertaintist norms necessarily involves motivation by reasons or rightness as such, and that such motivation is bad. I will argue that and are false, and that at any rate, the quality of an agent’s motivation is not pertinent to the truth or falsity of moral uncertaintism in the way that Weatherson’s and Hedden’s arguments require. (shrink)

Defenders of deontological constraints in normative ethics face a challenge: how should an agent decide what to do when she is uncertain whether some course of action would violate a constraint? The most common response to this challenge has been to defend a threshold principle on which it is subjectively permissible to act iff the agent's credence that her action would be constraint-violating is below some threshold t. But the threshold approach seems arbitrary and unmotivated: what would possibly determine where (...) the threshold should be set, and why should there be any precise threshold at all? Threshold views also seem to violate ought agglomeration, since a pair of actions each of which is below the threshold for acceptable moral risk can, in combination, exceed that threshold. In this paper, I argue that stochastic dominance reasoning can vindicate and lend rigor to the threshold approach: given characteristically deontological assumptions about the moral value of acts, it turns out that morally safe options will stochastically dominate morally risky alternatives when and only when the likelihood that the risky option violates a moral constraint is greater than some precisely definable threshold (in the simplest case, .5). I also show how, in combination with the observation that deontological moral evaluation is relativized to particular choice situations, this approach can overcome the agglomeration problem. This allows the deontologist to give a precise and well-motivated response to the problem of uncertainty. (shrink)

Given the deep disagreement surrounding population axiology, one should remain uncertain about which theory is best. However, this uncertainty need not leave one neutral about which acts are better or worse. We show that as the number of lives at stake grows, the Expected Moral Value approach to axiological uncertainty systematically pushes one towards choosing the option preferred by the Total and Critical Level views, even if one’s credence in those theories is low.

Moral dilemmas can arise from uncertainty, including uncertainty of the real values involved. One interesting example of this is that of experimentation on human embryos and foetuses, If these have a moral stauts similar to that of human persons then there will be server constraitns on what may be done to them. If embryous have a moral status similar to that of other small clusters of cells, then constraints will be motivated largely by consideration for (...) the persons into whom the embryos may develop. If the truth lies somewhere between these two extremes, the embryo having neither the full moral weight of persons, nor a completely negligible moral weight, then different kinds of constraints will be appropriate. On the face of it, in order to know what kinds of experiements, if any, we are morally justified in performing on embryos we have to know what the moral weight of the embryo is. But then an impasse threatens, for it seems implausible that we can settle with certainty the exact moral status of the human embryo. It is the purpose of this paper to show that moral uncertainty need not make rational moral justification impossible. I develop a framework which distinguishes between what is morally right/wrong, and what is morally justified/unjustified, and applies standard decision theoretic tools to the case of moral uncertainties. (This was the first published account of what has subsequently become known as Expected Moral Value Theory. An earlier version of the paper, "A decision theoretic argument against human embryo experimentation", was published in M. Fricke (ed.), Essays in honor of Bob Durrant. (University of Otago Press, 1986) 111-27.). (shrink)

In this article, I present a new interpretation of the pro-life view on the status of early human embryos. In my understanding, this position is based not on presumptions about the ontological status of embryos and their developmental capabilities but on the specific criteria of rational decisions under uncertainty and on a cautious response to the ambiguous status of embryos. This view, which uses the decision theory model of moral reasoning, promises to reconcile the uncertainty about the (...) ontological status of embryos with the certainty about normative obligations. I will demonstrate that my interpretation of the pro-life view, although seeming to be stronger than the standard one, has limited scope and cannot be used to limit destructive research on human embryos. (shrink)

Several philosophers have recently argued that decision-theoretic frameworks for rational choice under risk fail to provide prescriptions for choice in cases of moral uncertainty. They conclude that there are no rational norms that are “sensitive” to a decision-maker's moral uncertainty. But in this paper, I argue that one sometimes has a rational obligation to take one's moral uncertainty into account in the course of moral deliberation. I first provide positive motivation for the view (...) that one's moral beliefs can affect what it's rational for one to choose. I then address the problem of value comparison, according to which one cannot determine the expected moral value of one's actions. I argue that we should not infer from the problem of value comparison that there are no rational norms governing choice under moral uncertainty. (shrink)

In this paper we introduce the nascent literature on Moral Uncertainty Theory and explore its application to the criminal law. Moral Uncertainty Theory seeks to address the question of what we ought to do when we are uncertain about what to do because we are torn between rival moral theories. For instance, we may have some credence in one theory that tells us to do A but also in another that tells us to do B. (...) We examine how we might decide whether or not to criminalize some conduct when we are unsure as to whether or not the conduct is morally permitted, and whether or not it is permissible to criminalize the conduct. We also look at how we might make sentencing decisions under moral uncertainty. We argue that Moral Uncertainty Theory can be an illuminating way to address these questions, but find that doing so is a lot more complicated than applying Moral Uncertainty Theory to individual conduct. (shrink)

This paper explores the role of moral uncertainty in explaining the morally disruptive character of new technologies. We argue that existing accounts of technomoral change do not fully explain its disruptiveness. This explanatory gap can be bridged by examining the epistemic dimensions of technomoral change, focusing on moral uncertainty and inquiry. To develop this account, we examine three historical cases: the introduction of the early pregnancy test, the contraception pill, and brain death. The resulting account highlights (...) what we call “differential disruption” and provides a resource for fields such as technology assessment, ethics of technology, and responsible innovation. (shrink)

Non-Consequentialist moral theories posit the existence of moral constraints: prohibitions on performing particular kinds of wrongful acts, regardless of the good those acts could produce. Many believe that such theories cannot give satisfactory verdicts about what we morally ought to do when there is some probability that we will violate a moral constraint. In this article, I defend Non-Consequentialist theories from this critique. Using a general choice-theoretic framework, I identify various types of Non-Consequentialism that have otherwise been (...) conflated in the debate. I then prove a number of formal possibility and impossibility results establishing which types of Non-Consequentialism can -- and which cannot -- give us adequate guidance through through a risky world. (shrink)

In many situations, people are unsure in their moral judgements. In much recent philosophical literature, this kind of moral doubt has been analysed in terms of uncertainty in one’s moral beliefs. Non-cognitivists, however, argue that moral judgements express a kind of conative attitude, more akin to a desire than a belief. This paper presents a scientifically informed reconciliation of non-cognitivism and moral doubt. The central claim is that attitudinal ambivalence—the degree to which one holds (...) conflicting attitudes towards the same object—can play the role of moral doubt for non-cognitivists. I will demonstrate that ambivalence has all of the features that we would expect it to have in order to play the role of moral doubt. It is gradable, can vary through time, covaries with strength of motivation, and is suitably distinct from the other features of our moral judgements. As well as providing a defence of non-cognitivism, this insight poses a new challenge for the view: deciding how to act under moral ambivalence. (shrink)

This paper develops a philosophical account of moral disruption. According to Robert Baker (2013), moral disruption is a process in which technological innovations undermine established moral norms without clearly leading to a new set of norms. Here I analyze this process in terms of moral uncertainty, formulating a philosophical account with two variants. On the Harm Account, such uncertainty is always harmful because it blocks our knowledge of our own and others’ moral obligations. (...) On the Qualified Harm Account, there is no harm in cases where moral uncertainty is related to innovation that is “for the best” in historical perspective, or where uncertainty is the expression of a deliberative virtue. The two accounts are compared by applying them to Baker’s historical case of the introduction of mechanical ventilation and organ transplantation technologies, as well as the present-day case of mass data practices in the health domain. (shrink)

This paper develops a philosophical account of moral disruption. According to Robert Baker, moral disruption is a process in which technological innovations undermine established moral norms without clearly leading to a new set of norms. Here I analyze this process in terms of moral uncertainty, formulating a philosophical account with two variants. On the harm account, such uncertainty is always harmful because it blocks our knowledge of our own and others’ moral obligations. On (...) the qualified harm account, there is no harm in cases where moral uncertainty is related to innovation that is “for the best” in historical perspective or where uncertainty is the expression of a deliberative virtue. The two accounts are compared by applying them to Baker’s historical case of the introduction of mechanical ventilation and organ transplantation technologies, as well as the present-day case of mass data practices in the health domain. (shrink)

Investigation of neural and cognitive processes underlying individual variation in moral preferences is underway, with notable similarities emerging between moral- and risk-based decision-making. Here we specifically assessed moral distributive justice preferences and non-moral financial gambling preferences in the same individuals, and report an association between these seemingly disparate forms of decision-making. Moreover, we find this association between distributive justice and risky decision-making exists primarily when the latter is assessed with the Iowa Gambling Task. These findings are (...) consistent with neuroimaging studies of brain function during moral and risky decision-making. This research also constitutes the first replication of a novel experimental measure of distributive justice decision-making, for which individual variation in performance was found. Further examination of decision-making processes across different contexts may lead to an improved understanding of the factors affecting moral behaviour. (shrink)

In this paper, I enter the debate between those who hold that our normative uncertainty matters for what we ought to do, and those who hold that only our descriptive uncertainty matters. I argue that existing views in both camps have unacceptable implications in cases where our descriptive beliefs depend on our normative beliefs. I go on to propose a fix which is available only to those who hold that normative uncertainty matters, ultimately leaving the challenge as (...) a threat to recent skepticism about such views. (shrink)

How can someone reconcile the desire to eat meat, and a tendency toward vegetarian ideals? How should we reconcile contradictory moral values? How can we aggregate different moral theories? How individual preferences can be fairly aggregated to represent a will, norm, or social decision? Conflict resolution and preference aggregation are tasks that intrigue philosophers, economists, sociologists, decision theorists, and many other scholars, being a rich interdisciplinary area for research. When trying to solve questions about moral uncertainty (...) a meta understanding of the concept of normativity can help us to develop strategies to deal with norms themselves. 2nd-order normativity, or norms about norms, is a hierarchical way to think about how to combine many different normative structures and preferences into a single coherent decision. That is what metanormativity is all about, a way to answer: what should we do when we don’t know what to do? In this study, we will review a decision-making strategy dealing with moral uncertainty, Maximization of Expected Choice-Worthiness. This strategy, proposed by William MacAskill, allows for the aggregation and inter-theoretical comparison of different normative structures, cardinal theories, and ordinal theories. In this study, we will exemplify the metanormative methods proposed by MacAskill, using has an example, a series of vegetarian dilemmas. Given the similarity to this metanormative strategy to expected utility theory, we will also show that it is possible to integrate both models to address decision-making problems in situations of empirical and moral uncertainty. We believe that this kind of ethical-mathematical formalism can be useful to help develop strategies to better aggregate moral preferences and solve conflicts. (shrink)

What should a person do when, through no fault of her own, she ends up believing a false moral theory? Some suggest that she should act against what the false theory recommends; others argue that she should follow her rationally held moral beliefs. While the former view better accords with intuitions about cases, the latter one seems to enjoy a critical advantage: It seems better able to render moral requirements ‘followable’ or ‘action-guiding.’ But this tempting thought proves (...) difficult to justify. Indeed, whether it can be justified turns out to depend importantly on the rational status of epistemic akrasia. Furthermore, it can be argued, from premises all parties to the moral ignorance debate should accept, that rational epistemic akrasia is possible. If the argument proves successful, it follows that a person should sometimes act against her rationally held moral convictions. (shrink)

I analyze recent discussions about making moral decisions under normative uncertainty. I discuss whether this kind of uncertainty should have practical consequences for decisions and whether there are reliable methods of reasoning that deal with the possibility that we are wrong about some moral issues. I defend a limited use of the decision theory model of reasoning in cases of normative uncertainty.

Is normative uncertainty like factual uncertainty? Should it have the same effects on our actions? Some have thought not. Those who defend an asymmetry between normative and factual uncertainty typically do so as part of the claim that our moral beliefs in general are irrelevant to both the moral value and the moral worth of our actions. Here I use the consideration of Jackson cases to challenge this view, arguing that we can explain away (...) the apparent asymmetries between normative and factual uncertainty by considering the particular features of the cases in greater detail. Such consideration shows that, in fact, normative and factual uncertainty are equally relevant to moral assessment. (shrink)

How should an agent decide what to do when she is uncertain not just about morally relevant empirical matters, like the consequences of some course of action, but about the basic principles of morality itself? This question has only recently been taken up in a systematic way by philosophers. Advocates of moral hedging claim that an agent should weigh the reasons put forward by each moral theory in which she has positive credence, considering both the likelihood that that (...) theory is true and the strength of the reasons it posits. The view that it is sometimes rational to hedge for one's moral uncertainties, however, has recently come under attack both from those who believe that an agent should always be guided by the dictates of the single moral theory she deems most probable and from those who believe that an agent's moral beliefs are simply irrelevant to what she ought to do. Among the many objections to hedging that have been pressed in the recent literature is the worry that there is no non-arbitrary way of making the intertheoretic comparisons of moral value necessary to aggregate the value assignments of rival moral theories into a single ranking of an agent's options. -/- This dissertation has two principal objectives: First, I argue that, contra these recent objections, an agent's moral beliefs and uncertainties are relevant to what she rationally ought to do, and more particularly, that agents are at least sometimes rationally required to hedge for their moral uncertainties. My principal argument for these claims appeals to the enkratic conception of rationality, according to which the requirements of practical rationality derive from an agent's beliefs about the objective, desire-independent value or choiceworthiness of her options. Second, I outline a new general theory of rational choice under moral uncertainty. Central to this theory is the idea of content-based aggregation, that the principles according to which an agent should compare and aggregate rival moral theories are grounded in the content of those theories themselves, including not only their value assignments but also the metaethical and other non-surface-level propositions that underlie, justify, or explain those value assignments. (shrink)

Modern health data practices come with many practical uncertainties. In this paper, I argue that data subjects’ trust in the institutions and organizations that control their data, and their ability to know their own moral obligations in relation to their data, are undermined by significant uncertainties regarding the what, how, and who of mass data collection and analysis. I conclude by considering how proposals for managing situations of high uncertainty might be applied to this problem. These emphasize increasing (...) organizational flexibility, knowledge, and capacity, and reducing hazard. (shrink)

Current environmental problems and technological risks are a challenge for a new institutional arrangement of the value spheres of Science, Politics and Morality. Distinguished authors from different European countries and America provide a cross-disciplinary perspective on the problems of political decision making under the conditions of scientific uncertainty. cases from biotechnology and the environmental sciences are discussed. The papers collected for this volume address the following themes: (i) controversies about risks and political decision making; (ii) concepts of science for (...) policy; (iii) the use of social science in the policy making process; (iv) ethical problems with developments in science and technology; (v) public and state interests in the development and control of technology. (shrink)

I outline four conditions on permissible promise-making: the promise must be for a morally permissible end, must not be deceptive, must be in good faith, and must involve a realistic assessment of oneself. I then address whether promises that you are uncertain you can keep can meet these four criteria, with a focus on campaign promises as an illustrative example. I argue that uncertain promises can meet the first two criteria, but that whether they can meet the second two depends (...) on the source of the promisor's uncertainty. External uncertainty stemming from outside factors is unproblematic, but internal uncertainty stemming from the promisor's doubts about her own strength leads to promises that are in bad faith or unrealistic. I conclude that campaign promises are often subject to internal uncertainty and are therefore morally impermissible to make, all else being equal. (shrink)

I defend normative externalism from the objection that it cannot account for the wrongfulness of moral recklessness. The defence is fairly simple—there is no wrong of moral recklessness. There is an intuitive argument by analogy that there should be a wrong of moral recklessness, and the bulk of the paper consists of a response to this analogy. A central part of my response is that if people were motivated to avoid moral recklessness, they would have to (...) have an unpleasant sort of motivation, what Michael Smith calls “moral fetishism”. (shrink)

Until very recently, normative theorizing in ethics was frequently conducted without even mentioning uncertainty. Just a few years ago, Sven Ove Hansson described this state of affairs with the slogan: “Ethics still lives in a Newtonian world.” In the new Oxford Handbook of Philosophy and Probability, David McCarthy writes that “mainstream moral philosophy has not been much concerned with probability,” understanding probability as “the best-known tool for thinking about uncertainty.” This special predilection for certainty in ethics was (...) surprising since most decisions or evaluations are made both by individuals and policy-makers through the fog of a widely understood uncertainty that includes risk, ignorance, indeterminacy. Therefore, the main task of this special issue and international essay prize competition is to encourage philosophers to rethink the standard paradigm in ethics by redirecting discussions about ethical questions to problems involving different kinds of uncertainty when an individual or a policy maker does not have access to or knowledge about. (shrink)

Some, but not all, of the mistakes a person makes when acting in apparently necessary self-defense are reasonable: we take them not to violate the rights of the apparent aggressor. I argue that this is explained by duties grounded in agents' entitlements to a fair distribution of the risk of suffering unjust harm. I suggest that the content of these duties is filled in by a social signaling norm, and offer some moral constraints on the form such a norm (...) can take. (shrink)

Moral reasoning is as fallible as reasoning in any other cognitive domain, but we often behave as if it were not. I argue for a form of epistemically-based moral humility, in which we downgrade our moral beliefs in the face of moral disagreement. My argument combines work in metaethics and moral intuitionism with recent developments in epistemology. I argue against any demands for deep self-sufficiency in moral reasoning. Instead, I argue that we need to (...) take into account significant socially sourced information, especially as a check for failures on our own moral intuitions and reasoning. -/- First, I argue for an epistemically plausible version of moral intuitionism, based on recent work in epistemic entitlement and epistemic warrant. Second, I argue that getting clear on the epistemic basis shows the defeasibility of moral judgment. Third, I argue the existence of moral disagreement is a reason to reduce our certainty in moral judgment. Fourth, I argue that this effect is not a violation of norms of autonomy for moral judgment. (shrink)

In this paper, I argue that the fetishism objection to moral hedging fails. The objection rests on a reasons-responsiveness account of moral worth, according to which an action has moral worth only if the agent is responsive to moral reasons. However, by adopting a plausible theory of non-ideal moral reasons, one can endorse a reasons-responsiveness account of moral worth while maintaining that moral hedging is sometimes an appropriate response to moral uncertainty. (...) Thus, the theory of moral worth upon which the fetishism objection relies does not, in fact, support that objection. (shrink)

In this paper I present an argument in favour of a parental duty to use preimplantation genetic diagnosis (PGD). I argue that if embryos created in vitro were able to decide for themselves in a rational manner, they would sometimes choose PGD as a method of selection. Couples, therefore, should respect their hypothetical choices on a principle similar to that of patient autonomy. My thesis shows that no matter which moral doctrine couples subscribe to, they ought to conduct the (...) PGD procedure in the situations when it is impossible to implant all of the created embryos and if there is a significant risk for giving birth to a child with a serious condition. (shrink)

This paper offers a general model of substantive moral principles as a kind of hedged moral principles that can (but don't have to) tolerate exceptions. I argue that the kind of principles I defend provide an account of what would make an exception to them permissible. I also argue that these principles are nonetheless robustly explanatory with respect to a variety of moral facts; that they make sense of error, uncertainty, and disagreement concerning moral principles (...) and their implications; and that one can grasp these principles without having to grasp any particular list of their permissibly exceptional instances. I conclude by pointing out various advantages that this model of principles has over several of its rivals. The bottom line is that we should find nothing peculiarly odd or problematic about the idea of exception-tolerating and yet robustly explanatory moral principles. (shrink)

The research has three objectives: 1) to study the concept of Heisenberg’s uncertainty principle, 2) to study the concept of reality and knowledge in Buddhist philosophy, and 3) to analyze the concept of Heisenberg’s uncertainty principle in Buddhist philosophical perspective. This is documentary research. In this research, it was found that Heisenberg's uncertainty principle refers to the experiment of thought while studying physical reality on smaller particles than atoms where at the present no theory of Physics can (...) clearly explain such properties. In this respect, the mentioned principle is utilized to predict the pairs of a certain attribute of physics, position, and momentum, for instance. The accuracy of position, however, cannot be precisely yielded in advance by such a principle. In other words, it is impossible to measure the position and momentum of a quantum particle at the same time. In the study of the ultimate reality on the matter in the Buddhist philosophy, it showed that corporeality in nature is conditioned by cause and effect and thereby falling under the three common characteristics: 1) impermanence, 2) state of suffering, and 3) state of non-substantiality. In the study of Heisenberg’s uncertainty principle in the Buddhist philosophical perspective, this research was found that the processes in acquiring certain knowledge of Heisenberg and Buddhist philosophy are by one another in the sense that such knowledge is methodologically acquired through experience, rationality, and intuition because both see the Reality in the same manners, that is, the physical reality is viewed by Heisenberg as the thing that goes under changing state of wave-particle all the times, and the matter is seen by Buddhist philosophy as the impermanence and change depending upon its factors involved and thereby is not-self. However, in the different aspect, on the one hand, Buddhist philosophy utilizes the knowledge on the matter to develop the morality and ethics by which the cessation of suffering could be respectively made, but on the other hand, Heisenberg somehow applies the certain knowledge on physical objects into quantum technology to accommodate the physical comfortability in living life. Suggestions in the application of knowledge gained from this research into benefit were that while Buddhist philosophy can make use of Heisenberg’s uncertainty principle to provide certain help at the time of explanation of three common characteristics being done through the scientific method, science also can utilize knowledge gained from Buddhist philosophy to expand the framework of scientific knowledge which is aimed at studying only the physical objects to be able to study the mental objects through the integration of three epistemological methods as well. (shrink)

The research has three objectives: 1) to study the concept of Heisenberg’s uncertainty principle, 2) to study the concept of reality and knowledge in Buddhist philosophy, and 3) to analyze the concept of Heisenberg’s uncertainty principle in Buddhist philosophical perspective. This is documentary research. In this research, it was found that Heisenberg's uncertainty principle refers to the experiment of thought while studying physical reality on smaller particles than atoms where at the present no theory of Physics can (...) clearly explain such properties. In this respect, the mentioned principle is utilized to predict the pairs of a certain attribute of physics, position, and momentum, for instance. The accuracy of position, however, cannot be precisely yielded in advance by such a principle. In other words, it is impossible to measure the position and momentum of a quantum particle at the same time. In the study of the ultimate reality on the matter in the Buddhist philosophy, it showed that corporeality in nature is conditioned by cause and effect and thereby falling under the three common characteristics: 1) impermanence, 2) state of suffering, and 3) state of non-substantiality. In the study of Heisenberg’s uncertainty principle in the Buddhist philosophical perspective, this research was found that the processes in acquiring certain knowledge of Heisenberg and Buddhist philosophy are by one another in the sense that such knowledge is methodologically acquired through experience, rationality, and intuition because both see the Reality in the same manners, that is, the physical reality is viewed by Heisenberg as the thing that goes under changing state of wave-particle all the times, and the matter is seen by Buddhist philosophy as the impermanence and change depending upon its factors involved and thereby is not-self. However, in the different aspect, on the one hand, Buddhist philosophy utilizes the knowledge on the matter to develop the morality and ethics by which the cessation of suffering could be respectively made, but on the other hand, Heisenberg somehow applies the certain knowledge on physical objects into quantum technology to accommodate the physical comfortability in living life. Suggestions in the application of knowledge gained from this research into benefit were that while Buddhist philosophy can make use of Heisenberg’s uncertainty principle to provide certain help at the time of explanation of three common characteristics being done through the scientific method, science also can utilize knowledge gained from Buddhist philosophy to expand the framework of scientific knowledge which is aimed at studying only the physical objects to be able to study the mental objects through the integration of three epistemological methods as well. (shrink)

This article gives two arguments for believing that our society is unknowingly guilty of serious, large-scale wrongdoing. First is an inductive argument: most other societies, in history and in the world today, have been unknowingly guilty of serious wrongdoing, so ours probably is too. Second is a disjunctive argument: there are a large number of distinct ways in which our practices could turn out to be horribly wrong, so even if no particular hypothesized moral mistake strikes us as very (...) likely, the disjunction of all such mistakes should receive significant credence. The article then discusses what our society should do in light of the likelihood that we are doing something seriously wrong: we should regard intellectual progress, of the sort that will allow us to find and correct our moral mistakes as soon as possible, as an urgent moral priority rather than as a mere luxury; and we should also consider it important to save resources and cultivate flexibility, so that when the time comes to change our policies we will be able to do so quickly and smoothly. (shrink)

The topic of this thesis is axiological uncertainty – the question of how you should evaluate your options if you are uncertain about which axiology is true. As an answer, I defend Expected Value Maximisation (EVM), the view that one option is better than another if and only if it has the greater expected value across axiologies. More precisely, I explore the axiomatic foundations of this view. I employ results from state-dependent utility theory, extend them in various ways and (...) interpret them accordingly, and thus provide axiomatisations of EVM as a theory of axiological uncertainty. (shrink)

Artificially intelligent systems will be used to make increasingly important decisions about us. Many of these decisions will have to be made without consensus about the relevant moral facts. I argue that what makes moral disagreement especially challenging is that there are two very different ways of handling it. Political solutions aim for a fair compromise, while epistemic solutions aim at moral truth. While proposals for both kinds of solutions can be found in the AI ethics and (...) value alignment literature, hardly anything has been said to justify choosing one over the other. This paper aims to figure out what it would take to justify one over the other. Part of my goal is to show that most of the grounds that have been given for adopting political solutions are also grounds for adopting epistemic solutions. But, since neither kind of solution is obviously superior, I attempt to identify deeper reasons to favor one approach over the other. (shrink)

The paper discusses the notion of reasoning with comparative moral judgements (i.e judgements of the form “act a is morally superior to act b”) from the point of view of several meta-ethical positions. Using a simple formal result, it is argued that only a version of moral cognitivism that is committed to the claim that moral beliefs come in degrees can give a normatively plausible account of such reasoning. Some implications of accepting such a version of (...) class='Hi'>moral cognitivism are discussed. (shrink)

Robert Adams argues that often our moral commitment outstrips what we are epistemically entitled to believe; in these cases, the virtuous agent doxastic states are instances of “moral faith”. I argue against Adams’ views on the need for moral faith; at least in some cases, our moral “intuitions” provide us with certain moral knowledge. The appearance that there can be no certainty here is the result of dubious views about second-order or indirect doubts. Nonetheless, discussing (...) the phenomena that lead Adams to postulate moral faith brings to light the nature of the epistemic warrant underlying various kinds of moral commitments. (shrink)

Morally speaking, what should one do when one is morally uncertain? Call this the Moral Uncertainty Question. In this paper, I argue that a non-ideal moral theory provides the best answer to the Moral Uncertainty Question. I begin by arguing for a strong ought-implies-can principle---morally ought implies agentially can---and use that principle to clarify the structure of a compelling non-ideal moral theory. I then describe the ways in which one's moral uncertainty affects (...) one's moral prescriptions: moral uncertainty constrains the set of moral prescriptions one is subject to, and at the same time generates new non-ideal moral reasons for action. I end by surveying the problems that plague alternative answers to the Moral Uncertainty Question, and show that my preferred answer avoids most of those problems. (shrink)

In the growing literature on decision-making under moral uncertainty, a number of skeptics have argued that there is an insuperable barrier to rational "hedging" for the risk of moral error, namely the apparent incomparability of moral reasons given by rival theories like Kantianism and utilitarianism. Various general theories of intertheoretic value comparison have been proposed to meet this objection, but each suffers from apparently fatal flaws. In this paper, I propose a more modest approach that aims (...) to identify classes of moral theories that share common principles strong enough to establish bases for intertheoretic comparison. I show that, contra the claims of skeptics, there are often rationally perspicuous grounds for precise, quantitative value comparisons within such classes. In light of this fact, I argue, the existence of some apparent incomparabilities between widely divergent moral theories cannot serve as a general argument against hedging for one's moral uncertainties. (shrink)

The long unbearable sufferings in the past and agonies experienced in some future timelines in which a malevolent AI could torture people for some idiosyncratic reasons (s-risks) is a significant moral problem. Such events either already happened or will happen in causally disconnected regions of the multiverse and thus it seems unlikely that we can do anything about it. However, at least one pure theoretic way to cure past sufferings exists. If we assume that there is no stable substrate (...) of personal identity and thus a copy equals original, then by creating many copies of the next observer-moment of a person in pain in which he stops suffer, we could create indexical uncertainty in her future location and thus effectively steal her consciousness from her initial location and immediately relieve her sufferings. However, to accomplish this for people who have already died, we need to perform this operation for all possible people thus requiring enormous amounts of computations. Such computation could be performed by the future benevolent AI of Galactic scale. Many such AIs could cooperate acausally by distributing parts of the work between them via quantum randomness. To ensure their success, they need to outnumber all possible evil AIs by orders of magnitude, and thus they need to convert most of the available matter into computronium in all universes where they exist and cooperate acausally across the whole multiverse. Another option for curing past suffering is the use of wormhole time-travel to send a nanobot in the past which will, after a period of secret replication, collect the data about people and secretly upload them when their suffering becomes unbearable. (shrink)

People engage in pure moral inquiry whenever they inquire into the moral features of some act, agent, or state of affairs without inquiring into the non-moral features of that act, agent, or state of affairs. This chapter argues that ordinary people act rationally when they engage in pure moral inquiry, and so any adequate view in metaethics ought to be able to explain this fact. The Puzzle of Pure Moral Motivation is to provide such an (...) explanation. This chapter argues that each of the standard views in metaethics has trouble providing such an explanation. Discussion of why reveals that a metaethical view can provide such an explanation only if it meets two constraints: it allows ordinary moral inquirers to know the essences of moral properties, and the essence of each moral property makes it rational to care for its own sake whether that property is instantiated. (shrink)

In this paper, I will be primarily concerned with moral issues regarding future people and the environment. When it comes to the future, we have deontological and epistemic limitations. The closer to the present, the higher the certainty and the knowledge we have about facts. Thus, when we intend to find moral clarity regarding a future scenario, we deal with an inverse relation between certainty and time. The main problem is that most ways of dealing with moral (...) issues about future scenarios do not address this relation, and rather focus on things that seem to simplify and clarify the uncertainties of the future. In response to this, I propose a different approach, one that operates neutrally and timelessly dealing with the uncertainties of the future while providing moral groundings that can help to clarify the future’s state of moral vagueness. (shrink)

How should you decide what to do when you're uncertain about basic normative principles (e.g., Kantianism vs. utilitarianism)? A natural suggestion is to follow some "second-order" norm: e.g., "comply with the first-order norm you regard as most probable" or "maximize expected choiceworthiness". But what if you're uncertain about second-order norms too -- must you then invoke some third-order norm? If so, it seems that any norm-guided response to normative uncertainty is doomed to a vicious regress. In this paper, I (...) aim to rescue second-order norms from this threat of regress. I first elaborate and defend the suggestion some philosophers have entertained that the regress problem forces us to accept normative externalism, the view that at least one norm is incumbent on agents regardless of their beliefs or evidence concerning that norm. But, I then argue, we need not accept externalism about first-order (e.g., moral) norms, thus closing off any question of what an agent should do in light of her normative beliefs. Rather, it is more plausible to ascribe external force to a single, second-order rational norm: the enkratic principle, correctly formulated. This modest form of externalism, I argue, is both intrinsically well-motivated and sufficient to head off the threat of regress. (shrink)

Divine command theories come in several different forms but at their core all of these theories claim that certain moral statuses exist in virtue of the fact that God has commanded them to exist. Several authors argue that this core version of the DCT is vulnerable to an epistemological objection. According to this objection, DCT is deficient because certain groups of moral agents lack epistemic access to God’s commands. But there is confusion as to the precise nature and (...) significance of this objection, and critiques of its key premises. In this article, I try to clear up this confusion and address these critiques. I do so in three ways. First, I offer a simplified general version of the objection. Second, I address the leading criticisms of the premises of this objection, focusing in particular on the role of moral risk/uncertainty in our understanding of God’s commands. And third, I outline four possible interpretations of the argument, each with a differing degree of significance for the proponent of the DCT. (shrink)

Decision-making under normative uncertainty requires an agent to aggregate the assessments of options given by rival normative theories into a single assessment that tells her what to do in light of her uncertainty. But what if the assessments of rival theories differ not just in their content but in their structure -- e.g., some are merely ordinal while others are cardinal? This paper describes and evaluates three general approaches to this "problem of structural diversity": structural enrichment, structural depletion, (...) and multi-stage aggregation. All three approaches have notable drawbacks, but I tentatively defend multi-stage aggregation as least bad of the three. (shrink)

Quasi-realists face the challenge of providing a plausible analysis of acknowledgments of moral fallibility. This paper devel...