How ought you to evaluate your options if you’re uncertain about which axiology is true? One prominent response is Expected Moral Value Maximisation, the view that under axiological uncertainty, an option is better than another if and only if it has the greater expected moral value across axiologies. EMVM raises two fundamental questions. First, there’s a question about what it should even mean. In particular, it presupposes that we can compare moral value across axiologies. So to even understand EMVM, we (...) need to explain what it is for such comparisons to hold. Second, assuming that we understand it, there’s a question about whether EMVM is true. Since there are many plausible rivals, we need an argument to defend it. In this paper, I’ll introduce a representation theorem for axiological uncertainty to answer these two questions. Roughly, the theorem shows that if all our axiologies satisfy the von Neumann–Morgenstern axioms, and if the facts about which options are better than which in light of your uncertainty also satisfy these axioms as well as a Pareto condition, then these facts have a relevantly unique expected utility representation. If I’m right, this theorem at once affords us a compelling way to understand EMVM—and specifically intertheoretic comparisons—and a systematic argument for its truth. (shrink)

In this paper, we present and defend a natural yet novel analysis of normative reasons. According to what we call support-explanationism, for a fact to be a normative reason to φ is for it to explain why there's normative support for φ-ing. We critically consider the two main rival forms of explanationism—ought-explanationism, on which reasons explain facts about ought, and good-explanationism, on which reasons explain facts about goodness—as well as the popular Reasons-First view, which takes the notion of a normative (...) reason to be normatively fundamental. Support-explanationism, we argue, enjoys many of the virtues of these views while avoiding their drawbacks. We conclude by exploring several further important implications: among other things, we argue that the influential metaphor of ‘weighing’ reasons is inapt, and propose a better one; that, contrary to what Berker (2019) suggests, there's no reason for non-naturalists about normativity to accept the Reasons-First view; and that, contrary to what Wodak (2020b) suggests, explanationist views can successfully accommodate what he calls ‘redundant reasons’. (shrink)

Integrated assessment models play a major role in the science and policy of climate change. Similarly to other widely used computational tools for addressing socially relevant problems, IAMs need to account for the key uncertainties characterizing processes and socio-economic responses. In the case of climate change, these are particularly complex given the very long-term nature of climate and the deep uncertainty characterizing technological and human systems. Here we draw from philosophical discussion of mathematical modeling of social problems and review the (...) role of uncertainty in climate-economic modeling. In agreement with the literature, we highlight the crucial role of epistemic uncertainty in IAMs. We posit that the normative components of models, more than the physical and socio-techno-economic ones, are the most fraught by uncertainty and yet the least understood. We suggest a research agenda to explore uncertainties of evaluation frameworks, transcending the current implicit normativity of IAMs. (shrink)

ABSTRACT Average utilitarianism and several related axiologies, when paired with the standard expectational theory of decision-making under risk and with reasonable empirical credences, can find their practical prescriptions overwhelmingly determined by the minuscule probability that the agent assigns to solipsism—that is, to the hypothesis that there is only one welfare subject in the world, namely, herself. This either (i) constitutes a reductio of these axiologies, (ii) suggests that they require bespoke decision theories, or (iii) furnishes an unexpected argument for ethical (...) egoism. (shrink)

As ever more advanced digital systems are created, it becomes increasingly likely that some of these systems will be digital minds, i.e. digital subjects of experience. With digital minds comes the risk of digital suffering. The problem of digital suffering is that of mitigating this risk. We argue that the problem of digital suffering is a high stakes moral problem and that formidable epistemic obstacles stand in the way of solving it. We then propose a strategy for solving it: Access (...) Monitor Prevent (AMP). AMP uses a ‘dancing qualia’ argument to link the functional states of certain digital systems to their experiences—this yields epistemic access to digital minds. With that access, we can prevent digital suffering by only creating advanced digital systems that we have such access to, monitoring their functional profiles, and preventing them from entering states with functional markers of suffering. After introducing and motivating AMP, we confront limitations it faces and identify some options for overcoming them. We argue that AMP fits especially well with—and so provides a moral reason to prioritize—one approach to creating such systems: whole brain emulation. We also contend that taking other paths to digital minds would be morally risky. (shrink)

Artificially intelligent systems will be used to make increasingly important decisions about us. Many of these decisions will have to be made without universal agreement about the relevant moral facts. For other kinds of disagreement, it is at least usually obvious what kind of solution is called for. What makes moral disagreement especially challenging is that there are three different ways of handling it. Moral solutions apply a moral theory or related principles and largely ignore the details of the disagreement. (...) Compromise solutions apply a method of finding a compromise and taking information about the disagreement as input. Epistemic solutions apply an evidential rule that treats the details of the disagreement as evidence of moral truth. Proposals for all three kinds of solutions can be found in the AI ethics and value alignment literature, but little has been said to justify choosing one over the other. I argue that the choice is best framed in terms of moral risk. (shrink)

According to ‘Excluders’, descriptive uncertainty – but not normative uncertainty – matters to what we ought to do. Recently, several authors have argued that those wishing to treat normative uncertainty differently from descriptive uncertainty face a dependence problem because one's descriptive uncertainty can depend on one's normative uncertainty. The aim of this paper is to determine whether the phenomenon of dependence poses a decisive problem for Excluders. I argue that existing arguments fail to show this, and that, while stronger ones (...) can be found, Excluders can escape them. (shrink)

In this paper, I enter the debate between those who hold that our normative uncertainty matters for what we ought to do, and those who hold that only our descriptive uncertainty matters. I argue that existing views in both camps have unacceptable implications in cases where our descriptive beliefs depend on our normative beliefs. I go on to propose a fix which is available only to those who hold that normative uncertainty matters, ultimately leaving the challenge as a threat to (...) recent skepticism about such views. (shrink)

In many situations, people are unsure in their moral judgements. In much recent philosophical literature, this kind of moral doubt has been analysed in terms of uncertainty in one’s moral beliefs. Non-cognitivists, however, argue that moral judgements express a kind of conative attitude, more akin to a desire than a belief. This paper presents a scientifically informed reconciliation of non-cognitivism and moral doubt. The central claim is that attitudinal ambivalence—the degree to which one holds conflicting attitudes towards the same object—can (...) play the role of moral doubt for non-cognitivists. I will demonstrate that ambivalence has all of the features that we would expect it to have in order to play the role of moral doubt. It is gradable, can vary through time, covaries with strength of motivation, and is suitably distinct from the other features of our moral judgements. As well as providing a defence of non-cognitivism, this insight poses a new challenge for the view: deciding how to act under moral ambivalence. (shrink)

Here, we provide an ethical analysis of discrimination in private insurance to guide the application of non-discriminatory algorithms for risk prediction in the insurance context. This addresses the need for ethical guidance of data-science experts, business managers, and regulators, proposing a framework of moral reasoning behind the choice of fairness goals for prediction-based decisions in the insurance domain. The reference to private insurance as a business practice is essential in our approach, because the consequences of discrimination and predictive inaccuracy in (...) underwriting are different from those of using predictive algorithms in other sectors. Here we focus on the trade-off in the extent to which one can pursue indirect non-discrimination versus predictive accuracy. The moral assessment of this trade-off is related to the context of application—to the consequences of inaccurate risk predictions in the insurance domain. (shrink)

It may soon be possible to generate human organs inside of human-pig chimeras via a process called interspecies blastocyst complementation. This paper discusses what arguably the central ethical concern is raised by this potential source of transplantable organs: that farming human-pig chimeras for their organs risks perpetrating a serious moral wrong because the moral status of human-pig chimeras is uncertain, and potentially significant. Those who raise this concern usually take it to be unique to the creation of chimeric animals with (...) ‘humanised’ brains. In this paper, we show how that the same style of argument can be used to critique current uses of non-chimeric pigs in agriculture. This reveals an important tension between two common moral views: that farming human-pig chimeras for their organs is ethically concerning, and that farming non-chimeric pigs for food or research is ethically benign. At least one of these views stands in need of revision. (shrink)

De Re Significance accounts of moral appraisal consider an agent’s responsiveness to a particular kind of reason, normative moral reasons de re, to be of central significance for moral appraisal. Here, I argue that such accounts find it difficult to accommodate some neuroatypical agents. I offer an alternative account of how an agent’s responsiveness to normative moral reasons affects moral appraisal – the Reasonable Expectations Account. According to this account, what is significant for appraisal is not the content of the (...) reasons an agent is responsive to, but rather whether she is responsive to the reasons it is reasonable to expect her to be responsive to, irrespective of their content. I argue that this account does a better job of dealing with neuroatypical agents, while agreeing with the De Re Significance accounts on more ordinary cases. (shrink)

A straightforward way to handle moral uncertainty is simply to follow the moral theory in which you have most credence. This approach is known as My Favourite Theory. In this paper, I argue that, in some cases, My Favourite Theory prescribes choices that are, sequentially, worse in expected moral value than the opposite choices according to each moral theory you have any credence in. In addition this, problem generalizes to other approaches that avoid intertheoretic comparisons of value, such as My (...) Favourite Option, the Borda Rule, Variance Normalization, and the Principle of Maximizing Expected Normalized Moral Value. (shrink)

While ordinary decision theory focuses on empirical uncertainty, real decision-makers also face normative uncertainty: uncertainty about value itself. From a purely formal perspective, normative uncertainty is comparable to (Harsanyian or Rawlsian) identity uncertainty in the 'original position', where one's future values are unknown. A comprehensive decision theory must address twofold uncertainty -- normative and empirical. We present a simple model of twofold uncertainty, and show that the most popular decision principle -- maximising expected value (`Expectationalism') -- has different formulations, namely (...) Ex-Ante Expectationalism, Ex-Post Expectationalism, and hybrid theories. These alternative theories recommend different decisions, reasoning modes, and attitudes to risk. But they converge under an interesting (necessary and sufficient) condition. (shrink)

There is a concern that the widespread deployment of autonomous machines will open up a number of ‘responsibility gaps’ throughout society. Various articulations of such techno-responsibility gaps have been proposed over the years, along with several potential solutions. Most of these solutions focus on ‘plugging’ or ‘dissolving’ the gaps. This paper offers an alternative perspective. It argues that techno-responsibility gaps are, sometimes, to be welcomed and that one of the advantages of autonomous machines is that they enable us to embrace (...) certain kinds of responsibility gap. The argument is based on the idea that human morality is often tragic. We frequently confront situations in which competing moral considerations pull in different directions and it is impossible to perfectly balance these considerations. This heightens the burden of responsibility associated with our choices. We cope with the tragedy of moral choice in different ways. Sometimes we delude ourselves into thinking the choices we make were not tragic ; sometimes we delegate the tragic choice to others ; sometimes we make the choice ourselves and bear the psychological consequences. Each of these strategies has its benefits and costs. One potential advantage of autonomous machines is that they enable a reduced cost form of delegation. However, we only gain the advantage of this reduced cost if we accept that some techno-responsibility gaps are virtuous. (shrink)

What is techno-optimism and how can it be defended? Although techno-optimist views are widely espoused and critiqued, there have been few attempts to systematically analyse what it means to be a techno-optimist and how one might defend this view. This paper attempts to address this oversight by providing a comprehensive analysis and evaluation of techno-optimism. It is argued that techno-optimism is a pluralistic stance that comes in weak and strong forms. These vary along a number of key dimensions but each (...) shares the view that technology plays a key role in ensuring that the good prevails over the bad. Whatever its strength, to defend this stance, one must flesh out an argument with four key premises. Each of these premises is highly controversial and can be subjected to a number of critiques. The paper discusses five such critiques in detail. The paper also considers possible responses from the techno-optimist. Finally, it is concluded that although strong forms of techno-optimism are not intellectually defensible, a modest, agency-based version of techno-optimism may be defensible. (shrink)

We are sometimes unsure of the moral status of our relationships with other entities. Recent case studies in this uncertainty include our relationships with artificial agents (robots, assistant AI, etc.), animals, and patients with “locked-in” syndrome. Do these entities have basic moral standing? Could they count as true friends or lovers? What should we do when we do not know the answer to these questions? An influential line of reasoning suggests that, in such cases of moral uncertainty, we need meta-moral (...) decision rules that allow us to either minimize the risks of moral wrongdoing or improve the choice-worthiness of our actions. One particular argument adopted in this literature is the “risk asymmetry argument,” which claims that the risks associated with accepting or rejecting some moral facts may be sufficiently asymmetrical as to warrant favoring a particular practical resolution of this uncertainty. Focusing on the case study of artificial beings, this article argues that this is best understood as an ethical-epistemic challenge. The article argues that taking potential risk asymmetries seriously can help resolve disputes about the status of human–AI relationships, at least in practical terms (philosophical debates will, no doubt, continue); however, the resolution depends on a proper, empirically grounded assessment of the risks involved. Being skeptical about basic moral status, but more open to the possibility of meaningful relationships with such entities, may be the most sensible approach to take. (shrink)

The problem known as Buridan’s Ass says that a hungry donkey equipoised between two identical bales of hay will starve to death. Indecision kills the ass. Some philosophers worry about human analogs. Computer scientists since the 1960s have known about the computer versions of such cases. From what Leslie Lamport calls ‘Buridan’s Principle’—a discrete decision based on a continuous range of input-values cannot be made in a bounded time—it follows that the possibilities for human analogs of Buridan’s Ass are far (...) more wide-ranging and securely provable than has been acknowledged in philosophy. We are never necessarily decisive. This is mathematically provable. I explore four consequences: first, increased interest of the literature’s solutions to Buridan’s Ass; second, a new asymmetry between responsibility for omissions and responsibility for actions; third, clarification of the standard account of akrasia; and, fourth, clarification of the role of credences in normative decision-theory. (shrink)

According to the sufficiency principle, distributive justice requires that everyone have some sufficient level of resources or well-being, but inequalities above this threshold have no moral significance. This paper defends a version of the sufficiency principle as the appropriate response to moral uncertainty about distributive justice. Assuming that the appropriate response to moral uncertainty is to maximize expected choiceworthiness, and given a reasonable distribution of credence in some familiar views about distributive justice, a version of the sufficiency principle strikes the (...) optimal balance between the competing moral risks posed by implementing these views. In particular, it avoids the moral risk posed by views like Nozick’s libertarianism, which forbid redistributive taxation even for the sake of helping to provide for people’s basic needs: failing to do the latter, if it turns out that justice does require it, would be very morally wrong. This “uncertainty argument” has the advantage of minimizing reliance on controversial intuitions about distributive justice, helps to specifying a non-arbitrary threshold for sufficiency, and shows that the substantive moral implications of moral uncertainty are not limited to high-stakes applied ethics issues such as abortion and vegetarianism but instead extend to an issue at the heart of political philosophy. (shrink)

According to the traditional Bayesian view of credence, its structure is that of precise probability, its objects are descriptive propositions about the empirical world, and its dynamics are given by conditionalization. Each of the three essays that make up this thesis deals with a different variation on this traditional picture. The first variation replaces precise probability with sets of probabilities. The resulting imprecise Bayesianism is sometimes motivated on the grounds that our beliefs should not be more precise than the evidence (...) calls for. One known problem for this evidentially motivated imprecise view is that in certain cases, our imprecise credence in a particular proposition will remain the same no matter how much evidence we receive. In the first essay I argue that the problem is much more general than has been appreciated so far, and that it’s difficult to avoid without compromising the initial evidentialist motivation. The second variation replaces descriptive claims with moral claims as the objects of credence. I consider three standard arguments for probabilism with respect to descriptive uncertainty—representation theorem arguments, Dutch book arguments, and accuracy arguments—in order to examine whether such arguments can also be used to establish probabilism with respect to moral uncertainty. In the second essay, I argue that by and large they can, with some caveats. First, I don’t examine whether these arguments can be given sound non-cognitivist readings, and any conclusions therefore only hold conditional on cognitivism. Second, decision-theoretic representation theorems are found to be less convincing in the moral case, because there they implausibly commit us to thinking that intertheoretic comparisons of value are always possible. Third and finally, certain considerations may lead one to think that imprecise probabilism provides a more plausible model of moral epistemology. The third variation considers whether, in addition to conditionalization, agents may also change their minds by becoming aware of propositions they had not previously entertained, and therefore not previously assigned any probability. More specifically, I argue that if we wish to make room for reflective equilibrium in a probabilistic moral epistemology, we must allow for awareness growth. In the third essay, I sketch the outline of such a Bayesian account of reflective equilibrium. Given that this account gives a central place to awareness growth, and that the rationality constraints on belief change by awareness growth are much weaker than those on belief change by conditionalization, it follows that the rationality constraints on the credences of agents who are seeking reflective equilibrium are correspondingly weaker. (shrink)