According to Longtermism, our acts’ expected influence on the expected value of the world is mainly determined by their effects in the far future. There is, given total utilitarianism, a straightforward argument for Longtermism due to the enormous number of people that might exist in the future, but this argument does not work on person-affecting views. In this paper, we will argue that these views might also lead to Longtermism if Prudential Longtermism is true. Prudential Longtermism holds for a person (...) if and only if our acts’ overall influence on that person’s expected well-being is mainly determined by the acts’ effects in the far future. We argue that (due to a small chance of anti-ageing and uploading) there could be an enormous amount of prudential value for some contemporary person in the far future and that value may be so large that it dominates their overall expectation of lifetime well-being. (shrink)

This thesis consists of a series of papers in population ethics: a subfield of normative ethics concerned with the distinctive issues that arise in cases where our actions can affect the identities or number of people of who ever exist. Each paper can be read independently of the others. In Chapter 1, I present a dilemma for Archimedean views in population axiology: roughly, those views on which adding enough good lives to a population can make that population better than any (...) other. In Chapter 2, I extend Gustaf Arrhenius’s famous impossibility theorems in population axiology into the domain of choices under risk. My risky impossibility theorems dispense with the assumption that welfare levels are finitely fine-grained, and so tell against lexical views in population axiology. In Chapter 3, I present objections to critical-level and critical-range views in population axiology. I then sketch out what I call the ‘Imprecise Exchange Rates View’ and argue that it is an attractive alternative. In Chapter 4, I address critical-level and critical-range views again. This time, I note that they are vulnerable to objections from biographical identity: identity between lives. I suggest that these objections give us reason to reject critical-level and critical-range views and embrace the Total View. In Chapter 5, I argue that objections of the same form – objections from personal identity – tell against person-affecting views in population ethics. In Chapter 6, I draw out some counterintuitive implications of two recent complaints-based theories of the procreation asymmetry. (shrink)

Many philosophers and scientists claim that there is a ‘hard problem of consciousness’, that qualia, phenomenology, or subjective experience cannot be fully understood with reductive methods of neuroscience and psychology, and that there is a fact of the matter as to ‘what it is like’ to be conscious and which entities are conscious (Chalmers, 1995). Eliminativism and related views such as illusionism argue against this; they claim that consciousness does not exist in the ways implied by everyday or scholarly language. (...) However, this debate has largely consisted of each side jousting analogies and intuitions against the other. Both sides remain unconvinced. To break through this impasse, I present _consciousness semanticism_, a novel eliminativist theory that sidesteps analogy and intuition. Instead, it is based on a direct, formal argument drawing from the tension between the vague semantics in definitions of consciousness such as ‘what it is like’ to be an entity (Nagel, 1975) and the precise meaning implied by questions such as, ‘Is this entity conscious?’ I argue that semanticism naturally extends to erode realist notions of other philosophical concepts, such as morality and free will. Formal argumentation from precise semantics exposes these as pseudo-problems and removes their apparent mysteriousness and intractability. (shrink)

If non-human animals have high moral status, then we commit a grave moral error by eating them. Eating animals is thus morally risky, while many agree that it is morally permissible to not eat animals. According to some philosophers, then, non-animal ethicists should err on the side of caution and refrain from eating animals. I argue that this precautionary argument assumes a false dichotomy of dietary options: a diet that includes farm-raised animals or a diet that does not include animals (...) of any kind. There is a third dietary option, namely, a diet of plants and non-traditional animal protein, and there is evidence that such a diet results in the least amount of harm to animals. It follows therefore that moral uncertainty does not support the adoption of a vegetarian diet. (shrink)

A straightforward way to handle moral uncertainty is simply to follow the moral theory in which you have most credence. This approach is known as My Favourite Theory. In this paper, I argue that, in some cases, My Favourite Theory prescribes choices that are, sequentially, worse in expected moral value than the opposite choices according to each moral theory you have any credence in. In addition this, problem generalizes to other approaches that avoid intertheoretic comparisons of value, such as My (...) Favourite Option, the Borda Rule, Variance Normalization, and the Principle of Maximizing Expected Normalized Moral Value. (shrink)

I argue that legal punishment is morally wrong because it’s too morally risky. I first briefly explain how my argument differs from similar ones in the philosophical literature on legal punishment. Then I explain why legal punishment is morally risky, argue that it’s too morally risky, and discuss objections. In a nutshell, my argument goes as follows. Legal punishment is wrong because we can never sufficiently reduce the risk of doing wrong when we legally punish people. We can never sufficiently (...) reduce this risk because wrongful punishment is much worse than wrongful non-punishment and because punishment’s permissibility depends on the answers to a variety of difficult philosophical questions about which we’re fallible. (shrink)

How ought you to evaluate your options if you're uncertain about what's fundamentally valuable? A prominent response is Expected Value Maximisation (EVM)—the view that under axiological uncertainty, an option is better than another if and only if it has the greater expected value across axiologies. But the expected value of an option depends on quantitative probability and value facts, and in particular on value comparisons across axiologies. We need to explain what it is for such facts to hold. Also, EVM (...) is by no means self-evident. We need an argument to defend that it’s true. This book introduces an axiomatic approach to answer these worries. It provides an explication of what EVM means by use of representation theorems: intertheoretic comparisons can be understood in terms of facts about which options are better than which, and mutatis mutandis for intratheoretic comparisons and axiological probabilities. And it provides a systematic argument to the effect that EVM is true: the theory can be vindicated through simple axioms. The result is a formally cogent and philosophically compelling extension of standard decision theory, and original take on the problem of axiological or normative uncertainty. (shrink)

Metanormativists hold that moral uncertainty can affect how we ought, in some morally authoritative sense, to act. Many metanormativists aim to generalize expected utility theory for normative uncertainty. Such accounts face the “easy problem of intertheoretic comparisons”: the worry that distinct theories’ assessments of choiceworthiness are incomparable. The easy problem may well be resolvable, but another problem looms: while some moral theories assign cardinal degrees of choiceworthiness, other theories’ choiceworthiness assignments are merely ordinal. Expected choiceworthiness over such theories is undefined. (...) Call this the “hard problem of intertheoretic comparisons.” This paper argues that to solve the hard problem, we should model moral theories with imprecise choiceworthiness. Imprecise choiceworthiness assignments can model incomplete cardinal information about choiceworthiness, with precise cardinal choiceworthiness and merely ordinal choiceworthiness as limiting cases. Generalizing familiar decision theories for imprecise choiceworthiness to the case of moral uncertainty generates puzzles, however: natural generalizations seem to require reifying parts of the model that don’t correspond to anything in normative reality. I discuss three ways of addressing this problem: by demystifying the reified elements by using them as promiscuously as possible; by constructing alternative decision theories that don’t require the troublesome elements; and by employing an alternative model of metanormative decision problems, and of moral uncertainty generally. (shrink)

This paper explores the idea that it is instrumentally valuable to learn normative truths. We consider an argument for "normative hedging" based on this principle, and examine the structure of decision-making under moral uncertainty that arises from it. But it also turns out that the value of normative information is inconsistent with the principle that learning *empirical* truths is instrumentally valuable. We conclude with a brief comment on "metanormative regress.".

According to the sufficiency principle, distributive justice requires that everyone have some sufficient level of resources or well-being, but inequalities above this threshold have no moral significance. This paper defends a version of the sufficiency principle as the appropriate response to moral uncertainty about distributive justice. Assuming that the appropriate response to moral uncertainty is to maximize expected choiceworthiness, and given a reasonable distribution of credence in some familiar views about distributive justice, a version of the sufficiency principle strikes the (...) optimal balance between the competing moral risks posed by implementing these views. In particular, it avoids the moral risk posed by views like Nozick’s libertarianism, which forbid redistributive taxation even for the sake of helping to provide for people’s basic needs: failing to do the latter, if it turns out that justice does require it, would be very morally wrong. This “uncertainty argument” has the advantage of minimizing reliance on controversial intuitions about distributive justice, helps to specifying a non-arbitrary threshold for sufficiency, and shows that the substantive moral implications of moral uncertainty are not limited to high-stakes applied ethics issues such as abortion and vegetarianism but instead extend to an issue at the heart of political philosophy. (shrink)

Ruth Chang and Joseph Raz have both drawn far-reaching consequences for agency from the phenomenon of incommensurability. After criticizing their arguments, I outline an alternative view: if incommensurability is vagueness, then there are no substantial implications for agency, except perhaps a limited form of naturalistic voluntarism if our reasons are provided by desires.

How much value can our decisions create? We argue that unless our current understanding of physics is wrong in fairly fundamental ways, there exists an upper limit of value relevant to our decisions. First, due to the speed of light and the definition and conception of economic growth, the limit to economic growth is a restrictive one. Additionally, a related far larger but still finite limit exists for value in a much broader sense due to the physics of information and (...) the ability of physical beings to place value on outcomes. We discuss how this argument can handle lexicographic preferences, probabilities, and the implications for infinite ethics and ethical uncertainty. (shrink)

Human neural organoid research is advancing rapidly. As Greely notes in the target article, this progress presents an “onrushing ethical dilemma.” We can’t rule out the possibility that suff...

My paper builds on the conceptual tools from three interrelated philosophical debates that—as I believe—may help structure important if chaotic discussions about surrogates for living human brains and resolve some practical issues related to regulatory matters. In particular, I refer to the discussions about the “moral precautionary principle” in research ethics (Koplin and Wilkinson 2019); about normative uncertainty in ethics (MacAskill, Bykvist, and Ord 2020), and about the inductive risk problem for animal welfare scientists (Birch 2018). I elucidate upon the (...) possible meanings of the phrase “a too good human brain surrogate” used by Henry T. Greely (2021), and I demonstrate that the evaluation of the practical and regulatory implications of the “goodness” of such surrogates created for research purposes should be sensitive to the possible consequences of two types of errors: the under-attribution and over-attribution of moral status to such beings. Many authors writing about this topic (including Greely 2021, but see also, e.g., Koplin and Savulescu 2019) concentrate only on the first type of error, neglecting the negative consequences of the second type, i.e., over-attribution. (shrink)

Automated decision making for sentencing is the use of a software algorithm to analyse a convicted offender’s case and deliver a sentence. This chapter reviews the moral arguments for and against employing automated decision making for sentencing and finds that its use is in principle morally permissible. Specifically, it argues that well-designed automated decision making for sentencing will better approximate the just sentence than human sentencers. Moreover, it dismisses common concerns about transparency, privacy and bias as unpersuasive or inapplicable. The (...) chapter also notes that moral disagreement about theories of just sentencing are plausibly resolved by applying the principle of maximising expected moral choiceworthiness, and that automated decision making is better suited to the resulting ensemble model. Finally, the chapter considers the challenge posed by penal populism. The dispiriting conclusion is that although it is in theory morally desirable to use automated decision-making for criminal sentencing, it may well be the case that we ought not to try. (shrink)

Suppose that an altruistic agent who is uncertain between evidential and causal decision theory finds herself in a situation where these theories give conflicting verdicts. We argue that even if she has significantly higher credence in CDT, she should nevertheless act in accordance with EDT. First, we claim that the appropriate response to normative uncertainty is to hedge one's bets. That is, if the stakes are much higher on one theory than another, and the credences you assign to each of (...) these theories are not very different, then it is appropriate to choose the option that performs best on the high-stakes theory. Second, we show that, given the assumption of altruism, the existence of correlated decision makers will increase the stakes for EDT but leave the stakes for CDT unaffected. Together these two claims imply that whenever there are sufficiently many correlated agents, the appropriate response is to act in accordance with EDT. (shrink)

In this entry, we discuss both the definition of effective altruism and objections to effective altruism, so defined.

Pascal’s Wager involves expected utilities. In this chapter, we examine the Wager in light of two main features of expected utility theory: utilities and probabilities. We discuss infinite and finite utilities, and zero, infinitesimal, extremely low, imprecise, and undefined probabilities. These have all come up in recent literature regarding Pascal’s Wager. We consider the problems each creates and suggest prospects for the Wager in light of these problems.

Maximize Expected Choiceworthiness (MEC) is a theory of decision-making under moral uncertainty. It says that we ought to handle moral uncertainty in the way that Expected Value Theory (EVT) handles descriptive uncertainty. MEC inherits from EVT the problem of fanaticism. Roughly, a decision theory is fanatical when it requires our decision-making to be dominated by low-probability, high-payoff options. Proponents of MEC have offered two main lines of response. The first is that MEC should simply import whatever are the best solutions (...) to fanaticism on offer in decision theory. The second is to propose statistical normalization as a novel solution on behalf of MEC. This paper argues that the first response is open to serious doubt and that the second response fails. As a result, MEC appears significantly less plausible when compared to competing accounts of decision-making under moral uncertainty, which are not fanatical. (shrink)

Moral latitude is only ever a matter of coincidence on the most popular decision procedure in the literature on moral uncertainty. In all possible choice situations other than those in which two or more options happen to be tied for maximal expected choiceworthiness, Maximize Expected Choiceworthiness implies that only one possible option is uniquely appropriate. A better theory of appropriateness would be more sensitive to the decision maker’s credence in theories that endorse agent-centred prerogatives. In this paper, we will develop (...) and defend a modified version of this view that allows for agent-centred prerogatives and supererogation as part of its verdicts about appropriateness. (shrink)

This paper presents a unifying diagnosis of a number of important problems facing existing models of rational choice under moral uncertainty and proposes a remedy. I argue that the problems of (i) severely limited scope, (ii) intertheoretic comparisons, and (iii) 'swamping’ all stem from the way in which values are assigned to options in decision rules such as Maximisation of Expected Choiceworthiness. By assigning values to options under a given moral theory by asking something like ‘how much do I desire (...) this option, supposing this theory is true?’ rather than ‘how much value does this theory assign to this option?’ these problems can be avoided, while the appealing features of these accounts can be preserved. This amendment provides a role for the preferences, desires, or goals of rational agents that is curiously absent from the existing discussion of what individuals rationally ought to do when they are uncertain about what they morally ought to do. (shrink)

Multidimensional concepts are everywhere, and they are important. Examples include moral value, welfare, scientific confirmation, democracy, and biodiversity. How, if at all, can we aggregate the underlying dimensions of a multidimensional concept F to yield verdicts about which things are Fer than which overall? Social choice theory can be used to model and investigate this aggregation problem. Here, we focus on a particularly thorny problem made salient by this social choice-theoretic framework: the underlying dimensions of a given concept might be (...) measurable on different types of scales—e.g., some ordinal and some cardinal. An underappreciated impossibility theorem due to Anna Khmelnitskaya shows that seemingly plausible constraints on aggregation across scale types are inconsistent. This impossibility threatens to render the notion of overall Fness incoherent. We attempt to defuse this threat, arguing that the impossibility depends on an overly restrictive conception of measurement and of how measurement constrains aggregation. Adopting a more flexible—and, we think, more perspicuous—conception of measurement opens an array of possibilities for aggregation across disparate scale types. (shrink)

This thesis is about making decisions when we are uncertain about what will happen, how valuable it will be, and even how to make decisions. Even the most sure-footed amongst us are sometimes uncertain about all three, but surprisingly little attention has been given to the latter two. The three essays that constitute my thesis hope to do a small part in rectifying this problem. The first essay is about the value of finding out how to make decisions. Society spends (...) considerable resources funding people (like me) to research decision-making, so it is natural to wonder whether society is getting a good deal. This question is so shockingly underresearched that bedrock facts are readily discoverable, such as when this kind of information is valuable. My second essay concerns whether we can compare value when we are uncertain about value. Many people are in fact uncertain about value, and how we deal with this uncertainty hinges on these comparisons. I argue that value comparisons are only sometimes possible; I call this weak comparability. This essay is largely a synthesis of the literature, but I also present an argument which begins with a peculiar view of the self: it is as if each of us is a crowd of different people separated by time (but connected by continuity of experience). I’m not the first to endorse this peculiar view of the self, but I am the first to show how it supports the benign view that value is sometimes comparable. We may be uncertain of any decision rules, even those that would tell us how to act when we face uncertainty in decision rules. We may be uncertain of how to decide how to decide how to... And so on. If so, we might have to accept infinitely many decision rules just to make any mundane decision, such as whether to pick up a five-cent piece from the gutter. My third essay addresses this problem of regress. I think all of our decisions are forced: we must decide now or continue to deliberate. Surprisingly, this allows us to avoid the original problem. I call this solution “when forced, do your best”. (shrink)

As well as disagreeing about how much one should donate to charity, moral theories also disagree about where one should donate. In light of this disagreement, how should the morally uncertain philanthropist allocate her donations? In many cases, one intuitively attractive option is for the philanthropist to split her donations across all of the charities that are recommended by moral views in which she has positive credence, with each charity’s share being proportional to her credence in the moral theories that (...) recommend that particular charity. Despite the fact that something like this approach is already being used by real-world philanthropists to distribute billions of dollars of donations, it is not supported by any of the approaches to moral uncertainty that have been proposed thus-far in the philosophical literature. In this paper, we will develop a bargaining-based approach to moral uncertainty that honors the proportionality intuition in favor of splitting one’s donations. We also show how this bargaining-based approach has several further advantages over the best alternative proposals. (shrink)

This paper is not concerned with the (amply discussed) question as to the rational response to peer disagreement. Instead, it addresses a (considerably less often debated) problem to which many views about the (epistemic) significance of disagreement are vulnerable (to some extent or another): self-undermining. I reject several answers that have been proposed in the literature, defend one that has been offered (by meeting objections to it), and show that in its light, the prevalent assumption that the ‘equal-weight view’, a (...) prominent view about disagreement, rationally requires us to suspend judgement about contentious matters, is seen to be too pessimistic. (shrink)

1. 1.1. Suffering is bad. This is why, ceteris paribus, there are strong moral reasons to prevent suffering. Moreover, typically, those moral reasons are stronger when the amount of suffering at st...

We sometimes seem to face fundamental moral uncertainty, i.e., uncertainty about what is morally good or morally right that cannot be reduced to ordinary descriptive uncertainty. This phenomenon raises a puzzle for noncognitivism, according to which moral judgments are desire-like attitudes as opposed to belief-like attitudes. Can a state of moral uncertainty really be a noncognitive state? So far, noncognitivists have not been able to offer a completely satisfactory account. Here, we argue that noncognitivists should exploit the formal analogy between (...) moral uncertainty and moral multi-objective decision problems. Our ‘multi-objective story’ enables noncognitivists to save our moral uncertainty thought and talk by explaining how the underlying phenomenon could be noncognitive. (shrink)

In recent years, there has been an intense public debate about whether and, if so, to what extent investments in nuclear energy should be part of strategies to mitigate climate change. Here, we address this question from an ethical perspective, evaluating different strategies of energy system development in terms of three ethical criteria, which will differentially appeal to proponents of different normative ethical frameworks. Starting from a standard analysis of climate change as arising from an intergenerational collective action problem, we (...) evaluate whether contributions from nuclear energy will, on expectation, increase the likelihood of successfully phasing out fossil fuels in time to avert dangerous global warming. For many socio-economic and geographic contexts, our review of the energy system modeling literature suggests the answer to this question is “yes.” We conclude that, from the point of view of climate change mitigation, investments in nuclear energy as part of a broader energy portfolio will be ethically required to minimize the risks of decarbonization failure, and thus the tail risks of catastrophic global warming. Finally, using a sensitivity analysis, we consider which other aspects of nuclear energy deployment, apart from climate change, have the potential to overturn the ultimate ethical verdict on investments in nuclear energy. Out of several potential considerations, we suggest that its potential interplay — whether beneficial or adverse — with the proliferation of nuclear weapons is the most plausible candidate. (shrink)

Recently, there has been a revival in taking empirical magnitudes seriously. Weights, heights, velocities and the like have been accepted as abstract entities in their own right rather than just equivalence classes of objects. The aim of my paper is to show that this revival should include value magnitudes. If we posit such magnitudes, important value comparisons can be easily explained; it becomes easier to satisfy the axioms for measurement of value; goodness, badness, and neutrality can be given univocal definitions; (...) value aggregation can be given a non-mathematical understanding which allows for Moorean organic unities. Of course, this does not come for free. One has to accept a rich ontology of abstract value magnitudes, but, to quote David Lewis, ‘The price is right; the benefits in theoretical unity and economy are well worth the entities.’. (shrink)

According to the modal account of luck it is a matter of luck that p if p is true at the actual world, but false in a wide‐range of nearby worlds. According to the modal account of risk, it is risky that p if p is true at some close world. I argue that the modal accounts of luck and risk do not mesh well together. The views entail that p can be both maximally risky and maximally lucky, but there (...) is nothing which is both maximally lucky and maximally risky. I offer a novel theory of risk that fits together with the modal account of luck and demonstrate that it is both extensionally and formally superior to extant proposals. (shrink)

The application of artificial intelligence (AI) to judicial decision-making has already begun in many jurisdictions around the world. While AI seems to promise greater fairness, access to justice, and legal certainty, issues of discrimination and transparency have emerged and put liberal democratic principles under pressure, most notably in the context of bail decisions. Despite this, there has been no systematic analysis of the risks to liberal democratic values from implementing AI into judicial decision-making. This article sets out to fill this (...) void by identifying and engaging with challenges arising from artificial judicial decision-making, focusing on three pillars of liberal democracy, namely equal treatment of citizens, transparency, and judicial independence. Methodologically, the work takes a comparative perspective between human and artificial decision-making, using the former as a normative benchmark to evaluate the latter. -/- The chapter first argues that AI that would improve on equal treatment of citizens has already been developed, but not yet adopted. Second, while the lack of transparency in AI decision-making poses severe risks which ought to be addressed, AI can also increase the transparency of options and trade-offs that policy makers face when considering the consequences of artificial judicial decision-making. Such transparency of options offers tremendous benefits from a democratic perspective. Third, the overall shift of power from human intuition to advanced AI may threaten judicial independence, and with it the separation of powers. While improvements regarding discrimination and transparency are available or on the horizon, it remains unclear how judicial independence can be protected, especially with the potential development of advanced artificial judicial intelligence (AAJI). Working out the political and legal infrastructure to reap the fruits of artificial judicial intelligence in a safe and stable manner should become a priority of future research in this area. (shrink)

This Special Issue titled "Severe Uncertainty in Science, Medicine and Technology" aims to shed new light on the understanding of severe uncertainty and its multifaceted implications. The main idea of the papers of this collection is that, despite possible sophisticated statistical judgments towards future risks in science, medicine, and technology, severe forms of uncertainty still exist.While ignorance is usually assumed to be a total absence of knowledge, uncertainty often refers to the incompleteness of knowledge or information. In its extreme form, (...) this is called "severe uncertainty" but is also known as "fundamental," "radical," "deep," "great," or "genuine" uncertainty. A common characteristic of these... (shrink)

Non-cognitivism is a variety of irrealism about ethics with a number of influential variants. Non-cognitivists agree with error theorists that there are no moral properties or moral facts. But rather than thinking that this makes moral statements false, noncognitivists claim that moral statements are not in the business of predicating properties or making statements which could be true or false in any substantial sense. Roughly put, noncognitivists think that moral statements have no truth conditions. Furthermore, according to non-cognitivists, when people (...) utter moral sentences they are not typically expressing states of mind which are beliefs or which are cognitive in the way that beliefs are. Rather they are expressing non-cognitive attitudes more similar to desires, approval or disapproval. Cognitivism is the denial of non-cognitivism. Thus it holds that moral statements do express beliefs and that they are apt for truth and falsity. But cognitivism need not be a species of realism since a cognitivist can be an error theorist and think all moral statements false. Still, moral realists are cognitivists insofar as they think moral statements are apt for truth and falsity and that many of them are in fact true. (shrink)

In this paper, we explore an under-investigated question concerning the class of formal models that aim at providing normative guidance. We call such models normative models. In particular, we examine the question of how normative models can successfully exert normative guidance. First, we highlight the absence of a discussion of this question – which is surprising given the extensive debate about the success conditions of descriptive models – and motivate its importance. Second, we introduce and discuss two potential accounts of (...) the success conditions of normative models. Our tentative conclusion is that the second account is more promising. (shrink)

Rohana faces a choice where she can produce either a better outcome by lying or a worse outcome by telling the truth. She justifiably, but falsely, believes in.

Trolley problems and like cases are often thought to show the inadequacy of purely consequentialist moral theories. In particular, they are often taken to reveal that consequentialists unduly neglect the moral significance of the causal structure of decision problems. To precisify such critiques and one sort of deontological morality they motivate, I develop a formal modeling framework within which trolley problems can be represented as suitably supplemented structural causal models and various consequentialist and double effect-inspired moral theories can be viewed (...) as disagreeing over the inputs of a common decision rule. (shrink)

This article is about the role of factual uncertainty for moral decision-making as it concerns the ethics of machine decision-making. The view that is defended here is that factual uncertainties require a normative evaluation and that ethics of machine decision faces a triple-edged problem, which concerns what a machine ought to do, given its technical constraints, what decisional uncertainty is acceptable, and what trade-offs are acceptable to decrease the decisional uncertainty.

As AI Systems become increasingly autonomous, they are expected to engage in decision-making processes that have moral implications. In this research we integrate theoretical and empirical lines of thought to address the matters of moral reasoning and moral uncertainty in AI Systems. We reconceptualize the metanormative framework for decision-making under moral uncertainty and we operationalize it through a latent class choice model. The core idea being that moral heterogeneity in society can be codified in terms of a small number of (...) classes with distinct moral preferences and that this codification can be used to express moral uncertainty of an AI. Choice analysis allows for the identification of classes and their moral preferences based on observed choice data. Our reformulation of the metanormative framework is theory-rooted and practical in the sense that it avoids runtime issues in real time applications. To illustrate our approach we conceptualize a society in which AI Systems are in charge of making policy choices. While one of the systems uses a baseline morally certain model, the other uses a morally uncertain model. We highlight cases in which the AI Systems disagree about the policy to be chosen, thus illustrating the need to capture moral uncertainty in AI systems. (shrink)

Should we accept that different moral norms govern our treatment of human and nonhuman animals? In this paper I suggest that the answer is both yes and no. At the theoretical level of morality, a single, unified set of norms governs our treatment of all sentient beings. But at the practical level of morality, different sets of norms can govern our treatment of different groups in different contexts. And whether we accept that we should, say, respect rights or maximize utility (...) at the theoretical level, we might also accept that we should apply a relatively Kantian set of norms to our treatment of humans and a relatively utilitarian set of norms to our treatment of nonhumans in practice, with many caveats. I argue that this moderate “monist in theory, hybrid in practice” view has many advantages over fully monist or hybrid alternatives. (shrink)

The ongoing energy transition toward more sustainable energy systems implies a change in the values for which such systems are designed. The energy transition however is not just about sustainability but also about values like energy security and affordability, and we witness the emergence of new values like energy justice and energy democracy. How can we understand such value changes and how can or should they affect the design of future energy systems? This introduction to the special section on value (...) change in energy systems introduces the main themes and questions. It discusses different understandings of values and value change, explains why the topic is important and how it can be methodologically studied. (shrink)