Some authors have recently suggested that it is time to consider rights for robots. These suggestions are based on the claim that the question of robot rights should not depend on a standard set of conditions for ‘moral status’; but instead, the question is to be framed in a new way, by rejecting the is/ought distinction, making a relational turn, or assuming a methodological behaviourism. We try to clarify these suggestions and to show their highly problematic consequences. While (...) we find the suggestions ultimately unmotivated, the discussion shows that our epistemic condition with respect to the moral status of others does raise problems, and that the human tendency to empathise with things that do not have moral status should be taken seriously—we suggest that it produces a “derived moral status”. Finally, it turns out that there is typically no individual in real AI that could even be said to be the bearer of moral status. Overall, there is no reason to think that robot rights are an issue now. (shrink)

This article explores whether and under which circumstances it is ethically viable to include artificial beings worthy of moral consideration in virtual environments. In particular, the article focuses on virtual environments such as those in digital games and training simulations – interactive and persistent digital artifacts designed to fulfill specific purposes, such as entertainment, education, training, or persuasion. The article introduces the criteria for moral consideration that serve as a framework for this analysis. Adopting this framework, (...) the article tackles the question of whether including artificial intelligences that are entitled to moral consideration in virtual environments constitutes an immoral action on the part of human creators. To address this problem, the article draws on three conceptual lenses from the philosophical branch of ethics: the problem of parenthood and procreation, the question concerning the moral status of animals, and the classical problem of evil. Using a thought experiment, the concluding section proposes a contractualist answer to the question posed in this article. The same section also emphasizes the potential need to reframe our understanding of the design of virtual environments and their future stakeholders. (shrink)

According to the most popular theories of intentionality, a family of theories we will refer to as “functional intentionality,” a machine can have genuine intentional states so long as it has functionally characterizable mental states that are causally hooked up to the world in the right way. This paper considers a detailed description of a robot that seems to meet the conditions of functional intentionality, but which falls victim to what I call “the composition problem.” One obvious way to escape (...) the problem (arguably, the only way) is if the robot can be shown to be a moral patient – to deserve a particular moral status. If so, it isn’t clear how functional intentionality could remain plausible (something like “phenomenal intentionality” would be required). Finally, while it would have seemed that a reasonable strategy for establishing the moral status of intelligent machines would be to demonstrate that the machine possessed genuine intentionality, the composition argument suggests that the order of precedence is reversed: The machine must first be shown to possess a particular moral status before it is a candidate for having genuine intentionality. (shrink)

The aim of this thesis is to advance a philosophically justifiable account of Artificial Moral Agency (AMA). Concerns about the moral status of Artificial Intelligence (AI) traditionally turn on questions of whether these systems are deserving of moral concern (i.e. if they are moral patients) or whether they can be sources of moral action (i.e. if they are moral agents). On the Organic View of Ethical Status, being a moral (...) patient is a necessary condition for an entity to qualify as a moral agent. This view claims that because artificial agents (AAs) lack sentience, they cannot be proper subjects of moral concern and hence cannot be considered to be moral agents. I raise conceptual and epistemic issues with regards to the sense of sentience employed on this view, and I argue that the Organic View does not succeed in showing that machines cannot be moral patients. Nevertheless, irrespective of this failure, I also argue that the entire project is misdirected in that moral patiency need not be a necessary condition for moral agency. Moreover, I claim that whereas machines may conceivably be moral patients in the future, there is a strong case to be made that they are (or will very soon be) moral agents. Whereas it is often argued that machines cannot be agents simpliciter, let alone moral agents, I claim that this argument is predicated on a conception of agency that makes unwarranted metaphysical assumptions even in the case of human agents. Once I have established the shortcomings of this “standard account”, I move to elaborate on other, more plausible, conceptions of agency, on which some machines clearly qualify as agents. Nevertheless, the argument is still often made that while some machines may be agents, they cannot be moral agents, given their ostensible lack of the requisite phenomenal states. Against this thesis, I argue that the requirement of internal states for moral agency is philosophically unsound, as it runs up against the problem of other minds. In place of such intentional accounts of moral agency, I provide a functionalist alternative, which makes conceptual room for the existence of AMAs. The implications of this thesis are that at some point in the future we may be faced with situations for which no human being is morally responsible, but a machine may be. Moreover, this responsibility holds, I claim, independently of whether the agent in question is “punishable” or not. (shrink)

This paper presents a new trilemma with respect to resolving the control and alignment problems in machine ethics. Section 1 outlines three possible types of artificial moral agents (AMAs): (1) 'Inhuman AMAs' programmed to learn or execute moral rules or principles without understanding them in anything like the way that we do; (2) 'Better-Human AMAs' programmed to learn, execute, and understand moral rules or principles somewhat like we do, but correcting for various sources of human (...) class='Hi'>moral error; and (3) 'Human-Like AMAs' programmed to understand and apply moral values in broadly the same way that we do, with a human-like moral psychology. Sections 2–4 then argue that each type of AMA generates unique control and alignment problems that have not been fully appreciated. Section 2 argues that Inhuman AMAs are likely to behave in inhumane ways that pose serious existential risks. Section 3 then contends that Better-Human AMAs run a serious risk of magnifying some sources of human moral error by reducing or eliminating others. Section 4 then argues that Human-Like AMAs would not only likely reproduce human moral failures, but also plausibly be highly intelligent, conscious beings with interests and wills of their own who should therefore be entitled to similar moral rights and freedoms as us. This generates what I call the New Control Problem: ensuring that humans and Human-Like AMAs exert a morally appropriate amount of control over each other. Finally, Section 5 argues that resolving the New Control Problem would, at a minimum, plausibly require ensuring what Hume and Rawls term ‘circumstances of justice’ between humans and Human-Like AMAs. But, I argue, there are grounds for thinking this will be profoundly difficult to achieve. I thus conclude on a skeptical note. Different approaches to developing ‘safe, ethical AI’ generate subtly different control and alignment problems that we do not currently know how to adequately resolve, and which may or may not be ultimately surmountable. (shrink)

Thanks to mounting discussion about projected technologies’ possibly altering the species mentally and physically, philosophical investigation of what human beings are proceeds robustly. Many thinkers contend that whatever we are has little to do with how we should behave. Yet, tampering with what the human being is may tread upon human rights to be whatever one is. Rights given in widely recognized documents such as the U.N. Declaration of the Rights of Indigenous Peoples assume what humans are and need (...) depends upon ontological assumptions about human existence. Godman turns to human ontology—just what kind of beings humans are (from an angle distinct from the other two books) and how these play into rights. She is concerned with how well the social sciences accord with what we are. Gunkel homes in on a more specific moral topic than Godman's general concern with identity’s role in rights: automata moral status and rights. He enjoins us to inquire into what human rights are before we take on the new technologies’ challenge to it. Schneider’s Artificial You, while not explicitly about rights, poses a rights quandary. Certain individuals with reputable resources and practical backing explicitly seek to evolve the species as they see fit. The urgency among these works concerns how we need a sharper idea of what we are, how we should act and be treated, and how our rights fare among potential human improvements. (shrink)

Can artificial entities be worthy of moral considerations? Can they be artificial moral agents (AMAs), capable of telling the difference between good and evil? In this essay, I explore both questions—i.e., whether and to what extent artificial entities can have a moral status (“the machine question”) and moral agency (“the AMA question”)—in light of Kazuo Ishiguro’s 2021 novel Klara and the Sun. I do so by juxtaposing two prominent approaches to machine morality (...) that are central to the novel: the (1) view “from within,” including the standard (or “metaphysical”) perspective on moral agency, and the (2) view “from outside,” which includes behaviorism, functionalism and the social-relational perspective. Importantly, while the story illustrates both views, it exposes the epistemological vulnerability of the first in relation to the practical and social reality imposed by the second. That is, regardless of what metaphysical properties the Artificial Friend Klara can be said to have (from within), her moral status as well as agency ultimately depend on the views of others (from outside), including the others’ own epistemic beliefs about the nature of consciousness and personhood. (shrink)

Abstract: Artificial Morality is a new, emerging interdisciplinary field that centres around the idea of creating artificial moral agents, or AMAs, by implementing moral competence in artificial systems. AMAs are ought to be autonomous agents capable of socially correct judgements and ethically functional behaviour. This request for moral machines comes from the changes in everyday practice, where artificial systems are being frequently used in a variety of situations from home help and elderly care (...) purposes to banking and court algorithms. It is therefore important to create reliable and responsible machines based on the same ethical principles that society demands from people. New challenges in creating such agents appear. There are philosophical questions about a machine’s potential to be an agent, or mora l agent, in the first place. Then comes the problem of social acceptance of such machines, regardless of their theoretic agency status. As a result of efforts to resolve this problem, there are insinuations of needed additional psychological (emotional and cogn itive) competence in cold moral machines. What makes this endeavour of developing AMAs even harder is the complexity of the technical, engineering aspect of their creation. Implementation approaches such as top- down, bottom-up and hybrid approach aim to find the best way of developing fully moral agents, but they encounter their own problems throughout this effort. (shrink)

Arguably the most foundational principle in perception research is that our experience of the world goes beyond the retinal image; we perceive the distal environment itself, not the proximal stimulation it causes. Shape may be the paradigm case of such “unconscious inference”: When a coin is rotated in depth, we infer the circular object it truly is, discarding the perspectival ellipse projected on our eyes. But is this really the fate of such perspectival shapes? Or does a tilted coin retain (...) an elliptical appearance even when we know it’s circular? This question has generated heated debate from Locke and Hume to the present; but whereas extant arguments rely primarily on introspection, this problem is also open to empirical test. If tilted coins bear a representational similarity to elliptical objects, then a circular coin should, when rotated, impair search for a distal ellipse. Here, nine experiments demonstrate that this is so, suggesting that perspectival shapes persist in the mind far longer than traditionally assumed. Subjects saw search arrays of three-dimensional “coins,” and simply had to locate a distally elliptical coin. Surprisingly, rotated circular coins slowed search for elliptical targets, even when subjects clearly knew the rotated coins were circular. This pattern arose with static and dynamic cues, couldn’t be explained by strategic responding or unfamiliarity, generalized across shape classes, and occurred even with sustained viewing. Finally, these effects extended beyond artificial displays to real-world objects viewed in naturalistic, full-cue conditions. We conclude that objects have a remarkably persistent dual character: their objective shape “out there,” and their perspectival shape “from here.”. (shrink)

In light of recent breakneck pace in machine learning, questions about whether near-future artificial systems might be conscious and possess moral status are increasingly pressing. This paper argues that as matters stand these debates lack any clear criteria for resolution via the science of consciousness. Instead, insofar as they are settled at all, it is likely to be via shifts in public attitudes brought about by the increasingly close relationships between humans and AI users. Section 1 of (...) the paper I briefly lays out the current state of the science of consciousness and its limitations insofar as these pertain to machine consciousness, and claims that there are no obvious consensus frameworks to inform public opinion on AI consciousness. Section 2 examines the rise of conversational chatbots or Social AI, and argues that in many cases, these elicit strong and sincere attributions of consciousness, mentality, and moral status from users, a trend likely to become more widespread. Section 3 presents an inconsistent triad for theories that attempt to link consciousness, behaviour, and moral status, noting that the trends in Social AI systems will likely make the inconsistency of these three premises more pressing. Finally, Section 4 presents some limited suggestions for how consciousness and AI research communities should respond to the gap between expert opinion and folk judgment. (shrink)

Henry Shevlin’s paper—“How could we know when a robot was a moral patient?” – argues that we should recognize robots and artificial intelligence (AI) as psychological moral patients if they are cognitively equivalent to other beings that we already recognize as psychological moral patients (i.e., humans and, at least some, animals). In defending this cognitive equivalence strategy, Shevlin draws inspiration from the “behavioral equivalence” strategy that I have defended in previous work but argues that it (...) is flawed in crucial respects. Unfortunately—and I guess this is hardly surprising—I cannot bring myself to agree that the cognitive equivalence strategy is the superior one. In this article, I try to explain why in three steps. First, I clarify the nature of the question that I take both myself and Shevlin to be answering. Second, I clear up some potential confusions about the behavioral equivalence strategy, addressing some other recent criticisms of it. Third, I will explain why I still favor the behavioral equivalence strategy over the cognitive equivalence one. (shrink)

A common interpretation of Philip K. Dick’s texts _Do Androids Dream of Electric Sheep?_ and _We Can Build You_ is that they attempt to answer the question “What does it mean to be human?” -/- Unfortunately, these interpretations fail to deal with the fact that the term “human” has both metaphysical and moral connotations. Metaphysical meanings associated with theories of human nature and moral meanings associated with theories of moral status are thus blurred in the novels (...) and in the literature that discusses them. This is problematic on many levels. The conclusion argued for in this paper is that we should carefully disentangle these meanings. Doing so has many benefits, both for literary criticism and moral philosophy. For literary criticism, disentanglement helps solve some puzzling elements of the texts that are unlikely to be solved if the entanglements are not undone. -/- Furthermore, disentangling the moral and the metaphysical meanings of “human” provides an opportunity to showcase how theories of moral status can be used as an interpretive lens. For moral philosophy, exploring the entanglements of the novels can suggest new ideas about which non-humans—animals, robots, artificial intelligence—are part of the moral community. Finally, disentangling these meanings highlights problems that arise when one assumes that answers to metaphysical questions entail clear moral answers to questions about moral status. (shrink)

The chief themes of this discussion are as follows. First, we need a theory of the grounds of moral status that could guide practical considerations regarding how to treat the wide range of potentially conscious entities with which we are acquainted – injured humans, cerebral organoids, chimeras, artificially intelligent machines, and non-human animals. I offer an account of phenomenal value that focuses on the structure and sophistication of phenomenally conscious states at a time and over time in the (...) mental lives of conscious subjects. Second, we need to map a theory of moral status onto practical considerations. I prefer the precautionary framework proposed by many, and fruitfully precisified recently by Birch. I have suggested that in addition to further discussion surrounding the evidential bar for attributing consciousness to different types of entities, more discussion is needed regarding how value and moral status may vary across different entity-types, and regarding the sources of value in an entity’s mental life. (shrink)

This paper addresses the issue of the moral status of non-human animals, or the question whether sentient animals are morally considerable. The arguments for and against the moral status of animals are discussed, above all the argument from marginal cases. It is argued that sentient animals have moral status based on their having interests in their experiential well-being, but that there are degrees of moral status. Two interest-based approaches are presented and discussed: (...) DeGrazia’s view that sentient animals have interests in continuing to live, and that their interests should be granted moral weight; and McMahan’s TRIA which similarly postulates that animals have interests and that in a given situation we should compare the human and animal interests at stake. Finally, the paper concludes that the anthropocentric approach to animal ethics should be abandoned in favour of the biocentric ethics. (shrink)

This chapter is about micro-inequities and their connection to the problem of implicit bias. It begins by defining micro-inequities, goes on to discuss what makes them wrong and what solutions might be appropriate given the institutional context in which they occur.

In this paper, we defend three claims about what it will take for an AI system to be a basic moral patient to whom we can owe duties of non-maleficence not to harm her and duties of beneficence to benefit her: (1) Moral patients are mental patients; (2) Mental patients are true intentional systems; and (3) True intentional systems are systematically flexible. We suggest that we should be particularly alert to the possibility of such systematically flexible true intentional (...) systems developing in the areas of exploratory robots and artificial personal assistants. Finally, we argue that in light of our failure to respect the well-being of existing biological moral patients and worries about our limited resources, there are compelling moral reasons to treat artificial moral patiency as something to be avoided at least for now. (shrink)

Consciousness has an important role in ethics: when a being consciously experiences the frustration or satisfaction of its interests, those interests deserve higher moral priority than those of a behaviourally similar but non-conscious being. I consider the relationship between this ethical role and an a posteriori (or “type-B”) materialist solution to the mind-body problem. It is hard to avoid the conclusion that, if type-B materialism is correct, then the reference of the concept of phenomenal consciousness is radically indeterminate between (...) a neuronal-level property that is distinctive to mammals and a high-level functional property that is much more widely shared. This would leave many non-mammalian animals (such as birds, fish, insects and octopuses) with indeterminate moral status. There are ways to manage this radical moral indeterminacy, but all of these ways lead to profoundly troubling consequences. (shrink)

This article focuses on a particular issue under machine ethics—that is, the nature of Artificial Moral Agents. Machine ethics is a branch of artificial intelligence that looks into the moral status of artificial agents. Artificial moral agents, on the other hand, are artificial autonomous agents that possess moral value, as well as certain rights and responsibilities. This paper demonstrates that attempts to fully develop a theory that could possibly account for (...) the nature of Artificial Moral Agents may consider certain philosophical ideas, like the standard characterizations of agency, rational agency, moral agency, and artificial agency. At the very least, the said philosophical concepts may be treated as signposts for further research on how to truly account for the nature of Artificial Moral Agents. (shrink)

This article argues that criminal law should not, in general, prevent the creation of artificially intelligent servants who achieve humanlike moral status, even though it may well be immoral to construct such beings. In defending this claim, a series of thought experiments intended to evoke clear intuitions is proposed, and presuppositions about any particular theory of criminalization or any particular moral theory are kept to a minimum.

Moral judgments about an action are influenced by the action’s intentionality. The reverse is also true: judgments of intentionality can be influenced by an action’s moral valence. For example, respondents judge a harmful side-effect of an intended outcome to be more intentional than a helpful side-effect. Debate continues regarding the mechanisms underlying this “side-effect effect” and the conditions under which it will persist. The research behind this chapter tested whether the side-effect effect is intact in adolescents with psychopathic (...) traits, who are characterized by persistent immoral behavior, deficient moral emotions, and impairments in some forms of moral judgment. Results showed no differences between healthy adolescents and those with psychopathic traits: both groups judged harmful side-effects to be more intentional than helpful side-effects by an approximately 2:1 ratio. The chapter discusses these results in light of hypothesized mechanisms underlying the side-effect effect, and in light of our current understanding of moral reasoning deficits in psychopathy. (shrink)

There are many new philosophical queries about the moral status and rights of artificial intelligences; questions such as whether such entities can be considered as morally responsible entities and as having special rights. Recently, the contemporary philosophy of mind philosopher, Eric Schwitzgebel, has tried to defend the possibility of equal rights of AIs and human beings (in an imaginary future), by designing a new argument (2015). In this paper, after an introduction, the author reviews and analyzes (...) the main argument and then deals with four criticisms witch Schwitzgebel himself has presented and rejected and ultimately, the author presents and explains two new critiques against the argument. According to the writer, though the argument regarding his new criticisms and some other probable critiques is not convincing, or at least needs to be corrected, however, it holds appeal and raises questions and may open a new horizon for future questions and research. (shrink)

According to a common view, animals have moral status. Further, a standard defense of this view is the Argument from Consciousness: animals have moral status because they are conscious and can experience pain and it would be bad were they to experience pain. In a series of papers :277–291, 2015a, J Agric Environ Ethics 28:11270–1138, 2015b, J Agric Environ Ethics 30:37–54, 2017), Timothy Hsiao claims that animals do not have moral status and criticizes the (...) Argument from Consciousness. This short paper defends the Argument from Consciousness by providing two simple responses to Hsiao’s criticism. (shrink)

Recent years have seen a growing interest among psychologists for debates in moral philosophy. Moral psychologists have investigated the causal origins of the opposition between utilitarian and deontological judgments and the psychological underpinnings of people’s beliefs about the moral status of animals. One issue that remains underexplored in this research area is the relationship between people’s disposition to engage in utilitarian thinking and their attitudes towards animals. This gap is unfortunate considering the tight philosophical connection between (...) utilitarianism and the claim that animals have the same moral status as humans. Indeed, the principle of utility leads naturally enough to the view that animals count every bit as much as human beings. In this paper, we report two empirical studies dedicated to bridging this gap. In Study 1, we looked at the relationship between attitudes towards animals and utilitarian judgments in the context of sacrificial dilemmas. In Study 2, we bypassed the problems raised by the use of such dilemmas as a measure of utilitarianism by relying on other types of thought experiments. Overall, our results suggest no strong correlation between utilitarianism and attitudes towards animals. Rather, the existence of a correlation between utilitarianism and attitudes towards animals very much depends on how both are measured. (shrink)

According to a widely shared intuition, normal adult humans require greater moral concern than normal, adult animals in at least some circumstances. Even the most steadfast defenders of animals' moral status attempt to accommodate this intuition, often by holding that humans' higher-level capacities (intellect, linguistic ability, and so on) give rise to a greater number of interests, and thus the likelihood of greater satisfaction, thereby making their lives more valuable. However, the moves from capacities to interests, and (...) from interests to the likelihood of satisfaction, have up to now gone unexamined and undefended. I argue that context plays a morally significant role both in the formation of an individual's capacities, and in the determination of the individual's interests and potential for satisfaction based on those capacities. Claims about an individual's capacities and interests are typically presented as unconditional; but on closer examination, they are revealed to be contingent on tacit assumptions about context. Until we develop an understanding of how to account for the role of context within our moral theories, attempts to defend special moral concern for human beings based on their superior capacities are less firmly grounded than is commonly thought. (shrink)

I propose a framework, derived from moral theory, for assessing the moral status of intelligent machines. Using this framework, I claim that some current and foreseeable intelligent machines have approximately as much moral status as plants, trees, and other environmental entities. This claim raises the question: what obligations could a moral agent (e.g., a normal adult human) have toward an intelligent machine? I propose that the threshold for any moral obligation should be the (...) "functional morality" of Wallach and Allen [20], while the upper limit of our obligations should not exceed the upper limit of our obligations toward plants, trees, and other environmental entities. (shrink)

Suppose a fire broke out in a fertility clinic. One had time to save either a young girl, or a tray of ten human embryos. Would it be wrong to save the girl? According to Michael Sandel, the moral intuition is to save the girl; what is more, one ought to do so, and this demonstrates that human embryos do not possess full personhood, and hence deserve only limited respect and may be killed for medical research. We will argue, (...) however, that no relevant ethical implications can be drawn from the thought experiment. It demonstrates neither that one always ought to let the embryos die, nor does it allow for any general conclusion concerning the moral status of human embryos. (shrink)

The dominant conceptions of moral status in the English-speaking literature are either holist or individualist, neither of which accounts well for widespread judgments that: animals and humans both have moral status that is of the same kind but different in degree; even a severely mentally incapacitated human being has a greater moral status than an animal with identical internal properties; and a newborn infant has a greater moral status than a mid-to-late stage (...) foetus. Holists accord no moral status to any of these beings, assigning it only to groups to which they belong, while individualists such as welfarists grant an equal moral status to humans and many animals, and Kantians accord no moral status either to animals or severely mentally incapacitated humans. I argue that an underexplored, modal-relational perspective does a better job of accounting for degrees of moral status. According to modal-relationalism, something has moral status insofar as it capable of having a certain causal or intensional connection with another being. I articulate a novel instance of modal-relationalism grounded in salient sub-Saharan moral views, roughly according to which the greater a being's capacity to be part of a communal relationship with us, the greater its moral status. I then demonstrate that this new, African-based theory entails and plausibly explains the above judgments, among others, in a unified way. (shrink)

Which artificial intelligence (AI) systems are agents? To answer this question, I propose a multidimensional account of agency. According to this account, a system's agency profile is jointly determined by its level of goal-directedness and autonomy as well as is abilities for directly impacting the surrounding world, long-term planning and acting for reasons. Rooted in extant theories of agency, this account enables fine-grained, nuanced comparative characterizations of artificial agency. I show that this account has multiple important virtues and (...) is more informative than alternatives. More speculatively, it may help to illuminate two important emerging questions in AI ethics: 1. Can agency contribute to the moral status of non-human beings, and how? 2. When and why might AI systems exhibit power-seeking behaviour and does this pose an existential risk to humanity? (shrink)

David DeGrazia tentatively defends what he calls the Interests Model of moral status (see page 135).1 On this model all sentient beings have the same moral status, though some are owed more than others in virtue of having more or stronger interests. The proponent of this model can accept, say, that one should normally save the life of a human in preference to that of a dog. But she denies that we should save the human (...) because he has higher moral status. Instead, the human should be saved because he has more at stake—he may, for example, have a stronger interest in continued existence. In defending the Interests Model, DeGrazia cuts against the grain of recent theorising on moral status, which has instead favoured what he calls the Respect Model. (shrink)

Artificial agents (AAs), particularly but not only those in Cyberspace, extend the class of entities that can be involved in moral situations. For they can be conceived of as moral patients (as entities that can be acted upon for good or evil) and also as moral agents (as entities that can perform actions, again for good or evil). In this paper, we clarify the concept of agent and go on to separate the concerns of morality and (...) responsibility of agents (most interestingly for us, of AAs). We conclude that there is substantial and important scope, particularly in Computer Ethics, for the concept of moral agent not necessarily exhibiting free will, mental states or responsibility. This complements the more traditional approach, common at least since Montaigne and Descartes, which considers whether or not (artificial) agents have mental states, feelings, emotions and so on. By focussing directly on mind-less morality we are able to avoid that question and also many of the concerns of Artificial Intelligence. A vital component in our approach is the Method of Abstraction for analysing the level of abstraction (LoA) at which an agent is considered to act. The LoA is determined by the way in which one chooses to describe, analyse and discuss a system and its context. The Method of Abstraction is explained in terms of an interface or set of features or observables at a given LoA. Agenthood, and in particular moral agenthood, depends on a LoA. Our guidelines for agenthood are: interactivity (response to stimulus by change of state), autonomy (ability to change state without stimulus) and adaptability (ability to change the transition rules by which state is changed) at a given LoA. Morality may be thought of as a threshold defined on the observables in the interface determining the LoA under consideration. An agent is morally good if its actions all respect that threshold; and it is morally evil if some action violates it. That view is particularly informative when the agent constitutes a software or digital system, and the observables are numerical. Finally we review the consequences for Computer Ethics of our approach. In conclusion, this approach facilitates the discussion of the morality of agents not only in Cyberspace but also in the biosphere, where animals can be considered moral agents without their having to display free will, emotions or mental states, and in social contexts, where systems like organizations can play the role of moral agents. The primary cost of this facility is the extension of the class of agents and moral agents to embrace AAs. (shrink)

Could a sufficiently detailed computer simulation of consciousness replicate consciousness? In other words, is performing the right computations sufficient for artificial consciousness? Or will there remain a difference between simulating and being a conscious system, because the right computations must be implemented in the right way? From the perspective of Karl Friston's free energy principle, self-organising systems (such as living organisms) share a set of properties that could be realised in artificial systems, but are not instantiated by computers (...) with a classical (von Neumann) architecture. I argue that at least one of these properties, viz. a certain kind of causal flow, can be used to draw a distinction between systems that merely simulate, and those that actually replicate consciousness. Since this property is instantiated by all systems that conform to the free energy principle (not just conscious beings), the account on offer here can be extended to draw a distinction between simulating and being a certain type of system, more generally. In particular, this may inform meta-ethical accounts of artificial moral status and artificial moral agency. (shrink)

We are sometimes unsure of the moral status of our relationships with other entities. Recent case studies in this uncertainty include our relationships with artificial agents (robots, assistant AI, etc.), animals, and patients with “locked-in” syndrome. Do these entities have basic moral standing? Could they count as true friends or lovers? What should we do when we do not know the answer to these questions? An influential line of reasoning suggests that, in such cases of (...) class='Hi'>moral uncertainty, we need meta-moral decision rules that allow us to either minimize the risks of moral wrongdoing or improve the choice-worthiness of our actions. One particular argument adopted in this literature is the “risk asymmetry argument,” which claims that the risks associated with accepting or rejecting some moral facts may be sufficiently asymmetrical as to warrant favoring a particular practical resolution of this uncertainty. Focusing on the case study of artificial beings, this article argues that this is best understood as an ethical-epistemic challenge. The article argues that taking potential risk asymmetries seriously can help resolve disputes about the status of human–AI relationships, at least in practical terms (philosophical debates will, no doubt, continue); however, the resolution depends on a proper, empirically grounded assessment of the risks involved. Being skeptical about basic moral status, but more open to the possibility of meaningful relationships with such entities, may be the most sensible approach to take. (shrink)

This paper addresses a question about the moral status of Artificial Intelligence (AI): will AIs ever become moral patients? I argue that, while it is in principle possible for an intelligent machine to be a moral patient, there is no good reason to believe this will in fact happen. I start from the plausible assumption that traditional artifacts do not meet a minimal necessary condition of moral patiency: having a good of one's own. I (...) then argue that intelligent machines are no different from traditional artifacts in this respect. To make this argument, I examine the feature of AIs that enables them to improve their intelligence, i.e., machine learning. I argue that there is no reason to believe that future advances in machine learning will take AIs closer to having a good of their own. I thus argue that concerns about the moral status of future AIs are unwarranted. Nothing about the nature of intelligent machines makes them a better candidate for acquiring moral patiency than the traditional artifacts whose moral status does not concern us. (shrink)

Should we cognitively alter animals in ways that might change their moral status? There has been some discussion of this question. For example, Chan (2009) and Chan and Harris (2001) consider whether we should radically enhance the cognitive capacities of animals, while Thompson (2008) and Shriver (2009) argue that we should in fact substantially disenhance some animals to protect them from suffering. More controversially, some have countenanced radical and possibly moral status-altering transformations of human persons. ... (...) One question relevant to all of these discussions is whether it is good for a being to have moral status; whether a being’s moral status contributes to its wellbeing or (as I take to be equivalent) has prudential value for that being. (shrink)

Shelly Kagan has recently defended the view that it is morally worse for a human being to suffer some harm than it is for a lower animal (such as a dog or a cow) to suffer a harm that is equally severe (ceteris paribus). In this paper, I argue that this view receives rather less support from our intuitions than one might at first suppose. According to Kagan, moreover, an individual’s moral status depends partly upon her ‘modal capacities.’ (...) In this paper, I argue that the most natural strategy for justifying Kagan’s theory faces some important challenges. More generally, I argue that philosophers who wish to defend the view that human beings have a higher moral status than that of the lower animals face a dilemma. Either their theory of moral status will imply (unacceptably) that some severely cognitively impaired human beings have a significantly lower moral status than that of typical human beings, or these philosophers will be forced to ground moral status in a set of properties so far removed from a subject’s actual capacities that it will become difficult to see why these kinds of properties should have such moral importance. (shrink)

It seems obvious that phenomenally conscious experience is something of great value, and that this value maps onto a range of important ethical issues. For example, claims about the value of life for those in a permanent vegetative state, debates about treatment and study of disorders of consciousness, controversies about end-of-life care for those with advanced dementia, and arguments about the moral status of embryos, fetuses, and non-human animals arguably turn on the moral significance of various facts (...) about consciousness. However, though work has been done on the moral significance of elements of consciousness, such as pain and pleasure, little explicit attention has been devoted to the ethical significance of consciousness. In this book Joshua Shepherd presents a systematic account of the value present within conscious experience. This account emphasizes not only the nature of consciousness, but the importance of items within experience such as affect, valence, and the complex overall shape of particular valuable experiences. Shepherd also relates this account to difficult cases involving non-humans and those with disorders of consciousness, arguing that the value of consciousness influences and partially explains the degree of moral status a being possesses, without fully determining it. The upshot is a deeper understanding of both the moral importance of phenomenal consciousness and its relations to moral status. This book will be of great interest to philosophers and students of ethics, bioethics, philosophy of psychology, philosophy of mind and cognitive science. (shrink)

If we were required to sacrifice our own interests whenever doing so was best overall, or prohibited from doing so unless it was optimal, then we would be mere sites for the realisation of value. Our interests, not ourselves, would wholly determine what we ought to do. We are not mere sites for the realisation of value — instead we, ourselves, matter unconditionally. So we have options to act suboptimally. These options have limits, grounded in the very same considerations. Though (...) not merely such sites, you and I are also sites for the realisation of value, and our interests (and ourselves) must therefore sometimes determine what others ought to do, in particular requiring them to bear reasonable costs for our sake. Likewise, just as my moral status grounds a requirement that others show me appropriate respect, so must I do to myself. (shrink)

A central question in contemporary ethics and political philosophy concerns which entities have moral status. In this article, I provide a detailed analysis of the view that moral status comes in degrees. I argue that degrees of moral status can be specified along two dimensions: (i) the weight of the reason to protect an entity’s morally significant rights and interests; and/or (ii) the rights and interests that are considered morally significant. And I explore some (...) of the complexities that arise when we link degrees of moral status to the weight of reasons to protect bundles and/or the content and size of these bundles, in particular regarding the attribution of moral status to nonparadigmatic entities (e.g. people with severe cognitive disabilities, children, embryos and foetuses, robots, non-human animals, ecosystems, and rivers). (shrink)

The prospect of cognitive enhancement well beyond current human capacities raises worries that the fundamental equality in moral status of human beings could be undermined. Cognitive enhancement might create beings with moral status higher than persons. Yet, there is an expressibility problem of spelling out what the higher threshold in cognitive capacity would be like. Nicholas Agar has put forward the bold claim that we can show by means of inductive reasoning that indefinite cognitive (...) enhancement will probably mark a difference in moral status. The hope is that induction can determine the plausibility of post‐personhood existence in the absence of an account of what the higher status would be like. In this article, we argue that Agar's argument fails and, more generally, that inductive reasoning has little bearing on assessing the likelihood of post‐personhood in the absence of an account of higher status. We conclude that induction cannot bypass the expressibility problem about post‐persons. (shrink)

The aim of this exploratory paper is to review an under-appreciated parallel between group agency and artificial intelligence. As both phenomena involve non-human goal-directed agents that can make a difference to the social world, they raise some similar moral and regulatory challenges, which require us to rethink some of our anthropocentric moral assumptions. Are humans always responsible for those entities’ actions, or could the entities bear responsibility themselves? Could the entities engage in normative reasoning? Could they even (...) have rights and a moral status? I will tentatively defend the (increasingly widely held) view that, under certain conditions, artificial intelligent systems, like corporate entities, might qualify as responsible moral agents and as holders of limited rights and legal personhood. I will further suggest that regulators should permit the use of autonomous artificial systems in high-stakes settings only if they are engineered to function as moral (not just intentional) agents and/or there is some liability-transfer arrangement in place. I will finally raise the possibility that if artificial systems ever became phenomenally conscious, there might be a case for extending a stronger moral status to them, but argue that, as of now, this remains very hypothetical. (shrink)

It might become possible to build artificial minds with the capacity for experience. This raises a plethora of ethical issues, explored, among others, in the context of whole brain emulations (WBE). In this paper, I will take up the problem of vulnerability – given, for various reasons, less attention in the literature – that the conscious emulations will likely exhibit. Specifically, I will examine the role that vulnerability plays in generating ethical issues that may arise when dealing with WBEs. (...) I will argue that concerns about vulnerability are more matters of institutional design than individual ethics, both when it comes to creating humanlike brain emulations, and when animal-like emulations are concerned. Consequently, the article contains reflection on some institutional measures that can be taken to protect the sims' interests. It concludes that an institutional framework more likely to succeed in this task is competitive and poly-centric, rather than monopolistic and centralized. (shrink)

Consciousness-based approaches to non-human moral status maintain that consciousness is necessary for (some degree or level of) moral status. While these approaches are intuitive to many, in this paper I argue that the judgment that consciousness is necessary for moral status is not secure enough to guide policy regarding non-humans, that policies responsive to the moral status of non-humans should take seriously the possibility that psychological features independent of consciousness are sufficient for (...) moral status. Further, I illustrate some practical consequences of calling consciousness-based views into question. (shrink)

Set aside fanciful doomsday speculations about AI. Even lower-level AIs, while otherwise friendly and providing us a universal basic income, would be able to do all our jobs. Also, we would over-rely upon AI assistants even in our personal lives. Thus, John Danaher argues that a human crisis of moral passivity would result However, I argue firstly that if AIs are posited to lack the potential to become unfriendly, they may not be intelligent enough to replace us in all (...) our jobs. If instead they are intelligent enough to replace us, the risk they become unfriendly increases, given that they would not need us and humans would just compete for valuable resources. Their hostility will not promote our moral passivity. Secondly, the use of AI assistants in our personal lives will become a problem only if we rely on them for almost all our decision-making and motivation. But such a (maximally) pervasive level of dependence raises the question of whether humans would accept it, and consequently whether the crisis of passivity will arise. (shrink)

Artificial intelligence (AI) and robotics are digital technologies that will have significant impact on the development of humanity in the near future. They have raised fundamental questions about what we should do with these systems, what the systems themselves should do, what risks they involve, and how we can control these. - After the Introduction to the field (§1), the main themes (§2) of this article are: Ethical issues that arise with AI systems as objects, i.e., tools made and (...) used by humans. This includes issues of privacy (§2.1) and manipulation (§2.2), opacity (§2.3) and bias (§2.4), human-robot interaction (§2.5), employment (§2.6), and the effects of autonomy (§2.7). Then AI systems as subjects, i.e., ethics for the AI systems themselves in machine ethics (§2.8) and artificial moral agency (§2.9). Finally, the problem of a possible future AI superintelligence leading to a “singularity” (§2.10). We close with a remark on the vision of AI (§3). - For each section within these themes, we provide a general explanation of the ethical issues, outline existing positions and arguments, then analyse how these play out with current technologies and finally, what policy consequences may be drawn. (shrink)

Calum Miller recently argued that a commitment to a very modest form of egalitarianism—equality between non-disabled human adults—implies fetal personhood. Miller claims that the most plausible basis for human equality is in being human—an attribute which fetuses have—therefore, abortion is likely to be morally wrong. In this paper, I offer a plausible defence for the view that equality between non-disabled human adults does not imply fetal personhood. I also offer a challenge for Miller’s view.

The transgressive ontological character of hybrids—entities crossing the ontological binarism of naturalness and artificiality, e.g., biomimetic projects—calls for pondering the question of their ethical status, since metaphysical and moral ideas are often inextricably linked. The example of it is the concept of “moral considerability” and related to it the idea of “intrinsic value” understood as a non-instrumentality of a being. Such an approach excludes hybrids from moral considerations due to their instrumental character. In the paper, we (...) revisit the boundaries of moral considerability by reexamining the legitimacy of identifying intrinsic value with a non-instrumental one. We offer the concept of “functional value,” which we define as a simultaneous contribution to the common good of the ecosystem and the possibility to disclose the full variety of aspects of a being’s identity. We argue that such a value of hybrids allows us to include them into the scope of moral considerability. (shrink)

In this paper, I aim to show that agency-based accounts of moral status are more plausible than many have previously thought. I do this by developing a novel account of moral status that takes agency, understood as the capacity for intentional action, to be the necessary and sufficient condition for the possession of moral status. This account also suggests that the capacities required for sentience entail the possession of agency, and the capacities required for (...) agency, entail the possession of sentience. Thus on this account sentient beings possess agency and agents possess sentience. If this is correct, it will show that an Agency Account of moral status can offer a plausible defence of the moral status of all sentient beings, something that previous Agency Accounts have not succeeded in doing. What is more, this account could establish that all sentient animals are not just moral status holders per se, but that they are owed pro tanto obligations regarding continued existence and liberty, similar in kind, though not always in strength, to those owed to humans. (shrink)

Dignity is traditionally thought to apply to almost all and almost only humans. However, I argue that an account of a distinctly human dignity cannot achieve a coherent and non-arbitrary justification; either it must exclude some humans or include some nonhumans. This conclusion is not as worrying as might be first thought. Rather than attempting to vindicate human dignity, dignity should extend beyond the human, to include a range of nonhuman animals. Not only can we develop a widely inclusive account (...) of dignity by pursuing this route, but we can still defend the three core principles that lie at the heart of contemporary thinking about dignity: that bearers of dignity possess dignity to an equal degree, in virtue of possessing the same intrinsic worth, and that this generates direct and claimable rights. I thus develop an account of dignity that includes nonhuman animals. I argue that the capacity to value most plausibly grounds dignity. This capacity arises from valenced sentience: a being values insofar as they have experiences that matter to them. I then characterise what follows from this. First, I contend that it is only the capacity to value grounds dignity because this produces the most plausible, simplest, and most explanatorily powerful account of dignity. We ought to reject pluralist accounts which assert a sharp distinction between bearers and non-bearers of rational agency, and biocentric accounts which include non-sentient organic entities. Second, I argue this property grounds an account of dignity that is non-hierarchical. There are no degrees of dignity. Instead, all possessors of the capacity to value have the same kind of intrinsic value, and the same equal fundamental right: to consideration of their interest in leading a life of value. Finally, I argue that since the fundamental right is to consideration, moral agents have claimable duties to engage in a deliberative procedure with actionable requirements. Specific rights are instantiations of this general procedure. Certain revisionist conclusions follow on my view, for instance, that nonhumans should be given greater weight and inclusion in a far wider range of cases, but my account is sensitive to the range of different things different beings value, so it does not generate counterintuitive implications. I conclude that dignity extends beyond the human. (shrink)

Recently, I argued that human subjects in artificial wombs (AWs) “share the same moral status as newborns” and so, deserve the same treatment and protections as newborns. This thesis rests on two claims: (A) “Subjects of partial ectogenesis—those that develop in utero for at time before being transferred to AWs—are newborns,” and (B) “Subjects of complete ectogenesis—those who develop in AWs entirely—share the same moral status as newborns.” In response, Elizabeth Chloe Romanis argued that the (...) subject in an AW is “a unique human entity…rather than a fetus or a newborn.” She provides four lines of response to my essay. First, she argues that I have “misconstrued” what birth is. Once we correct that error, it becomes clear that subjects of partial ectogenesis have not been born. Second, she argues that my claims imply that non-implanted embryos (existing in vivo) “would also be ‘born.’” But that is absurd. Third, she claims I fail to “meaningfully respond” to distinctions she draws between subjects of ectogenesis and neonates. Finally, she criticizes my essay for focusing on subjects of AWs rather than focusing on pregnant persons (who should be at the “centre” of debates over AWs). I respond to each of these charges. In doing so, I reaffirm that (contra Romanis) some subjects of ectogenesis are newborns and all subjects of ectogenesis—even those that have not been born—share the same moral status as newborns. (shrink)

This paper addresses the issue of the moral standing of nonhuman animals and their moral and legal rights. First of all, two most prominent views arguing for moral significance of animals are discussed. Peter Singer’s utilitarian view is that animals are sentient beings and therefore deserve equal consideration of their interests. Next, Tom Regan’s standpoint is that many animals have inherent value as experiencing subjects of a life, and consequently an equal right to be treated with (...) respect. This is followed by a discussion about legislation and legal practice in our country and abroad. Finally, it is argued that animals should have at least some basic rights guaranteed by the law. (shrink)