Artificial intelligence (AI) and robotics are digital technologies that will have significant impact on the development of humanity in the near future. They have raised fundamental questions about what we should do with these systems, what the systems themselves should do, what risks they involve, and how we can control these. - After the Introduction to the field (§1), the main themes (§2) of this article are: Ethical issues that arise with AI systems as objects, i.e., tools made and used (...) by humans. This includes issues of privacy (§2.1) and manipulation (§2.2), opacity (§2.3) and bias (§2.4), human-robot interaction (§2.5), employment (§2.6), and the effects of autonomy (§2.7). Then AI systems as subjects, i.e., ethics for the AI systems themselves in machine ethics (§2.8) and artificial moral agency (§2.9). Finally, the problem of a possible future AI superintelligence leading to a “singularity” (§2.10). We close with a remark on the vision of AI (§3). - For each section within these themes, we provide a general explanation of the ethical issues, outline existing positions and arguments, then analyse how these play out with current technologies and finally, what policy consequences may be drawn. (shrink)

-/- Artificial intelligence powers Google’s search engine, enables Facebook to target advertising, and allows Alexa and Siri to do their jobs. AI is also behind self-driving cars, predictive policing, and autonomous weapons that can kill without human intervention. These and other AI applications raise complex ethical issues that are the subject of ongoing debate. This volume in the MIT Press Essential Knowledge series offers an accessible synthesis of these issues. Written by a philosopher of technology, AI Ethics goes beyond the (...) usual hype and nightmare scenarios to address concrete questions. -/- Mark Coeckelbergh describes influential AI narratives, ranging from Frankenstein’s monster to transhumanism and the technological singularity. He surveys relevant philosophical discussions: questions about the fundamental differences between humans and machines and debates over the moral status of AI. He explains the technology of AI, describing different approaches and focusing on machine learning and data science. He offers an overview of important ethical issues, including privacy concerns, responsibility and the delegation of decision making, transparency, and bias as it arises at all stages of data science processes. He also considers the future of work in an AI economy. Finally, he analyzes a range of policy proposals and discusses challenges for policymakers. He argues for ethical practices that embed values in design, translate democratic values into practices and include a vision of the good life and the good society . (shrink)

Joseph Raz presents a penetrating exploration of the interdependence of value, reason, and the will. These essays illuminate a wide range of questions concerning fundamental aspects of human thought and action. Engaging Reason is a summation of many years of original, compelling, and influential work by a major contemporary philosopher.

Value theory, or axiology, looks at what things are good or bad, how good or bad they are, and, most fundamentally, what it is for a thing to be good or bad. Questions about value and about what is valuable are important to moral philosophers, since most moral theories hold that we ought to promote the good. This Handbook focuses on value theory as it pertains to ethics, broadly construed, and provides a comprehensive overview of contemporary debates pertaining not only (...) to philosophy but also to other disciplines-most notably, political theory and economics.The Handbook's twenty-two newly commissioned chapters are divided into three parts. Part I: Foundations concerns fundamental and interrelated issues about the nature of value and distinctions between kinds of value. Part II: Structure concerns formal properties of value that bear on the possibilities of measuring and comparing value. Part III: Extensions, finally, considers specific topics, ranging from health to freedom, where questions of value figure prominently. (shrink)

Many industry leaders and academics from the field of machine ethics would have us believe that the inevitability of robots coming to have a larger role in our lives demands that robots be endowed with moral reasoning capabilities. Robots endowed in this way may be referred to as artificial moral agents. Reasons often given for developing AMAs are: the prevention of harm, the necessity for public trust, the prevention of immoral use, such machines are better moral reasoners than humans, and (...) building these machines would lead to a better understanding of human morality. Although some scholars have challenged the very initiative to develop AMAs, what is currently missing from the debate is a closer examination of the reasons offered by machine ethicists to justify the development of AMAs. This closer examination is especially needed because of the amount of funding currently being allocated to the development of AMAs coupled with the amount of attention researchers and industry leaders receive in the media for their efforts in this direction. The stakes in this debate are high because moral robots would make demands on society; answers to a host of pending questions about what counts as an AMA and whether they are morally responsible for their behavior or not. This paper shifts the burden of proof back to the machine ethicists demanding that they give good reasons to build AMAs. The paper argues that until this is done, the development of commercially available AMAs should not proceed further. (shrink)

Many industry leaders and academics from the field of machine ethics would have us believe that the inevitability of robots coming to have a larger role in our lives demands that robots be endowed with moral reasoning capabilities. Robots endowed in this way may be referred to as artificial moral agents. Reasons often given for developing AMAs are: the prevention of harm, the necessity for public trust, the prevention of immoral use, such machines are better moral reasoners than humans, and (...) building these machines would lead to a better understanding of human morality. Although some scholars have challenged the very initiative to develop AMAs, what is currently missing from the debate is a closer examination of the reasons offered by machine ethicists to justify the development of AMAs. This closer examination is especially needed because of the amount of funding currently being allocated to the development of AMAs coupled with the amount of attention researchers and industry leaders receive in the media for their efforts in this direction. The stakes in this debate are high because moral robots would make demands on society; answers to a host of pending questions about what counts as an AMA and whether they are morally responsible for their behavior or not. This paper shifts the burden of proof back to the machine ethicists demanding that they give good reasons to build AMAs. The paper argues that until this is done, the development of commercially available AMAs should not proceed further. (shrink)

As Louisiana and Cuba emerged from slavery in the late nineteenth century, each faced the question of what rights former slaves could claim. Degrees of Freedom compares and contrasts these two societies in which slavery was destroyed by war, and citizenship was redefined through social and political upheaval. Both Louisiana and Cuba were rich in sugar plantations that depended on an enslaved labor force. After abolition, on both sides of the Gulf of Mexico, ordinary people-cane cutters and cigar workers, laundresses (...) and labor organizers-forged alliances to protect and expand the freedoms they had won. But by the beginning of the twentieth century, Louisiana and Cuba diverged sharply in the meanings attributed to race and color in public life, and in the boundaries placed on citizenship. Louisiana had taken the path of disenfranchisement and state-mandated racial segregation; Cuba had enacted universal manhood suffrage and had seen the emergence of a transracial conception of the nation. What might explain these differences? Moving through the cane fields, small farms, and cities of Louisiana and Cuba, Rebecca Scott skillfully observes the people, places, legislation, and leadership that shaped how these societies adjusted to the abolition of slavery. The two distinctive worlds also come together, as Cuban exiles take refuge in New Orleans in the 1880s, and black soldiers from Louisiana garrison small towns in eastern Cuba during the 1899 U.S. military occupation. Crafting her narrative from the words and deeds of the actors themselves, Scott brings to life the historical drama of race and citizenship in postemancipation societies. (shrink)

Joseph Raz presents a penetrating exploration of the interdependence of value, reason, and the will. These essays illuminate a wide range of questions concerning fundamental aspects of human thought and action. Engaging Reason is a summation of many years of original, compelling, and influential work by a major contemporary philosopher.

In this paper we discuss the hypothesis that, ‘moral agency is distributed over both humans and technological artefacts’, recently proposed by Peter-Paul Verbeek. We present some arguments for thinking that Verbeek is mistaken. We argue that artefacts such as bridges, word processors, or bombs can never be (part of) moral agents. After having discussed some possible responses, as well as a moderate view proposed by Illies and Meijers, we conclude that technological artefacts are neutral tools that are at most bearers (...) of instrumental value. (shrink)

According to the Value-Neutrality Thesis, technology is morally and politically neutral, neither good nor bad. A knife may be put to bad use to murder an innocent person or to good use to peel an apple for a starving person, but the knife itself is a mere instrument, not a proper subject for moral or political evaluation. While contemporary philosophers of technology widely reject the VNT, it remains unclear whether claims about values in technology are just a figure of speech (...) or nontrivial empirical claims with genuine factual content and real-world implications. This paper provides the missing argument. I argue that by virtue of their material properties, technological artifacts are part of the normative order rather than external to it. I illustrate how values can be empirically identified in technology. The reason why value-talk is not trivial or metaphorical is that due to the endurance and longevity of technological artifacts, values embedded in them have long-term implications that surpass their designers and builders. I further argue that taking sides in this debate has real-world implications in the form of moral constraints on the development of technology. (shrink)

According to some philosophers of technology, technology embodies moral values in virtue of its functional properties and the intentions of its designers. But this paper shows that such an account makes the values supposedly embedded in technology epistemically opaque and that it does not allow for values to change. Therefore, to overcome these shortcomings, the paper introduces the novel Affordance Account of Value Embedding as a superior alternative. Accordingly, artefacts bear affordances, that is, artefacts make certain actions likelier given the (...) circumstances. Based on an interdisciplinary perspective that invokes recent moral anthropology, I conceptualize affordances as response-dependent properties. That is, they depend on intrinsic as well as extrinsic properties of the artefact. We have reason to value these properties. Therefore, artefacts embody values and are not value-neutral, which has practical implications for the design of new technologies. (shrink)

Floridi and Sanders, seminal work, “On the morality of artificial agents” has catalyzed attention around the moral status of computer systems that perform tasks for humans, effectively acting as “artificial agents.” Floridi and Sanders argue that the class of entities considered moral agents can be expanded to include computers if we adopt the appropriate level of abstraction. In this paper we argue that the move to distinguish levels of abstraction is far from decisive on this issue. We also argue that (...) adopting certain levels of abstraction out of context can be dangerous when the level of abstraction obscures the humans who constitute computer systems. We arrive at this critique of Floridi and Sanders by examining the debate over the moral status of computer systems using the notion of interpretive flexibility. We frame the debate as a struggle over the meaning and significance of computer systems that behave independently, and not as a debate about the ‘true’ status of autonomous systems. Our analysis leads to the conclusion that while levels of abstraction are useful for particular purposes, when it comes to agency and responsibility, computer systems should be conceptualized and identified in ways that keep them tethered to the humans who create and deploy them. (shrink)

After discussing the distinction between artifacts and natural entities, and the distinction between artifacts and technology, the conditions of the traditional account of moral agency are identified. While computer system behavior meets four of the five conditions, it does not and cannot meet a key condition. Computer systems do not have mental states, and even if they could be construed as having mental states, they do not have intendings to act, which arise from an agent’s freedom. On the other hand, (...) computer systems have intentionality, and because of this, they should not be dismissed from the realm of morality in the same way that natural objects are dismissed. Natural objects behave from necessity; computer systems and other artifacts behave from necessity after they are created and deployed, but, unlike natural objects, they are intentionally created and deployed. Failure to recognize the intentionality of computer systems and their connection to human intentionality and action hides the moral character of computer systems. Computer systems are components in human moral action. When humans act with artifacts, their actions are constituted by the intentionality and efficacy of the artifact which, in turn, has been constituted by the intentionality and efficacy of the artifact designer. All three components – artifact designer, artifact, and artifact user – are at work when there is an action and all three should be the focus of moral evaluation. (shrink)

In their important paper “Autonomous Agents”, Floridi and Sanders use “levels of abstraction” to argue that computers are or may soon be moral agents. In this paper we use the same levels of abstraction to illuminate differences between human moral agents and computers. In their paper, Floridi and Sanders contributed definitions of autonomy, moral accountability and responsibility, but they have not explored deeply some essential questions that need to be answered by computer scientists who design artificial agents. One such question (...) is, “Can an artificial agent that changes its own programming become so autonomous that the original designer is no longer responsible for the behavior of the artificial agent?” To explore this question, we distinguish between LoA1 (the user view) and LoA2 (the designer view) by exploring the concepts of unmodifiable, modifiable and fully modifiable tables that control artificial agents. We demonstrate that an agent with an unmodifiable table, when viewed at LoA2, distinguishes an artificial agent from a human one. This distinction supports our first counter-claim to Floridi and Sanders, namely, that such an agent is not a moral agent, and the designer bears full responsibility for its behavior. We also demonstrate that even if there is an artificial agent with a fully modifiable table capable of learning* and intentionality* that meets the conditions set by Floridi and Sanders for ascribing moral agency to an artificial agent, the designer retains strong moral responsibility. (shrink)

Artificial agents (AAs), particularly but not only those in Cyberspace, extend the class of entities that can be involved in moral situations. For they can be conceived of as moral patients (as entities that can be acted upon for good or evil) and also as moral agents (as entities that can perform actions, again for good or evil). In this paper, we clarify the concept of agent and go on to separate the concerns of morality and responsibility of agents (most (...) interestingly for us, of AAs). We conclude that there is substantial and important scope, particularly in Computer Ethics, for the concept of moral agent not necessarily exhibiting free will, mental states or responsibility. This complements the more traditional approach, common at least since Montaigne and Descartes, which considers whether or not (artificial) agents have mental states, feelings, emotions and so on. By focussing directly on mind-less morality we are able to avoid that question and also many of the concerns of Artificial Intelligence. A vital component in our approach is the Method of Abstraction for analysing the level of abstraction (LoA) at which an agent is considered to act. The LoA is determined by the way in which one chooses to describe, analyse and discuss a system and its context. The Method of Abstraction is explained in terms of an interface or set of features or observables at a given LoA. Agenthood, and in particular moral agenthood, depends on a LoA. Our guidelines for agenthood are: interactivity (response to stimulus by change of state), autonomy (ability to change state without stimulus) and adaptability (ability to change the transition rules by which state is changed) at a given LoA. Morality may be thought of as a threshold defined on the observables in the interface determining the LoA under consideration. An agent is morally good if its actions all respect that threshold; and it is morally evil if some action violates it. That view is particularly informative when the agent constitutes a software or digital system, and the observables are numerical. Finally we review the consequences for Computer Ethics of our approach. In conclusion, this approach facilitates the discussion of the morality of agents not only in Cyberspace but also in the biosphere, where animals can be considered moral agents without their having to display free will, emotions or mental states, and in social contexts, where systems like organizations can play the role of moral agents. The primary cost of this facility is the extension of the class of agents and moral agents to embrace AAs. (shrink)

In this paper we present an action-theoretic account of artefact using and designing and describe our ICE-theory of function ascriptions to technical artefacts. By means of this account and theory we analyse the thesis of the dual nature of technical artefacts according to which descriptions of technical artefacts draw on structural and intentional conceptualisations. We show that the ascription of technical functions to technical artefacts can connect the intentional and structural parts of descriptions of artefacts, but also separate these parts. (...) Our conclusion is that the concept of technical functions forms a ‘conceptual drawbridge’ between the intentional and structural natures of technical artefacts.Keywords: Intentional and structural descriptions; Technical artefacts; Function theory; Action theory; Use; Design. (shrink)

Through the use of such "folk" concepts as belief, desire, intention, and expectation, Daniel Dennett asserts in this first full scale presentation of...

Edna Ullmann-Margalit provides an original account of the emergence of norms. Her main thesis is that certain types of norms are possible solutions to problems posed by certain types of social interaction situations. She presents illuminating discussions of Prisoners' Dilemma, co-ordination, and inequality situations.

One of the objectives in the field of artificial intelligence for some decades has been the development of artificial agents capable of coexisting in harmony with people and other systems. The computing research community has made efforts to design artificial agents capable of doing tasks the way people do, tasks requiring cognitive mechanisms such as planning, decision-making, and learning. The application domains of such software agents are evident nowadays. Humans are experiencing the inclusion of artificial agents in their environment as (...) unmanned vehicles, intelligent houses, and humanoid robots capable of caring for people. In this context, research in the field of machine ethics has become more than a hot topic. Machine ethics focuses on developing ethical mechanisms for artificial agents to be capable of engaging in moral behavior. However, there are still crucial challenges in the development of truly Artificial Moral Agents. This paper aims to show the current status of Artificial Moral Agents by analyzing models proposed over the past two decades. As a result of this review, a taxonomy to classify Artificial Moral Agents according to the strategies and criteria used to deal with ethical problems is proposed. The presented review aims to illustrate (1) the complexity of designing and developing ethical mechanisms for this type of agent, and (2) that there is a long way to go (from a technological perspective) before this type of artificial agent can replace human judgment in difficult, surprising or ambiguous moral situations. (shrink)

The Handbook of Value combines the forces of the many disciplines involved in value research, by integrating the perspectives of distinguished scholars from the different disciplines. Contributions cover conceptual issues such as definitions of value, psychological and neurological mechanisms underlying value computation and representation, types and taxonomies of value, interindividual and intercultural value differences, the role of value in emotion, moral judgment, decision-making and behavior, as well as case studies of individual varieties of value. The volume contributes to an interdisciplinary (...) dialogue and integration by providing a common reference point that may serve as a resource for disciplinary excellence and interdisciplinary cross-fertilization. (shrink)

The Handbook of Value combines the forces of the many disciplines involved in value research, by integrating the perspectives of distinguished scholars from the different disciplines. Contributions cover conceptual issues such as definitions of value, psychological and neurological mechanisms underlying value computation and representation, types and taxonomies of value, interindividual and intercultural value differences, the role of value in emotion, moral judgment, decision-making and behavior, as well as case studies of individual varieties of value. The volume contributes to an interdisciplinary (...) dialogue and integration by providing a common reference point that may serve as a resource for disciplinary excellence and interdisciplinary cross-fertilization. (shrink)

The literature on self-driving cars and ethics continues to grow. Yet much of it focuses on ethical complexities emerging from an individual vehicle. That is an important but insufficient step towards determining how the technology will impact human lives and society more generally. What must complement ongoing discussions is a broader, system level of analysis that engages with the interactions and effects that these cars will have on one another and on the socio-technical systems in which they are embedded. To (...) bring the conversation of self-driving cars to the system level, we make use of two traffic scenarios which highlight some of the complexities that designers, policymakers, and others should consider related to the technology. We then describe three approaches that could be used to address such complexities and their associated shortcomings. We conclude by bringing attention to the “Moral Responsibility for Computing Artifacts: The Rules”, a framework that can provide insight into how to approach ethical issues related to self-driving cars. (shrink)

Women as commercial baby factories, nature as an economic resource, life as one big shopping mall: This is what we get when we use the market as a common ...

A principal goal of the discipline of artificial morality is to design artificial agents to act as if they are moral agents. Intermediate goals of artificial morality are directed at building into AI systems sensitivity to the values, ethics, and legality of activities. The development of an effective foundation for the field of artificial morality involves exploring the technological and philosophical issues involved in making computers into explicit moral reasoners. The goal of this paper is to discuss strategies for implementing (...) artificial morality and the differing criteria for success that are appropriate to different strategies. (shrink)

In The Grammar of Society, first published in 2006, Cristina Bicchieri examines social norms, such as fairness, cooperation, and reciprocity, in an effort to understand their nature and dynamics, the expectations that they generate, and how they evolve and change. Drawing on several intellectual traditions and methods, including those of social psychology, experimental economics and evolutionary game theory, Bicchieri provides an integrated account of how social norms emerge, why and when we follow them, and the situations where we are most (...) likely to focus on relevant norms. Examining the existence and survival of inefficient norms, she demonstrates how norms evolve in ways that depend upon the psychological dispositions of the individual and how such dispositions may impair social efficiency. By contrast, she also shows how certain psychological propensities may naturally lead individuals to evolve fairness norms that closely resemble those we follow in most modern societies. (shrink)

A summation of the work of one of the most influential and provocative interpreters of science, it aims at saving what is good and valuable in modernity and ...

The truth of the matter is that our deficiency does not lie in the want of well-verified "facts." What we lack is our bearings. The contemporary experience of things technological has repeatedly confounded our vision, our expectations, and our capacity to make intelligent judgments. Categories, arguments, conclusions, and choices that would have been entirely obvious in earlier times are obvious no longer. Patterns of perceptive thinking that were entirely reliable in the past now lead us systematically astray. Many of our (...) standard conceptions of technology reveal a disorientation that borders on dissociation from reality. And as long as we lack the ability to make our situation intelligible, all of the "data" in the world will make no difference.;From the Introduction. (shrink)

Value theory, or axiology, looks at what things are good or bad, how good or bad they are, and, most fundamentally, what it is for a thing to be good or bad. Questions about value and about what is valuable are important to moral philosophers, since most moral theories hold that we ought to promote the good. This Handbook focuses on value theory as it pertains to ethics, broadly construed, and provides a comprehensive overview of contemporary debates pertaining not only (...) to philosophy but also to other disciplines-most notably, political theory and economics.The Handbook's twenty-two newly commissioned chapters are divided into three parts. Part I: Foundations concerns fundamental and interrelated issues about the nature of value and distinctions between kinds of value. Part II: Structure concerns formal properties of value that bear on the possibilities of measuring and comparing value. Part III: Extensions, finally, considers specific topics, ranging from health to freedom, where questions of value figure prominently. (shrink)

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

The essays in this volume represent the first steps by philosophers and artificial intelligence researchers toward explaining why it is necessary to add an ...

Technology is a practically indispensible means for satisfying one’s basic interests in all central areas of human life including nutrition, habitation, health care, entertainment, transportation, and social interaction. It is impossible for any one person, even a well-trained scientist or engineer, to know enough about how technology works in these different areas to make a calculated choice about whether to rely on the vast majority of the technologies she/he in fact relies upon. Yet, there are substantial risks, uncertainties, and unforeseen (...) practical consequences associated with the use of technological artifacts and systems. The salience of technological failure (both catastrophic and mundane), as well as technology’s sometimes unforeseeable influence on our behavior, makes it relevant to wonder whether we are really justified as individuals in our practical reliance on technology. Of course, even if we are not justified, we might nonetheless continue in our technological reliance, since the alternatives might not be attractive or feasible. In this chapter I argue that a conception of trust in technological artifacts and systems is plausible and helps us understand what is at stake philosophically in our reliance on technology. Such an account also helps us understand the relationship between trust and technological risk and the ethical obligations of those who design, manufacture, and deploy technological artifacts. (shrink)

In controversies about technology and society, there is no idea more pro vocative than the notion that technical things have political qualities. At issue is the claim that the machines, structures, and systems of modern material culture can be accurately judged not only for their contributions of efficiency and pro-ductivity, not merely for their positive and negative environmental side effects, but also for the ways in which they can embody specific forms of power and authority. Since ideas of this kind (...) have a persistent and troubling presence in discussions about the meaning of technology, they deserve explicit attention... (shrink)

In this paper Sullins argues that in certain circumstances robots can be seen as real moral agents. A distinction is made between persons and moral agents such that, it is not necessary for a robot to have personhood in order to be a moral agent. I detail three requirements for a robot to be seen as a moral agent. The first is achieved when the robot is significantly autonomous from any programmers or operators of the machine. The second is when (...) one can analyze or explain the robot's behavior only by ascribing to it some predisposition or 'intention' to do good or harm. And finally, robot moral agency requires the robot to behave in a way that shows and understanding of responsibility to some other moral agent. Robots with all of these criteria will have moral rights as well as responsibilities regardless of their status as persons. (shrink)

Many authors have proposed constraining the behaviour of intelligent systems with ‘machine ethics’ to ensure positive social outcomes from the development of such systems. This paper critically analyses the prospects for machine ethics, identifying several inherent limitations. While machine ethics may increase the probability of ethical behaviour in some situations, it cannot guarantee it due to the nature of ethics, the computational limitations of computational agents and the complexity of the world. In addition, machine ethics, even if it were to (...) be ‘solved’ at a technical level, would be insufficient to ensure positive social outcomes from intelligent systems. (shrink)