The question of whether AI systems such as robots can or should be afforded moral agency or patiency is not one amenable either to discovery or simple reasoning, because we as societies constantly reconstruct our artefacts, including our ethical systems. Consequently, the place of AI systems in society is a matter of normative, not descriptive ethics. Here I start from a functionalist assumption, that ethics is the set of behaviour that maintains a society. This assumption allows me to exploit the (...) theoretical biology of sociality and autonomy to explain our moral intuitions. From this grounding I extend to consider possible ethics for maintaining either human- or of artefact-centred societies. I conclude that while constructing AI systems as either moral agents or patients is possible, neither is desirable. In particular, I argue that we are unlikely to construct a coherent ethics in which it it is ethical to afford AI moral subjectivity. We are therefore obliged not to build AI we are obliged to. (shrink)

This paper adds another argument to the rising tide of panic about robots and AI. The argument is intended to have broad civilization-level significance, but to involve less fanciful speculation about the likely future intelligence of machines than is common among many AI-doomsayers. The argument claims that the rise of the robots will create a crisis of moral patiency. That is to say, it will reduce the ability and willingness of humans to act in the world as responsible moral agents, (...) and thereby reduce them to moral patients. Since that ability and willingness is central to the value system in modern liberal democratic states, the crisis of moral patiency has a broad civilization-level significance: it threatens something that is foundational to and presupposed in much contemporary moral and political discourse. I defend this argument in three parts. I start with a brief analysis of an analogous argument made in pop culture. Though those arguments turn out to be hyperbolic and satirical, they do prove instructive as they illustrates a way in which the rise of robots could impact upon civilization, even when the robots themselves are neither malicious nor powerful enough to bring about our doom. I then introduce the argument from the crisis of moral patiency, defend its main premises and address objections. (shrink)

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

In this book Michael McKenna advances a new theory of moral responsibility, one that builds upon the work of P. F. Strawson. As McKenna demonstrates, moral responsibility can be explained on analogy with a conversation. The relation between a morally responsible agent and those who hold her morally responsible is similar to the relation between a speaker and her audience. A responsible agent's actions are bearers of meaning--agent meaning--just as a speaker's utterances are bearers of speaker meaning. Agent meaning is (...) a function of the moral quality of the will with which the agent acts. Those who hold an agent morally responsible for what she does do so by responding to her as if in a conversation. By responding with certain morally reactive attitudes, such as resentment or indignation, they thereby communicate their regard for the meaning taken to be revealed in that agent's actions. It is then open for the agent held responsible to respond to those holding her responsible by offering an apology, a justification, an excuse, or some other response, thereby extending the evolving conversational exchange.The conversational theory of moral responsibility that McKenna develops here accepts two features of Strawson's theory: that moral responsibility is essentially interpersonal--so that being responsible must be understood by reference to the nature of holding responsible--and that the moral emotions are central to holding responsible. While upholding these two aspects of Strawson's theory, McKenna's theory rejects a further Strawsonian thesis, which is that holding morally responsible is more fundamental or basic than being morally responsible. On the conversational theory, the conditions for holding responsible are dependent on the nature of the agent who is responsible. So holding responsible cannot be more basic than being responsible. Nevertheless, the nature of the agent who is morally responsible is to be understood in terms of sensitivity to those who would make moral demands of her, thereby holding her responsible. Being responsible is therefore also dependent on holding responsible. Thus, neither being nor holding morally responsible is more basic than the other. They are mutually dependent. (shrink)

Do we know what we're doing, and why? Psychological research seems to suggest not: reflection and self-awareness are surprisingly uncommon and inaccurate. John M. Doris presents a new account of agency and responsibility, which reconciles our understanding of ourselves as moral agents with empirical work on the unconscious mind.

Recently T. M. Scanlon and others have advanced an ostensibly comprehensive theory of moral responsibility—a theory of both being responsible and being held responsible—that best accounts for our moral practices. I argue that both aspects of the Scanlonian theory fail this test. A truly comprehensive theory must incorporate and explain three distinct conceptions of responsibility—attributability, answerability, and accountability—and the Scanlonian view conflates the first two and ignores the importance of the third. To illustrate what a truly comprehensive theory might look (...) like, I investigate what it would say about the difficult case of the psychopath. (shrink)

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would normally (...) be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

Technology moves us to a better world. We contend that through technology people can simplify and solve moral tasks when they are in presence of incomplete information and possess a diminished capacity to act morally. Many external things, usually inert from the moral point of view, can be transformed into the so-called moral mediators. Hence, not all of the moral tools are inside the head, many of them are shared and distributed in “external” objects and structures which function as ethical (...) devices. (shrink)

The doyen of living English philosophers, by these reflections, took hold of and changed the outlook of a good many other philosophers, if not quite enough. He did so, essentially, by assuming that talk of freedom and responsibility is talk not of facts or truths, in a certain sense, but of our attitudes. His more explicit concern was to look again at the question of whether determinism and freedom are consistent with one another -- by shifting attention to certain personal (...) rather than moral attitudes, first of all gratitude and resentment. In the end, he arrived at a kind of Compatibilist or, as he says, Optimist conclusion. That is no doubt a recommendation but not the largest recommendation of this splendidly rich piece of philosophy. (shrink)

Our ability to locate moral responsibility is often thought to be a necessary condition for conducting morally permissible medical practice, engaging in a just war, and other high-stakes endeavors. Yet, with increasing reliance upon artificially intelligent systems, we may be facing a wideningresponsibility gap, which, some argue, cannot be bridged by traditional concepts of responsibility. How then, if at all, can we make use of crucial emerging technologies? According to Colin Allen and Wendell Wallach, the advent of so-called ‘artificial moral (...) agents’ (AMAs) is inevitable. Still, this notion may seem to push back the problem, leaving those who have an interest in developing autonomous technology with a dilemma. We may need to scale-back our efforts at deploying AMAs (or at least maintain human oversight); otherwise, we must rapidly and drastically update our moral and legal norms in a way that ensures responsibility for potentially avoidable harms. This paper invokes contemporary accounts of responsibility in order to show how artificially intelligent systems might be held responsible. Although many theorists are concerned enough to develop artificial conceptions ofagencyor to exploit our present inability to regulate valuable innovations, the proposal here highlights the importance of—and outlines a plausible foundation for—a workable notion ofartificial moral responsibility. (shrink)

The task of this essay is to respond to the question concerning robots and responsibility—to answer for the way that we understand, debate, and decide who or what is able to answer for decisions and actions undertaken by increasingly interactive, autonomous, and sociable mechanisms. The analysis proceeds through three steps or movements. It begins by critically examining the instrumental theory of technology, which determines the way one typically deals with and responds to the question of responsibility when it involves technology. (...) It then considers three instances where recent innovations in robotics challenge this standard operating procedure by opening gaps in the usual way of assigning responsibility. The innovations considered in this section include: autonomous technology, machine learning, and social robots. The essay concludes by evaluating the three different responses—instrumentalism 2.0, machine ethics, and hybrid responsibility—that have been made in face of these difficulties in an effort to map out the opportunities and challenges of and for responsible robotics. (shrink)

The technological advances of contemporary society have outpaced our moral understanding of the problems that they create. How will we deal with profound ecological changes, human cloning, hybrid people, and eroding cyberprivacy, just to name a few issues? In this book, Lorenzo Magnani argues that existing moral constructs often cannot be applied to new technology. He proposes an entirely different ethical approach, one that blends epistemology with cognitive science. The resulting moral strategy promises renewed dignity for overlooked populations, both of (...) today and of the future. (shrink)

Young children generally learn words from other people. Recent research has shown that children can learn new actions and skills from nonhuman agents. This study examines whether young children could learn words from a robot. Preschool children were shown a video in which either a woman or a mechanical robot labeled novel objects. Then the children were asked to select the objects according to the names used in the video. The results revealed that children in the human condition were more (...) likely to select the correct objects than those in the robot condition. Nevertheless, the five-year-old children in the robot condition performed significantly better than chance level, while the four-year olds did not. Thus there is a developmental difference in children’s potential to learn words from a robot. The results contribute to our understanding of how children interact with non-human agents. Keywords: developmental cybernetics; word learning; social cognition; cognitive development. (shrink)

David Shoemaker presents a new pluralistic theory of responsibility, based on the idea of quality of will. His approach is motivated by our ambivalence to real-life cases of marginal agency, such as those caused by clinical depression, dementia, scrupulosity, psychopathy, autism, intellectual disability, and poor formative circumstances. Our ambivalent responses suggest that such agents are responsible in some ways but not others. Shoemaker develops a theory to account for our ambivalence, via close examination of several categories of pancultural emotional responsibility (...) responses and their appropriateness conditions. The result is three distinct types of responsibility, each with its own set of required capacities: attributability, answerability, and accountability. Attributability is about the having and expressing of various traits of character, and it is the target of a range of aretaic sentiments and emotional practices organized around disdain and admiration. Answerability is about one’s capacity to govern one’s actions and attitudes by one’s evaluative judgments about the worth of various practical reasons, and it is the target of a range of sentiments and emotional practices organized around regret and pride. Accountability is about one’s ability to regard others, both evaluatively and emotionally, and it is the target of a range of sentiments and emotional practices organized around anger and gratitude. In Part One of the book, this tripartite theory is developed and defended. In Part Two of the book, the tripartite theory’s predictions about specific marginal cases are tested, once certain empirical details about the nature of those agents have been filled in and discussed. (shrink)

In this book Michael McKenna advances a new theory of moral responsibility, one that builds upon the work of P.F. Strawson.

Recent findings in empirical psychology show that implicit biases can affect behavior in ways that are difficult to control deliberatively. Doris argues that findings like these constitute a threat to agency, if agency is defined as the ability to reflectively, deliberatively direct one’s actions. I argue, however, that implicit biases pose no fundamental threat to agency since they can be brought under indirect deliberative control, whereby deliberative, reflective actions put in place automatic processes that automatically inhibit unwanted biases. Since automatic (...) processes can be thus used to achieve deliberatively, reflectively endorsed goals, agency should be defined as the ability to act in line with reflectively endorsed goals, whether by deliberative or automatic processes. (shrink)

There has been much debate whether computers can be responsible. This question is usually discussed in terms of personhood and personal characteristics, which a computer may or may not possess. If a computer fulfils the conditions required for agency or personhood, then it can be responsible; otherwise not. This paper suggests a different approach. An analysis of the concept of responsibility shows that it is a social construct of ascription which is only viable in certain social contexts and which serves (...) particular social aims. If this is the main aspect of responsibility then the question whether computers can be responsible no longer hinges on the difficult problem of agency but on the possibly simpler question whether responsibility ascriptions to computers can fulfil social goals. The suggested solution to the question whether computers can be subjects of responsibility is the introduction of a new concept, called “quasi-responsibility” which will emphasise the social aim of responsibility ascription and which can be applied to computers. (shrink)

This paper follows directly from an earlier paper where we discussed the requirements for an artifact to be a moral agent and concluded that the artifactual question is ultimately a red herring. As...