We propose that the prevalent moral aversion to AWS is supported by a pair of compelling objections. First, we argue that even a sophisticated robot is not the kind of thing that is capable of replicating human moral judgment. This conclusion follows if human moral judgment is not codifiable, i.e., it cannot be captured by a list of rules. Moral judgment requires either the ability to engage in wide reflective equilibrium, the ability to perceive certain facts as moral considerations, moral (...) imagination, or the ability to have moral experiences with a particular phenomenological character. Robots cannot in principle possess these abilities, so robots cannot in principle replicate human moral judgment. If robots cannot in principle replicate human moral judgment then it is morally problematic to deploy AWS with that aim in mind. Second, we then argue that even if it is possible for a sufficiently sophisticated robot to make ‘moral decisions’ that are extensionally indistinguishable from (or better than) human moral decisions, these ‘decisions’ could not be made for the right reasons. This means that the ‘moral decisions’ made by AWS are bound to be morally deficient in at least one respect even if they are extensionally indistinguishable from human ones. Our objections to AWS support the prevalent aversion to the employment of AWS in war. They also enjoy several significant advantages over the most common objections to AWS in the literature. (shrink)

For an artificial agent to be morally praiseworthy, its rules for behaviour and the mechanisms for supplying those rules must not be supplied entirely by external humans. Such systems are a substantial departure from current technologies and theory, and are a low prospect. With foreseeable technologies, an artificial agent will carry zero responsibility for its behavior and humans will retain full responsibility.

One of the enduring concerns of moral philosophy is deciding who or what is deserving of ethical consideration. Much recent attention has been devoted to the "animal question" -- consideration of the moral status of nonhuman animals. In this book, David Gunkel takes up the "machine question": whether and to what extent intelligent and autonomous machines of our own making can be considered to have legitimate moral responsibilities and any legitimate claim to moral consideration. The machine question poses a fundamental (...) challenge to moral thinking, questioning the traditional philosophical conceptualization of technology as a tool or instrument to be used by human agents. Gunkel begins by addressing the question of machine moral agency: whether a machine might be considered a legitimate moral agent that could be held responsible for decisions and actions. He then approaches the machine question from the other side, considering whether a machine might be a moral patient due legitimate moral consideration. Finally, Gunkel considers some recent innovations in moral philosophy and critical theory that complicate the machine question, deconstructing the binary agent--patient opposition itself. Technological advances may prompt us to wonder if the science fiction of computers and robots whose actions affect their human companions could become science fact. Gunkel's argument promises to influence future considerations of ethics, ourselves, and the other entities who inhabit this world. (shrink)

The development of robots that closely resemble human beings can contribute to cognitive research. An android provides an experimental apparatus that has the potential to be controlled more precisely than any human actor. However, preliminary results indicate that only very humanlike devices can elicit the broad range of responses that people typically direct toward each other. Conversely, to build androids capable of emulating human behavior, it is necessary to investigate social activity in detail and to develop models of the cognitive (...) mechanisms that support this activity. Because of the reciprocal relationship between android development and the exploration of social mechanisms, it is necessary to establish the field of android science. Androids could be a key testing ground for social, cognitive, and neuroscientific theories as well as platform for their eventual unification. Nevertheless, subtle flaws in appearance and movement can be more apparent and eerie in very humanlike robots. This uncanny phenomenon may be symptomatic of entities that elicit our model of human other but do not measure up to it. If so, very humanlike robots may provide the best means of pinpointing what kinds of behavior are perceived as human, since deviations from human norms are more obvious in them than in more mechanical-looking robots. In pursuing this line of inquiry, it is essential to identify the mechanisms involved in evaluations of human likeness. One hypothesis is that, by playing on an innate fear of death, an uncanny robot elicits culturally-supported defense responses for coping with death’s inevitability. An experiment, which borrows from methods used in terror management research, was performed to test this hypothesis. [Thomson Reuters Essential Science Indicators: Fast Breaking Paper in Social Sciences, May 2008]. (shrink)

Taking a fresh look at a central controversy in criminal law theory, The Ethics of Capital Punishment presents a rationale for the death penalty grounded in a theory of the nature of evil and the nature of defilement. Original, unsettling, and deeply controversial, it will be an essential reference point for future debates on the subject.

This ambitious, interdisciplinary book seeks to explain the origins of religion using our knowledge of the evolution of cognition. A cognitive anthropologist and psychologist, Scott Atran argues that religion is a by-product of human evolution just as the cognitive intervention, cultural selection, and historical survival of religion is an accommodation of certain existential and moral elements that have evolved in the human condition.

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would normally (...) be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)

May lethal autonomous weapons systems—‘killer robots ’—be used in war? The majority of writers argue against their use, and those who have argued in favour have done so on a consequentialist basis. We defend the moral permissibility of killer robots, but on the basis of the non-aggregative structure of right assumed by Just War theory. This is necessary because the most important argument against killer robots, the responsibility trilemma proposed by Rob Sparrow, makes the same assumptions. We show that the (...) crucial moral question is not one of responsibility. Rather, it is whether the technology can satisfy the requirements of fairness in the re-distribution of risk. Not only is this possible in principle, but some killer robots will actually satisfy these requirements. An implication of our argument is that there is a public responsibility to regulate killer robots ’ design and manufacture. (shrink)

Many of our questions about religion, says renowned anthropologist Pascal Boyer, are no longer mysteries. We are beginning to know how to answer questions such as "Why do people have religion?" Using findings from anthropology, cognitive science, linguistics, and evolutionary biology, Religion Explained shows how this aspect of human consciousness is increasingly admissible to coherent, naturalistic explanation. This brilliant and controversial book gives readers the first scientific explanation for what religious feeling is really about, what it consists of, and where (...) it comes from. (shrink)

Neil Levy presents a new theory of freedom and responsibility. He defends a particular account of consciousness--the global workspace view--and argues that consciousness plays an especially important role in action. There are good reasons to think that the naïve assumption, that consciousness is needed for moral responsibility, is in fact true.

This paper discusses the relation between intelligence and motivation in artificial agents, developing and briefly arguing for two theses. The first, the orthogonality thesis, holds (with some caveats) that intelligence and final goals (purposes) are orthogonal axes along which possible artificial intellects can freely vary—more or less any level of intelligence could be combined with more or less any final goal. The second, the instrumental convergence thesis, holds that as long as they possess a sufficient level of intelligence, agents having (...) any of a wide range of final goals will pursue similar intermediary goals because they have instrumental reasons to do so. In combination, the two theses help us understand the possible range of behavior of superintelligent agents, and they point to some potential dangers in building such an agent. (shrink)

In this book, David Boonin examines the problem of punishment, and particularly the problem of explaining why it is morally permissible for the state to treat those who break the law in ways that would be wrong to treat those who do not? Boonin argues that there is no satisfactory solution to this problem and that the practice of legal punishment should therefore be abolished. Providing a detailed account of the nature of punishment and the problems that it generates, he (...) offers a comprehensive and critical survey of the various solutions that have been offered to the problem and concludes by considering victim restitution as an alternative to punishment. Written in a clear and accessible style, The Problem of Punishment will be of interest to anyone looking for a critical introduction to the subject as well as to those already familiar with it. (shrink)

This article discusses mechanisms and principles for assignment of moral responsibility to intelligent robots, with special focus on military robots. We introduce the concept autonomous power as a new concept, and use it to identify the type of robots that call for moral considerations. It is furthermore argued that autonomous power, and in particular the ability to learn, is decisive for assignment of moral responsibility to robots. As technological development will lead to robots with increasing autonomous power, we should be (...) prepared for a future when people blame robots for their actions. It is important to, already today, investigate the mechanisms that control human behavior in this respect. The results may be used when designing future military robots, to control unwanted tendencies to assign responsibility to the robots. Independent of the responsibility issue, the moral quality of robots’ behavior should be seen as one of many performance measures by which we evaluate robots. How to design ethics based control systems should be carefully investigated already now. From a consequentialist view, it would indeed be highly immoral to develop robots capable of performing acts involving life and death, without including some kind of moral framework. (shrink)

This book presents a comprehensive overview of what the criminal law would look like if organised around the principle that those who deserve punishment should receive punishment commensurate with, but no greater than, that which they deserve. Larry Alexander and Kimberly Kessler Ferzan argue that desert is a function of the actor's culpability, and that culpability is a function of the risks of harm to protected interests that the actor believes he is imposing and his reasons for acting in the (...) face of those risks. The authors deny that resultant harms, as well as unperceived risks, affect the actor's desert. They thus reject punishment for inadvertent negligence as well as for intentions or preparatory acts that are not risky. Alexander and Ferzan discuss the reasons for imposing risks that negate or mitigate culpability, the individuation of crimes, and omissions. (shrink)

In _The Immorality of Punishment_ Michael Zimmerman argues forcefully that not only our current practice but indeed any practice of legal punishment is deeply morally repugnant, no matter how vile the behaviour that is its target. Despite the fact that it may be difficult to imagine a state functioning at all, let alone well, without having recourse to punishing those who break its laws, Zimmerman makes a timely and compelling case for the view that we must seek and put into (...) practice alternative means of preventing crime and promoting social stability. (shrink)

In a series of publications, Ronald Arkin and his team have proposed the concept of a deontologically programmed 'ethical governor,' which is supposed to effectively control and enforce the ethical use of lethal force by robots on the battlefield. This paper attempts to analyse the concept of an ethical governor in the context of a more general criticism of algorithmic robot morality implementations. It is argued that the metaphor of the ethical governor is dangerously misleading in multiple respects: the governor, (...) as proposed by Arkin, overlooks a fundamental clash of interests of the robot designer/operator, that is not present in the original governor, and that can be shown to make effective robot control in the proposed implementation impossible. The concept also suggests that ethics control is a matter of correcting behavioural deviations from a 'reference ethical action' by a negative feedback loop, although it can be shown that this does not lead to an appropriate description of moral behaviour, and that in particular it overlooks the central role of conscience and dissent in morality. Finally, the concept as proposed is based on a fundamental confusion of the properties of laws, rules of just war, terms of engagement, and moral rules. At the same time, experimental implementations of 'moral' robot controllers threaten to produce an ad-hoc regulation of ethical issues on the battlefield, which is removed from public scrutiny and democratic control. Considering these issues, the concept of an ethical governor, and, more generally, the existing attempts to handle robot morality by algorithmic means can be shown to be both misleading and dangerous, and to not appropriately address the moral problems they are supposed to solve. Consequently, such attempts in their present form must be questioned and re-examined, and a more critical approach to artefact morality should be adopted. (shrink)