There are at least three things we might mean by "ethics in robotics": the ethical systems built into robots, the ethics of people who design and use robots, and the ethics of how people treat robots. This paper argues that the best approach to robot ethics is one which addresses all three of these, and to do this it ought to consider robots as socio-technical systems. By so doing, it is possible to think of a continuum of agency that lies (...) between amoral and fully autonomous moral agents. Thus, robots might move gradually along this continuum as they acquire greater capabilities and ethical sophistication. It also argues that many of the issues regarding the distribution of responsibility in complex socio-technical systems might best be addressed by looking to legal theory, rather than moral theory. This is because our overarching interest in robot ethics ought to be the practical one of preventing robots from doing harm, as well as preventing humans from unjustly avoiding responsibility for their actions. (shrink)

Jeff McMahan urges us to reject the view, dominant throughout history, that mere participation in an unjust war is not wrong.

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would normally (...) be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

Explores the moral dimensions of the current global role of the U.S. military.

This paper makes the case for arms control regimes to govern the development and deployment of autonomous weapon systems and long range uninhabited aerial vehicles.

Man and machine are rife with fundamental differences. Formal research in artificial intelligence and robotics has for half a century aimed to cross this divide, whether from the perspective of understanding man by building models, or building machines which could be as intelligent and versatile as humans. Inevitably, our sources of inspiration come from what exists around us, but to what extent should a machine's conception be sourced from such biological references as ourselves? Machines designed to be capable of explicit (...) social interaction with people necessitates employing the human frame of reference to a certain extent. However, there is also a fear that once this man-machine boundary is crossed that machines will cause the extinction of mankind. The following paper briefly discusses a number of fundamental distinctions between humans and machines in the field of social robotics, and situating these issues with a view to understanding how to address them. (shrink)

As arti® cial intelligence moves ever closer to the goal of producing fully autonomous agents, the question of how to design and implement an arti® cial moral agent (AMA) becomes increasingly pressing. Robots possessing autonomous capacities to do things that are useful to humans will also have the capacity to do things that are harmful to humans and other sentient beings. Theoretical challenges to developing arti® cial moral agents result both from controversies among ethicists about moral theory itself, and from (...) computational limits to the implementation of such theories. In this paper the ethical disputes are surveyed, the possibility of a `moral Turing Test ’ is considered and the computational di culties accompanying the diŒerent types of approach are assessed. Human-like performance, which is prone to include immoral actions, may not be acceptable in machines, but moral perfection may be computationally unattainable. The risks posed by autonomous machines ignorantly or deliberately harming people and other sentient beings are great. The development of machines with enough intelligence to assess the eŒects of their actions on sentient beings and act accordingly may ultimately be the most important task faced by the designers of arti® cially intelligent automata. (shrink)

Warrior cultures throughout history have developed unique codes that restrict their behavior and set them apart from the rest of society. But what possible reason could a warrior have for accepting such restraints? Why should those whose profession can force them into hellish kill-or-be-killed conditions care about such lofty concepts as honor, courage, nobility, duty, and sacrifice? And why should it matter so much to the warriors themselves that they be something more than mere murderers? The Code of the Warrior (...) tackles these timely issues and takes the reader on a tour of warrior cultures and their values, from the ancient Greeks and Romans to the 'barbaric' Vikings and Celts, from legendary chivalric knights to Native American tribesmen, from Chinese warrior monks pursuing enlightenment to Japanese samurai practicing death. Drawing these rich traditions up to the present, the author quests for a code for the warriors of today, as they do battle in asymmetric conflicts against unconventional forces and the scourge of global terrorism. (shrink)

This paper is reprinted in the book Machine Ethics, eds. M. Anderson and S. Anderson, Cambridge University Press, 2011.

THERE’S a well-known scene in Shakespeare’s Henry V in which the King, disguised as an ordinary soldier, is conversing with some of his soldiers on the eve of the battle of Agincourt. Hoping to find or inspire support among them, he remarks: “Methinks I could not die anywhere so contented as in the King’s company, his cause being just and his quarrel honorable.” One soldier replies: “That’s more than we know,” whereupon a second says: “Ay, or more than we should (...) seek after; for we know enough if we know we are the King’s subjects: if his cause be wrong, our obedience to the King wipes the crime of it out of us.”. (shrink)

War, Richard Norman reminds us, is treated as the great exception to the strong moral prohibition against the killing of other humans. Despite the widespread belief that war is, in many cases, permissible, its morally exceptional character suggests that there is a strong presumption against its permissibility. Norman argues that this presumption cannot be successfully rebutted and, in particular, that just-war theory, which attempts to provide such a rebuttal, fails in this endeavor. But Norman’s work is more than a critique (...) of just-war theory. He also takes up the more general task of demonstrating the basis of the moral presumption against war, that is, the basis and the nature of the prohibition against killing. This is a necessary preliminary, for only when we understand the prohibition can we adequately address the question whether the presumption against war that it establishes can be sustained. Norman provides interesting and subtle arguments concerning both the prohibition against killing and the just-war rebuttal to the presumption against war, but in the end it is not clear that his position can be coherently distinguished from the just-war position he criticizes. (shrink)

War robots clearly hold tremendous advantages-from saving the lives of our own soldiers, to safely defusing roadside bombs, to operating in inaccessible and dangerous environments such as mountainside caves and underwater. Without emotions and other liabilities on the battlefield, they could conduct warfare more ethically and effectively than human soldiers who are susceptible to overreactions, anger, vengeance, fatigue, low morale, and so on. But the use of robots, especially autonomous ones, raises a a host of ethical and risk issues. This (...) paper offers a a survey of such emerging issues in this new but rapidly advancing area of technology. (shrink)

Can war ever be justified? Why is it wrong to kill? In this new book Richard Norman looks at these and other related questions, and thereby examines the possibility and nature of rational moral argument. Practical examples, such as the Gulf War and the Falklands War, are used to show that, whilst moral philosophy can offer no easy answers, it is a worthwhile enterprise which sheds light on many pressing contemporary problems. A combination of lucid exposition and original argument makes (...) this the ideal introduction to both the particular debate about the ethics of killing and war, and also to the fundamental issues of moral philosophy itself. (shrink)