A television nature programme a year or two ago contained a striking sequence in which a giant squid was under threat from some other creature . The squid responded in a way which struck me immediately and powerfully as one of fear. Part of what was striking in this sequence was the way in which it was possible to see in the behaviour of a creature physically so very different from human beings an emotion which was so unambiguously and specifically (...) one of fear. (shrink)

I begin, as I shall end, with fictions.In a well-known tale, The Sandman, Hoffmann has a student, Nathaniel, fall in love with a beautiful doll, Olympia, whom he has spied upon as she sits at a window across the street from his lodgings. We are meant to suppose that Nathaniel mistakes an automaton for a human being. The mistake is the result of an elaborate but obscure deception on the part of the doll's designer, Professor Spalanzani. Nathaniel is disabused quite (...) by accident when he over-hears a quarrel between Spalanzani, who made Olympia's clockwork, and the sinister Coppelius, who contributed the eyes. (shrink)

We will next speak of Liberality. Now this is thought to be the mean state, having for its object-matter Wealth: I mean, the Liberal man is praised not in the circumstances of war, nor in those which constitute the character of perfected self-mastery, nor again in judicial decisions, but in respect of giving and receiving Wealth, chiefly the former. By the term Wealth I mean all those things whose worth is measured by money.

In the “Lecture on ethics”, Wittgenstein declares that ethical statements are essentially nonsense. He later told Friedrich Waismann that it is essential to “speak for oneself” on ethical matters. These comments might be taken to suggest that Wittgenstein shared an emotivist view of ethics—that one can only speak for oneself because there is no truth in ethics, only expressions of opinion (or emotions). I argue that this assimilation of Wittgenstein to emotivist thought is deeply misguided, and rests upon a serious (...) misunderstanding of what is implied by the nonsensicality of ethical claims on Wittgenstein's view. I develop a reading of Wittgenstein's remarks in the “Lecture on ethics” on which ethical statements, despite their nonsensicality, reveal the perspective of the speaker. The purpose of ethical language is to elucidate a speaker's perspective. Such elucidations, and the perspectives they reveal, can be evaluated, criticized, and respected on principled grounds even if, as Wittgenstein insists, no ethical judgment can be (objectively) justified by any fact. I contrast Wittgenstein's comments on ethics with some comments made by Frank Ramsey (from the same period), which appear similar to Wittgenstein's remarks on value. Contra Ramsey's insistence that there is “nothing to discuss” about (or within) ethics, a proper understanding of Wittgenstein's views does not commit us to passing over ethics in silence. (shrink)

One of the enduring concerns of moral philosophy is deciding who or what is deserving of ethical consideration. Much recent attention has been devoted to the "animal question" -- consideration of the moral status of nonhuman animals. In this book, David Gunkel takes up the "machine question": whether and to what extent intelligent and autonomous machines of our own making can be considered to have legitimate moral responsibilities and any legitimate claim to moral consideration. The machine question poses a fundamental (...) challenge to moral thinking, questioning the traditional philosophical conceptualization of technology as a tool or instrument to be used by human agents. Gunkel begins by addressing the question of machine moral agency: whether a machine might be considered a legitimate moral agent that could be held responsible for decisions and actions. He then approaches the machine question from the other side, considering whether a machine might be a moral patient due legitimate moral consideration. Finally, Gunkel considers some recent innovations in moral philosophy and critical theory that complicate the machine question, deconstructing the binary agent--patient opposition itself. Technological advances may prompt us to wonder if the science fiction of computers and robots whose actions affect their human companions could become science fact. Gunkel's argument promises to influence future considerations of ethics, ourselves, and the other entities who inhabit this world. (shrink)

Raimond Gaita draws moral philosophy away from the academic study of ethics and considers instead how real people actually think, talk and feel about morality. He explores our ideas of good and evil, and their link to our respect for human beings and the'preciousness' of each individual.

Peter Winch; I*—The Presidential Address: “Eine Einstellung zur Seele”, Proceedings of the Aristotelian Society, Volume 81, Issue 1, 1 June 1981, Pages 1–16, ht.

We provide a description and informal analysis of the commonalities in moral discourse concerning issues in the field of information and communications technology, present a logic model (DEAL) of this type of moral discourse that makes use of recent research in deontic, epistemic, and action logic, and indicate – drawing upon recent research in computer implementations of modal logic – how information systems may be developed that implement the proposed formalization.

If, as a number of writers have predicted, the computers of the future will possess intelligence and capacities that exceed our own then it seems as though they will be worthy of a moral respect at least equal to, and perhaps greater than, human beings. In this paper I propose a test to determine when we have reached that point. Inspired by Alan Turing’s (1950) original “Turing test”, which argued that we would be justified in conceding that machines could think (...) if they could fill the role of a person in a conversation, I propose a test for when computers have achieved moral standing by asking when a computer might take the place of a human being in a moral dilemma, such as a “triage” situation in which a choice must be made as to which of two human lives to save. We will know that machines have achieved moral standing comparable to a human when the replacement of one of these people with an artificial intelligence leaves the character of the dilemma intact. That is, when we might sometimes judge that it is reasonable to preserve the continuing existence of a machine over the life of a human being. This is the “Turing Triage Test”. I argue that if personhood is understood as a matter of possessing a set of important cognitive capacities then it seems likely that future AIs will be able to pass this test. However this conclusion serves as a reductio of this account of the nature of persons. I set out an alternative account of the nature of persons, which places the concept of a person at the centre of an interdependent network of moral and affective responses, such as remorse, grief and sympathy. I argue that according to this second, superior, account of the nature of persons, machines will be unable to pass the Turing Triage Test until they possess bodies and faces with expressive capacities akin to those of the human form. (shrink)

There is increasing speculation within military and policy circles that the future of armed conflict is likely to include extensive deployment of robots designed to identify targets and destroy them without the direct oversight of a human operator. My aim in this paper is twofold. First, I will argue that the ethical case for allowing autonomous targeting, at least in specific restricted domains, is stronger than critics have acknowledged. Second, I will attempt to uncover, explicate, and defend the intuition that (...) even in this context there would be something ethically problematic about such targeting. I argue that an account of the non-consequentialist foundations of the principle of distinction suggests that the use of autonomous weapon systems is unethical by virtue of failing to show appropriate respect for the humanity of our enemies. However, the success of the strongest form of this argument depends upon understanding the robot itself as doing the killing. To the extent that we believe that, on the contrary, AWS are only the means whereby those who order them into action kill, the idea that the use of AWS fails to respect the humanity of our enemy will turn upon an account of what is required by respect that is essentially conventional. Thus, while the theoretical foundations of the idea that AWS are weapons that are “evil in themselves” are weaker than critics have sometimes maintained, they are nonetheless sufficient to the task of demanding a prohibition of the development and deployment of such weapons. (shrink)

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would normally (...) be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

The present debate over the creation and potential deployment of lethal autonomous weapons, or ‘killer robots’, is garnering more and more attention. Much of the argument revolves around whether such machines would be able to uphold the principle of noncombatant immunity. However, much of the present debate fails to take into consideration the practical realties of contemporary armed conflict, particularly generating military objectives and the adherence to a targeting process. This paper argues that we must look to the targeting process (...) if we are to gain a fuller picture of the consequences of creating or fielding lethal autonomous robots. This paper argues that once we look to how militaries actually create military objectives, and thus identify potential targets, we face an additional problem: the Strategic Robot Problem. The ability to create targeting lists using military doctrine and targeting processes is inherently strategic, and handing this capability over to a machine undermines existing comman.. (shrink)

This article discusses mechanisms and principles for assignment of moral responsibility to intelligent robots, with special focus on military robots. We introduce the concept autonomous power as a new concept, and use it to identify the type of robots that call for moral considerations. It is furthermore argued that autonomous power, and in particular the ability to learn, is decisive for assignment of moral responsibility to robots. As technological development will lead to robots with increasing autonomous power, we should be (...) prepared for a future when people blame robots for their actions. It is important to, already today, investigate the mechanisms that control human behavior in this respect. The results may be used when designing future military robots, to control unwanted tendencies to assign responsibility to the robots. Independent of the responsibility issue, the moral quality of robots’ behavior should be seen as one of many performance measures by which we evaluate robots. How to design ethics based control systems should be carefully investigated already now. From a consequentialist view, it would indeed be highly immoral to develop robots capable of performing acts involving life and death, without including some kind of moral framework. (shrink)

Julia Annas offers a new account of virtue and happiness as central ethical ideas. She argues that exercising a virtue involves practical reasoning of the kind we find in someone exercising an everyday practical skill, such as farming, building, or playing the piano. This helps us to see virtue as part of an agent's happiness or flourishing.

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

The essays in this volume represent the first steps by philosophers and artificial intelligence researchers toward explaining why it is necessary to add an ...

Virtue ethics is perhaps the most important development within late twentieth-century moral philosophy. Rosalind Hursthouse, who has made notable contributions to this development, here presents a full exposition and defense of her neo-Aristotelian version of virtue ethics. She shows how virtue ethics can provide guidance for action, illuminate moral dilemmas, and bring out the moral significance of the emotions.

This paper is reprinted in the book Machine Ethics, eds. M. Anderson and S. Anderson, Cambridge University Press, 2011.