First published in 1903, this volume revolutionized philosophy and forever altered the direction of ethical studies. A philosopher’s philosopher, G. E. Moore was the idol of the Bloomsbury group, and Lytton Strachey declared that Principia Ethica marked the rebirth of the Age of Reason. This work clarifies some of moral philosophy’s most common confusions and redefines the science’s terminology. Six chapters explore: the subject matter of ethics, naturalistic ethics, hedonism, metaphysical ethics, ethics in relation to conduct, and the ideal. Moore's (...) simplicity of style and precise use of everyday language exercised an enormous influence on the development of analytic philosophy, and they contribute to the continuing resonance of his compelling arguments. (shrink)

Modern technology is more than a neutral tool: it is the framework of our civilization and shapes our way of life. Social critics claim that we must choose between this way of life and human values. Critical Theory of Technology challenges that pessimistic cliche. This pathbreaking book argues that the roots of the degradation of labor, education, and the environment lie not in technology per se but in the cultural values embodied in its design. Rejecting such popular solutions as economic (...) simplicity or spiritual renewal, Feenberg presents a compelling argument for broader democratic participation in technological choices. This book will be of special interest to scholars and students of philosophy, sociology, contemporary Marxism, and Critical Theory. (shrink)

This essay warns of eroding accountability in computerized societies. It argues that assumptions about computing and features of situations in which computers are produced create barriers to accountability. Drawing on philosophical analyses of moral blame and responsibility, four barriers are identified: 1) the problem of many hands, 2) the problem of bugs, 3) blaming the computer, and 4) software ownership without liability. The paper concludes with ideas on how to reverse this trend.

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would normally (...) be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)

After discussing the distinction between artifacts and natural entities, and the distinction between artifacts and technology, the conditions of the traditional account of moral agency are identified. While computer system behavior meets four of the five conditions, it does not and cannot meet a key condition. Computer systems do not have mental states, and even if they could be construed as having mental states, they do not have intendings to act, which arise from an agent’s freedom. On the other hand, (...) computer systems have intentionality, and because of this, they should not be dismissed from the realm of morality in the same way that natural objects are dismissed. Natural objects behave from necessity; computer systems and other artifacts behave from necessity after they are created and deployed, but, unlike natural objects, they are intentionally created and deployed. Failure to recognize the intentionality of computer systems and their connection to human intentionality and action hides the moral character of computer systems. Computer systems are components in human moral action. When humans act with artifacts, their actions are constituted by the intentionality and efficacy of the artifact which, in turn, has been constituted by the intentionality and efficacy of the artifact designer. All three components – artifact designer, artifact, and artifact user – are at work when there is an action and all three should be the focus of moral evaluation. (shrink)

I propose to consider the question, "Can machines think?" This should begin with definitions of the meaning of the terms "machine" and "think." The definitions might be framed so as to reflect so far as possible the normal use of the words, but this attitude is dangerous, If the meaning of the words "machine" and "think" are to be found by examining how they are commonly used it is difficult to escape the conclusion that the meaning and the answer to (...) the question, "Can machines think?" is to be sought in a statistical survey such as a Gallup poll. But this is absurd. Instead of attempting such a definition I shall replace the question by another, which is closely related to it and is expressed in relatively unambiguous words. The new form of the problem can be described in terms of a game which we call the 'imitation game." It is played with three people, a man (A), a woman (B), and an interrogator (C) who may be of either sex. The interrogator stays in a room apart front the other two. The object of the game for the interrogator is to determine which of the other two is the man and which is the woman. He knows them by labels X and Y, and at the end of the game he says either "X is A and Y is B" or "X is B and Y is A." The interrogator is allowed to put questions to A and B. We now ask the question, "What will happen when a machine takes the part of A in this game?" Will the interrogator decide wrongly as often when the game is played like this as he does when the game is played between a man and a woman? These questions replace our original, "Can machines think?". (shrink)

The essays in this volume represent the first steps by philosophers and artificial intelligence researchers toward explaining why it is necessary to add an ...

This chapter contains sections titled: Critical Theories of Technology Technology and Democracy Code and Bias Modernity, Premodernity, Alternative Modernity References and Further Reading.

Luciano Floridi develops the first ethical framework for dealing with the new challenges posed by Information and Communication Technologies. He establishes the conceptual foundations of Information Ethics by exploring important metatheoretical and introductory issues, and answering key theoretical questions of great philosophical interest.

The truth of the matter is that our deficiency does not lie in the want of well-verified "facts." What we lack is our bearings. The contemporary experience of things technological has repeatedly confounded our vision, our expectations, and our capacity to make intelligent judgments. Categories, arguments, conclusions, and choices that would have been entirely obvious in earlier times are obvious no longer. Patterns of perceptive thinking that were entirely reliable in the past now lead us systematically astray. Many of our (...) standard conceptions of technology reveal a disorientation that borders on dissociation from reality. And as long as we lack the ability to make our situation intelligible, all of the "data" in the world will make no difference.;From the Introduction. (shrink)

Technology permeates nearly every aspect of our daily lives. Cars enable us to travel long distances, mobile phones help us to communicate, and medical devices make it possible to detect and cure diseases. But these aids to existence are not simply neutral instruments: they give shape to what we do and how we experience the world. And because technology plays such an active role in shaping our daily actions and decisions, it is crucial, Peter-Paul Verbeek argues, that we consider the (...) moral dimension of technology. _Moralizing Technology_ offers exactly that: an in-depth study of the ethical dilemmas and moral issues surrounding the interaction of humans and technology. Drawing from Heidegger and Foucault, as well as from philosophers of technology such as Don Ihde and Bruno Latour, Peter-Paul Verbeek locates morality not just in the human users of technology but in the interaction between us and our machines. Verbeek cites concrete examples, including some from his own life, and compellingly argues for the morality of _things_. Rich and multifaceted, and sure to be controversial, _Moralizing Technology_ will force us all to consider the virtue of new inventions and to rethink the rightness of the products we use every day. (shrink)

One of the enduring concerns of moral philosophy is deciding who or what is deserving of ethical consideration. Much recent attention has been devoted to the "animal question" -- consideration of the moral status of nonhuman animals. In this book, David Gunkel takes up the "machine question": whether and to what extent intelligent and autonomous machines of our own making can be considered to have legitimate moral responsibilities and any legitimate claim to moral consideration. The machine question poses a fundamental (...) challenge to moral thinking, questioning the traditional philosophical conceptualization of technology as a tool or instrument to be used by human agents. Gunkel begins by addressing the question of machine moral agency: whether a machine might be considered a legitimate moral agent that could be held responsible for decisions and actions. He then approaches the machine question from the other side, considering whether a machine might be a moral patient due legitimate moral consideration. Finally, Gunkel considers some recent innovations in moral philosophy and critical theory that complicate the machine question, deconstructing the binary agent--patient opposition itself. Technological advances may prompt us to wonder if the science fiction of computers and robots whose actions affect their human companions could become science fact. Gunkel's argument promises to influence future considerations of ethics, ourselves, and the other entities who inhabit this world. (shrink)

In this paper Sullins argues that in certain circumstances robots can be seen as real moral agents. A distinction is made between persons and moral agents such that, it is not necessary for a robot to have personhood in order to be a moral agent. I detail three requirements for a robot to be seen as a moral agent. The first is achieved when the robot is significantly autonomous from any programmers or operators of the machine. The second is when (...) one can analyze or explain the robot's behavior only by ascribing to it some predisposition or 'intention' to do good or harm. And finally, robot moral agency requires the robot to behave in a way that shows and understanding of responsibility to some other moral agent. Robots with all of these criteria will have moral rights as well as responsibilities regardless of their status as persons. (shrink)

By endowing technology with the attributes of autonomous agency, human beings are ethically sidelined. Individuals are relieved of responsibility. The suggestion of being in the grip of irresistible forces provides an excuse for rejecting responsibility for oneself and others, thus creating conditions for inappropriate or antisocial behavior. It also impedes the search for solutions to pressing social problems associated with applications of technology. Failure to assign and accept responsibility for decisions to deploy “conventional” technology will inevitably impede our ability to (...) deal with the social and ethical challenges of robotics. (shrink)

Latour is a world famous and widely published French sociologist who has written with great eloquence and perception about the relationship between people, science, and technology. He is also closely associated with the school of thought known as Actor Network Theory. In this book he sets out for the first time in one place his own ideas about Actor Network Theory and its relevance to management and organization theory.

Editors’ Overview: Moral Responsibility in Technology and Engineering Content Type Journal Article Category Original Paper Pages 1-11 DOI 10.1007/s11948-011-9285-z Authors Neelke Doorn, Department of Technology, Policy and Management, Delft University of Technology, P.O. Box 5015, 2600 GA Delft, The Netherlands Ibo van de Poel, Department of Technology, Policy and Management, Delft University of Technology, P.O. Box 5015, 2600 GA Delft, The Netherlands Journal Science and Engineering Ethics Online ISSN 1471-5546 Print ISSN 1353-3452 Journal Volume Volume 18 Journal Issue Volume 18, (...) Number 1. (shrink)

Can we build ‘moral robots’? If morality depends on emotions, the answer seems negative. Current robots do not meet standard necessary conditions for having emotions: they lack consciousness, mental states, and feelings. Moreover, it is not even clear how we might ever establish whether robots satisfy these conditions. Thus, at most, robots could be programmed to follow rules, but it would seem that such ‘psychopathic’ robots would be dangerous since they would lack full moral agency. However, I will argue that (...) in the future we might nevertheless be able to build quasi-moral robots that can learn to create the appearance of emotions and the appearance of being fully moral. I will also argue that this way of drawing robots into our social-moral world is less problematic than it might first seem, since human morality also relies on such appearances. (shrink)

As this book reveals, his vision was much more complex and interesting. He hoped that machines would release people from relentless and repetitive drudgery in order to achieve more creative pursuits.

Floridi and Sanders, seminal work, “On the morality of artificial agents” has catalyzed attention around the moral status of computer systems that perform tasks for humans, effectively acting as “artificial agents.” Floridi and Sanders argue that the class of entities considered moral agents can be expanded to include computers if we adopt the appropriate level of abstraction. In this paper we argue that the move to distinguish levels of abstraction is far from decisive on this issue. We also argue that (...) adopting certain levels of abstraction out of context can be dangerous when the level of abstraction obscures the humans who constitute computer systems. We arrive at this critique of Floridi and Sanders by examining the debate over the moral status of computer systems using the notion of interpretive flexibility. We frame the debate as a struggle over the meaning and significance of computer systems that behave independently, and not as a debate about the ‘true’ status of autonomous systems. Our analysis leads to the conclusion that while levels of abstraction are useful for particular purposes, when it comes to agency and responsibility, computer systems should be conceptualized and identified in ways that keep them tethered to the humans who create and deploy them. (shrink)

This paper is a summary and evaluation of work presented at the AAAI 2005 Fall Symposium on Machine Ethics that brought together participants from the fields of Computer Science and Philosophy to the end of clarifying the nature of this newly emerging field and discussing different approaches one could take towards realizing the ultimate goal of creating an ethical machine.

This book questions the book itself, archivization, machines for writing, and the mechanicity inherent in language, the media, and intellectuals. Derrida questions what takes place between the paper and the machine inscribing it. He examines what becomes of the archive when the world of paper is subsumed in new machines for virtualization, and whether there can be a virtual event or a virtual archive. Derrida continues his long-standing investigation of these issues, and ties them into the new themes that governed (...) his teaching and thinking in the past few years: the secret, pardon, perjury, state sovereignty, hospitality, the university, animal rights, capital punishment, the question of what sort of mediatized world is replacing the print epoch, and the question of the “wholly other.” Derrida is remarkable at making seemingly occasional pieces into part of a complexly interconnected trajectory of thought. (shrink)

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

There are not only true or false solutions, there are also false questions. The task of philosophy is not to provide answers or solutions, but to submit to critical analysis the questions themselves, to make us see how the very way we perceive a problem is an obstacle to its solution. This holds especially for today’s public debates on ecological threats, on lack of faith, on democracy and the “war on terror”, in which the “unknown knowns”, the silent presuppositions we (...) are not aware of, determine our acts. (shrink)

Ethics is ordinarily understood as being concerned with questions of responsibility for and in the face of an other. This other is more often than not conceived of as another human being and, as such, necessarily excludes others – most notably animals and machines. This essay examines the ethics of such exclusivity. It is divided into three parts. The first part investigates the exclusive anthropocentrism of traditional forms of moral␣thinking and, following the example of recent innovations in animal rights philosophy, (...) questions the mechanisms of such exclusion. Although recent work in animal- and bio-ethics has successfully implemented strategies for the inclusion of the animal as a legitimate subject of moral consideration, its other, the machine, has remained conspicuously excluded. The second part looks at recent attempts to include these machinic others in moral thinking and critiques the assumptions, values, and strategies that have been employed by these various innovations. And the third part proposes a means for thinking otherwise. That is, it introduces an alternative way to consider these other forms of otherness that is not simply reducible to the conceptual order that has structured and limited moral philosophy’s own concern with and for others. (shrink)

The growing prominence of computers in contemporary life, often seemingly with minds of their own, invites rethinking the question of moral responsibility. If the moral responsibility for an act lies with the subject that carried it out, it follows that different concepts of the subject generate different views of moral responsibility. Some recent theorists have argued that actions are produced by composite, fluid subjects understood as extended agencies (cyborgs, actor networks). This view of the subject contrasts with methodological individualism: the (...) idea that actions are produced only by human individuals. This essay compares two views of responsibility: moral individualism (the ethical twin of methodological individualism), and joint responsibility (associated with extended agency theory). It develops a view of what joint responsibility might look like, and considers the advantages it might bring relative to moral individualism as well as the objections that are sure to be raised against it. (shrink)

Combining ideas from philosophy, artificial intelligence, and neurobiology, Daniel Dennett leads the reader on a fascinating journey of inquiry, exploring such intriguing possibilities as: Can any of us really know what is going on in someone else's mind? What distinguishes the human mind from the minds of animals, especially those capable of complex behavior? If such animals, for instance, were magically given the power of language, would their communities evolve an intelligence as subtly discriminating as ours? Will robots, once they (...) have been endowed with sensory systems like those that provide us with experience, ever exhibit the particular traits long thought to distinguish the human mind, including the ability to think about thinking? Dennett addresses these questions from an evolutionary perspective. Beginning with the macromolecules of DNA and RNA, the author shows how, step-by-step, animal life moved from the simple ability to respond to frequently recurring environmental conditions to much more powerful ways of beating the odds, ways of using patterns of past experience to predict the future in never-before-encountered situations. Whether talking about robots whose video-camera ”eyes” give us the powerful illusion that ”there is somebody in there” or asking us to consider whether spiders are just tiny robots mindlessly spinning their webs of elegant design, Dennett is a master at finding and posing questions sure to stimulate and even disturb. (shrink)

The possibility that autonomous weapons will be deployed on the battlefields of the future raises the challenge of determining who can be held responsible for how these weapons act. Robert Sparrow has argued that it would be impossible to attribute responsibility for autonomous robots' actions to their creators, their commanders, or the robots themselves. This essay reaches a much different conclusion. It argues that the problem of determining responsibility for autonomous robots can be solved by addressing it within the context (...) of the military chain of command. The military hierarchy is a system of distributing responsibility between decision makers on different levels and constraining autonomy. If autonomous weapons are employed as agents operating within this system, then responsibility for their actions can be attributed to their creators and their civilian and military superiors. (shrink)

Bill Joy’s deep pessimism is now famous. Why the Future Doesn’t Need Us, his defense of that pessimism, has been read by, it seems, everyone—and many of these readers, apparently, have been converted to the dark side, or rather more accurately, to the future-is-dark side. Fortunately (for us; unfortunately for Joy), the defense, at least the part of it that pertains to AI and robotics, fails. Ours may be a dark future, but we cannot know that on the basis of (...) Joy’s reasoning. On the other hand, we ought to fear a good deal more than fear itself: we ought to fear not robots, but what some of us may do with robots. (shrink)

This article addresses prospective and retrospective responsibility issues connected with medical robotics. It will be suggested that extant conceptual and legal frameworks are sufficient to address and properly settle most retrospective responsibility problems arising in connection with injuries caused by robot behaviours (which will be exemplified here by reference to harms occurred in surgical interventions supported by the Da Vinci robot, reported in the scientific literature and in the press). In addition, it will be pointed out that many prospective responsibility (...) issues connected with medical robotics are nothing but well-known robotics engineering problems in disguise, which are routinely addressed by roboticists as part of their research and development activities: for this reason they do not raise particularly novel ethical issues. In contrast with this, it will be pointed out that novel and challenging prospective responsibility issues may emerge in connection with harmful events caused by normal robot behaviours. This point will be illustrated here in connection with the rehabilitation robot Lokomat. (shrink)

As non-biological machines come to be designed in ways which exhibit characteristics comparable to human mental states, the manner in which the law treats these entities will become increasingly important both to designers and to society at large. The direct question will become whether, given certain attributes, a non-biological machine could ever be viewed as a legal person. In order to begin to understand the ramifications of this question, this paper starts by exploring the distinction between the related concepts of (...) human, person, and property. Once it is understood that person in the legal sense can apply to a non-biological entity such as a corporation, the inquiry then goes on to examine the folk psychology view of intentionality and the concept of autonomy. The conclusion reached is that these two attributes can support the view that a non-biological machine, at least in theory, can be viewed as a legal person. (shrink)

There has been much debate whether computers can be responsible. This question is usually discussed in terms of personhood and personal characteristics, which a computer may or may not possess. If a computer fulfils the conditions required for agency or personhood, then it can be responsible; otherwise not. This paper suggests a different approach. An analysis of the concept of responsibility shows that it is a social construct of ascription which is only viable in certain social contexts and which serves (...) particular social aims. If this is the main aspect of responsibility then the question whether computers can be responsible no longer hinges on the difficult problem of agency but on the possibly simpler question whether responsibility ascriptions to computers can fulfil social goals. The suggested solution to the question whether computers can be subjects of responsibility is the introduction of a new concept, called “quasi-responsibility” which will emphasise the social aim of responsibility ascription and which can be applied to computers. (shrink)

Machine generated contents note: -- Acknowledgements -- Introduction - The Problem of Moral Status -- PART I: MORAL ONTOLOGIES: FROM INDIVIDUAL TO RELATIONAL DOGMAS -- Individual Properties -- Appearance and Virtue -- Relations: Communitarian and Metaphysical -- Relations: Natural and Social -- Relations: Hybrid and Environmental -- Conclusion Part I: Diogenes's Challenge -- PART II: MORAL STATUS ASCRIPTION AND ITS CONDITIONS OF POSSIBILITY: A TRANSCENDENTAL ARGUMENT -- Words and Sentences: Forms of Language Use -- Societies and Cultures (1): Forms of (...) Living Together -- Societies and Cultures (2): Forms of Life -- Bodies and Things: Forms of Feeling and Making -- Spirits and Gods: Forms of Religion -- Fences, Walls, and Maps: Forms of Historical Space -- Moral Metamorphosis: Concluding the Transcendental Argument -- General Conclusion -- References -- Index. (shrink)

Telerobotically operated and semiautonomous machines have become a major component in the arsenals of industrial nations around the world. By the year 2015 the United States military plans to have one-third of their combat aircraft and ground vehicles robotically controlled. Although there are many reasons for the use of robots on the battlefield, perhaps one of the most interesting assertions are that these machines, if properly designed and used, will result in a more just and ethical implementation of warfare. This (...) paper will focus on these claims by looking at what has been discovered about the capability of humans to behave ethically on the battlefield, and then comparing those findings with the claims made by robotics researchers that their machines are able to behave more ethically on the battlefield than human soldiers. Throughout the paper we will explore the philosophical critique of this claim and also look at how the robots of today are impacting our ability to fight wars in a just manner. (shrink)

It has been argued that moral problems in relation to Information Technology (IT) require new theories of ethics. In recent years, an interesting new theory to address such concerns has been proposed, namely the theory of Information Ethics (IE). Despite the promise of IE, the theory has not enjoyed public discussion. The aim of this paper is to initiate such discussion by critically evaluating the theory of IE.