The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would normally (...) be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

There have been two recent strands of argument arguing for the pro tanto impermissibility of fully autonomous weapon systems. On Sparrow's view, AWS are impermissible because they generate a morally problematic ‘responsibility gap’. According to Purves et al., AWS are impermissible because moral reasoning is not codifiable and because AWS are incapable of acting for the ‘right’ reasons. I contend that these arguments are flawed and that AWS are not morally problematic in principle. Specifically, I contend that these arguments presuppose (...) an incoherent conception of an AWS as somehow making genuine decisions but not being morally responsible for those very same decisions. Rather than conceiving of AWS in this way, I argue that an AWS is either a socially-constructed institution that has been physically instantiated or it is a genuine agent. If it is the former, then we should treat AWS as we do any other collective action problem. If it is the latter, then we should treat AWS as responsibility-bearers, but also as bearers of rights and/or interests. To reject this disjunction is not only conceptually incoherent but also potentially morally dangerous. (shrink)

We propose that the prevalent moral aversion to AWS is supported by a pair of compelling objections. First, we argue that even a sophisticated robot is not the kind of thing that is capable of replicating human moral judgment. This conclusion follows if human moral judgment is not codifiable, i.e., it cannot be captured by a list of rules. Moral judgment requires either the ability to engage in wide reflective equilibrium, the ability to perceive certain facts as moral considerations, moral (...) imagination, or the ability to have moral experiences with a particular phenomenological character. Robots cannot in principle possess these abilities, so robots cannot in principle replicate human moral judgment. If robots cannot in principle replicate human moral judgment then it is morally problematic to deploy AWS with that aim in mind. Second, we then argue that even if it is possible for a sufficiently sophisticated robot to make ‘moral decisions’ that are extensionally indistinguishable from (or better than) human moral decisions, these ‘decisions’ could not be made for the right reasons. This means that the ‘moral decisions’ made by AWS are bound to be morally deficient in at least one respect even if they are extensionally indistinguishable from human ones. Our objections to AWS support the prevalent aversion to the employment of AWS in war. They also enjoy several significant advantages over the most common objections to AWS in the literature. (shrink)

Self‐driving cars hold out the promise of being much safer than regular cars. Yet they cannot be 100% safe. Accordingly, we need to think about who should be held responsible when self‐driving cars crash and people are injured or killed. We also need to examine what new ethical obligations might be created for car users by the safety potential of self‐driving cars. The article first considers what lessons might be learned from the growing legal literature on responsibility for crashes with (...) self‐driving cars. Next, worries about responsibility gaps and retribution gaps from the philosophical literature are introduced. This leads to a discussion of whether self‐driving cars are a form of agents that act independently of human agents. It is suggested that it is better to analyze their apparent agency in terms of human–robot collaborations, within which humans play the most important roles. The next topic is the idea that the safety potential of self‐driving cars might create a duty to either switch to self‐driving cars or seek means of making conventional cars safer. Lastly, there is a short discussion of ethical issues related to safe human–robot coordination within mixed traffic featuring both self‐driving cars and conventional cars. (shrink)

Many ethicists writing about automated systems attribute agency to these systems. Not only that; they seemingly attribute an autonomous or independent form of agency to these machines. This leads some ethicists to worry about responsibility-gaps and retribution-gaps in cases where automated systems harm or kill human beings. In this paper, I consider what sorts of agency it makes sense to attribute to most current forms of automated systems, in particular automated cars and military robots. I argue that whereas it indeed (...) makes sense to attribute different forms of fairly sophisticated agency to these machines, we ought not to regard them as acting on their own, independently of any human beings. Rather, the right way to understand the agency exercised by these machines is in terms of human–robot collaborations, where the humans involved initiate, supervise, and manage the agency of their robotic collaborators. This means, I argue, that there is much less room for justified worries about responsibility-gaps and retribution-gaps than many ethicists think. (shrink)

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)

Future weapons will make life-or-death decisions without a human in the loop. When such weapons inflict unwarranted harm, no one appears to be responsible. There seems to be a responsibility gap. I first reconstruct the argument for such responsibility gaps to then argue that this argument is not sound. The argument assumes that commanders have no control over whether autonomous weapons inflict harm. I argue against this assumption. Although this investigation concerns a specific case of autonomous weapons systems, I take (...) steps towards vindicating the more general idea that superiors can be morally responsible in virtue of being in command. (shrink)

In this essay, I describe and explain the standard accounts of agency, natural agency, artificial agency, and moral agency, as well as articulate what are widely taken to be the criteria for moral agency, supporting the contention that this is the standard account with citations from such widely used and respected professional resources as the Stanford Encyclopedia of Philosophy, Routledge Encyclopedia of Philosophy, and the Internet Encyclopedia of Philosophy. I then flesh out the implications of some of these well-settled theories (...) with respect to the prerequisites that an ICT must satisfy in order to count as a moral agent accountable for its behavior. I argue that each of the various elements of the necessary conditions for moral agency presupposes consciousness, i.e., the capacity for inner subjective experience like that of pain or, as Nagel puts it, the possession of an internal something-of-which-it is-is-to-be-like. I ultimately conclude that the issue of whether artificial moral agency is possible depends on the issue of whether it is possible for ICTs to be conscious. (shrink)

A number of companies including Google and BMW are currently working on the development of autonomous cars. But if fully autonomous cars are going to drive on our roads, it must be decided who is to be held responsible in case of accidents. This involves not only legal questions, but also moral ones. The first question discussed is whether we should try to design the tort liability for car manufacturers in a way that will help along the development and improvement (...) of autonomous vehicles. In particular, Patrick Lin’s concern that any security gain derived from the introduction of autonomous cars would constitute a trade-off in human lives will be addressed. The second question is whether it would be morally permissible to impose liability on the user based on a duty to pay attention to the road and traffic and to intervene when necessary to avoid accidents. Doubts about the moral legitimacy of such a scheme are based on the notion that it is a form of defamation if a person is held to blame for causing the death of another by his inattention if he never had a real chance to intervene. Therefore, the legitimacy of such an approach would depend on the user having an actual chance to do so. The last option discussed in this paper is a system in which a person using an autonomous vehicle has no duty of interfering, but is still held responsible for possible accidents. Two ways of doing so are discussed, but only one is judged morally feasible. (shrink)

The task of this essay is to respond to the question concerning robots and responsibility—to answer for the way that we understand, debate, and decide who or what is able to answer for decisions and actions undertaken by increasingly interactive, autonomous, and sociable mechanisms. The analysis proceeds through three steps or movements. It begins by critically examining the instrumental theory of technology, which determines the way one typically deals with and responds to the question of responsibility when it involves technology. (...) It then considers three instances where recent innovations in robotics challenge this standard operating procedure by opening gaps in the usual way of assigning responsibility. The innovations considered in this section include: autonomous technology, machine learning, and social robots. The essay concludes by evaluating the three different responses—instrumentalism 2.0, machine ethics, and hybrid responsibility—that have been made in face of these difficulties in an effort to map out the opportunities and challenges of and for responsible robotics. (shrink)

This article discusses mechanisms and principles for assignment of moral responsibility to intelligent robots, with special focus on military robots. We introduce the concept autonomous power as a new concept, and use it to identify the type of robots that call for moral considerations. It is furthermore argued that autonomous power, and in particular the ability to learn, is decisive for assignment of moral responsibility to robots. As technological development will lead to robots with increasing autonomous power, we should be (...) prepared for a future when people blame robots for their actions. It is important to, already today, investigate the mechanisms that control human behavior in this respect. The results may be used when designing future military robots, to control unwanted tendencies to assign responsibility to the robots. Independent of the responsibility issue, the moral quality of robots’ behavior should be seen as one of many performance measures by which we evaluate robots. How to design ethics based control systems should be carefully investigated already now. From a consequentialist view, it would indeed be highly immoral to develop robots capable of performing acts involving life and death, without including some kind of moral framework. (shrink)

Responsibility and the Moral Sentiments offers an account of moral responsibility. It addresses the question: what are the forms of capacity or ability that render us morally accountable for the things we do? A traditional answer has it that the conditions of moral responsibility include freedom of the will, where this in turn involves the availability of robust alternative possibilities. I reject this answer, arguing that the conditions of moral responsibility do not include any condition of alternative possibilities. In the (...) terms that have become familiar, the book thus defends a compatibilist account of moral responsibility. (shrink)

Drawing on earlier work of the author that is both clarified and amplified here, this article explores the question: what is it for two or more people to intend to do something in the future? In short, what is it for people to share an intention? It argues for three criteria of adequacy for an account of shared intention (the disjunction, concurrence, and obligation criteria) and offers an account that satisfies them. According to this account, in technical terms explained in (...) the paper, people share an intention when and only when they are jointly committed to intend as a body to do such-and-such in the future. This account is compared and contrasted with the common approach that treats shared intention as a matter of the correlative personal intentions, with particular reference to the work of Michael Bratman. (shrink)

This article explores the question: what is it for two or more people to intend to do something in the future? In a technical phrase, what is it for people to share an intention ? Extending and refining earlier work of the author’s, it argues for three criteria of adequacy for an account of shared intention (the disjunction, concurrence, and obligation criteria) and offers an account that satisfies them. According to this account, in technical terms explained in the paper, people (...) share an intention when and only when they are jointly committed to intend as a body to do such-and-such in the future. This account is compared and contrasted with the common approach that treats shared intention as a matter of personal intentions, with particular reference to the work of Michael Bratman. (shrink)

Through the use of such "folk" concepts as belief, desire, intention, and expectation, Daniel Dennett asserts in this first full scale presentation of...

What is the relation between a reason and an action when the reason explains the action by giving the agent's reason for doing what he did? We may call such explanations rationalizations, and say that the reason rationalizes the action. In this paper I want to defend the ancient - and common-sense - position that rationalization is a species of ordinary causal explanation. The defense no doubt requires some redeployment, but not more or less complete abandonment of the position, as (...) urged by many recent writers. (shrink)

We are living through an era of increased robotisation. Some authors have already begun to explore the impact of this robotisation on legal rules and practice. In doing so, many highlight potential liability gaps that might arise through robot misbehaviour. Although these gaps are interesting and socially significant, they do not exhaust the possible gaps that might be created by increased robotisation. In this article, I make the case for one of those alternative gaps: the retribution gap. This gap arises (...) from a mismatch between the human desire for retribution and the absence of appropriate subjects of retributive blame. I argue for the potential existence of this gap in an era of increased robotisation; suggest that it is much harder to plug this gap than it is to plug those thus far explored in the literature; and then highlight three important social implications of this gap. (shrink)

This paper explores how the phenomenology of using self-driving cars influences conditions for exercising and ascribing responsibility. First, a working account of responsibility is presented, which identifies two classic Aristotelian conditions for responsibility and adds a relational one, and which makes a distinction between responsibility for (what one does) and responsibility to (others). Then, this account is applied to a phenomenological analysis of what happens when we use a self-driving car and participate in traffic. It is argued that self-driving cars (...) threaten the excercise and ascription of responsibility in several ways. These include the replacement of human agency by machine agency, but also the user’s changing epistemic relation to the environment and others, which can be described in terms of (dis)engagement. It is concluded that the discussion about the ethics of self-driving cars and related problems of responsibility should be restricted neither to general responsibilities related to the use of self-driving cars and its objective risks, nor to questions regarding the behavior, intelligence, autonomy, and ethical “thinking” of the car in response to the objective features of the traffic situations (e.g. various scenarios). Rather, it should also reflect on the shifting experience of the user: how the new technology reshapes the subjectivity of the user and on the morel consequences this has. (shrink)

In Freedom Within Reason, Susan Wolf charts a course between incompatibilism, or the notion that freedom and responsibility require causal and metaphysical independence from the impersonal forces of nature, and compatibilism, or the notion that people are free and responsible as long as their actions are governed by their desires. Wolf argues that some of the forces which are beyond our control are friends to freedom rather than enemies of it, enabling us to see the world for what it is. (...) The freedom we want is not independence from the world, but independence from the forces that prevent us from choosing how to live in the light of a sufficient appreciation of the world. (shrink)

This book provides a comprehensive, systematic theory of moral responsibility. The authors explore the conditions under which individuals are morally responsible for actions, omissions, consequences, and emotions. The leading idea in the book is that moral responsibility is based on 'guidance control'. This control has two components: the mechanism that issues in the relevant behavior must be the agent's own mechanism, and it must be appropriately responsive to reasons. The book develops an account of both components. The authors go on (...) to offer a sustained defense of the thesis that moral responsibility is compatible with causal determinism. (shrink)

This innovative approach to freedom starts from an account of what we mean by describing someone, in a psychological vein, as a free subject. Pettit develops an argument as to what it is that makes someone free in that basic sense; and then goes on to derive the implications of the approach for issues of freedom in political theory. Freedom in the subject is equated with the person's being fit to be held responsible and to be authorized as a partner (...) in interaction. This book is unique among contemporary approaches - although it is true to the spirit of classical writers like Hobbes and Kant - in seeking a theory that applies to psychological issues of free agency and free will as well as to political issues in the theory of the free state and the free constitution. The driving thesis is that it is only by connecting up the different issues of freedom, psychological and political, that we can fully appreciate the nature of the questions involved, and the requirements for their resolution. The book does not not seek a comprehensive reach just for its own sake, but rather for the sake of the illumination it provides._ _ _A Theory of Freedom_ is a ground-breaking volume which will be of wide interest to scholars and students in political philosophy and political science. (shrink)

Robert Kane provides a critical overview of debates about free will of the past half century, relating this recent inquiry to the broader history of the free will issue and to vital currents of twentieth century thought. Kane also defends a traditional libertarian or incompatibilist view of free will, employing arguments that are both new to philosophy and that respond to contemporary developments in physics and biology, neuro science, and the cognitive and behavioral sciences.

David Shoemaker presents a new pluralistic theory of responsibility, based on the idea of quality of will. His approach is motivated by our ambivalence to real-life cases of marginal agency, such as those caused by clinical depression, dementia, scrupulosity, psychopathy, autism, intellectual disability, and poor formative circumstances. Our ambivalent responses suggest that such agents are responsible in some ways but not others. Shoemaker develops a theory to account for our ambivalence, via close examination of several categories of pancultural emotional responsibility (...) responses and their appropriateness conditions. The result is three distinct types of responsibility, each with its own set of required capacities: attributability, answerability, and accountability. Attributability is about the having and expressing of various traits of character, and it is the target of a range of aretaic sentiments and emotional practices organized around disdain and admiration. Answerability is about one’s capacity to govern one’s actions and attitudes by one’s evaluative judgments about the worth of various practical reasons, and it is the target of a range of sentiments and emotional practices organized around regret and pride. Accountability is about one’s ability to regard others, both evaluatively and emotionally, and it is the target of a range of sentiments and emotional practices organized around anger and gratitude. In Part One of the book, this tripartite theory is developed and defended. In Part Two of the book, the tripartite theory’s predictions about specific marginal cases are tested, once certain empirical details about the nature of those agents have been filled in and discussed. (shrink)

R. Jay Wallace argues in this book that moral accountability hinges on questions of fairness: When is it fair to hold people morally responsible for what they do? Would it be fair to do so even in a deterministic world? To answer these questions, we need to understand what we are doing when we hold people morally responsible, a stance that Wallace connects with a central class of moral sentiments, those of resentment, indignation, and guilt. To hold someone responsible, he (...) argues, is to be subject to these reactive emotions in one's dealings with that person. Developing this theme with unusual sophistication, he offers a new interpretation of the reactive emotions and traces their role in our practices of blame and moral sanction. With this account in place, Wallace advances a powerful and sustained argument against the common view that accountability requires freedom of will. Instead, he maintains, the fairness of holding people responsible depends on their rational competence: the power to grasp moral reasons and to control their behavior accordingly. He shows how these forms of rational competence are compatible with determinism. At the same time, giving serious consideration to incompatibilist concerns, Wallace develops a compelling diagnosis of the common assumption that freedom is necessary for responsibility. Rigorously argued, eminently readable, this book touches on issues of broad concern to philosophers, legal theorists, political scientists, and anyone with an interest in the nature and limits of responsibility. (shrink)

Are companies, churches, and states genuine agents? Or are they just collections of individuals that give a misleading impression of unity? This question is important, since the answer dictates how we should explain the behaviour of these entities and whether we should treat them as responsible and accountable on the model of individual agents. Group Agency offers a new approach to that question and is relevant, therefore, to a range of fields from philosophy to law, politics, and the social sciences. (...) Christian List and Philip Pettit argue that there really are group or corporate agents, over and above the individual agents who compose them, and that a proper approach to the social sciences, law, morality, and politics must take account of this fact. Unlike some earlier defences of group agency, their account is entirely unmysterious in character and, despite not being technically difficult, is grounded in cutting-edge work in social choice theory, economics, and philosophy. (shrink)

The result is nothing less than a fundamental reorientation of moral theory that enables it at last to account for morality's supreme authority--an account that ...

Human beings act together in characteristic ways. Forms of shared activity matter to us a great deal, both intrinsically – think of friendship and love, singing duets, and the joys of conversation -- and instrumentally – think of how we frequently manage to work together to achieve complex goals. My focus will be on activities of small, adult groups in the absence of asymmetric authority relations within those groups. My approach begins with an underlying model of individual planning agency, and (...) then seeks a conceptual and metaphysical bridge from such individual planning agency to modest forms of sociality. (shrink)

Functionalism in the philosophy of mind is the doctrine that what makes something a mental state of a particular type does not depend on its internal constitution, but rather on the way it functions, or the role it plays, in the system of which it is a part. This doctrine is rooted in Aristotle's conception of the soul, and has antecedents in Hobbes's conception of the mind as a “calculating machine”, but it has become fully articulated (and popularly endorsed) only (...) in the last third of the 20th century. Though the term ‘functionalism’ is used to designate a variety of positions in a variety of other disciplines, including psychology, sociology, economics, and architecture, this entry focuses exclusively on functionalism as a philosophical thesis about the nature of mental states. (shrink)

The philosophy of mind and cognition has been transformed by recent advances in what is loosely called cognitive science. This book is a thoroughly up-to-date introduction to and account of that transformation, in which the many strands in contemporary cognitive science are brought together into a coherent philosophical picture of the mind. The book begins with discussions of the pre-history of contemporary philosophy of mind - dualism, behaviourism, and early versions of the identity theory of mind - and moves through (...) discussions of functionalism in autonomy of psychology, to topics such as eliminative materialism, individualism and the problems of content and representation. The synoptic nature of the discussion makes it ideal as the foundation of an undergraduate course in the philosophy of mind. (shrink)

The doyen of living English philosophers, by these reflections, took hold of and changed the outlook of a good many other philosophers, if not quite enough. He did so, essentially, by assuming that talk of freedom and responsibility is talk not of facts or truths, in a certain sense, but of our attitudes. His more explicit concern was to look again at the question of whether determinism and freedom are consistent with one another -- by shifting attention to certain personal (...) rather than moral attitudes, first of all gratitude and resentment. In the end, he arrived at a kind of Compatibilist or, as he says, Optimist conclusion. That is no doubt a recommendation but not the largest recommendation of this splendidly rich piece of philosophy. (shrink)

What is Functionalism? Functionalism is one of the major proposals that have been offered as solutions to the mind/body problem. Solutions to the mind/body problem usually try to answer questions such as: What is the ultimate nature of the mental? At the most general level, what makes a mental state mental? Or more specifically, What do thoughts have in common in virtue of which they are thoughts? That is, what makes a thought a thought? What makes a pain a pain? (...) Cartesian Dualism said the ultimate nature of the mental was to be found in a special mental substance. Behaviorism identified mental states with behavioral dispositions; physicalism in its most influential version identifies mental states with brain states. Functionalism says that mental states are constituted by their causal relations to one another and to sensory inputs and behavioral outputs. Functionalism is one of the major theoretical developments of Twentieth Century analytic philosophy, and provides the conceptual underpinnings of much work in cognitive science. (shrink)

What is Functionalism? Functionalism is one of the major proposals that have been offered as solutions to the mind/body problem. Solutions to the mind/body problem usually try to answer questions such as: What is the ultimate nature of the mental? At the most general level, what makes a mental state mental? Or more specifically, What do thoughts have in common in virtue of which they are thoughts? That is, what makes a thought a thought? What makes a pain a pain? (...) Cartesian Dualism said the ultimate nature of the mental was to be found in a special mental substance. Behaviorism identified mental states with behavioral dispositions; physicalism in its most influential version identifies mental states with brain states. Functionalism says that mental states are constituted by their causal relations to one another and to sensory inputs and behavioral outputs. Functionalism is one of the major theoretical developments of Twentieth Century analytic philosophy, and provides the conceptual underpinnings of much work in cognitive science. (shrink)

Human beings act together in characteristic ways that matter to us a great deal. This book explores the conceptual, metaphysical and normative foundations of such sociality. It argues that appeal to the planning structures involved in our individual, temporally extended agency provides substantial resources for understanding these foundations of our sociality.