Are companies, churches, and states genuine agents? Or are they just collections of individuals that give a misleading impression of unity? This question is important, since the answer dictates how we should explain the behaviour of these entities and whether we should treat them as responsible and accountable on the model of individual agents. Group Agency offers a new approach to that question and is relevant, therefore, to a range of fields from philosophy to law, politics, and the social sciences. (...) Christian List and Philip Pettit argue that there really are group or corporate agents, over and above the individual agents who compose them, and that a proper approach to the social sciences, law, morality, and politics must take account of this fact. Unlike some earlier defences of group agency, their account is entirely unmysterious in character and, despite not being technically difficult, is grounded in cutting-edge work in social choice theory, economics, and philosophy. (shrink)

R. Jay Wallace argues in this book that moral accountability hinges on questions of fairness: When is it fair to hold people morally responsible for what they do? Would it be fair to do so even in a deterministic world? To answer these questions, we need to understand what we are doing when we hold people morally responsible, a stance that Wallace connects with a central class of moral sentiments, those of resentment, indignation, and guilt. To hold someone responsible, he (...) argues, is to be subject to these reactive emotions in one's dealings with that person. Developing this theme with unusual sophistication, he offers a new interpretation of the reactive emotions and traces their role in our practices of blame and moral sanction. With this account in place, Wallace advances a powerful and sustained argument against the common view that accountability requires freedom of will. Instead, he maintains, the fairness of holding people responsible depends on their rational competence: the power to grasp moral reasons and to control their behavior accordingly. He shows how these forms of rational competence are compatible with determinism. At the same time, giving serious consideration to incompatibilist concerns, Wallace develops a compelling diagnosis of the common assumption that freedom is necessary for responsibility. Rigorously argued, eminently readable, this book touches on issues of broad concern to philosophers, legal theorists, political scientists, and anyone with an interest in the nature and limits of responsibility. (shrink)

Bentham's best-known book stands as a classic of both philosophy and jurisprudence. The 1789 work articulates an important statement of the foundations of utilitarian philosophy — it also represents a pioneering study of crime and punishment. Bentham's reasoning remains central to contemporary debates in moral and political philosophy, economics, and legal theory.

In der 1785 veröffentlichten Grundlegung zur Metaphysik der Sitten formuliert Kant erstmals die Prinzipien einer universalistischen Ethik der Autonomie, deren Einfluß bis heute ungebrochen ist. Schon beim Übergang von der gemeinen zur philosophischen Vernunfterkenntnis findet man die Hauptgedanken: In der Ethik geht es nicht primär um das gute Leben und das Glück, und es geht auch zunächst nicht darum, welche Handlungserfolge erzielt werden; Gegenstand moralischer Hochschätzung sind vielmehr Intentionen und Maximen. Gut ist, was für alle vernünftigen Wesen gilt, weil es (...) von ihnen als autonomen und vernünftigen Wesen gewollt wird. Die Schrift ist kurz, einfach gegliedert und verständlich geschrieben. Sie eignet sich daher als Einführung in Kants Ethik, enthält aber zugleich als Grundlegung alle wesentlichen Gedanken seiner praktischen Philosophie. Auf der Grundlage der Originalausgabe von 1785/86 wurde der Text völlig neu erstellt. Eines der wichtigsten Bücher der Philosophiegeschichte liegt damit in einer zuverlässigen und preisgünstigen Neuausgabe vor. (shrink)

In the subsequent pages, I want to develop a distinction between wanting and valuing which will enable the familiar view of freedom to make sense of the notion of an unfree action. The contention will be that, in the case of actions that are unfree, the agent is unable to get what he most wants, or values, and this inability is due to his own "motivational system." In this case the obstruction to the action that he most wants to do (...) is his own will. It is in this respect that the action is unfree: the agent is obstructed in and by the very performance of the action. (shrink)

Nelkin presents a simple and natural account of freedom and moral responsibility which responds to the great variety of challenges to the idea that we are free and responsible, before ultimately reaffirming our conception of ourselves as agents. Making Sense of Freedom and Responsibility begins with a defense of the rational abilities view, according to which one is responsible for an action if and only if one acts with the ability to recognize and act for good reasons. The view is (...) compatibilist -- that is, on the view defended, responsibility is compatible with determinism -- and one of its striking features is a certain asymmetry: it requires the ability to do otherwise for responsibility when actions are praiseworthy, but not when they are blameworthy. In defending and elaborating the view, Nelkin questions long-held assumptions such as those concerning the relation between fairness and blame and the nature of so-called reactive attitudes such as resentment and forgiveness. Her argument not only fits with a metaphysical picture of causation -- agent-causation -- often assumed to be available only to incompatibilist accounts, but receives positive support from the intuitively appealing Ought Implies Can Principle, and establishes a new interpretation of freedom and moral responsibility that dovetails with a compelling account of our inescapable commitments as rational agents. (shrink)

This article argues that an ethical framework will help to harness the potential of AI while keeping humans in control.

Research on the ethics of algorithms has grown substantially over the past decade. Alongside the exponential development and application of machine learning algorithms, new ethical problems and solutions relating to their ubiquitous use in society have been proposed. This article builds on a review of the ethics of algorithms published in 2016, 2016). The goals are to contribute to the debate on the identification and analysis of the ethical implications of algorithms, to provide an updated analysis of epistemic and normative (...) concerns, and to offer actionable guidance for the governance of the design, development and deployment of algorithms. (shrink)

Responsibility and the Moral Sentiments offers an account of moral responsibility. It addresses the question: what are the forms of capacity or ability that render us morally accountable for the things we do? A traditional answer has it that the conditions of moral responsibility include freedom of the will, where this in turn involves the availability of robust alternative possibilities. I reject this answer, arguing that the conditions of moral responsibility do not include any condition of alternative possibilities. In the (...) terms that have become familiar, the book thus defends a compatibilist account of moral responsibility. (shrink)

Research on the ethics of algorithms has grown substantially over the past decade. Alongside the exponential development and application of machine learning algorithms, new ethical problems and solutions relating to their ubiquitous use in society have been proposed. This article builds on a review of the ethics of algorithms published in 2016, 2016). The goals are to contribute to the debate on the identification and analysis of the ethical implications of algorithms, to provide an updated analysis of epistemic and normative (...) concerns, and to offer actionable guidance for the governance of the design, development and deployment of algorithms. (shrink)

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would normally (...) be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

A series of recent developments points towards auditing as a promising mechanism to bridge the gap between principles and practice in AI ethics. Building on ongoing discussions concerning ethics-based auditing, we offer three contributions. First, we argue that ethics-based auditing can improve the quality of decision making, increase user satisfaction, unlock growth potential, enable law-making, and relieve human suffering. Second, we highlight current best practices to support the design and implementation of ethics-based auditing: To be feasible and effective, ethics-based auditing (...) should take the form of a continuous and constructive process, approach ethical alignment from a system perspective, and be aligned with public policies and incentives for ethically desirable behaviour. Third, we identify and discuss the constraints associated with ethics-based auditing. Only by understanding and accounting for these constraints can ethics-based auditing facilitate ethical alignment of AI, while enabling society to reap the full economic and social benefits of automation. (shrink)

The question of the psychopath's responsibility for his or her wrongdoing has received considerable attention. Much of this attention has been directed toward whether psychopaths are a counterexample to motivational internalism (MI): Do they possess normal moral beliefs, which fail to motivate them? In this paper, I argue that this is a question that remains conceptually and empirically intractable, and that we ought to settle the psychopath's responsibility in some other way. I argue that recent empirical work on the moral (...) judgments of psychopaths provides us with good reason to think that they are not fully responsible agents, because their actions cannot express the kinds of ill-will toward others that grounds attributions of distinctively moral responsibility. I defend this view against objections, especially those due to an influential account of moral responsibility that holds that moral knowledge is not necessary for responsibility. (shrink)

A series of recent developments points towards auditing as a promising mechanism to bridge the gap between principles and practice in AI ethics. Building on ongoing discussions concerning ethics-based auditing, we offer three contributions. First, we argue that ethics-based auditing can improve the quality of decision making, increase user satisfaction, unlock growth potential, enable law-making, and relieve human suffering. Second, we highlight current best practices to support the design and implementation of ethics-based auditing: To be feasible and effective, ethics-based auditing (...) should take the form of a continuous and constructive process, approach ethical alignment from a system perspective, and be aligned with public policies and incentives for ethically desirable behaviour. Third, we identify and discuss the constraints associated with ethics-based auditing. Only by understanding and accounting for these constraints can ethics-based auditing facilitate ethical alignment of AI, while enabling society to reap the full economic and social benefits of automation. (shrink)

This paper argues that there is an urgent need for an international doctrine for cyberspace skirmishes before they escalate into conventional warfare.

It typically taken for granted that agents can be morally responsible for such things as, for example, the death of the victim and the capture of the murderer in the sense that one may be blameworthy or praiseworthy for such things. The primary task of a theory of moral responsibility, it is thought, is to specify the appropriate relationship one must stand to such things in order to be morally responsible for them. I argue that this common approach is problematic (...) because it attempts to explain the way in which an agent can be morally responsible for something that is external to her, the agent. Since, I argue, everything that matters for moral responsibility is internal to the agent, the accounts that emerge from this approach are committed to a particular form of moral luck. Instead, we should reject this form of moral luck, and with it, the possibility of moral responsibility for objects external to the agent. We are, I argue, morally responsible only for our inner willings. Thus, a form of internalism about moral responsibility is defended. (shrink)

The concept of distributed moral responsibility (DMR) has a long history. When it is understood as being entirely reducible to the sum of (some) human, individual and already morally loaded actions, then the allocation of DMR, and hence of praise and reward or blame and punishment, may be pragmatically difficult, but not conceptually problematic. However, in distributed environments, it is increasingly possible that a network of agents, some human, some artificial (e.g. a program) and some hybrid (e.g. a group of (...) people working as a team thanks to a software platform), may cause distributed moral actions (DMAs). These are morally good or evil (i.e. morally loaded) actions caused by local interactions that are in themselves neither good nor evil (morally neutral). In this article, I analyse DMRs that are due to DMAs, and argue in favour of the allocation, by default and overridably, of full moral responsibility (faultless responsibility) to all the nodes/agents in the network causally relevant for bringing about the DMA in question, independently of intentionality. The mechanism proposed is inspired by, and adapts, three concepts: back propagation from network theory, strict liability from jurisprudence and common knowledge from epistemic logic. (shrink)

The phenomenon of distributed knowledge is well-known in epistemic logic. In this paper, a similar phenomenon in ethics, somewhat neglected so far, is investigated, namely distributed morality. The article explains the nature of distributed morality, as a feature of moral agency, and explores the implications of its occurrence in advanced information societies. In the course of the analysis, the concept of infraethics is introduced, in order to refer to the ensemble of moral enablers, which, although morally neutral per se, can (...) significantly facilitate or hinder both positive and negative moral behaviours. (shrink)

Sparrow argues that military robots capable of making their own decisions would be independent enough to allow us denial for their actions, yet too unlike us to be the targets of meaningful blame or praise—thereby fostering what Matthias has dubbed “the responsibility gap.” We agree with Sparrow that someone must be held responsible for all actions taken in a military conflict. That said, we think Sparrow overlooks the possibility of what we term “blank check” responsibility: A person of sufficiently high (...) standing could accept responsibility for the actions of autonomous robotic devices—even if that person could not be causally linked to those actions besides this prior agreement. The basic intuition behind our proposal is that humans can impute relations even when no other form of contact can be established. The missed alternative we want to highlight, then, would consist in an exchange: Social prestige in the occupation of a given office would come at the price of signing away part of one's freedoms to a contingent and unpredictable future guided by another agency. (shrink)

In this report we focus on the definition of autonomous weapons systems (AWS). We provide a comparative analysis of existing official definitions of AWS as provided by States and international organisations, like ICRC and NATO. The analysis highlights that the definitions draw focus on different aspects of AWS and hence lead to different approaches to address the ethical and legal problems of these weapons systems. This approach is detrimental both in terms of fostering an understanding of AWS and in facilitating (...) agreement around conditions of deployment and regulations of their use and, indeed, whether AWS are to be used at all. We draw from the comparative analysis to identify essential aspects of AWS and then offer a definition that provides a value-neutral ground to address the relevant ethical and legal problems. In particular, we identify four key aspects—autonomy; adapting capabilities of AWS; human control; and purpose of use—as the essential factors to define AWS and which are key when considering the related ethical and legal implications. (shrink)

Minimal responsibility threateners are epistemically justified but mistaken in thinking that imposing a nonnegligible risk on others is permissible. On standard accounts, an MRT forfeits her right not to be defensively killed. I propose an alternative account: an MRT is liable only to the degree of harm equivalent to what she risks causing multiplied by her degree of responsibility. Harm imposed on the MRT above that amount is justified as a lesser evil, relative to allowing the MRT to kill her (...) victim. This hybrid account, which generalizes to those are who are more than minimally responsible, has considerable advantages. (shrink)

This book deals with the problem of dual-use science research and technology. It first explains the concept of dual use and then offers analyses of collective knowledge and collective ignorance. It goes on to present a theory of collective responsibility, followed by four chapters focusing on a particular scientific field or industry of dual use concern: the chemical industry, the nuclear industry, cyber-technology and the biological sciences. The problem of dual-use science research and technology arises because such research and technology (...) has the potential to be used for great evil as well as for great good. On the one hand, knowledge is a necessary condition, and perhaps a constitutive feature, of technologies that contribute greatly to individual and collective well-being. Consider, for example, nuclear technology that enables the generation of low cost electricity in populations without obvious alternative energy sources. So technological knowledge is a good thing and ignorance of it a bad thing. On the other hand, these same technologies can be extremely harmful to individuals and collectives, as with the atomic bombs dropped on Hiroshima and Nagasaki. So, at least with respect to some technologies evidently knowledge is a bad thing and ignorance a good thing. Accordingly, the question arises as to whether we ought to limit scientific research and/or the development of technology and, if so, which research or technology, in what manner and to what extent. This book examines the answer to that question. (shrink)

There has recently been increasing interest in the possibility and ethics of lethal autonomous weapons systems (LAWS), which would combine sophisticated AI with machinery capable of deadly force. One objection to LAWS is that their use will create a troubling responsibility gap, where no human agent can properly be held accountable for the outcomes that they create. While some authors have attempted to show that individual agents can, in fact, be responsible for the behaviour of LAWS in various circumstances, this (...) will not be possible in all cases. This article argues, however, that by assigning responsibilities to group agents operating within the military‐industrial complex, as well as the military‐industrial complex as a whole, we may be able to close the responsibility gap, or at least reduce its costs. Insofar as the potential for responsibility gaps poses an ethical barrier to the development and deployment of LAWS, this argument, if sound, may show their use to be morally permissible in a greater range of cases. (shrink)

The immediate aim of this paper is to articulate the essential features of an alternative compatibilist position, one that is responsive to sources of resistance to the compatibilist program based on considerations of fate and luck. The approach taken relies on distinguishing carefully between issues of skepticism and pessimism as they arise in this context. A compatibilism that is properly responsive to concerns about fate and luck is committed to what I describe as free will pessimism, which is to be (...) distinguished from free will skepticism. Free will skepticism is the view that our vulnerability to conditions of fate and luck serve to discredit our view of ourselves as free and responsible agents. Free will pessimism rejects free will scepticism, since the basis of its pessimism rests with the assumption that we are free and responsible agents who are, nevertheless, subject to fate and luck in this aspect of our lives. According to free will pessimism, all the major parties and positions in the free will debate, including that of skepticism, are modes of evasion and distortion regarding our human predicament in respect of agency and moral life. (shrink)

Defence agencies across the globe identify artificial intelligence as a key technology to maintain an edge over adversaries. As a result, efforts to develop or acquire AI capabilities for defence are growing on a global scale. Unfortunately, they remain unmatched by efforts to define ethical frameworks to guide the use of AI in the defence domain. This article provides one such framework. It identifies five principles—justified and overridable uses, just and transparent systems and processes, human moral responsibility, meaningful human control (...) and reliable AI systems—and related recommendations to foster ethically sound uses of AI for national defence purposes. (shrink)

The possibility that autonomous weapons will be deployed on the battlefields of the future raises the challenge of determining who can be held responsible for how these weapons act. Robert Sparrow has argued that it would be impossible to attribute responsibility for autonomous robots' actions to their creators, their commanders, or the robots themselves. This essay reaches a much different conclusion. It argues that the problem of determining responsibility for autonomous robots can be solved by addressing it within the context (...) of the military chain of command. The military hierarchy is a system of distributing responsibility between decision makers on different levels and constraining autonomy. If autonomous weapons are employed as agents operating within this system, then responsibility for their actions can be attributed to their creators and their civilian and military superiors. (shrink)

To many, the idea of autonomous weapons systems (AWS) killing human beings is grotesque. Yet critics have had difficulty explaining why it should make a significant moral difference if a human combatant is killed by an AWS as opposed to being killed by a human combatant. The purpose of this paper is to explore the roots of various deontological concerns with AWS and to consider whether these concerns are distinct from any concerns that also apply to long-distance, human-guided weaponry. We (...) suggest that at least one major driver of the intuitive moral aversion to lethal AWS is that their use disrespects their human targets by violating the martial contract between human combatants. On our understanding of this doctrine, service personnel cede a right not to be directly targeted with lethal violence to other human agents alone. Artificial agents, of which AWS are one example, cannot understand the value of human life. A human combatant cannot transfer his privileges of targeting enemy combatants to a robot. Therefore, the human duty-holder who deploys AWS breaches the martial contract between human combatants and disrespects the targeted combatants. We consider whether this novel deontological objection to AWS forms the foundation of several other popular yet imperfect deontological objections to AWS. (shrink)

THERE’S a well-known scene in Shakespeare’s Henry V in which the King, disguised as an ordinary soldier, is conversing with some of his soldiers on the eve of the battle of Agincourt. Hoping to find or inspire support among them, he remarks: “Methinks I could not die anywhere so contented as in the King’s company, his cause being just and his quarrel honorable.” One soldier replies: “That’s more than we know,” whereupon a second says: “Ay, or more than we should (...) seek after; for we know enough if we know we are the King’s subjects: if his cause be wrong, our obedience to the King wipes the crime of it out of us.”. (shrink)

In this article, we focus on the scholarly and policy debate on autonomous weapon systems and particularly on the objections to the use of these weapons which rest on jus ad bellum principles of proportionality and last resort. Both objections rest on the idea that AWS may increase the incidence of war by reducing the costs for going to war or by providing a propagandistic value. We argue that whilst these objections offer pressing concerns in their own right, they suffer (...) from important limitations: they overlook the difficulties of calculating ad bellum proportionality; confuse the concept of proportionality of effects with the precision of weapon systems; disregard the ever-changing nature of war and of its ethical implications; mistake the moral obligation imposed by the principle of last resort with the impact that AWS may have on political decision to resort to war. Our analysis does not entail that AWS are acceptable or justifiable, but it shows that ad bellum principles are not the best set of ethical principles for tackling the ethical problems raised by AWS; and that developing adequate understanding of the transformations that the use of AWS poses to the nature of war itself is a necessary, preliminary requirement to any ethical analysis of the use of these weapons. (shrink)

Accountability and responsibility are key concepts in the academic and societal debate on Autonomous Weapon Systems, but these notions are often used as high-level overarching constructs and are not operationalised to be useful in practice. “Meaningful Human Control” is often mentioned as a requirement for the deployment of Autonomous Weapon Systems, but a common definition of what this notion means in practice, and a clear understanding of its relation with responsibility and accountability is also lacking. In this paper, we present (...) a definition of these concepts and describe the relations between accountability, responsibility, control and oversight in order to show how these notions are distinct but also connected. We focus on accountability as a particular form of responsibility—the obligation to explain one’s action to a forum—and we present three ways in which the introduction of Autonomous Weapon Systems may create “accountability gaps”. We propose a Framework for Comprehensive Human Oversight based on an engineering, socio-technical and governance perspective on control. Our main claim is that combining the control mechanisms at technical, socio-technical and governance levels will lead to comprehensive human oversight over Autonomous Weapon Systems which may ensure solid controllability and accountability for the behaviour of Autonomous Weapon Systems. Finally, we give an overview of the military control instruments that are currently used in the Netherlands and show the applicability of the comprehensive human oversight Framework to Autonomous Weapon Systems. Our analysis reveals two main gaps in the current control mechanisms as applied to Autonomous Weapon Systems. We have identified three first options as future work for the design of a control mechanism, one in the technological layer, one in the socio-technical layer and one the governance layer, in order to achieve comprehensive human oversight and ensure accountability over Autonomous Weapon Systems. (shrink)

In this article I examine the relation between causation and moral responsibility. I distinguish four possible views about that relation. One is the standard view: the view that an agent's moral responsibility for an outcome requires, and is grounded in, the agent's causal responsibility for it. I discuss several challenges to the standard view, which motivate the three remaining views. The final view – the view I argue for – is that causation is the vehicle of transmission of moral responsibility. (...) According to this view, although moral responsibility does not require causation, causation still grounds moral responsibility. (shrink)

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)