Advances in artificial intelligence research allow us to build fairly sophisticated agents: robots and computer programs capable of acting and deciding on their own. These systems raise questions about who is responsible when something goes wrong—when such systems harm or kill humans. In a recent paper, Sven Nyholm has suggested that, because current AI will likely possess what we might call “supervised agency”, the theory of responsibility for individual agency is the wrong place to look for an answer to the (...) question of responsibility. Instead, or so argues Nyholm, because supervised agency is a form of collaborative agency—of acting together—the right place to look is the theory of collaborative responsibility—responsibility in cases of acting together. This paper concedes that current AI will possess supervised agency, but argues that it is nevertheless wrong to think of the relevant human-AI interactions as a form of collaborative agency and, hence, that responsibility in cases of collaborative agency is not the right place to look for the responsibility-grounding relation in human-AI interactions. It also suggests that the right place to look for this responsibility-grounding relation in human-AI interactions is the use of certain sorts of agents as instruments. (shrink)

In a landmark essay, Andreas Matthias claimed that current developments in autonomous, artificially intelligent (AI) systems are creating a so-called responsibility gap, which is allegedly ever-widening and stands to undermine both the moral and legal frameworks of our society. But how severe is the threat posed by emerging technologies? In fact, a great number of authors have indicated that the fear is thoroughly instilled. The most pessimistic are calling for a drastic scaling-back or complete moratorium on AI systems, while the (...) optimists aim to show that the gap can be bridged nonetheless. Contrary to both camps, I argue against the prevailing assumption that there is a technology-based responsibility gap. I show how moral responsibility is a dynamic and flexible process, one that can effectively encompass emerging technological entities. (shrink)

Philosophical work exploring the relation between cognition and the Internet is now an active area of research. Some adopt an externalist framework, arguing that the Internet should be seen as environmental scaffolding that drives and shapes cognition. However, despite growing interest in this topic, little attention has been paid to how the Internet influences our affective life — our moods, emotions, and our ability to regulate these and other feeling states. We argue that the Internet scaffolds not only cognition but (...) also affect. Using various case studies, we consider some ways that we are increasingly dependent on our Internet-enabled “techno-social niches” to regulate the contours of our own affective life and participate in the affective lives of others. We argue further that, unlike many of the other environmental resources we use to regulate affect, the Internet has distinct properties that introduce new dimensions of complexity to these regulative processes. First, it is radically social in a way many of these other resources are not. Second, it is a radically distributed and decentralized resource; no one individual or agent is responsible for the Internet’s content or its affective impact on users. Accordingly, while the Internet can profoundly augment and enrich our affective life and deepen our connection with others, there is also a distinctive kind of affective precarity built into our online endeavors as well. (shrink)

Robotization is an increasingly pervasive feature of our lives. Robots with high degrees of autonomy may cause harm, yet in sufciently complex systems neither the robots nor the human developers may be candidates for moral blame. John Danaher has recently argued that this may lead to a retribution gap, where the human desire for retribution faces a lack of appropriate subjects for retributive blame. The potential social and moral implications of a retribution gap are considerable. I argue that the retributive (...) intuitions that feed into retribution gaps are best understood as deontological intuitions. I apply a debunking argument for deontological intuitions in order to show that retributive intuitions cannot be used to justify retributive punishment in cases of robot harm without clear candidates for blame. The fundamental moral question thus becomes what we ought to do with these retributive intuitions, given that they do not justify retribution. I draw a parallel from recent work on implicit biases to make a case for taking moral responsibility for retributive intuitions. In the same way that we can exert some form of control over our unwanted implicit biases, we can and should do so for unjustifed retributive intuitions in cases of robot harm. (shrink)

Can robots have significant moral status? This is an emerging topic of debate among roboticists and ethicists. This paper makes three contributions to this debate. First, it presents a theory – ‘ethical behaviourism’ – which holds that robots can have significant moral status if they are roughly performatively equivalent to other entities that have significant moral status. This theory is then defended from seven objections. Second, taking this theoretical position onboard, it is argued that the performative threshold that robots need (...) to cross in order to be afforded significant moral status may not be that high and that they may soon cross it (if they haven’t done so already). Finally, the implications of this for our procreative duties to robots are considered, and it is argued that we may need to take seriously a duty of ‘procreative beneficence’ towards robots. (shrink)

Friendship is an important part of the good life. While many roboticists are eager to create friend-like robots, many philosophers and ethicists are concerned. They argue that robots cannot really be our friends. Robots can only fake the emotional and behavioural cues we associate with friendship. Consequently, we should resist the drive to create robot friends. In this article, I argue that the philosophical critics are wrong. Using the classic virtue-ideal of friendship, I argue that robots can plausibly be considered (...) our virtue friends - that to do so is philosophically reasonable. Furthermore, I argue that even if you do not think that robots can be our virtue friends, they can fulfil other important friendship roles, and can complement and enhance the virtue friendships between human beings. (shrink)

This essay attempts to provide and defend what may be the first actual argument in support of P. F. Strawson's merely stated vision of a response-dependent theory of moral responsibility. It does so by way of an extended analogy with the funny. In part 1, it makes the easier and less controversial case for response-dependence about the funny. In part 2, it shows the tight analogy between anger and amusement in developing the harder and more controversial case for response-dependence about (...) a kind of blameworthiness. It then defends the view from three serious skeptical challenges. (shrink)

New technologies from artificial intelligence to drones, and biomedical enhancement make the future of the human family increasingly hard to predict and protect. This book explores how the philosophical tradition of virtue ethics can help us to cultivate the moral wisdom we need to live wisely and well with emerging technologies.

We are living through an era of increased robotisation. Some authors have already begun to explore the impact of this robotisation on legal rules and practice. In doing so, many highlight potential liability gaps that might arise through robot misbehaviour. Although these gaps are interesting and socially significant, they do not exhaust the possible gaps that might be created by increased robotisation. In this article, I make the case for one of those alternative gaps: the retribution gap. This gap arises (...) from a mismatch between the human desire for retribution and the absence of appropriate subjects of retributive blame. I argue for the potential existence of this gap in an era of increased robotisation; suggest that it is much harder to plug this gap than it is to plug those thus far explored in the literature; and then highlight three important social implications of this gap. (shrink)

In this book Michael McKenna advances a new theory of moral responsibility, one that builds upon the work of P. F. Strawson. As McKenna demonstrates, moral responsibility can be explained on analogy with a conversation. The relation between a morally responsible agent and those who hold her morally responsible is similar to the relation between a speaker and her audience. A responsible agent's actions are bearers of meaning--agent meaning--just as a speaker's utterances are bearers of speaker meaning. Agent meaning is (...) a function of the moral quality of the will with which the agent acts. Those who hold an agent morally responsible for what she does do so by responding to her as if in a conversation. By responding with certain morally reactive attitudes, such as resentment or indignation, they thereby communicate their regard for the meaning taken to be revealed in that agent's actions. It is then open for the agent held responsible to respond to those holding her responsible by offering an apology, a justification, an excuse, or some other response, thereby extending the evolving conversational exchange.The conversational theory of moral responsibility that McKenna develops here accepts two features of Strawson's theory: that moral responsibility is essentially interpersonal--so that being responsible must be understood by reference to the nature of holding responsible--and that the moral emotions are central to holding responsible. While upholding these two aspects of Strawson's theory, McKenna's theory rejects a further Strawsonian thesis, which is that holding morally responsible is more fundamental or basic than being morally responsible. On the conversational theory, the conditions for holding responsible are dependent on the nature of the agent who is responsible. So holding responsible cannot be more basic than being responsible. Nevertheless, the nature of the agent who is morally responsible is to be understood in terms of sensitivity to those who would make moral demands of her, thereby holding her responsible. Being responsible is therefore also dependent on holding responsible. Thus, neither being nor holding morally responsible is more basic than the other. They are mutually dependent. (shrink)

Recently, a number of people have argued that certain entities embodied by groups of agents themselves qualify as agents, with their own beliefs, desires, and intentions; even, some claim, as moral agents. However, others have independently argued that fully-fledged moral agency involves a capacity for reactive attitudes such as guilt and indignation, and these capacities might seem beyond the ken of “collective” or “ corporate ” agents. Individuals embodying such agents can of course be ashamed, proud, or indignant about what (...) the agent has done. But just as an entity needs to have its own beliefs, desires, and intentions to qualify as a bona fide agent, the required capacity for reactive attitudes is a capacity to have one’s own reactive attitudes. If fully-fledged moral agency requires reactive attitudes, the corporate agent must itself be capable of guilt and indignation. In this paper, we argue that at least certain corporate agents are. Or, more precisely, we argue that if there are bona fide corporate agents, these agents can have the capacities that are both associated with guilt and indignation and plausibly required for moral agency; in particular certain epistemic and motivational capacities. (shrink)

ABSTRACTIt has recently become fashionable among those who write on questions of moral responsibility to distinguish two different concepts, or senses, of moral responsibility via the labels ‘responsibility as attributability’ and ‘responsibility as accountability’. Gary Watson was perhaps the first to introduce this distinction in his influential 1996 article ‘Two Faces of Responsibility’ , but it has since been taken up by many other philosophers. My aim in this study is to raise some questions and doubts about this distinction and (...) to argue that it has led to confusion rather than clarification in debates over moral responsibility. In place of the attributability/accountability distinction, I propose that there is a single concept of moral responsibility underlying our actual moral practices. This core notion of moral responsibility, which I call ‘responsibility as answerability’, is well positioned to explain thos.. (shrink)

Part I: Building blocks. 1. Folk convictions -- 2. Doubts about libertarianism -- 3. Nihilism and revisionism -- 4. Building a better theory -- Part II. A theory of moral responsibility. 5. The primacy of reasons -- 6. Justifying the practice -- 7. Responsible agency -- 8. Blame and desert -- 9. History and manipulation --10. Some conclusions.

The author presents and defends three theses: (1) "the first is that it is not profitable for us at present to do moral philosophy; that should be laid aside at any rate until we have an adequate philosophy of psychology." (2) "the second is that the concepts of obligation, And duty... And of what is morally right and wrong, And of the moral sense of 'ought', Ought to be jettisoned if this is psychologically possible...." (3) "the third thesis is that (...) the differences between the well-Known english writers on moral philosophy from sidgwick to the present day are of little importance." (staff). (shrink)

Can we build ‘moral robots’? If morality depends on emotions, the answer seems negative. Current robots do not meet standard necessary conditions for having emotions: they lack consciousness, mental states, and feelings. Moreover, it is not even clear how we might ever establish whether robots satisfy these conditions. Thus, at most, robots could be programmed to follow rules, but it would seem that such ‘psychopathic’ robots would be dangerous since they would lack full moral agency. However, I will argue that (...) in the future we might nevertheless be able to build quasi-moral robots that can learn to create the appearance of emotions and the appearance of being fully moral. I will also argue that this way of drawing robots into our social-moral world is less problematic than it might first seem, since human morality also relies on such appearances. (shrink)

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)

The doyen of living English philosophers, by these reflections, took hold of and changed the outlook of a good many other philosophers, if not quite enough. He did so, essentially, by assuming that talk of freedom and responsibility is talk not of facts or truths, in a certain sense, but of our attitudes. His more explicit concern was to look again at the question of whether determinism and freedom are consistent with one another -- by shifting attention to certain personal (...) rather than moral attitudes, first of all gratitude and resentment. In the end, he arrived at a kind of Compatibilist or, as he says, Optimist conclusion. That is no doubt a recommendation but not the largest recommendation of this splendidly rich piece of philosophy. (shrink)

This book argues that we need to explore how human beings can best coordinate and collaborate with robots in responsible ways. It investigates ethically important differences between human agency and robot agency to work towards an ethics of responsible human-robot interaction.

This paper discusses the problem of responsibility attribution raised by the use of artificial intelligence technologies. It is assumed that only humans can be responsible agents; yet this alone already raises many issues, which are discussed starting from two Aristotelian conditions for responsibility. Next to the well-known problem of many hands, the issue of “many things” is identified and the temporal dimension is emphasized when it comes to the control condition. Special attention is given to the epistemic condition, which draws (...) attention to the issues of transparency and explainability. In contrast to standard discussions, however, it is then argued that this knowledge problem regarding agents of responsibility is linked to the other side of the responsibility relation: the addressees or “patients” of responsibility, who may demand reasons for actions and decisions made by using AI. Inspired by a relational approach, responsibility as answerability thus offers an important additional, if not primary, justification for explainability based, not on agency, but on patiency. (shrink)

Many ethicists writing about automated systems attribute agency to these systems. Not only that; they seemingly attribute an autonomous or independent form of agency to these machines. This leads some ethicists to worry about responsibility-gaps and retribution-gaps in cases where automated systems harm or kill human beings. In this paper, I consider what sorts of agency it makes sense to attribute to most current forms of automated systems, in particular automated cars and military robots. I argue that whereas it indeed (...) makes sense to attribute different forms of fairly sophisticated agency to these machines, we ought not to regard them as acting on their own, independently of any human beings. Rather, the right way to understand the agency exercised by these machines is in terms of human–robot collaborations, where the humans involved initiate, supervise, and manage the agency of their robotic collaborators. This means, I argue, that there is much less room for justified worries about responsibility-gaps and retribution-gaps than many ethicists think. (shrink)

David Shoemaker presents a new pluralistic theory of responsibility, based on the idea of quality of will. His approach is motivated by our ambivalence to real-life cases of marginal agency, such as those caused by clinical depression, dementia, scrupulosity, psychopathy, autism, intellectual disability, and poor formative circumstances. Our ambivalent responses suggest that such agents are responsible in some ways but not others. Shoemaker develops a theory to account for our ambivalence, via close examination of several categories of pancultural emotional responsibility (...) responses and their appropriateness conditions. The result is three distinct types of responsibility, each with its own set of required capacities: attributability, answerability, and accountability. Attributability is about the having and expressing of various traits of character, and it is the target of a range of aretaic sentiments and emotional practices organized around disdain and admiration. Answerability is about one’s capacity to govern one’s actions and attitudes by one’s evaluative judgments about the worth of various practical reasons, and it is the target of a range of sentiments and emotional practices organized around regret and pride. Accountability is about one’s ability to regard others, both evaluatively and emotionally, and it is the target of a range of sentiments and emotional practices organized around anger and gratitude. In Part One of the book, this tripartite theory is developed and defended. In Part Two of the book, the tripartite theory’s predictions about specific marginal cases are tested, once certain empirical details about the nature of those agents have been filled in and discussed. (shrink)

R. Jay Wallace argues in this book that moral accountability hinges on questions of fairness: When is it fair to hold people morally responsible for what they do? Would it be fair to do so even in a deterministic world? To answer these questions, we need to understand what we are doing when we hold people morally responsible, a stance that Wallace connects with a central class of moral sentiments, those of resentment, indignation, and guilt. To hold someone responsible, he (...) argues, is to be subject to these reactive emotions in one's dealings with that person. Developing this theme with unusual sophistication, he offers a new interpretation of the reactive emotions and traces their role in our practices of blame and moral sanction. With this account in place, Wallace advances a powerful and sustained argument against the common view that accountability requires freedom of will. Instead, he maintains, the fairness of holding people responsible depends on their rational competence: the power to grasp moral reasons and to control their behavior accordingly. He shows how these forms of rational competence are compatible with determinism. At the same time, giving serious consideration to incompatibilist concerns, Wallace develops a compelling diagnosis of the common assumption that freedom is necessary for responsibility. Rigorously argued, eminently readable, this book touches on issues of broad concern to philosophers, legal theorists, political scientists, and anyone with an interest in the nature and limits of responsibility. (shrink)

The Southern Journal of Philosophy, Volume 60, Issue 1, Page 88-117, March 2022.

Recent rapid advances in Artificial Intelligence (AI) and Machine Learning have raised many questions about the regulatory and governance mechanisms for autonomous machines. Many commentators, scholars, and policy-makers now call for ensuring that algorithms governing our lives are transparent, fair, and accountable. Here, I propose a conceptual framework for the regulation of AI and algorithmic systems. I argue that we need tools to program, debug and maintain an algorithmic social contract, a pact between various human stakeholders, mediated by machines. To (...) achieve this, we can adapt the concept of human-in-the-loop (HITL) from the fields of modeling and simulation, and interactive machine learning. In particular, I propose an agenda I call society-in-the-loop (SITL), which combines the HITL control paradigm with mechanisms for negotiating the values of various stakeholders affected by AI systems, and monitoring compliance with the agreement. In short, ‘SITL = HITL + Social Contract.’. (shrink)

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)

Every day, new warnings emerge about artificial intelligence rebelling against us. All the while, a more immediate dilemma flies under the radar. Have forces been unleashed that are thrusting humanity down an ill-advised path, one that's increasingly making us behave like simple machines? In this wide-reaching, interdisciplinary book, Brett Frischmann and Evan Selinger examine what's happening to our lives as society embraces big data, predictive analytics, and smart environments. They explain how the goal of designing programmable worlds goes hand in (...) hand with engineering predictable and programmable people. Detailing new frameworks, provocative case studies, and mind-blowing thought experiments, Frischmann and Selinger reveal hidden connections between fitness trackers, electronic contracts, social media platforms, robotic companions, fake news, autonomous cars, and more. This powerful analysis should be read by anyone interested in understanding exactly how technology threatens the future of our society, and what we can do now to build something better. (shrink)

Should we give moral standing to machines? In this paper, I explore the implications of a relational approach to moral standing for thinking about machines, in particular autonomous, intelligent robots. I show how my version of this approach, which focuses on moral relations and on the conditions of possibility of moral status ascription, provides a way to take critical distance from what I call the “standard” approach to thinking about moral status and moral standing, which is based on properties. It (...) does not only overcome epistemological problems with the standard approach, but can also explain how we think about, experience, and act towards machines—including the gap that sometimes occurs between reasoning and experience. I also articulate the non-Cartesian orientation of my “relational” research program and specify the way it contributes to a different paradigm in thinking about moral standing and moral knowledge. (shrink)

As artificial intelligence becomes ubiquitous, it will be increasingly involved in novel, morally significant situations. Thus, understanding what it means for a machine to be morally responsible is important for machine ethics. Any method for ascribing moral responsibility to AI must be intelligible and intuitive to the humans who interact with it. We argue that the appropriate approach is to determine how AIs might fare on a standard account of human moral responsibility: a Strawsonian account. We make no claim that (...) our Strawsonian approach is either the only one worthy of consideration or the obviously correct approach, but we think it is preferable to trying to marry fundamentally different ideas of moral responsibility into a single cohesive account. Under a Strawsonian framework, people are morally responsible when they are appropriately subject to a particular set of attitudes—reactive attitudes—and determine under what conditions it might be appropriate to subject machines to this same set of attitudes. Although the Strawsonian account traditionally applies to individual humans, it is plausible that entities that are not individual humans but possess these attitudes are candidates for moral responsibility under a Strawsonian framework. We conclude that weak AI is never morally responsible, while a strong AI with the right emotional capacities may be morally responsible. (shrink)

Automated technologies and robots make decisions that cannot always be fully controlled or predicted. In addition to that, they cannot respond to punishment and blame in the ways humans do. Therefore, when automated cars harm or kill people, for example, this gives rise to concerns about responsibility-gaps and retribution-gaps. According to Sven Nyholm, however, automated cars do not pose a challenge on human responsibility, as long as humans can control them and update them. He argues that the agency exercised in (...) automated cars should be understood in terms of human–robot collaborations. This brief note focuses on the problem that arises when there are multiple people involved, but there is no obvious shared collaboration among them. Building on John Danaher’s discussion of command responsibility, it is argued that, although Nyholm might be right that autonomous cars cannot be regarded as acting on their own, independently of any human beings, worries about responsibility-gaps and retribution-gaps are still justified, because it often remains unclear how to allocate or distribute responsibility satisfactorily among the key humans involved after they have been successfully identified. (shrink)