The ethics of autonomous cars and automated driving have been a subject of discussion in research for a number of years :28–58, 2016). As levels of automation progress, with partially automated driving already becoming standard in new cars from a number of manufacturers, the question of ethical and legal standards becomes virulent. For exam-ple, while automated and autonomous cars, being equipped with appropriate detection sensors, processors, and intelligent mapping material, have a chance of being much safer than human-driven cars in (...) many regards, situations will arise in which accidents cannot be completely avoided. Such situations will have to be dealt with when programming the software of these vehicles. In several instances, internationally, regulations have been passed, based on legal considerations of road safety, mostly. However, to date, there have been few, if any, cases of a broader ethics code for autonomous or automated driving preceding actual regulation and being based on a broadly composed ethics committee of independent experts. In July 2016, the German Federal Minister of Transport and Digital Infrastructure, Alexander Dobrindt, appointed a national ethics committee for automated and connected driving, which began its work in September 2016. In June 2017, this committee presented a code of ethics which was published in German and in English. It consists of 20 ethical guidelines. Having been a member of this committee, I will present the main ethical topics of these guidelines and the discussions that lay behind them. (shrink)

The convergence of computing, sensing, and communication technology will soon permit large-scale deployment of self-driving vehicles. This will in turn permit a radical transformation of traffic control technology. This paper makes a case for the importance of addressing questions of social justice in this transformation, and sketches a preliminary framework for doing so. We explain how new forms of traffic control technology have potential implications for several dimensions of social justice, including safety, sustainability, privacy, efficiency, and equal access. Our central (...) focus is on efficiency and equal access as desiderata for traffic control design. We explain the limitations of conventional traffic control in meeting these desiderata, and sketch a preliminary vision for a next-generation traffic control tailored to address better the demands of social justice. One component of this vision is cooperative, hierarchically distributed self-organization among vehicles. Another component of this vision is a priority system enabling selection of priority levels by the user for each vehicle trip in the network, based on the supporting structure of non-monetary credits. (shrink)

Self-driving cars hold out the promise of being safer than manually driven cars. Yet they cannot be a 100 % safe. Collisions are sometimes unavoidable. So self-driving cars need to be programmed for how they should respond to scenarios where collisions are highly likely or unavoidable. The accident-scenarios self-driving cars might face have recently been likened to the key examples and dilemmas associated with the trolley problem. In this article, we critically examine this tempting analogy. We identify three important ways (...) in which the ethics of accident-algorithms for self-driving cars and the philosophy of the trolley problem differ from each other. These concern: the basic decision-making situation faced by those who decide how self-driving cars should be programmed to deal with accidents; moral and legal responsibility; and decision-making in the face of risks and uncertainty. In discussing these three areas of disanalogy, we isolate and identify a number of basic issues and complexities that arise within the ethics of the programming of self-driving cars. (shrink)

In der 1785 veröffentlichten Grundlegung zur Metaphysik der Sitten formuliert Kant erstmals die Prinzipien einer universalistischen Ethik der Autonomie, deren Einfluß bis heute ungebrochen ist. Schon beim Übergang von der gemeinen zur philosophischen Vernunfterkenntnis findet man die Hauptgedanken: In der Ethik geht es nicht primär um das gute Leben und das Glück, und es geht auch zunächst nicht darum, welche Handlungserfolge erzielt werden; Gegenstand moralischer Hochschätzung sind vielmehr Intentionen und Maximen. Gut ist, was für alle vernünftigen Wesen gilt, weil es (...) von ihnen als autonomen und vernünftigen Wesen gewollt wird. Die Schrift ist kurz, einfach gegliedert und verständlich geschrieben. Sie eignet sich daher als Einführung in Kants Ethik, enthält aber zugleich als Grundlegung alle wesentlichen Gedanken seiner praktischen Philosophie. Auf der Grundlage der Originalausgabe von 1785/86 wurde der Text völlig neu erstellt. Eines der wichtigsten Bücher der Philosophiegeschichte liegt damit in einer zuverlässigen und preisgünstigen Neuausgabe vor. (shrink)

Moral Failure: On the Impossible Demands of Morality asks what happens when the sense that "I must" collides with the realization that "I can't." Bringing together philosophical and empirical work in moral psychology, Lisa Tessman here examines moral requirements that are non-negotiable and that contravene the principle that "ought implies can.".

One of the reasons why most of us feel puzzled about the problem of abortion is that we want, and do not want, to allow to the unborn child the rights that belong to adults and children. When we think of a baby about to be born it seems absurd to think that the next few minutes or even hours could make so radical a difference to its status; yet as we go back in the life of the fetus we (...) are more and more reluctant to say that this is a human being and must be treated as such. No doubt this is the deepest source of our dilemma, but it is not the only one. For we are also confused about the general question of what we may and may not do where the interests of human beings conflict. We have strong intuitions about certain cases; saying, for instance, that it is all right to raise the level of education in our country, though statistics allow us to predict that a rise in the suicide rate will follow, while it is not all right to kill the feeble-minded to aid cancer research. It is not easy, however, to see the principles involved, and one way of throwing light on the abortion issue will be by setting up parallels involving adults or children once born. So we will be able to isolate the “equal rights” issue and should be able to make some advance... (shrink)

A strong tradition in philosophy denies the possibility of moral dilemmas. Recently, several philosophers reversed this tradition. In this dissertation, I clarify some fundamental issues in this debate, argue for the possibility of moral dilemmas, and determine some implications of this possibility. ;In chapter I, I define moral dilemmas roughly as situations where an agent morally ought to adopt each of two alternatives but cannot adopt both. Moral dilemmas are resolvable if and only if one of the moral oughts overrides (...) the other. ;In chapter II, I criticize several opponents of moral dilemmas, including utilitarians, Kant, Aquinas, and Ross. My main criticism is that no opponent of moral dilemmas can adequately justify moral residue . ;Chapters III and IV concern the two main arguments against the possibility of moral dilemmas. First, the argument for 'ought' implies 'can' runs as follows. If the agent cannot adopt both, then it is not the case that the agent ought to adopt both. But the agent ought to adopt both, since the agent ought to adopt each . Thus, the defining judgements of a moral dilemma seem to imply a contradiction. In response, I argue that the relation between 'ought' and 'can' is not a logical implication but a conversational implicature. ;Chapter IV concerns the argument from 'ought' implies 'permitted': If the agent ought to adopt one alternative, then the agent is permitted to adopt that alternative, which means that it is not the case that the agent ought not to adopt that alternative. But the agent ought not to adopt that alternative, since the agent ought to adopt the other alternative and cannot adopt both. I respond that 'ought' does not logically imply but conversationally implicates 'permitted'. ;In chapter V, I argue that, despite recent claims, both moral realism and anti-realism are compatible with the possibility of moral dilemmas. Thus, there are several reasons to accept and no reasons to deny the possibility of moral dilemmas. (shrink)

Moral dilemmas set a challenge for ethical theory. They are situations where agents seem to be under an obligation both to do, and to refrain from doing, a specific act. Are such situations possible? What is their exact nature? These are the questions that _Moral Dilemmas_ tries to answer. The book argues that moral theories should not allow for the possibility of irresolvable dilemmas, for situations in which no right answer exists. To this end, arguments seeking to prove the existence (...) of irresolvable dilemmas, especially the argument from the incommensurability of values, are discussed at length and refuted. The book shows that though on the normative level dilemmas are resolved, they typically involve a high moral cost for which there is no adequate compensation. This moral cost is the source of the regret and pain suffered by agents in moral dilemmas. Thus, moral dilemmas do not point to any inconsistency in our moral reasoning or theory, but to a problematic aspect of the human condition; at times, human beings are justified, and even required, to dirty their hands by behaving in ways that in ordinary situations would be strictly forbidden and condemned. (shrink)

Our lives are such that moral wrongdoing is sometimes inescapable for us. We have moral responsibilities to persons which may conflict and which it is wrong to violate even when they do conflict. Christopher W. Gowans argues that we must accept this conclusion if we are to make sense of our moral experience and the way in which persons are valuable to us. In defending this position, he critically examines the recent moral dilemmas debate. He maintains that what is important (...) in this debate is not whether there are irresolvable moral conflicts, but whether there are moral conflicts in which wrongdoing is unavoidable. Though it would be incoherent to conclude moral deliberation by deciding to perform incompatible actions, he argues that there is nothing incoherent in supposing that we have conflicting moral responsibilities. In this way, he shows that it is possible to capture the intuitions of those who have defended the idea of moral dilemmas while meeting the objections of those who have rejected this idea. Gowans carefully evaluates utilitarian and Kantian analyses of moral dilemmas. He argues that these approaches eliminate genuine moral conflict only by displacing persons as direct objects of moral concern. As an alternative, he develops a more concrete account in which moral responsibilities to persons are central. The book also includes discussions of Melville's Billy Budd, methodology in moral philosophy, moral pluralism, moral tragedy, and "dirty hands" in politics. (shrink)

Mainstream moral theories deal with situations in which the outcome of each possible action is well-determined and knowable. In order to make ethics relevant for problems of risk and uncertainty, moral theories have to be extended so that they cover actions whose outcomes are not determinable beforehand. One approach to this extension problem is to develop methods for appraising probabilistic combinations of outcomes. This approach is investigated and shown not to solve the problem. An alternative approach is then developed. Its (...) starting-point is that everyone has a prima facie moral right not to be exposed to risk. However, this right can be overridden if the risk-exposure is part of an equitable system for risk-taking that works to the advantage of the individual risk-exposed person. (shrink)

With their prospect for causing both novel and known forms of damage, harm and injury, the issue of responsibility has been a recurring theme in the debate concerning autonomous vehicles. Yet, the discussion of responsibility has obscured the finer details both between the underlying concepts of responsibility, and their application to the interaction between human beings and artificial decision-making entities. By developing meaningful distinctions and examining their ramifications, this article contributes to this debate by refining the underlying concepts that together (...) inform the idea of responsibility. Two different approaches are offered to the question of responsibility and autonomous vehicles: targeting and risk distribution. The article then introduces a thought experiment which situates autonomous vehicles within the context of crash optimisation impulses and coordinated or networked decision-making. It argues that guiding ethical frameworks overlook compound or aggregated effects which may arise, and which can lead to subtle forms of structural discrimination. Insofar as such effects remain unrecognised by the legal systems relied upon to remedy them, the potential for societal inequalities is increased and entrenched, situations of injustice and impunity may be unwittingly maintained. This second set of concerns may represent a hitherto overlooked type of responsibility gap arising from inadequate accountability processes capable of challenging systemic risk displacement. (shrink)

This article puts forward solutions to some of the ethical and legal dilemmas posed in the current discussion on how to program crash algorithms in autonomous or self-driving cars. The first part of the paper defines the scope of the problem in the criminal legal field, and the next section gives a critical analysis of the proposal to always prioritise the interest of the occupant of the vehicle in situations with conflict of interests. The principle of minimizing social damage as (...) a model for configuring self-driving cars is examined in the third section. Despite its apparent plausibility, within the framework of a liberal legal system that recognises humans as free agents who have rights and responsibilities, maximizing the function of social utility does not justify harmful interference into a person’s legal sphere. Therefore, in the fourth part, the author argues the need to program the crash algorithms of autonomous cars based on a deontological understanding of the system of justifications in criminal law. The solution to the dilemma lies in a prior analysis of the legal positions of all agents involved in the conflict, from a perspective of the principles of autonomy and solidarity as the core of the system of justifications. (shrink)

Autonomous vehicles must be programmed with procedures for dealing with trolley-style dilemmas where actions result in harm to either pedestrians or passengers. This paper outlines a Rawlsian algorithm as an alternative to the Utilitarian solution. The algorithm will gather the vehicle’s estimation of probability of survival for each person in each action, then calculate which action a self-interested person would agree to if he or she were in an original bargaining position of fairness. I will employ Rawls’ assumption that the (...) Maximin procedure is what self-interested agents would use from an original position, and then show how the Maximin procedure can be operationalized to produce unique outputs over probabilities of survival. (shrink)

Moral dilemmas set a challenge for ethical theory. They are situations where agents seem to be under an obligation both to do, and to refrain from doing, a specific act. Are such situations possible? What is their exact nature? These are the questions that _Moral Dilemmas_ tries to answer. The book argues that moral theories should not allow for the possibility of irresolvable dilemmas, for situations in which no right answer exists. To this end, arguments seeking to prove the existence (...) of irresolvable dilemmas, especially the argument from the incommensurability of values, are discussed at length and refuted. The book shows that though on the normative level dilemmas are resolved, they typically involve a high moral cost for which there is no adequate compensation. This moral cost is the source of the regret and pain suffered by agents in moral dilemmas. Thus, moral dilemmas do not point to any inconsistency in our moral reasoning or theory, but to a problematic aspect of the human condition; at times (probably less often than is usually believed), human beings are justified, and even required, to dirty their hands by behaving in ways that in ordinary situations would be strictly forbidden and condemned. (shrink)

The recent progress in the development of autonomous cars has seen ethical questions come to the forefront. In particular, life and death decisions regarding the behavior of self-driving cars in trolley dilemma situations are attracting widespread interest in the recent debate. In this essay we want to ask whether we should implement a mandatory ethics setting for the whole of society or, whether every driver should have the choice to select his own personal ethics setting. While the consensus view seems (...) to be that people would not be willing to use an automated car that might sacrifice themselves in a dilemma situation, we will defend the somewhat contra-intuitive claim that this would be nevertheless in their best interest. The reason is, simply put, that a PES regime would most likely result in a prisoner’s dilemma. (shrink)

Name der Zeitschrift: Jahrbuch für Wissenschaft und Ethik Jahrgang: 19 Heft: 1 Seiten: 5-24.

This paper surveys the current philosophical discussion of the ethics of risk imposition, placing it in the context of relevant work in psychology, economics and social theory. The central philosophical problem starts from the observation that it is not practically possible to assign people individual rights not to be exposed to risk, as virtually all activity imposes some risk on others. This is the ‘problem of paralysis’. However, the obvious alternative theory that exposure to risk is justified when its total (...) benefits exceed its total costs faces the standard distributional challenges of consequentialism. Forms of contractualism have been proposed as a solution, but how exactly such theories can be formulated remains problematic, especially when confronted with the difficult cases of mass, novel, risk such as climate change. (shrink)

Some of the major problems in radiation protection are closely connected to issues that have a long, independent tradition in moral philosophy. This contribution focuses on two of these issues. One is the relationship between the protection of individuals and optimisation on the collective level, and the other is the relative valuation of future versus immediate damage. Some of the intellectual tools that have been developed by philosophers can be useful in radiation protection. On the other hand, philosophers have much (...) to learn from radiation protectors, not least when it comes to finding pragmatic solutions to problems that may be intractable in principle. (shrink)

Accidents involving autonomous vehicles raise difficult ethical dilemmas and legal issues. It has been argued that self-driving cars should be programmed to kill, that is, they should be equipped with pre-programmed approaches to the choice of what lives to sacrifice when losses are inevitable. Here we shall explore a different approach, namely, giving the user/passenger the task of deciding what ethical approach should be taken by AVs in unavoidable accident scenarios. We thus assume that AVs are equipped with what we (...) call an “Ethical Knob”, a device enabling passengers to ethically customise their AVs, namely, to choose between different settings corresponding to different moral approaches or principles. Accordingly, AVs would be entrusted with implementing users’ ethical choices, while manufacturers/programmers would be tasked with enabling the user’s choice and ensuring implementation by the AV. (shrink)