Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of (...) our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence. (shrink)

Consequentialism is the view that the rightness or wrongness of actions depend solely on their consequences. It is one of the most influential, and controversial, of all ethical theories. In this book, Julia Driver introduces and critically assesses consequentialism in all its forms. After a brief historical introduction to the problem, Driver examines utilitarianism, and the arguments of its most famous exponents, John Stuart Mill and Jeremy Bentham, and explains the fundamental questions underlying utilitarian theory: what value is to be (...) specified and how it is to be maximized. Driver also discusses indirect forms of consequentialism, the important theories of motive consequentialism and virtue consequentialism, and explains why the distinction between subjective and objective consequentialism is so important. Including helpful features such as a glossary, chapter summaries, and annotated further reading at the end of each chapter, Consequentialism is ideal for students seeking an authoritative and clearly explained survey of this important problem. (shrink)

The goal of this paper is to frame a theory of reasons--what they are, how they support actions or conclusions--using the tools of default logic. After sketching the basic account of reasons as provided by defaults, I show how it can be elaborated to deal with two more complicated issues: first, situations in which the priority relation among defaults, and so reasons as well, is itself established through default reasoning; second, the treatment of undercutting defeat and exclusionary reasons. Finally, and (...) by way of application, I show how the resulting account can shed some light on Jonathan Dancy's argument from reason holism to a form of extreme particularism in moral theory. (shrink)

Scientists from various disciplines have begun to focus attention on the psychology and biology of human morality. One research program that has recently gained attention is universal moral grammar (UMG). UMG seeks to describe the nature and origin of moral knowledge by using concepts and models similar to those used in Chomsky's program in linguistics. This approach is thought to provide a fruitful perspective from which to investigate moral competence from computational, ontogenetic, behavioral, physiological and phylogenetic perspectives. In this article, (...) I outline a framework for UMG and describe some of the evidence that supports it. I also propose a novel computational analysis of moral intuitions and argue that future research on this topic should draw more directly on legal theory. (shrink)

The moral philosophy of the first half of the twentieth century, at least in the English-speaking part of the world, has been largely devoted to problems of an ontological or epistemological nature. This concentration of effort by many acute analytical minds has not produced any general agreement with respect to the solution of these problems; it seems likely, on the contrary, that the wealth of proposed solutions, each making some claim to plausibility, has resulted in greater disagreement than ever before, (...) and in some cases disagreement about issues so fundamental that certain schools of thought now find it unrewarding, if not impossible, to communicate with one another. Moral philosophers of almost all schools seem to agree, however, that no major possibility has been neglected during this period, and that every proposed solution which can be adjudged at all plausible has been examined with considerable thoroughness. It is now common practice, for example, for the authors of books on moral philosophy to introduce their own theories by what purports to be a classification and review of all \emph{possible} solutions to the basic problems of analysis; and in many cases, indeed, the primary defense of the author's own position seems to consist in the negative argument that his own position cannot fail to be correct because none of the others which he has mentioned is satisfactory. (shrink)

Cognitive scientists have identified a wide range of biases and heuristics in human decision making over the past few decades. Only recently have bioethicists begun to think seriously about the implications of these findings for topics such as agency, autonomy, and consent. This article aims to provide an overview of biases and heuristics that have been identified and a framework in which to think comprehensively about the impact of them on the exercise of autonomous decision making. I analyze the impact (...) that these biases and heuristics have on the following dimensions of autonomy: understanding, intentionality, absence of alienating or controlling influence, and match between formally autonomous preferences or decisions and actual choices or actions. (shrink)

Moral problems do not always come in the form of great social controversies. More often, the moral decisions we make are made quietly, constantly, and within the context of everyday activities and quotidian dilemmas. Indeed, these smaller decisions are based on a moral foundation that few of us ever stop to think about but which guides our every action. Here distinguished philosopher Bernard Gert presents a clear and concise introduction to what he calls "common morality" -- the moral system that (...) most thoughtful people implicitly use when making everyday, common sense moral decisions and judgments. Common Morality is useful in that -- while not resolving every disagreement on controversial issues -- it is able to distinguish between acceptable and unacceptable answers to moral problems. In the first part of the book Gert lays out the fundamental features of common morality: moral rules, moral ideals, and a two-step procedure for determining when a violation of a moral rule is justified. Written in a non-technical style, the ten general moral rules include rules on which everyone can agree, such as "do not kill," "do not deceive," and "keep your promises." The moral ideals include similarly uncontroversial precepts such as "Relieve pain" and "Aid the needy." In the second part of the book Gert examines the underlying concepts that justify common morality, such as the notions of rationality and impartiality. The distillation of over 40 years of scholarship, this book is the most accessible version of Gert's influential theory of morality as well as an eye-opening look at the moral foundations of our everyday actions. Throughout the discussion is clear enough for a reader with little or no philosophy background. (shrink)

When patients enrolled in early‐phase cancer treatment trials are asked later to explain their decision to participate, they often reveal unrealistically high expectations for therapeutic benefit from participation. This phenomenon has given rise to a complex and ongoing debate over the quality and validity of informed consent to these trials. Bioethicists and researchers must better understand these expectations and why research participants so often have them. This article presents a new explanation for this phenomenon by drawing on social psychology research (...) on mindsets and, in particular, on a distinction between deliberative and implementation mindsets. (shrink)