In this book, T. M. Scanlon offers new answers to these questions, as they apply to the central part of morality that concerns what we owe to each other.

The enhancement of human traits has received academic attention for decades, but only recently has moral enhancement using biomedical means – moral bioenhancement (MB) – entered the discussion. After explaining why we ought to take the possibility of MB seriously, the paper considers the shape and content of moral improvement, addressing at some length a challenge presented by reasonable moral pluralism. The discussion then proceeds to this question: Assuming MB were safe, effective, and universally available, would it be morally desirable? (...) In particular, would it pose an unacceptable threat to human freedom? After defending a negative answer to the latter question – which requires an investigation into the nature and value of human freedom – and arguing that there is nothing inherently wrong with MB, the paper closes with reflections on what we should value in moral behaviour. (shrink)

Many industry leaders and academics from the field of machine ethics would have us believe that the inevitability of robots coming to have a larger role in our lives demands that robots be endowed with moral reasoning capabilities. Robots endowed in this way may be referred to as artificial moral agents. Reasons often given for developing AMAs are: the prevention of harm, the necessity for public trust, the prevention of immoral use, such machines are better moral reasoners than humans, and (...) building these machines would lead to a better understanding of human morality. Although some scholars have challenged the very initiative to develop AMAs, what is currently missing from the debate is a closer examination of the reasons offered by machine ethicists to justify the development of AMAs. This closer examination is especially needed because of the amount of funding currently being allocated to the development of AMAs coupled with the amount of attention researchers and industry leaders receive in the media for their efforts in this direction. The stakes in this debate are high because moral robots would make demands on society; answers to a host of pending questions about what counts as an AMA and whether they are morally responsible for their behavior or not. This paper shifts the burden of proof back to the machine ethicists demanding that they give good reasons to build AMAs. The paper argues that until this is done, the development of commercially available AMAs should not proceed further. (shrink)

Many industry leaders and academics from the field of machine ethics would have us believe that the inevitability of robots coming to have a larger role in our lives demands that robots be endowed with moral reasoning capabilities. Robots endowed in this way may be referred to as artificial moral agents. Reasons often given for developing AMAs are: the prevention of harm, the necessity for public trust, the prevention of immoral use, such machines are better moral reasoners than humans, and (...) building these machines would lead to a better understanding of human morality. Although some scholars have challenged the very initiative to develop AMAs, what is currently missing from the debate is a closer examination of the reasons offered by machine ethicists to justify the development of AMAs. This closer examination is especially needed because of the amount of funding currently being allocated to the development of AMAs coupled with the amount of attention researchers and industry leaders receive in the media for their efforts in this direction. The stakes in this debate are high because moral robots would make demands on society; answers to a host of pending questions about what counts as an AMA and whether they are morally responsible for their behavior or not. This paper shifts the burden of proof back to the machine ethicists demanding that they give good reasons to build AMAs. The paper argues that until this is done, the development of commercially available AMAs should not proceed further. (shrink)

This paper explores the ambiguous impact of new information and communications technologies on the cultivation of moral skills in human beings. Just as twentieth century advances in machine automation resulted in the economic devaluation of practical knowledge and skillsets historically cultivated by machinists, artisans, and other highly trained workers , while also driving the cultivation of new skills in a variety of engineering and white collar occupations, ICTs are also recognized as potential causes of a complex pattern of economic deskilling, (...) reskilling, and upskilling. In this paper, I adapt the conceptual apparatus of sociological debates over economic deskilling to illuminate a different potential for technological deskilling/upskilling, namely the ability of ICTs to contribute to the moral deskilling of human users, a potential that exists alongside rich but currently underrealized possibilities for moral reskilling and/or upskilling. I flesh out this general hypothesis by means of examples involving automated weapons technology, new media practices, and social robotics. I conclude that since moral skills are essential prerequisites for the effective development of practical wisdom and virtuous character, and since market and cultural forces are not presently aligned to bring about the more salutary of the ambiguous potentials presented here, the future shape of these developments warrants our close attention—and perhaps active intervention. (shrink)

Moral enhancement is an ostensibly laudable project. Who wouldn’t want people to become more moral? Still, the project’s approach is crucial. We can distinguish between two approaches for moral enhancement: direct and indirect. Direct moral enhancements aim at bringing about particular ideas, motives or behaviors. Indirect moral enhancements, by contrast, aim at making people more reliably produce the morally correct ideas, motives or behaviors without committing to the content of those ideas, motives and/or actions. I will argue, on Millian grounds, (...) that the value of disagreement puts serious pressure on proposals for relatively widespread direct moral enhancement. A more acceptable path would be to focus instead on indirect moral enhancements while staying neutral, for the most part, on a wide range of substantive moral claims. I will outline what such indirect moral enhancement might look like, and why we should expect it to lead to general moral improvement. (shrink)

This book originated as lectures for a course on political philosophy that Rawls taught regularly at Harvard in the 1980s.

This paper critically assesses the possibility of moral enhancement with ambient intelligence technologies and artificial intelligence presented in Savulescu and Maslen (2015). The main problem with their proposal is that it is not robust enough to play a normative role in users’ behavior. A more promising approach, and the one presented in the paper, relies on an artifi-cial moral reasoning engine, which is designed to present its users with moral arguments grounded in first-order normative theories, such as Kantianism or utilitarianism, (...) that reason-responsive people can be persuaded by. This proposal can play a normative role and it is also a more promising avenue towards moral enhancement. It is more promising because such a system can be designed to take advantage of the sometimes undue trust that people put in automated technologies. We could therefore expect a well-designed moral reasoner system to be able to persuade people that may not be persuaded by similar arguments from other people. So, all things considered, there is hope in artificial intelli-gence for moral enhancement, but not in artificial intelligence that relies solely on ambient intelligence technologies. (shrink)

This paper considers, firstly, to what extent the administration of oxytocin can augment the capacity of empathy in human beings; and secondly, whether or not such practice ought to be allowed. In relation to the latter, the author develops an argument in favour of this intervention by virtue of its consistency with the belief that, if a therapeutic treatment is to be considered acceptable, it is essential that it maximizes the well-being of those affected and that it does not compromise (...) the autonomy of the patient. Having rejected several objections related to the nature of this intervention, the author finally questions its morality on the basis of a concern with its universalizability. (shrink)

This paper identifies human enhancement as one of the most significant areas of bioethical interest in the last twenty years. It discusses in more detail one area, namely moral enhancement, which is generating significant contemporary interest. The author argues that so far from being susceptible to new forms of high tech manipulation, either genetic, chemical, surgical or neurological, the only reliable methods of moral enhancement, either now or for the foreseeable future, are either those that have been in human and (...) animal use for millennia, namely socialization, education and parental supervision or those high tech methods that are general in their application. By that is meant those forms of cognitive enhancement that operate across a wide range of cognitive abilities and do not target specifically ‘ethical’ capacities. The paper analyses the work of some of the leading contemporary advocates of moral enhancement and finds that in so far as they identify moral qualities or moral emotions for enhancement they have little prospect of success. (shrink)

We describe a form of moral artificial intelligence that could be used to improve human moral decision-making. We call it the “artificial moral advisor”. The AMA would implement a quasi-relativistic version of the “ideal observer” famously described by Roderick Firth. We describe similarities and differences between the AMA and Firth’s ideal observer. Like Firth’s ideal observer, the AMA is disinterested, dispassionate, and consistent in its judgments. Unlike Firth’s observer, the AMA is non-absolutist, because it would take into account the human (...) agent’s own principles and values. We argue that the AMA would respect and indeed enhance individuals’ moral autonomy, help individuals achieve wide and a narrow reflective equilibrium, make up for the limitations of human moral psychology in a way that takes conservatives’ objections to human bioenhancement seriously, and implement the positive functions of intuitions and emotions in human morality without their downsides, such as biases and prejudices. (shrink)

Is morality rational? In this book Gauthier argues that moral principles are principles of rational choice. He proposes a principle whereby choice is made on an agreed basis of cooperation, rather than according to what would give an individual the greatest expectation of value. He shows that such a principle not only ensures mutual benefit and fairness, thus satisfying the standards of morality, but also that each person may actually expect greater utility by adhering to morality, even though the choice (...) did not have that end primarily in view. In resolving what may appear to be a paradox, the author establishes morals on the firm foundation of reason. Gauthier's argument includes an account of value, linking it to preference and utility; a discussion of the curcumstances in which morality is unnecessary; and an application of morals by agreement to relations between peoples at different levels of development and different generations. Finally, he reflects on the assumptions about individuality and community made by his account of rationality and morality. (shrink)

One of the reasons why moral enhancement may be controversial, is because the advantages of moral enhancement may fall upon society rather than on those who are enhanced. If directed at individuals with certain counter-moral traits it may have direct societal benefits by lowering immoral behavior and increasing public safety, but it is not directly clear if this also benefits the individual in question. In this paper, we will discuss what we consider to be moral enhancement, how different means may (...) be used to achieve it and whether the means we employ to reach moral enhancement matter morally. Are certain means to achieve moral enhancement wrong in themselves? Are certain means to achieve moral enhancement better than others, and if so, why? More specifically, we will investigate whether the difference between direct and indirect moral enhancement matters morally. Is it the case that indirect means are morally preferable to direct means of moral enhancement and can we indeed pinpoint relevant intrinsic, moral differences between both? We argue that the distinction between direct and indirect means is indeed morally relevant, but only insofar as it tracks an underlying distinction between active and passive interventions. Although passive interventions can be ethical provided specific safeguards are put in place, these interventions exhibit a greater potential to compromise autonomy and disrupt identity. (shrink)

The moral philosophy of the first half of the twentieth century, at least in the English-speaking part of the world, has been largely devoted to problems of an ontological or epistemological nature. This concentration of effort by many acute analytical minds has not produced any general agreement with respect to the solution of these problems; it seems likely, on the contrary, that the wealth of proposed solutions, each making some claim to plausibility, has resulted in greater disagreement than ever before, (...) and in some cases disagreement about issues so fundamental that certain schools of thought now find it unrewarding, if not impossible, to communicate with one another. Moral philosophers of almost all schools seem to agree, however, that no major possibility has been neglected during this period, and that every proposed solution which can be adjudged at all plausible has been examined with considerable thoroughness. It is now common practice, for example, for the authors of books on moral philosophy to introduce their own theories by what purports to be a classification and review of all \emph{possible} solutions to the basic problems of analysis; and in many cases, indeed, the primary defense of the author's own position seems to consist in the negative argument that his own position cannot fail to be correct because none of the others which he has mentioned is satisfactory. (shrink)

Opponents of biomedical enhancement often claim that, even if such enhancement would benefit the enhanced, it would harm others. But this objection looks unpersuasive when the enhancement in question is a moral enhancement — an enhancement that will expectably leave the enhanced person with morally better motives than she had previously. In this article I (1) describe one type of psychological alteration that would plausibly qualify as a moral enhancement, (2) argue that we will, in the medium-term future, probably be (...) able to induce such alterations via biomedical intervention, and (3) defend future engagement in such moral enhancements against possible objections. My aim is to present this kind of moral enhancement as a counter-example to the view that biomedical enhancement is always morally impermissible. (shrink)

Unfit for the Future argues that the future of our species depends on radical enhancement of the moral aspects of our nature. Population growth and technological advances are threatening to undermine the conditions of worthwhile life on earth forever. We need to modify the biological bases of human motivation to deal with this challenge.

Presenting a look at the human mind's capacity while criticizing artificial intelligence, the author makes suggestions about classical and quantum physics and ..

It is possible to survey humankind and be proud, even to smile, for we accomplish great things. Art and science are two notable worthy human accomplishments. Consonant with art and science are some of the ways we treat each other. Sacrifice and heroism are two admirable human qualities that pervade human interaction. But, as everyone knows, all this goodness is more than balanced by human depravity. Moral corruption infests our being. Why?

As arti® cial intelligence moves ever closer to the goal of producing fully autonomous agents, the question of how to design and implement an arti® cial moral agent (AMA) becomes increasingly pressing. Robots possessing autonomous capacities to do things that are useful to humans will also have the capacity to do things that are harmful to humans and other sentient beings. Theoretical challenges to developing arti® cial moral agents result both from controversies among ethicists about moral theory itself, and from (...) computational limits to the implementation of such theories. In this paper the ethical disputes are surveyed, the possibility of a `moral Turing Test ’ is considered and the computational di culties accompanying the diŒerent types of approach are assessed. Human-like performance, which is prone to include immoral actions, may not be acceptable in machines, but moral perfection may be computationally unattainable. The risks posed by autonomous machines ignorantly or deliberately harming people and other sentient beings are great. The development of machines with enough intelligence to assess the eŒects of their actions on sentient beings and act accordingly may ultimately be the most important task faced by the designers of arti® cially intelligent automata. (shrink)