This chapter examines the possibility of using AI technologies to improve human moral reasoning and decision-making, especially in the context of purchasing and consumer decisions. We characterize such AI technologies as artificial ethics assistants (AEAs). We focus on just one part of the AI-aided moral improvement question: the case of the individual who wants to improve their morality, where what constitutes an improvement is evaluated by the individual’s own values. We distinguish three broad areas in which an individual might think (...) their own moral reasoning and decision-making could be improved: one’s actions, character, or other evaluable attributes fall short of one’s values and moral beliefs; one sometimes misjudges or is uncertain about what the right thing to do is in particular situations, given one’s values; one is uncertain about some fundamental moral questions or recognizes a possibility that some of one’s core moral beliefs and values are mistaken. We sketch why one might think that AI tools could be used to support moral improvement in those areas, and describe two types of assistance: preparatory assistance, including advice and training supplied in advance of moral deliberation; and on-the-spot assistance, including on-the-spot advice and facilitation of moral functioning over the course of moral deliberation. Then, we turn to some of the ethical issues that AEAs might raise, looking in particular at three under-appreciated problems posed by the use of AI for moral self-improvement: namely, reliance on sensitive moral data; the inescapability of outside influences on AEAs; and AEA usage prompting the user to adopt beliefs and make decisions without adequate reasons. (shrink)

Some skeptics question the very possibility of moral bioenhancement by arguing that if we lack a widely acceptable notion of morality, we will not be able to accept the use of a biotechnological technique as a tool for moral bioenhancement. I will examine this skepticism and argue that the assessment of moral bioenhancement does not require such a notion of morality. In particular, I will demonstrate that this skepticism can be neutralized in the case of recent neurofeedback techniques. This goal (...) will be accomplished in four steps. First, I will draw an outline of the skepticism against the possibility of moral bioenhancement and point out that a long-lasting dispute among moral philosophers nourishes this skepticism. Second, I will survey recent neurofeedback techniques and outline their three features: the variety of the target human faculties, such as emotion, cognition, and behavior; the flexibility or personalizability of the target brain state; and the nonclinical application of neurofeedback techniques. Third, I will argue that, by virtue of these three unique features, neurofeedback techniques can be a tool for moral bioenhancement without adopting any specific notion of morality. Fourth, I will examine the advantages and threats that neurofeedback-based moral enhancement may have. Finally, I will conclude that neurofeedback-based moral enhancement can become a new and promising tool for moral bioenhancement and requires further ethical investigations on its unique features. (shrink)

Scientific progress in recent neurofeedback research may bring about a new type of moral neuroenhancement, namely, neurofeedback-based moral enhancement; however, this has yet to be examined thoroughly. This paper presents an ethical analysis of the possibility of neurofeedback-based moral enhancement and demonstrates that this type of moral enhancement sheds new light on the moral enhancement debate. First, I survey this debate and extract the typical structural flow of its arguments. Second, by applying structure to the case of neurofeedback-based moral enhancement, (...) I examine the ethical, legal, and social issues to show that this technique is unique and traditionalist, which makes it compatible with almost all our conservative notions, so that it, accordingly, can be seen as an ethically acceptable option. Third, by rejecting the premise in the moral enhancement debate that bio/neuro-enhancement has its unique ELSI that traditional methods would never create, I demonstrate that, by virtue of its traditional or conservative features, neurofeedback-based moral enhancement can be incorporated into the traditional moral education network. Finally, I conclude that, being a part of the traditional moral education network, neurofeedback-based moral enhancement can be a unique and ethically acceptable option of moral neuroenhancement. (shrink)

In this chapter, we introduce the notion of “moral neuroenhancement,” offering a novel definition as well as spelling out three conditions under which we expect that such neuroenhancement would be most likely to be permissible (or even desirable). Furthermore, we draw a distinction between first-order moral capacities, which we suggest are less promising targets for neurointervention, and second-order moral capacities, which we suggest are more promising. We conclude by discussing concerns that moral neuroenhancement might restrict freedom or otherwise “misfire,” and (...) argue that these concerns are not as damning as they may seem at first. (shrink)

This paper aims to analyze technical and internal aspects of one particular type of human moral enhancement, i.e. enhancement of moral motivation via direct emotion modulation. More precisely, it challenges the assumption that modifying certain emotions will have the results desired by the advocates of this theory. It is argued that neuropsychological understanding of the role and function of emotions, as well as of underlying cognitive mechanisms, might be relevant for the discussion about biomedical enhancement of moral capacities. Moreover, typical (...) claims about direct emotion modulation seem to be contradicted, or at least seriously challenged, by available neuroscientific data. Particular attention is paid to the theory that emotions are evolved and functionally specialized programs whose task is to coordinate other adaptive mechanisms of human psychology in order to promote one’s fitness. If this view of emotions is plausible, it can be argued that several difficulties for moral bioenhancement theory ensue. Neuroscientific and evolutionary-psychological perspective seem to indicate that emotions don’t fulfill necessary requirements to serve as the vehicles of moral enhancement and it should, therefore, take into account role and function of entire cognitive modules associated with moral decision-making. (shrink)

Moral enhancement is an ostensibly laudable project. Who wouldn’t want people to become more moral? Still, the project’s approach is crucial. We can distinguish between two approaches for moral enhancement: direct and indirect. Direct moral enhancements aim at bringing about particular ideas, motives or behaviors. Indirect moral enhancements, by contrast, aim at making people more reliably produce the morally correct ideas, motives or behaviors without committing to the content of those ideas, motives and/or actions. I will argue, on Millian grounds, (...) that the value of disagreement puts serious pressure on proposals for relatively widespread direct moral enhancement. A more acceptable path would be to focus instead on indirect moral enhancements while staying neutral, for the most part, on a wide range of substantive moral claims. I will outline what such indirect moral enhancement might look like, and why we should expect it to lead to general moral improvement. (shrink)

This chapter reviews recent philosophical and neuroethical literature on the morality of moral neuroenhancements. It first briefly outlines the main moral arguments that have been made concerning moral status neuroenhancements. These are neurointerventions that would augment the moral status of human persons. It then surveys recent debate regarding moral desirability neuroenhancements: neurointerventions that augment that the moral desirability of human character traits, motives or conduct. This debate has contested, among other claims (i) Ingmar Persson and Julian Savulescu’s contention that there (...) is a moral imperative to pursue the development of moral desirability neuroenhancements, (ii) Thomas Douglas’ claim that voluntarily undergoing moral desirability neuroenhancements would often be morally permissible, and (iii) David DeGrazia’s claim that moral desirability neuroenhancements would often be morally desirable. The chapter discusses a number of concerns that have been raised regarding moral desirability neuroenhancements, including concerns that they would restrict freedom, would produce only a superficial kind of moral improvement, would rely on technologies that are liable to be misused, and would frequently misfire, resulting in moral deterioration rather than moral improvement. (shrink)

The debate on the ethical aspects of moral bioenhancement focuses on the desirability of using biomedical as opposed to traditional means to achieve moral betterment. The aim of this paper is to systematically review the ethical reasons presented in the literature for and against moral bioenhancement.

In this article, I argue that as we learn more about how we might intervene in the brain in ways that impact human behavior, the scope of what counts as “moral behavior” becomes smaller and smaller because things we successfully manipulate using evidence-based science are often things that fall outside the sphere of morality. Consequently, the argument that we are morally obligated to morally enhance our neighbors starts to fall apart, not because humans should be free to make terrible choices, (...) but because morality is not something subject to such manipulation. To illustrate my argument, I shall use the rise of veteran diversion courts in the United States as a putative instance of an intervention designed to change human behavior for the better. Part of my purpose in working my way through this case study is to demonstrate that many philosophers have the psychology of immoral action wrong. (shrink)

To gain insight into the reasons that the public may have for endorsing or eschewing pharmacological moral enhancement for themselves or for others, we used empirical tools to explore public attitudes towards these issues. Participants from the United States were recruited via Amazon’s Mechanical Turk and were randomly assigned to read one of several contrastive vignettes in which a 13-year-old child is described as bullying another student in school and then is offered an empathy-enhancing program. The empathy-enhancing program is described (...) as either involving taking a pill or playing a video game on a daily basis for four weeks. In addition, participants were asked to imagine either their own child bullying another student at school, or their own child being bullied by another student. This resulted in a 2 × 2 between-subjects design. In an escalating series of morally challenging questions, we asked participants to rate their overall support for the program; whether they would support requiring participation; whether they would support requiring participation of children who are at higher risk to become bullies in the future; whether they would support requiring participation of all children or even the entire population; and whether they would be willing to participate in the program themselves. We found that people were significantly more troubled by pharmacological as opposed to non-pharmacological moral enhancement interventions. The results indicate that members of the public for the greater part oppose pharmacological moral bioenhancement, yet are open to non-biomedical means to attain moral enhancement. [248 words]. (shrink)

Recently there has been some discussion concerning a particular type of enhancement, namely ‘moral enhancement’. However, there is no consensus on what precisely constitutes moral enhancement, and as a result the concept is used and defined in a wide variety of ways. In this article, we develop a clarificatory taxonomy of these definitions and we identify the criteria that are used to delineate the concept. We think that the current definitions can be distinguished from each other by the criteria used (...) for determining whether an intervention is indeed moral enhancement. For example, some definitions are broad and include moral enhancement by any means, while other definitions focus only on moral enhancement by means of specific types of intervention. Moreover, for some definitions it suffices for an intervention to be aimed or intended to morally enhance a person, while other definitions only refer to ‘moral enhancement’ in relation to interventions that are actually effective. For all these differences in definitions we discuss some of their implications. This shows that definitions are significantly less descriptive and more normative than they are regularly portrayed to be. We therefore hope that the taxonomy developed in this paper and the comments on the implications for the normative debate of the variety of definitions will provide conceptual clarity in a complex and highly interesting debate. (shrink)

We propose to expand the conversation around moral enhancement from direct brain-altering methods to include technological means of modifying the environments and media through which agents can achieve moral improvement. Virtual Reality (VR) based enhancement would not bypass a person’s agency, much less their capacity for reasoned reflection. It would allow agents to critically engage with moral insights occasioned by a technologically mediated intervention. Users would gain access to a vivid ‘experience machine’ that allows for embodied presence and immersion in (...) a virtual world that meaningfully replicates relevant aspects of real life. We explore how VR can train empathy and foster moral growth in complex ways that would be inaccessible even for traditional moral education. Virtual Reality Perspective Taking is a unique medium for making empathy more reflective. (shrink)

The ongoing debate about moral bioenhancement has been exceptionally stimulating, but it is defined by extreme polarization and lack of consensus about any relevant aspect of MBE. This article reviews the discussion on MBE, showing that a lack of consensus about enhancements’ desirable features and the constant development of the debate calls for a more rigorous ethical analysis. I identify a list of factors that may be of crucial importance for illuminating the matters of moral permissibility in the MBE debate (...) and which could help us move beyond the current lack of consensus. More precisely, I propose three important theoretical and normative standards that MBE should satisfy if we wish to mitigate the concerns about its utter impermissibility. Systematically assessing MBE interventions across the presented categories should provide valuable conclusions about its theoretical soundness and feasibility, its compatibility with fundamental moral norms, and its compatibility with or facilitation of socio-political goals of equality and justice. (shrink)

Our present moral traits are unable to provide the level of large-scale co-operation necessary to deal with risks such as nuclear proliferation, drastic climate change and pandemics. In order to survive in an environment with powerful and easily available technologies, some authors claim that we need to improve our moral traits with moral enhancement. But this is prone to produce paradoxical effects, be self-reinforcing and harm personal identity. The risks of moral enhancement require the use of a safety framework; such (...) a framework should guarantee practical robustness to moral uncertainty, empirical adequacy, correct balance between dispositions, preservation of identity, and be sensitive to practical considerations such as emergent social effects. A virtue theory can meet all these desiderata. Possible frameworks incorporate them to variable degrees. The social value orientations framework is one of the most promising candidates. (shrink)

Some bioethicists have argued that moral bioenhancement, complementing traditional means of enhancing individuals’ moral dispositions, is essential if we are to survive as a species. Traditional means of moral enhancement have historically included civil legislation, socially recognized moral exemplars, religious teachings and disciplines, and familial upbringing. I explore the necessity and feasibility of pursuing methods of moral bioenhancement as a complement to such traditional means, grounding my analysis within a virtue-theoretic framework. Specifically, I focus on the essential intellectual virtue for (...) proper moral reasoning, prudence, and whether proposed methods of moral bioenhancement could facilitate the cultivation of this virtue within the psyches of moral agents. I conclude that certain means of bioenhancement may serve to augment the ability to reason prudentially and assist moral agents to align their wills with their higher-order rational desires, though such means require those higher-order desires to already have been formulated independently. (shrink)

Current suggestions for capacities that should be targeted for moral enhancement has centered on traits like empathy, fairness or aggression. The literature, however, lacks a proper model for understanding the interplay and complexity of moral capacities, which limits the practicability of proposed interventions. In this paper, I integrate some existing knowledge on the nature of human moral behavior and present a formal model of prosocial motivation. The model provides two important results regarding the most friction-free route to moral enhancement. First, (...) we should consider decreasing self-interested motivation rather than increasing prosociality directly. Second, this should be complemented with cognitive enhancement. These suggestions are tested against existing and emerging evidence on cognitive capacity, mindfulness meditation and the effects of psychedelic drugs and are found to have sufficient grounding for further theoretical and empirical exploration. Furthermore, moral effects of the latter two are hypothesized to result from a diminished sense of self with subsequent reductions in self-interest. (shrink)

In Unfit for the Future, Ingmar Persson and Julian Savulescu present a sophisticated argument in defense of the imperative of moral enhancement. They claim that without moral enhancement, the future of humanity is seriously compromised. The possibility of ultimate harm, caused by a dreadful terrorist attack or by a final unpreventable escalation of the present environmental crisis aggravated by the availability of cognitive enhancement, makes moral enhancement a top priority. It may be considered optimistic to think that our present moral (...) capabilities can be successfully improved by means of moral education, moral persuasion, and fear of punishment. So, without moral enhancement, drastic restrictions on human freedom would become the only alternative to prevent those dramatic potential outcomes. In this article, I will try to show that we still have reason to be less pessimistic and that Persson & Savulescu’s arguments are fortunately unconvincing. (shrink)

Animal models are used in experiments in the behavioural neurosciences that aim to contribute to the prevention and treatment of cognitive and affective disorders in human beings, such as anxiety and depression. Ironically, those animals that are likely to be the best models for psychopathology are also likely to be considered the ones that are most morally problematic to use, if it seems probable that (and if indeed they are initially selected as models because) they have experiences that are similar (...) to human experiences that we have strong reasons to avoid causing, and indeed aim to alleviate (such as pain, anxiety or sadness). In this paper, against the background of contemporary discussions in animal ethics and the philosophy of animal minds, we discuss the views that it is morally permissible to use animals in these kinds of experiments, and that it is better to use less cognitively complex animals (such as zebrafish) than more complex animals (such as dogs). First, we criticise some justifications for the claim that human beings and more complex animals have higher moral status. We argue that contemporary approaches that attribute equal moral status to all beings that are capable of conscious strivings (e.g. avoiding pain and anxiety; aiming to eat and play) are based on more plausible assumptions. Second, we argue that it is problematic to assume that less cognitively complex animals have a lesser sensory and emotional experience than more complex beings across the board. In specific cases, there might be good reasons to assume that more complex beings would be harmed more by a specific physical or environmental intervention, but it might also be that they sometimes are harmed less because of a better ability to cope. Determining whether a specific experiment is justified is therefore a complex issue. Our aim in this chapter is to stimulate further reflection on these common assumptions behind the use of animal models for psychopathologies. In order to be able to draw more definite conclusions, more research will have to be done on the influence of cognitive complexity on the experience of (human and non-human) animals. (shrink)

In their recent bookUnfit for the Future, Persson and Savulescu make a heartfelt plea for the increasing necessity of “moral enhancement”, interventions that improve human capacities for moral behaviour.3They argue that, with all the technological advances of the 20thand 21stcenturies, the sheer scope of horror that humans can now potentially wreak on their neighbours or the world is staggering. Hence, we are morally obliged to use interventions at our disposal to prevent such atrocities. However, as we learn more about human (...) behaviour and decision-making, the argument that we are morally obligated to morally enhance our friends, neighbours, or countrymen starts to fall apart. For us to be more moral requires more than sharpening our reasoning capacities so that we can more effectively recognise what is better or increasing personal motivation so that we are more likely to do what is good. It requires that we all agree on what the good is and how to achieve it, and that there are no social, cultural, physical, or psychological impediments that prevent us from recognising the good or acting on it. To illustrate my position, I use the phenomenon of self-radicalised terrorists as a case study. In particular, I focus on how historians, psychologists, sociologists, criminologists, and political scientists understand the process of self-radicalisation, who self-radicalises, and why, and what all this tells us about it should be “treated”. Part of my purpose in working my way through this case study is to demonstrate that many philosophers misunderstand or over-simplify the science behind so-called immoral actions; consequently, their discussions of whether to enhance someone's morality miss their mark. (shrink)

I will argue that deep moral enhancement is relatively prone to unexpected consequences. I first argue that even an apparently straightforward example of moral enhancement such as increasing human co-operation could plausibly lead to unexpected harmful effects. Secondly, I generalise the example and argue that technological intervention on individual moral traits will often lead to paradoxical effects on the group level. Thirdly, I contend that insofar as deep moral enhancement targets higher-order desires, it is prone to be self-reinforcing and irreversible. (...) Fourthly, I argue that the complex causal history of moral traits, with its relatively high frequency of contingencies, indicates their fragility. Finally, I conclude that attempts at deep moral enhancement pose greater risks than other enhancement technologies. For example, one of the major problems that moral enhancement is hoped to address is lack of co-operation between groups. If humanity developed and distributed a drug that dramatically increased co-operation between individuals, we would likely see a paradoxical decrease in co-operation between groups and a self-reinforcing increase in the disposition to engage in further modifications – both of which are potential problems. (shrink)

How should ethics help decide the morality of enhancing morality? The idea of morally enhancing the human brain quickly emerged when the promise of cognitive enhancement in general began to seem realizable. However, on reflection, achieving moral enhancement must be limited by the practical challenges to any sort of cognitive modification, along with obstacles particular to morality’s bases in social cognition. The objectivity offered by the brain sciences cannot ensure the technological achievement of moral bioenhancement for humanity-wide application. Additionally, any (...) limited moral enhancement will not easily fulfil ethical expectations. Three hypothetical scenarios involving putative moral enhancement help illustrate why. Philosophical concerns about the “Does-Must Dichotomy” and the “Factor-Cause Plurality,” as I label them, forbid easy leaps from views about morality on to conclusions about ways to enhance morality, and then further on to ethically justifying those enhancements. A modest and realistic approach to moral enhancement emerges from exploring these issues. (shrink)

In the debate over moral bioenhancement, some object that biochemical, genetic, and neurological interventions aiming at enhancing moral agency threaten the autonomy of persons, as they compromise moral deliberation and motivation. Opponents of this view argue that such interventions may actually enhance autonomy itself, thereby increasing a person's capacity for moral agency. My aim is to explore the various senses of autonomy commonly appealed to in such controversies and to expose their limitations in resolving the central disputed issues. I propose (...) that a Kantian conception of autonomy is more effective in addressing these issues, as it specifies the key features that inform an intelligible account of moral worth and moral law. A consideration of these features is typically lacking in the arguments advanced by contenders in these debates. Guided by a Kantian framework, I argue that moral bioenhancement projects directed at affecting moral autonomy are not as promising as they appear, for both metaphysical and empirical reasons. (shrink)

In this chapter I will discuss some of the arguments presented inUnfit for the Future, where the authors stress the necessity of moral enhancement to prevent a global catastrophe. Persson and Savulescu promote a reductionistic view of moral intuitions suggesting that oxytocin, serotonin, and genetic treatments could save humanity from the perils of contemporary liberalism, weapons of mass destruction, and uncontrolled pollution. I will contend that although we need a moral enhancement it cannot be a brute manipulation of our biology (...) but something where human plasticity is seen as paramount. Following the lesson of Dewey's instrumentalism, I advocate a non-reductionistic, pluralistic view where neuroscientific data may be used to develop a more effective moral pedagogy. In my opinion, this prospect is currently much more feasible (and less risky) than a hypothetical mass psycho-civilisation created using drugs and electrodes. (shrink)

Enhancements for morality could become technologically practical at the expense of becoming unethical and uncivil. A mode of moral enhancement intensifying a person's imposition of conformity upon others, labeled here as “moral righteousness”, is particularly problematic. Moral energies contrary to expansions of civil rights and liberties can drown out reasoned justifications for equality and freedom, delaying social progress. The technological capacity of moral righteousness in the hands of a majority could impose puritanical conformities and override some rights and liberties. Fortunately, (...) there cannot be a human right or a civil right to access righteous moral enhancement, and governments would be prudent to forbid such technology for moral righteousness. From an enlarged perspective, less righteousness could lead to a more just society. Going further, if a neurological intervention for moral righteousness could be invented, so too could moral de-enhancement, here labeled as “moral toleration”. Perhaps moral toleration deserves as much commendation as so-called moral enhancement. Justice with less delay can be justice enhanced. (shrink)

The aim of this essay is to question the coherence of debates on moral enhancement by neurophysical or pharmaceutical means in the absence of a cogent conception of the object of moral scrutiny: namely, moral enhancement. I present two conceptions of moral enhancement—weak and strong—and argue that given the problem of acquiring a standard measure of moral enhancement, regardless of whether enhancement is present in its weak or strong form and regardless of whether one endorses moral realism or different forms (...) of antirealism, presenting a cogent conception of moral enhancement is fraught with difficulty. This fact has serious implications for continuing debates on the morality of moral enhancement, insofar as it limits the extent to which we have, or it is possible to have, an agreed conception of moral enhancement that could (in principle) be empirically verified and count as an object for moral scrutiny. (shrink)

Abstract:An integrated and principled neuroethics offers ethical guidelines able to transcend conventional and medical reliance on normality standards. Elsewhere we have proposed four principles for wise guidance on human transformations. Principles like these are already urgently needed, as bio- and cyberenhancements are rapidly emerging. Context matters. Neither “treatments” nor “enhancements” are objectively identifiable apart from performance expectations, social contexts, and civic orders. Lessons learned from disability studies about enablement and inclusion suggest a fresh way to categorize modifications to the body (...) and its performance. The term “enhancement” should be broken apart to permit recognition of enablements and augmentations, and kinds of radical augmentation for specialized performance. Augmentations affecting the self, self-worth, and self-identity of persons require heightened ethical scrutiny. Reversibility becomes the core problem, not the easy answer, as augmented persons may not cooperate with either decommissioning or displacement into unaccommodating societies. We conclude by indicating how our four principles of self-creativity, nonobsolescence, empowerment, and citizenship establish a neuroethics beyond normal that is better prepared for a future in which humans and their societies are going so far beyond normal. (shrink)

Moral enhancement techniques modifying brain processes to produce improved moral conduct present us with new challenges for how we grapple with the ethical questions raised. John Shook (2012) argues that we should greet these developments with some measure of skepticism and cynicism regarding their success and desirability. This commentary considers further Shook’s scepticism. It is argued that the issue of “moral enhancement” raises questions about which view(s) may benefit and the problems this poses for societies characterized by the fact of (...) reasonable pluralism. More importantly, it is further argued that moral enhancement runs into greater difficulties where enhancement is thought to contribute to alleviating illegal behavior. This is because law and morality are related imperfectly and, therefore, improved moral sensitivity may not translate into less illegality. Thus, moral enhancement techniques may create moral Frankensteins that (a) may undermine the existence of reasonable pluralism in modern liberal societies and (b) may fail to better achieve lawful behavior. (shrink)