The intention of this paper is to point to the dilemma humanity may face in light of AI advancements. The dilemma is whether to create a world with less evil or maintain the human status of moral agents. This dilemma may arise as a consequence of using automated decision-making systems for high-stakes decisions. The use of automated decision-making bears the risk of eliminating human moral agency and autonomy and reducing humans to mere moral patients. On the other hand, it also (...) has the potential to bring tremendous benefits to humanity by decreasing human-induced harm in the world. After presenting how this dilemma may arise, I explore general avenues for addressing it. I will argue that we do not have to solve this dilemma in an all-or-nothing fashion and that a more nuanced approach may be suitable. However, the main point I want to highlight is that we need to have a principled way of addressing this dilemma, which is currently missing. (shrink)

Human beings are internally inconsistent in various ways. One way to develop this thought involves using the language of value alignment: the values we hold are not always aligned with our behavior, and are not always aligned with each other. Because of this self-misalignment, there is room for potential projects of human enhancement that involve achieving a greater degree of value alignment than we presently have. Relatedly, discussions of AI ethics sometimes focus on what is known as the value alignment (...) problem, the challenge of how to build AI that acts in accordance with our human values. We argue that there is an especially close connection between solving the value alignment problem in AI ethics and using AI to pursue certain forms of human enhancement. But in addition, we also argue that there are important limits to what kinds of human enhancement can be pursued in this way, because some forms of human enhancement—namely moral revolutions—involve a kind of value misalignment rather than alignment. (shrink)

This paper discusses two opposing views about the relation between artificial intelligence (AI) and human intelligence: on the one hand, a worry that heavy reliance on AI technologies might make people less intelligent and, on the other, a hope that AI technologies might serve as a form of cognitive enhancement. The worry relates to the notion that if we hand over too many intelligence-requiring tasks to AI technologies, we might end up with fewer opportunities to train our own intelligence. Concerning (...) AI as a potential form of cognitive enhancement, the paper explores two possibilities: (1) AI as extending—and thereby enhancing—people’s minds, and (2) AI as enabling people to behave in artificially intelligent ways. That is, using AI technologies might enable people to behave as if they have been cognitively enhanced. The paper considers such enhancements both on the level of individuals and on the level of groups. (shrink)

This paper offers an overview of the prospects and ethics of using AI to achieve human enhancement, and more broadly what we call intellectual augmentation (IA). After explaining the central notions of human enhancement, IA, and AI, we discuss the state of the art in terms of the main technologies for IA, with or without brain-computer interfaces. Given this picture, we discuss potential ethical problems, namely inadequate performance, safety, coercion and manipulation, privacy, cognitive liberty, authenticity, and fairness in more detail. (...) We conclude that while there are very significant technical hurdles to real human enhancement through AI, and significant ethical problems, there are also significant benefits that may realistically be achieved in ways that are consonant with a rights-based ethics as well. We also highlight the specific concerns that apply particularly to applications of AI for "sheer" IA (more realistic in the near term), and to enhancement applications, respectively. (shrink)

In most domains of human life, we are willing to accept that there are experts with greater knowledge and competencies that distinguish them from non-experts or laypeople. Despite this fact, the very recognition of expertise curiously becomes more controversial in the case of “moral experts”. Do moral experts exist? And, if they indeed do, are there ethical reasons for us to follow their advice? Likewise, can emerging technological developments broaden our very concept of moral expertise? In this article, we begin (...) by arguing that the objections that have tried to deny the existence (and convenience) of moral expertise are unsatisfactory. After that, we show that people have ethical reasons to ask for a piece of moral advice in daily life situations. Then, we argue that some Artificial Intelligence (AI) systems can play an increasing role in human morality by becoming moral experts. Some AI-based moral assistants can qualify as artificial moral experts and we would have good ethical reasons to use them. (shrink)

The paper presents an ethical analysis and constructive critique of the current practice of AI ethics. It identifies conceptual substantive and procedural challenges and it outlines strategies to address them. The strategies include countering the hype and understanding AI as ubiquitous infrastructure including neglected issues of ethics and justice such as structural background injustices into the scope of AI ethics and making the procedures and fora of AI ethics more inclusive and better informed with regard to philosophical ethics. These measures (...) integrate the perspective of AI justice into AI ethics, strengthening its capacity to provide comprehensive normative orientation and guidance for the development and use of AI that actually improves human lives and living together. (shrink)

Tackling climate change is one of the most demanding challenges of humanity in the 21st century. Still, the efforts to mitigate the current environmental crisis do not seem enough to deal with the increased existential risks for the human and other species. Persson and Savulescu have proposed that our evolutionarily forged moral psychology is one of the impediments to facing as enormous a problem as global warming. They suggested that if we want to address properly some of the most pressing (...) problems that cause catastrophic harm to our existence, we should enhance our moral behavior by biomedical means. The objective of this paper is, precisely, to reflect on whether a Moral Bio-Enhancement (henceforth MBE) program would be a viable option to confront the climate emergency. To meet this goal, I will propose the Ultimate Mostropic (hereafter UM) thought experiment, a hypothetical situation where we have already discovered the UM, an available, safe (without any deleterious secondary effects), extremely cheap and effective pill to enhance our cognitive, affective and motivational abilities related to morality. After briefly presenting the main argument of Persson and Savulescu regarding MBE and climate change, I will point out some of the difficulties that make MBE a daunting but exciting philosophical and scientific debate. In order to overcome these complications, I will describe the UM thought experiment, which involves two scenarios of the MBE program: (a) the state-driven, compulsory and universal enterprise, and (b) the initiative of voluntary individuals. I will show that the shortcomings of MBE programs through the UM in both scenarios make Persson and Savulescu’s proposal a not appealing pathway to mitigate climate change. In the final section, I will suggest that an inaccurate attribution of responsibilities underlies their proposal and that the collective inaction problem should be redirected primarily through a reinforcement of the political nature of the solutions. (shrink)

Conversational Artificial Intelligence (CAI) systems (also known as AI “chatbots”) are among the most promising examples of the use of technology in mental health care. With already millions of users worldwide, CAI is likely to change the landscape of psychological help. Most researchers agree that existing CAIs are not “digital therapists” and using them is not a substitute for psychotherapy delivered by a human. But if they are not therapists, what are they, and what role can they play in mental (...) health care? To answer these questions, we appeal to two well-established and widely discussed concepts: cognitive and affective artifacts. Cognitive artifacts are artificial devices contributing functionally to the performance of a cognitive task. Affective artifacts are objects which have the capacity to alter subjects’ affective state. We argue that therapeutic CAIs are a kind of cognitive-affective artifacts which contribute to positive therapeutic change by (i) simulating a (quasi-)therapeutic interaction, (ii) supporting the performance of cognitive tasks, and (iii) altering the affective condition of their users. This sheds new light on why virtually all existing mental health CAIs implement principles and techniques of Cognitive Behavioral Therapy — a therapeutic orientation according to which affective change and, ultimately, positive therapeutic change is mediated by cognitive change. Simultaneously, it allows us to conceptualize better the potential and limitations of applying these technologies in therapy. (shrink)

This article discusses the datafied embodiment of the Internet of Bodies (IoB) technology by applying the methodology of postphenomenology. Firstly, the author claims that the boundaries of dual distinction between real and virtual, online and offline, and embodiment and disembodiment have become increasingly blurred. Secondly, the author argues that postphenomenology can help us to study today’s emerging technologies’ mediating role in human–world relations. Thirdly, the author analyses the implication of embodiment from phenomenological and postphenomenological perspectives and then demonstrates in what (...) sense the data collected from the IoB devices can constitute our embodiment and selfhood. Fourthly, the author elucidates how the IoB devices are datafying our bodies and the whole lifeworld and how these devices mediate and transform our religious practices and experiences. Fifthly, the author points out that the Quantified Religion as the possible new religious model would smooth out the differences and diversities between religions and then create homogeneous religious data selves, which will mediate, reshape, constitute and even replace our physical selves. Ultimately, the author argues that responsible designing of the IoB devices and establishing the ownership of personal religious data can be seen as significant measures in the face of the risk of our quantified religious future. Contribution: This article contributes to understanding the potential religious transformations caused by the IoB technology. This article analyses the mediating role the IoB technology plays in the relationship between humans and the world through a postphenomenological perspective, thereby explaining how body data harvested from the IoB devices can datafy and constitute our embodiment and selfhood. The article argues that the Quantified Religion as a new religious model will emerge in the future IoB era, and it will mediate, constitute and shape our religious practices and experiences through personal data harvesting and analysis. (shrink)

Moral enhancement proposals struggle to be both plausible and ethically defensible while nevertheless interestingly distinct from both cognitive enhancement as well as (mere) moral education. Brian Earp (_Royal Institute of Philosophy Supplement_ 83:415–439, 12 ) suggests that a promising middle ground lies in focusing on the (suitably qualified) use of psychedelics as _adjuncts_ to moral development. But what would such an adjunctive use of psychedelics look like in practice? In this paper, I draw on literature from three areas where techniques (...) for moral development have been discussed: psychotherapy (e.g., Overholser 2010; Burns 1980) education (e.g., Uhl and Lütge, 2018), and AI-assisted enhancement (e.g., Lara and Deckers, _Neuroethics_ 13(3):275–287, 17 ) in order to propose more concrete ways in which to use psychedelics as adjuncts to moral development. It is shown that in each of these areas, we can see that _trusting_ relationships (e.g., Baier 1986; Hawley 2019) between the facilitator and the agent will very plausibly maximize the success of this type of moral enhancement. Finally, I appeal to literature on informed consent for use of psychedelics (e.g., Smith and Sisti, _Journal of Medical Ethics_, 22 ; Johnson et al., _The Journal of Psychopharmacology_ 22(6):603–20, 23 ) and on the therapeutic relationship in psychotherapy (e.g., Dryden and Reeves 2013; Horvath et al. 2011) to outline concrete suggestions for facilitating dimensions of trust most likely to maximize the benefits of (adjunctive) psychedelic moral enhancement. The result is a newly detailed practical proposal for how we might best facilitate moral enhancement by using drugs as adjuncts to moral development. (shrink)

Departing from the claim that AI needs to be trustworthy, we find that ethical advice from an AI-powered algorithm is trusted even when its users know nothing about its training data and when they learn information about it that warrants distrust. We conducted online experiments where the subjects took the role of decision-makers who received advice from an algorithm on how to deal with an ethical dilemma. We manipulated the information about the algorithm and studied its influence. Our findings suggest (...) that AI is overtrusted rather than distrusted. We suggest digital literacy as a potential remedy to ensure the responsible use of AI. (shrink)

This paper focuses on the potential of “equitech”—AI technology that improves equity. Recently, interventions have been developed to reduce the harm of implicit bias, the automatic form of stereotype or prejudice that contributes to injustice. However, these interventions—some of which are assisted by AI-related technology—have significant limitations, including unintended negative consequences and general inefficacy. To overcome these limitations, we propose a two-dimensional framework to assess current AI-assisted interventions and explore promising new ones. We begin by using the case of human (...) resource recruitment as a focal point to show that existing approaches have exploited only a subset of the available solution space. We then demonstrate how our framework facilitates the discovery of new approaches. The first dimension of this framework helps us systematically consider the analytic information, intervention implementation, and modes of human-machine interaction made available by advancements in AI-related technology. The second dimension enables the identification and incorporation of insights from recent research on implicit bias intervention. We argue that a design strategy that combines complementary interventions can further enhance the effectiveness of interventions by targeting the various interacting cognitive systems that underlie implicit bias. We end with a discussion of how our cognitive interventions framework can have positive downstream effects for structural problems. (shrink)

Several proposals for moral enhancement would use AI to augment (auxiliary enhancement) or even supplant (exhaustive enhancement) human moral reasoning or judgment. Exhaustive enhancement proposals conceive AI as some self-contained oracle whose superiority to our own moral abilities is manifest in its ability to reliably deliver the ‘right’ answers to all our moral problems. We think this is a mistaken way to frame the project, as it presumes that we already know many things that we are still in the process (...) of working out, and reflecting on this fact reveals challenges even for auxiliary proposals that eschew the oracular approach. We argue there is nonetheless a substantial role that ‘AI mentors’ could play in our moral education and training. Expanding on the idea of an AI Socratic Interlocutor, we propose a modular system of multiple AI interlocutors with their own distinct points of view reflecting their training in a diversity of concrete wisdom traditions. This approach minimizes any risk of moral disengagement, while the existence of multiple modules from a diversity of traditions ensures pluralism is preserved. We conclude with reflections on how all this relates to the broader notion of moral transcendence implicated in the project of AI moral enhancement, contending it is precisely the whole concrete socio-technical system of moral engagement that we need to model if we are to pursue moral enhancement. (shrink)

Deep learning AI systems have proven a wide capacity to take over human-related activities such as car driving, medical diagnosing, or elderly care, often displaying behaviour with unpredictable consequences, including negative ones. This has raised the question whether highly autonomous AI may qualify as morally responsible agents. In this article, we develop a set of four conditions that an entity needs to meet in order to be ascribed moral responsibility, by drawing on Aristotelian ethics and contemporary philosophical research. We encode (...) these conditions and generate a flowchart that we call the Moral Responsibility Test. This test can be used as a tool both to evaluate whether an entity is a morally responsible agent and to inform human moral decision-making over the influencing variables of the context of action. We apply the test to the case of Artificial Moral Advisors and conclude that this form of AI cannot qualify as morally responsible agents. We further discuss the implications for the use of AMAs as moral enhancement and show that using AMAs to offload human responsibility is inadequate. We argue instead that AMAs could morally enhance users if they are interpreted as enablers for moral knowledge of the contextual variables surrounding human moral decision-making, with the implication that such a use might actually enlarge human moral responsibility. (shrink)

It has been suggested that neuroenhancements could be used to improve the abilities of criminal justice authorities. Judges could be made more able to make adequately informed and unbiased decisions, for example. Yet, while such a prospect appears appealing, the views of neuroenhanced criminal justice authorities could also be alien to the unenhanced public. This could compromise the legitimacy and functioning of the criminal justice system. In this article, I assess possible solutions to this problem. I maintain that none of (...) them qualifies as a satisfactory general solution to it, a solution that could reasonably be taken to solve the problem or to suffice for dealing with it in at least most cases. Yet I also suggest that, depending on contingent empirical circumstances, the responses – either singly or together – can sometimes amount to a sufficient answer to it. (shrink)

Many of our daily activities are now made more convenient and efficient by virtual assistants, and the day when they can be designed to instruct us in certain skills, such as those needed to make moral judgements, is not far off. In this paper we ask to what extent it would be ethically acceptable for these so-called virtual assistants for moral enhancement to use subtle strategies, known as “nudges”, to influence our decisions. To achieve our goal, we will first characterise (...) nudges in their standard use and discuss the debate they have generated around their possible manipulative character, establishing three conditions of manipulation. Secondly, we ask whether nudges can occur in moral virtual assistants that are not manipulative. After critically analysing some proposed virtual assistants, we argue in favour of one of them, given that by pursuing an open and neutral moral enhancement, it promotes and respects the autonomy of the person as much as possible. Thirdly, we analyse how nudges could enhance the functioning of such an assistant, and evaluate them in terms of their degree of threat to the subject’s autonomy and their level of transparency. Finally, we consider the possibility of using motivational nudges, which not only help us in the formation of moral judgements but also in our moral behaviour. (shrink)

In the present article, I will advocate caution against developing artificial moral agents based on the notion that the utilization of preliminary forms of AMAs will potentially negatively feed back on the human social system and on human moral thought itself and its value—e.g., by reinforcing social inequalities, diminishing the breadth of employed ethical arguments and the value of character. While scientific investigations into AMAs pose no direct significant threat, I will argue against their premature utilization for practical and economical (...) use. I will base my arguments on two thought experiments. The first thought experiment deals with the potential to generate a replica of an individual’s moral stances with the purpose to increase, what I term, ’moral efficiency’. Hence, as a first risk, an unregulated utilization of premature AMAs in a neoliberal capitalist system is likely to disadvantage those who cannot afford ’moral replicas’ and further reinforce social inequalities. The second thought experiment deals with the idea of a ’moral calculator’. As a second risk, I will argue that, even as a device equally accessible to all and aimed at augmenting human moral deliberation, ’moral calculators’ as preliminary forms of AMAs are likely to diminish the breadth and depth of concepts employed in moral arguments. Again, I base this claim on the idea that the current most dominant economic system rewards increases in productivity. However, increases in efficiency will mostly stem from relying on the outputs of ’moral calculators’ without further scrutiny. Premature AMAs will cover only a limited scope of moral argumentation and, hence, over-reliance on them will narrow human moral thought. In addition and as the third risk, I will argue that an increased disregard of the interior of a moral agent may ensue—a trend that can already be observed in the literature. (shrink)

It has been suggested that neuroenhancements could be used to improve the abilities of criminal justice authorities. Judges could be made more able to make adequately informed and unbiased decisions, for example. Yet, while such a prospect appears appealing, the views of neuroenhanced criminal justice authorities could also be alien to the unenhanced public. This could compromise the legitimacy and functioning of the criminal justice system. In this article, I assess possible solutions to this problem. I maintain that none of (...) them qualifies as a satisfactory general solution to it, a solution that could reasonably be taken to solve the problem or to suffice for dealing with it in at least most cases. Yet I also suggest that, depending on contingent empirical circumstances, the responses – either singly or together – can sometimes amount to a sufficient answer to it. (shrink)

Can Artificial Intelligence be more effective than human instruction for the moral enhancement of people? The author argues that it only would be if the use of this technology were aimed at increasing the individual's capacity to reflectively decide for themselves, rather than at directly influencing behaviour. To support this, it is shown how a disregard for personal autonomy, in particular, invalidates the main proposals for applying new technologies, both biomedical and AI-based, to moral enhancement. As an alternative to these (...) proposals, this article proposes a virtual assistant that, through dialogue, neutrality and virtual reality technologies, can teach users to make better moral decisions on their own. The author concludes that, as long as certain precautions are taken in its design, such an assistant could do this better than a human instructor adopting the same educational methodology. (shrink)

The ongoing debate about moral bioenhancement has been exceptionally stimulating, but it is defined by extreme polarization and lack of consensus about any relevant aspect of MBE. This article reviews the discussion on MBE, showing that a lack of consensus about enhancements’ desirable features and the constant development of the debate calls for a more rigorous ethical analysis. I identify a list of factors that may be of crucial importance for illuminating the matters of moral permissibility in the MBE debate (...) and which could help us move beyond the current lack of consensus. More precisely, I propose three important theoretical and normative standards that MBE should satisfy if we wish to mitigate the concerns about its utter impermissibility. Systematically assessing MBE interventions across the presented categories should provide valuable conclusions about its theoretical soundness and feasibility, its compatibility with fundamental moral norms, and its compatibility with or facilitation of socio-political goals of equality and justice. (shrink)