This paper aims to clear up the epistemology of learning morality from Artificial Moral Advisors (AMAs). We start with a brief consideration of what counts as moral enhancement and consider the risk of deskilling raised by machines that offer moral advice. We then shift focus to the epistemology of moral advice and show when and under what conditions moral advice can lead to enhancement. We argue that people’s motivational dispositions are enhanced by inspiring (...) people to act morally, instead of merely telling them how to act. Drawing upon these insights, we claim that if AMAs are to genuinely enhance people morally, they should be designed as inspiration and not authority machines. In the final section, we evaluate existing AMA models to shed light on which holds the most promise for helping to make users better moral agents. (shrink)

Our rapidly increasing reliance on frictionless AI interactions may increase cognitive and emotional distance, thereby letting our adaptive resilience slacken and our ethical virtues atrophy from disuse. Many trends already well underway involve the offloading of cognitive, emotional, and ethical labor to AI software in myriad social, civil, personal, and professional contexts. Gradually, we may lose the inclination and capacity to engage in critically reflective thought, making us more cognitively and emotionally vulnerable and thus more anxious and prone to manipulation (...) from false news, deceptive advertising, and political rhetoric. In this article, I consider the overarching features of this problem and provide a framework to help AI designers tackle it through system enhancements in smartphones and other products and services in the burgeoning internet of things (IoT) marketplace. The framework is informed by two ideas: psychologist Daniel Kahneman’s cognitive dual process theory and moral self-awareness theory, a four-level model of moral identity that I developed with Benjamin M. Cole. (shrink)

The history of humankind is full of examples that indicate a constant desire to make human beings more moral. Nowadays, technological breakthroughs might have a significant impact on our moral character and abilities. This is the case of Virtual Reality (VR) technologies. The aim of this paper is to consider the ethical aspects of the use of VR in enhancing empathy. First, we will offer an introduction to VR, explaining its fundamental features, devices and concepts. Then, we will (...) approach the characterization of VR as an “empathy machine,” showing why this medium has aroused so much interest and why, nevertheless, we do not believe it is the ideal way to enhance empathy. As an alternative, we will consider fostering empathy-related abilities through virtual embodiment in avatars. In the conclusion, however, we will, we will examine some of the serious concerns related to the ethical relevance of empathy and will defend the philosophical case for a reason-guided empathy, also suggesting specific guidelines for possible future developments of empathy enhancement projects through VR embodied experiences. (shrink)

¿Puede la inteligencia artificial (IA) hacernos más morales o ayudarnos a tomar decisiones más éticas? El libro Más (que) humanos. Biotecnología, inteligencia artificial y ética de la mejora, editado por Francisco Lara y Julian Savulescu (2021), puede inspirarnos filosóficamente sobre este debate contemporáneo. En esta nota crítica, contextualizo la aportación general del volumen y analizo los dos últimos capítulos de Monasterio-Astobiza y de Lara y Deckers, quienes argumentan a favor del uso de la IA para hacernos mejores agentes morales. El (...) objetivo es ampliar y matizar críticamente algunas cuestiones clave sobre cómo la IA puede asistirnos para tomar decisiones más éticas. (shrink)

This article presents a robust defense of the concept of “datafied enhancement” as a subset of human enhancement. Firstly, the author notes that the widespread development of ICT and AI technologies has made it possible to collect and analyze human biometric data, thus integrating data into the concept of embodiment. Secondly, the author explores the cultural and intellectual history of datafied enhancement, highlighting the significant role data has played in human evolution. Thirdly, the author examines the functional (...) classifications of datafied enhancement, arguing that conversational, wearable, ingestible, and embeddable technological devices can enhance individuals’ physical, cognitive, emotional, and moral capacities by collecting body data. Fourthly, the author underscores the importance of distinguishing datafied enhancement from dataism to avoid misconceptions. Finally, the author addresses potential ethical issues, such as data exclusivity, the uncontrollable data self, and privacy invasion. By acknowledging these risks, datafied enhancement can be guided to become a technology that respects human dignity and promotes the common good. (shrink)

Artificial intelligence (AI), blockchain, virtual and augmented reality, (semi-)autonomous ve- hicles, autoregulatory weapon systems, enhancement, reproductive technologies and human- oid robotics – these technologies (and many others) are no longer speculative visions of the future; they have already found their way into our lives or are on the verge of a breakthrough. These rapid technological developments awaken a need for orientation: what distinguishes hu- man from machine and human intelligence from artificial intelligence, how far should the body be allowed (...) to be changed and what are the dangers and opportunities presented by these technologies? Many of these questions are also addressed to theology. For example, questions about the image of humanity, the understanding of creation, the ethics of technological body interventions or the moral status of robots. What does theology have to say about these technological developments? It is the right time for theology to scientifically explore tech- nologization and AI and to formulate answers. As technology changes the various areas of human life, society and the world around us, the places and topics of theology are also undergoing transformation. Puzio, Anna: Theology Meets AI: Examining Perspectives, Tasks, and Theses on the Intersection of Technology and Religion. In: Puzio, Anna/Kunkel, Nicole/Klinge, Hendrik (Hg.): Alexa, How Do You Feel About Religion? Theological Approaches to Technology and Artificial Intelligence (Theology and AI 1). Darmstadt: wbg 2023, S. 29–41. DOI: 10.53186/1030373. (shrink)

Autonomy has been central to moral and political philosophy for millenia, and has been positioned as a critical aspect of both justice and wellbeing. Research in psychology supports this position, providing empirical evidence that autonomy is critical to motivation, personal growth and psychological wellness. Responsible AI will require an understanding of, and ability to effectively design for, human autonomy (rather than just machine autonomy) if it is to genuinely benefit humanity. Yet the effects on human autonomy of digital experiences (...) are neither straightforward nor consistent, and are complicated by commercial interests and tensions around compulsive overuse. This multi-layered reality requires an analysis that is itself multidimensional and that takes into account human experience at various levels of resolution. We borrow from HCI and psychological research to apply a model (“METUX”) that identifies six distinct spheres of technology experience. We demonstrate the value of the model for understanding human autonomy in a technology ethics context at multiple levels by applying it to the real-world case study of an AI-enhanced video recommender system. In the process we argue for the following three claims: 1) There are autonomy-related consequences to algorithms representing the interests of third parties, and they are not impartial and rational extensions of the self, as is often perceived; 2) Designing for autonomy is an ethical imperative critical to the future design of responsible AI; and 3) Autonomy-support must be analysed from at least six spheres of experience in order to approriately capture contradictory and downstream effects. (shrink)

In this article, I use science-fiction scenarios drawn from Dan Simmons’ “Hyperion Cantos” (Hyperion, The Fall of Hyperion, Endymion, The Rise of Endymion) to explore a cluster of issues related to the evolutionary history and neural bases of human moral cognition, and the moral desirability of improving our ability to make moral decisions by techniques of neuroengineering. I begin by sketching a picture of what recent research can teach us about the character of human moral psychology, (...) with a particular emphasis on highlighting the importance of our evolutionary background as social mammals. I then consider how the moral psychology of intelligent machines might differ from our own, and argue that the differences would depend on the extent to which their evolutionary background resembled our own. I offer two very different case studies—the “Technocore AIs” that have evolved from early, parasitic computer programs, and the mysterious “Shrike,” who travels backward through time. I close by looking at the character of Aenea, a messianic figure that is a joint descendant of humans and machines. I argue that while the sort of “moral enhancement” she represents is far beyond the scope of either contemporary neuroscience or artificial intelligence research, it nevertheless represents a worthwhile goal. (shrink)

While philosophers are often concerned with the conditions for moral knowledge or justification, in practice something arguably less demanding is just as, if not more, important – reliably making correct moral judgments. Judges and juries should hand down fair sentences, government officials should decide on just laws, members of ethics committees should make sound recommendations, and so on. We want such agents, more often than not and as often as possible, to make the right decisions. The purpose of (...) this paper is to propose a method of enhancing the moral reliability of such agents. In particular, we advocate for a procedural approach; certain internal processes generally contribute to people’s moral reliability. Building on the early work of Rawls, we identify several particular factors related to moral reasoning that are specific enough to be the target of practical intervention: logical competence, conceptual understanding, empirical competence, openness, empathy and bias. Improving on these processes can in turn make people more morally reliable in a variety of contexts and has implications for recent debates over moral enhancement. (shrink)

John Harris recently argues that the moral bioenhancement proposed by Persson and Savulescu can damage moral agency by depriving the recipients of their freedom to fall (freedom to make wrongful choices) and therefore should not be pursued. The link Harris makes between moral agency and the freedom to fall, however, implies that all forms of moral enhancement, including moral education, that aim to make the enhancement recipients less likely to “fall” are detrimental to (...) moral agency. In this paper, I present a new moral agency-based critique against the moral bioenhancement program envisaged by Persson and Savulescu. I argue that the irresistible influences exerted by the bioenhancement program harms our capabilities for conducting accurate self-reflection and forming decisions that truly express our will, which subsequently undermine our moral agency. (shrink)

Moral enhancement is an ostensibly laudable project. Who wouldn’t want people to become more moral? Still, the project’s approach is crucial. We can distinguish between two approaches for moral enhancement: direct and indirect. Direct moral enhancements aim at bringing about particular ideas, motives or behaviors. Indirect moral enhancements, by contrast, aim at making people more reliably produce the morally correct ideas, motives or behaviors without committing to the content of those ideas, motives and/or (...) actions. I will argue, on Millian grounds, that the value of disagreement puts serious pressure on proposals for relatively widespread direct moral enhancement. A more acceptable path would be to focus instead on indirect moral enhancements while staying neutral, for the most part, on a wide range of substantive moral claims. I will outline what such indirect moral enhancement might look like, and why we should expect it to lead to general moral improvement. (shrink)

This paper explores the position that moral enhancement interventions could be medically indicated in cases where they provide a remedy for a lack of empathy, when such a deficit is considered pathological. In order to argue this claim, the question as to whether a deficit of empathy could be considered to be pathological is examined, taking into account the difficulty of defining illness and disorder generally, and especially in the case of mental health. Following this, Psychopathy and a (...) fictionalised mental disorder are explored with a view to consider moral enhancement techniques as possible treatments for both conditions. At this juncture, having asserted and defended the position that moral enhancement interventions could, under certain circumstances, be considered medically indicated, this paper then goes on to briefly explore some of the consequences of this assertion. First, it is acknowledged that this broadening of diagnostic criteria in light of new interventions could fall foul of claims of medicalisation. It is then briefly noted that considering moral enhancement technologies to be akin to therapies in certain circumstances could lead to ethical and legal consequences and questions, such as those regarding regulation, access, and even consent. (shrink)

Opponents to genetic or biomedical human enhancement often claim that the availability of these technologies would have negative consequences for those who either choose not to utilize these resources or lack access to them. However, Thomas Douglas has argued that this objection has no force against the use of technologies that aim to bring about morally desirable character traits, as the unenhanced would benefit from being surrounded by such people. I will argue that things are not as straightforward as (...) Douglas makes out. The widespread use of moral enhancement would raise the standards for praise and blame worthiness, making it much harder for the unenhanced to perform praiseworthy actions or avoid performing blameworthy actions. This shows that supporters of moral enhancement cannot avoid this challenge in the way that Douglas suggests. (shrink)

Recently, Brummett and Crutchfield advanced two critiques of theists who object to moral enhancement. First, a conceptual critique: theists who oppose moral enhancement commonly do so because virtue is thought to be acquired only via a special kind of process. Enhancement does not involve such processes. Hence, enhancement cannot produce virtue. Yet theists also commonly claim that God is perfectly virtuous and not subject to processes. If virtue requires a process and God is perfectly (...) virtuous without a process, however, then theists contradict themselves. Second, a moral critique: theists who reject moral enhancement are selfish, because accepting moral enhancement would (allegedly) reduce widespread suffering. Theists often condemn selfishness, however. By condemning selfishness and (simultaneously) rejecting enhancement, therefore, theists contradict themselves yet again. We argue that both critiques fail. Both substantially misrepresent their target. First, Brummett and Crutchfield confuse metaphysical enhancement (attempts to alter human nature) with moral enhancement (attempts to become better human beings). Authors that Brummett and Crutchfield cite object to the former, not the latter. Second, both conceptual and moral critiques overlook the many resources within theistic traditions that can quickly resolve relevant (alleged) contradictions. The conceptual critique, for example, misrepresents both common views held among theists (regarding God's virtue) and the ways in which virtue may be acquired. Similarly, the moral critique mischaracterizes the relationship commonly posited by theists between enhancement and agency. By attending to what theists actually claim—rather than relying on caricatures—it becomes clear that each of Brummett and Crutchfield's critiques fail. (shrink)

There is recent empirical evidence that personal identity is constituted by one’s moral traits. If true, this poses a problem for those who advocate for moral enhancement, or the manipulation of a person’s moral traits through pharmaceutical or other biological means. Specifically, if moral enhancement manipulates a person’s moral traits, and those moral traits constitute personal identity, then it is possible that moral enhancement could alter a person’s identity. I go (...) a step further and argue that under the right conditions, moral enhancement can constitute murder. I then argue that these conditions are not remote. (shrink)

A common objection to moral enhancement is that it would undermine our moral freedom and that this is a bad thing because moral freedom is a great good. Michael Hauskeller has defended this view on a couple of occasions using an arresting thought experiment called the 'Little Alex' problem. In this paper, I reconstruct the argument Hauskeller derives from this thought experiment and subject it to critical scrutiny. I claim that the argument ultimately fails because (a) (...) it assumes that moral freedom is an intrinsic good when, in fact, it is more likely to be an axiological catalyst; and (b) there are reasons to think that moral enhancement does not undermine moral freedom. (shrink)

The proposal of moral enhancement as a valuable means to face the environmental, technological and social challenges that threaten the future of humanity has been criticized by a number of authors. One of the main criticisms has been that moral enhancement would diminish our freedom. It has been said that moral enhancement would lead enhanced people to lose their ‘freedom to fall’, that is, it would prevent them from being able to decide to carry (...) out some morally bad actions, and the possibility to desire and carry out these bad actions is an essential ingredient of free will, which would thus be limited or destroyed—or so the argument goes. In this paper we offer an answer to this criticism. We contend that a morally enhanced agent could lose the ‘freedom to fall’ without losing her freedom for two reasons. First, because we do not consider that a morally well-educated person, for whom the ‘freedom to fall’ is a remote option, is less free than an evildoer, and there is no reason to suppose that bioenhancement introduces a significant difference here. Second, because richness in the amount of alternative possibilities of action may be restored if the stated loss is compensated with an improvement in sensitivity and lucidity that can lead to seeing new options and nuances in the remaining possible actions. (shrink)

Technology could be used to improve morality but it could do so in different ways. Some technologies could augment and enhance moral behaviour externally by using external cues and signals to push and pull us towards morally appropriate behaviours. Other technologies could enhance moral behaviour internally by directly altering the way in which the brain captures and processes morally salient information or initiates moral action. The question is whether there is any reason to prefer one method over (...) the other? In this article, I argue that there is. Specifically, I argue that internal moral enhancement is likely to be preferable to external moral enhancement, when it comes to the legitimacy of political decision-making processes. In fact, I go further than this and argue that the increasingly dominant forms of external moral enhancement may already be posing a significant threat to political legitimacy, one that we should try to address. Consequently, research and development of internal moral enhancements should be prioritised as a political project. (shrink)

Proponents of moral enhancement believe that we should pursue and apply biotechnological means to morally enhance human beings, as failing to do so is likely to lead to humanity's demise. Unsurprisingly, these proposals have generated a substantial amount of debate about the moral permissibility of using such interventions. Here I put aside concerns about the permissibility of moral enhancement and focus on the conceptual and evidentiary grounds for the moral enhancement project. I argue (...) that such grounds are quite precarious. (shrink)

This chapter examines the possibility of using AI technologies to improve human moral reasoning and decision-making, especially in the context of purchasing and consumer decisions. We characterize such AI technologies as artificial ethics assistants (AEAs). We focus on just one part of the AI-aided moral improvement question: the case of the individual who wants to improve their morality, where what constitutes an improvement is evaluated by the individual’s own values. We distinguish three broad areas in which an individual (...) might think their own moral reasoning and decision-making could be improved: one’s actions, character, or other evaluable attributes fall short of one’s values and moral beliefs; one sometimes misjudges or is uncertain about what the right thing to do is in particular situations, given one’s values; one is uncertain about some fundamental moral questions or recognizes a possibility that some of one’s core moral beliefs and values are mistaken. We sketch why one might think that AI tools could be used to support moral improvement in those areas, and describe two types of assistance: preparatory assistance, including advice and training supplied in advance of moral deliberation; and on-the-spot assistance, including on-the-spot advice and facilitation of moral functioning over the course of moral deliberation. Then, we turn to some of the ethical issues that AEAs might raise, looking in particular at three under-appreciated problems posed by the use of AI for moral self-improvement: namely, reliance on sensitive moral data; the inescapability of outside influences on AEAs; and AEA usage prompting the user to adopt beliefs and make decisions without adequate reasons. (shrink)

With the rise and public accessibility of AI-enabled decision-support systems, individuals outsource increasingly more of their decisions, even those that carry ethical dimensions. Considering this trend, scholars have highlighted that uncritical deference to these systems would be problematic and consequently called for investigations of the impact of pertinent technology on humans’ ethical decision-making. To this end, this article conducts a systematic review of existing scholarship and derives an integrated framework that demonstrates how intelligent decision-support systems (IDSSs) shape humans’ ethical decision-making. (...) In particular, we identify resulting consequences on an individual level (i.e., deliberation enhancement, motivation enhancement, autonomy enhancement and action enhancement) and on a societal level (i.e., moral deskilling, restricted moral progress and moral responsibility gaps). We carve out two distinct methods/operation types (i.e., processoriented and outcome-oriented navigation) that decision-support systems can deploy and postulate that these determine to what extent the previously stated consequences materialize. Overall, this study holds important theoretical and practical implications by establishing clarity in the conceptions, underlying mechanisms and (directions of) influences that can be expected when using particular IDSSs for ethical decisions. (shrink)

Scientific progress in recent neurofeedback research may bring about a new type of moral neuroenhancement, namely, neurofeedback-based moral enhancement; however, this has yet to be examined thoroughly. This paper presents an ethical analysis of the possibility of neurofeedback-based moral enhancement and demonstrates that this type of moral enhancement sheds new light on the moral enhancement debate. First, I survey this debate and extract the typical structural flow of its arguments. Second, by (...) applying structure to the case of neurofeedback-based moral enhancement, I examine the ethical, legal, and social issues to show that this technique is unique and traditionalist, which makes it compatible with almost all our conservative notions, so that it, accordingly, can be seen as an ethically acceptable option. Third, by rejecting the premise in the moral enhancement debate that bio/neuro-enhancement has its unique ELSI that traditional methods would never create, I demonstrate that, by virtue of its traditional or conservative features, neurofeedback-based moral enhancement can be incorporated into the traditional moral education network. Finally, I conclude that, being a part of the traditional moral education network, neurofeedback-based moral enhancement can be a unique and ethically acceptable option of moral neuroenhancement. (shrink)

Advocates of moral enhancement through pharmacological, genetic, or other direct interventions sometimes explicitly argue, or assume without argument, that traditional moral education and development is insufficient to bring about moral enhancement. Traditional moral education grounded in a Kohlbergian theory of moral development is indeed unsuitable for that task; however, the psychology of moral development and education has come a long way since then. Recent studies support the view that moral cognition is (...) a higher-order process, unified at a functional level, and that a specific moral faculty does not exist. It is more likely that moral cognition involves a number of different mechanisms, each connected to other cognitive and affective processes. Taking this evidence into account, we propose a novel, empirically informed approach to moral development and education, in children and adults, which is based on a cognitive-affective approach to moral dispositions. This is an interpretative approach that derives from the cognitive-affective personality system (Mischel and Shoda, 1995). This conception individuates moral dispositions by reference to the cognitive and affective processes that realise them. Conceived of in this way, moral dispositions influence an agent's behaviour when they interact with situational factors, such as mood or social context. Understanding moral dispositions in this way lays the groundwork for proposing a range of indirect methods of moral enhancement, techniques that promise similar results as direct interventions whilst posing fewer risks. (shrink)

In this article I discuss a recent proposal according to which human beings are in need of moral enhancement by novel biomedical means in order to reduce the risk of catastrophes that could threaten the very possibility of continued human existence on this planet. I raise two objections to this proposal. The first objection claims that the idea that human beings could be morally enhanced by altering our emotional psychological inclinations, such as altruism, is misguided. In the line (...) with Kantian understanding of morality I argue that our morality is based on rationality and not on inclinations. If we take this view of morality it becomes clear that the proposed enhancement by biomedical means cannot be moral enhancement. What is enhanced is emotional aspect of our character, not our morality. People enhanced in this way would not act on the basis of their deliberate choices but on basis of preprogramed psychological inclination. This would in turn undermine our basic moral concept of freedom and, thereby, of moral responsibility. The second objection to the proposal show how the idea that moral enhancement by biomedical means should be mandatory violates political freedom of citizens. Faced with the objection that moral enhancement by biomedical means could be necessary in order to prevent catastrophic destruction of environment, in the final part of this chapter I try to point to education and liberal democracy as the alternative and morally acceptable ways of changing our behaviour. (shrink)

Concerns that people would be disinclined to voluntarily undergo moral enhancement have led to suggestions that an incentivised programme should be introduced to encourage participation. This paper argues that, while such measures do not necessarily result in coercion or undue inducement (issues with which one may typically associate the use of incentives in general), the use of incentives for this purpose may present a taboo tradeoff. This is due to empirical research suggesting that those characteristics likely to be (...) affected by moral enhancement are often perceived as fundamental to the self; therefore, any attempt to put a price on such traits would likely be deemed morally unacceptable by those who hold this view. A better approach to address the possible lack of participation may be to instead invest in alternative marketing strategies and remove incentives altogether. (shrink)

Abstract: Artificial Intelligence (AI) has rapidly advanced, offering significant potential to transform business decision-making. This paper delves into how AI can be harnessed to enhance strategic decision-making within business contexts. It investigates the integration of AI-driven analytics, predictive modeling, and automation, emphasizing their role in improving decision accuracy and operational efficiency. By examining current applications and case studies, the paper underscores the opportunities AI offers, including improved data insights, risk management, and personalized customer experiences. It also addresses the challenges businesses (...) face when adopting AI, such as data privacy concerns, integration difficulties, and the need for skilled professionals. The paper concludes by offering recommendations for successfully implementing AI solutions to maximize benefits while mitigating potential challenges. (shrink)

Some skeptics question the very possibility of moral bioenhancement by arguing that if we lack a widely acceptable notion of morality, we will not be able to accept the use of a biotechnological technique as a tool for moral bioenhancement. I will examine this skepticism and argue that the assessment of moral bioenhancement does not require such a notion of morality. In particular, I will demonstrate that this skepticism can be neutralized in the case of recent neurofeedback (...) techniques. This goal will be accomplished in four steps. First, I will draw an outline of the skepticism against the possibility of moral bioenhancement and point out that a long-lasting dispute among moral philosophers nourishes this skepticism. Second, I will survey recent neurofeedback techniques and outline their three features: the variety of the target human faculties, such as emotion, cognition, and behavior; the flexibility or personalizability of the target brain state; and the nonclinical application of neurofeedback techniques. Third, I will argue that, by virtue of these three unique features, neurofeedback techniques can be a tool for moral bioenhancement without adopting any specific notion of morality. Fourth, I will examine the advantages and threats that neurofeedback-based moral enhancement may have. Finally, I will conclude that neurofeedback-based moral enhancement can become a new and promising tool for moral bioenhancement and requires further ethical investigations on its unique features. (shrink)

This paper critically assesses the possibility of moral enhancement with ambient intelligence technologies and artificial intelligence presented in Savulescu and Maslen (2015). The main problem with their proposal is that it is not robust enough to play a normative role in users’ behavior. A more promising approach, and the one presented in the paper, relies on an artifi-cial moral reasoning engine, which is designed to present its users with moral arguments grounded in first-order normative theories, such (...) as Kantianism or utilitarianism, that reason-responsive people can be persuaded by. This proposal can play a normative role and it is also a more promising avenue towards moral enhancement. It is more promising because such a system can be designed to take advantage of the sometimes undue trust that people put in automated technologies. We could therefore expect a well-designed moral reasoner system to be able to persuade people that may not be persuaded by similar arguments from other people. So, all things considered, there is hope in artificial intelli-gence for moral enhancement, but not in artificial intelligence that relies solely on ambient intelligence technologies. (shrink)

Robert Sparrow recently argues that state-driven moral bioenhancement is morally problematic because it inevitably invites moral perfectionism. While sharing Sparrow’s worry about state-driven moral bioenhancement, I argue that his anti-perfectionism argument is too strong to offer useful normative guidance. That is, if we reject state-driven moral bioenhancement because it cannot remain neutral between different conceptions of the good, we might have to conclude that all forms of moral enhancement program ought not be made compulsory, (...) including the least controversial and most popular state-driven program: compulsory (moral) education. -/- In this paper, I argue that instead, the spirit of Sparrow’s worry should be recast in the language of the capability approach – an approach that strives to enhance people’s capabilities to develop their own conceptions of the good by restricting itself from endorsing thick conceptions of the good. The distinction made regarding thick and thin conceptions of the good helps better capture sentiments against state-driven bioenhancement programs without falling prey to the issues I raise against Sparrow’s anti-perfectionist arguments. (shrink)

In a recent issue of Bioethics, I argued that compulsory moral bioenhancement should be administered covertly. Alexander Zambrano has criticized this argument on two fronts. First, contrary to my claim, Zambrano claims that the prevention of ultimate harm by covert moral bioenhancement fails to meet conditions for permissible liberty‐restricting public health interventions. Second, contrary to my claim, Zambrano claims that covert moral bioenhancement undermines autonomy to a greater degree than does overt moral bioenhancement. In this paper, (...) I rebut both of these arguments, then finish by noting important avenues of research that Zambrano’s arguments motivate. (shrink)

A prominent objection to non-cognitive moral bio-enhancements is that they would compromise the recipient’s ‘freedom to fall’. I begin by discussing some ambiguities in this objection, before outlining an Aristotelian reading of it. I suggest that this reading may help to forestall Persson and Savulescu’s ‘God-Machine’ criticism; however, I suggest that the objection still faces the problem of explaining why the value of moral conformity is insufficient to outweigh the value of the freedom to fall itself. I also (...) question whether the objection is compatible with Neil Levy’s parity principle. Accordingly, I go on to consider an alternative relational freedom-based objection to NCMBEs that aims to explain the fundamental moral importance of the freedom that NCMBEs would violate. I argue that although this strategy might allow the critic of NCMBEs to bypass a powerful criticism of Harris’ objection, it also weakens the freedom-based objection’s compatibility with the parity principle. (shrink)

Bioethics, Volume 36, Issue 4, Page 367-373, May 2022.

Abstract:This paper considers novel ethical issues pertaining to near-future artificial intelligence (AI) systems that seek to support, maintain, or enhance the capabilities of older adults as they age and experience cognitive decline. In particular, we focus on smart assistants (SAs) that would seek to provide proactive assistance and mediate social interactions between users and other members of their social or support networks. Such systems would potentially have significant utility for users and their caregivers if they could reduce the cognitive load (...) for tasks that help older adults maintain their autonomy and independence. However, proactively supporting even simple tasks, such as providing the user with a summary of a meeting or a conversation, would require a future SA to engage with ethical aspects of human interactions which computational systems currently have difficulty identifying, tracking, and navigating. If SAs fail to perceive ethically relevant aspects of social interactions, the resulting deficit in moral discernment would threaten important aspects of user autonomy and well-being. After describing the dynamic that generates these ethical challenges, we note how simple strategies for prompting user oversight of such systems might also undermine their utility. We conclude by considering how near-future SAs could exacerbate current worries about privacy, commodification of users, trust calibration and injustice. (shrink)

The possibility of employing human enhancement interventions to aid in future space missions has been gaining attention lately. These possibilities have included one of the more controversial kinds of enhancements: biomedical moral enhancement. However, the discussion has thus far remained on a rather abstract level. In this paper we further this conversation by looking more closely at what type of interventions with what sort of effects we should expect when we are talking about biomedical moral enhancements. (...) We suggest that a more grounded way to picture moral enhancement, at least in the near term, is to envision a form of cognitive enhancement that also provides some moral benefits by heightening the enhanced person's capability for acting according to their own subjective moral code. While this concept of moral adherence enhancement also has relevance for the moral enhancement discussion more widely, in this paper we apply it specifically in the context of space missions. We argue that there are weighty reasons to consider making biomedical enhancements of the proposed kind a mandatory feature of early-phase long-distance space travel because these missions are high-stakes in nature and take place in an environment where the enhancement could be seen as conferring important advantages while negating many of the traditional arguments weighed against it. (shrink)

Table of Contents Foreword .................................................................................................... ......................................... xiv Preface .................................................................................................... .............................................. xv Acknowledgment .................................................................................................... .......................... xxiii Section 1 On the Cusp: Critical Appraisals of a Growing Dependency on Intelligent Machines Chapter 1 Algorithms versus Hive Minds and the Fate of Democracy ................................................................... 1 Rick Searle, IEET, USA Chapter 2 We Can Make Anything: Should We? .................................................................................................. 15 Chris Bateman, University of Bolton, UK Chapter 3 Grounding Machine Ethics within the Natural System ........................................................................ 30 Jared Gassen, JMG Advising, USA Nak Young Seong, Independent Scholar, South (...) Korea Section 2 From the Outside In: Intelligent Machine Technologies as a Window on Human Morality both as Evolved and as Evident in Internet Discourse, Today Chapter 4 The Emergence of Arti cial Autonomy: A View from the Foothills of a Challenging Climb ............. 51 Fernando da Costa Cardoso, Universidade Nova de Lisboa, Portugal Luís Moniz Pereira, Universidade Nova de Lisboa, Portugal Chapter 5 Semantic Analysis of Bloggers Experiences as a Knowledge Source of Average Human Morality .... 73 Rafal Rzepka, Hokkaido University, Japan Kenji Araki, Hokkaido University, Japan Section 3 From the Inside Out: The Ethics of Human Enhancement from Moral Perception to Competition in the Workplace Chapter 6 Machine Ethics Interfaces: An Ethics of Perception of Nanocognition ............................................... 97 Melanie Swan, Kingston University, UK Chapter 7 Ethical Concerns in Human Enhancement: Advantages in Corporate/Organizational Settings ......... 124 Ben Tran, Alliant International University, USA Section 4 From Far to Near and Near to Far: The Ethics of Distancing Technologies in Education and Warfare Chapter 8 Responsibility and War Machines: Toward a Forward-Looking and Functional Account ................. 152 Jai Galliott, Macquarie University, Australia Chapter 9 Ethical Responsibilities of Preserving Academicians in an Age of Mechanized Learning: Balancing the Demands of Educating at Capacity and Preserving Human Interactivity ................... 166 James E. Willis III, Indiana University, USA Viktoria Alane Strunk, Independent Scholar, USA Section 5 Wrapping Things Up, then Unwrapping Them Again: Integral Visions of Morality in a Technological World, Over Evolutionary Time, with Revolutionary Means, and with Open Questions about the Final Purpose of It All Chapter 10 Bridging Two Realms of Machine Ethics ........................................................................................... 197 Luís Moniz Pereira, Universidade Nova de Lisboa, Portugal Ari Saptawijaya, Universidade Nova de Lisboa, Portugal & Universitas Indonesia, Indonesia Chapter 11 Robots in Warfare and the Occultation of the Existential Nature of Violence ................................... 225 Rick Searle, IEET, USA Chapter 12 Self-Referential Complex Systems and Aristotle’s Four Causes ........................................................ 239 Aleksandar Malecic, University of Nis, Serbia Related References .................................................................................................... ........................ 261 Compilation of References .................................................................................................... ........... 292 About the Contributors .................................................................................................... ................ 325 Index .................................................................................................... ............................................... 329 . (shrink)

This chapter focuses on AI-based cognitive and perceptual enhancements. AI-based brain enhancements are already under development, and they may become commonplace over the next 30–50 years. We raise doubts concerning whether radical AI-based enhancements transhumanists advocate will accomplish the transhumanists goals of longevity, human flourishing, and intelligence enhancement. We urge that even if the technologies are medically safe and are not used as tools by surveillance capitalism or an authoritarian dictatorship, these enhancements may still fail to do their job (...) for philosophical reasons. In what follows, we explore one such concern, a problem that involves the nature of the self. We illustrate that the so called transhumanist efforts to “merge oneself with AI” could lead to perverse realizations of AI technology, such as the demise of the person who sought enhancement. And, in a positive vein, we offer ways to avoid this, at least within the context of one theory of the nature of personhood. (shrink)

In this article I discuss one of the most significant areas of bioethical interest, which is the problem of moral enhancement. Since I claim that the crucial issue in the current debate on human bioenhancement is the problem of agency, I bring out and examine the conditions of possibility of self-understanding, acting subjects attributing responsible authorship for their actions to themselves. I shall argue that the very idea of moral enhancement, properly understood, fails to justify the (...) claims that enhancing the “biological” factor that plays a part in the process of making moral choices, whether through biomedical or genetic interventions, will actually increase the probability of having “morally better future motives”. (shrink)

New scientific advances have created previously unheard of possibilities for enhancing combatants' performance. Future war fighters may be smarter, stronger, and braver than ever before. If these technologies are safe, is there any reason to reject their use? In this article, I argue that the use of enhancements is constrained by the importance of maintaining the moral responsibility of military personnel. This is crucial for two reasons: the military's ethical commitments require military personnel to be morally responsible agents, and (...) moral responsibility is necessary for integrity and the moral emotions of guilt and remorse, both of which are important for moral growth and psychological well-being. Enhancements that undermined combatants' moral responsibility would therefore undermine the military's moral standing and would harm combatants' well-being. A genuine commitment to maintaining the military's ethical standards and the well-being of combatants therefore requires a careful analysis of performance-enhancing technologies before they are implemented. (shrink)

Nicholas Agar, Jeff McMahan and Allen Buchanan have all expressed concerns about enhancing humans far outside the species-typical range. They argue radically enhanced beings will be entitled to greater and more beneficial treatment through an enhanced moral status, or a stronger claim to basic rights. I challenge these claims by first arguing that emerging technologies will likely give the enhanced direct control over their mental states. The lack of control we currently exhibit over our mental lives greatly contributes to (...) our sense of vulnerability. I then argue moral status should be viewed in terms of vulnerability. The enhanced will slowly gain the ability to command their mental states, reducing their vulnerability. These radically enhanced beings will have greater capacities, and possibly an inner life more valuable than our own. They will also be less vulnerable, and as a result, their moral status will be subordinate to our own. (shrink)

Review of Harris Wiseman, The Myth of the Moral Brain: The Limits of Moral Enhancement, 340 pp.

The prospect of cognitive enhancement well beyond current human capacities raises worries that the fundamental equality in moral status of human beings could be undermined. Cognitive enhancement might create beings with moral status higher than persons. Yet, there is an expressibility problem of spelling out what the higher threshold in cognitive capacity would be like. Nicholas Agar has put forward the bold claim that we can show by means of inductive reasoning that indefinite cognitive enhancement (...) will probably mark a difference in moral status. The hope is that induction can determine the plausibility of post‐personhood existence in the absence of an account of what the higher status would be like. In this article, we argue that Agar's argument fails and, more generally, that inductive reasoning has little bearing on assessing the likelihood of post‐personhood in the absence of an account of higher status. We conclude that induction cannot bypass the expressibility problem about post‐persons. (shrink)

The Moral Argument for AI Ethics emphasizes the need for an adaptive, globally equitable, and philosophically grounded framework for the ethical development and deployment of artificial intelligence. It highlights key principles, including dynamic adaptation to societal values, inclusivity, and the mitigation of global disparities. Drawing from historical AI ethical failures, the argument underscores the urgency of proactive and enforceable frameworks addressing bias, surveillance, and existential threats. The conclusion advocates for international coalitions that integrate diverse philosophical traditions and practical implementation (...) strategies, ensuring AI’s role as a force for global good. (shrink)

This paper offers an overview of the prospects and ethics of using AI to achieve human enhancement, and more broadly what we call intellectual augmentation (IA). After explaining the central notions of human enhancement, IA, and AI, we discuss the state of the art in terms of the main technologies for IA, with or without brain-computer interfaces. Given this picture, we discuss potential ethical problems, namely inadequate performance, safety, coercion and manipulation, privacy, cognitive liberty, authenticity, and fairness in (...) more detail. We conclude that while there are very significant technical hurdles to real human enhancement through AI, and significant ethical problems, there are also significant benefits that may realistically be achieved in ways that are consonant with a rights-based ethics as well. We also highlight the specific concerns that apply particularly to applications of AI for "sheer" IA (more realistic in the near term), and to enhancement applications, respectively. (shrink)

Large Language Models (LLMs) are generative AI systems capable of producing original texts based on inputs about topic and style provided in the form of prompts or questions. The introduction of the outputs of these systems into human discursive practices poses unprecedented moral and political questions. The article articulates an analysis of the moral status of these systems and their interactions with human interlocutors based on the Habermasian theory of communicative action. The analysis explores, among other things, Habermas's (...) inquiries into the analogy between human minds and computers, and into the status of atypical participants in the linguistic community such as genetically modified subjects and animals. Major conclusions are the LLMs seem to qualify as authors that originally participate in discursive practices but do display only a structurally derivative form of communicative competence and fail to meet the status of communicative agents. In this sense, while the contribution of AI writing systems in public discourse and deliberation can support the process of mutual understanding within the community of speakers, the human actors involved in the development, use, and diffusion of these systems share a collective responsibility for the disclosure of AI authorship and verification and adjudication of validity claims. (shrink)

This article connects philosophical debates about cognitive enhancement and situated cognition. It does so by focusing on moral aspects of enhancing our cognitive abilities with the aid of external artifacts. Such artifacts have important moral dimensions that are addressed neither by the cognitive enhancement debate nor situated cognition theory. In order to fill this gap in the literature, three moral aspects of cognitive artifacts are singled out: their consequences for brains, cognition, and culture; their (...) class='Hi'>moral status; and their relation to personal identity. (shrink)

This article analyzes emerging artificial intelligence (AI)-enhanced lie detection systems from ethical and human resource (HR) management perspectives. I show how these AI enhancements transform lie detection, followed with analyses as to how the changes can lead to moral problems. Specifically, I examine how these applications of AI introduce human rights issues of fairness, mental privacy, and bias and outline the implications of these changes for HR management. The changes that AI is making to lie detection are altering the (...) roles of human test administrators and human subjects, adding machine learning-based AI agents to the situation and establishing invasive data collection processes as well as introducing certain biases in results. I project that the potentials for pervasive and continuous lie detection initiatives (“truth machines”) are substantial, displacing human-centered efforts to establish trust and foster integrity in organizations. I argue that if it is possible for HR managers to do so, they should cease using technologically-based lie detection systems entirely and work to foster trust and accountability on a human scale. However, if these AI-enhanced technologies are put into place by organizations by law, agency mandate, or other compulsory measures, care should be taken that the impacts of the technologies on human rights and wellbeing are considered. The article explores how AI can displace the human agent in some aspects of lie detection and credibility assessment scenarios, expanding the prospects for inscrutable, “black box” processes and novel physiological constructs (such as “biomarkers of deceit”) that may increase the potential for such human rights concerns as fairness, mental privacy, and bias. Employee interactions with autonomous lie detection systems rather with than human beings who administer specific tests can reframe organizational processes and rules concerning the assessment of personal honesty and integrity. The dystopian projection of organizational life in which analyses and judgments of the honesty of one’s utterances are made automatically and in conjunction with one’s personal profile provides unsettling prospects for the autonomy of self-representation. (shrink)

With AI permeating our lives, there is widespread concern regarding the proper framework needed to morally assess and regulate it. This has given rise to many attempts to devise ethical guidelines that infuse guidance for both AI development and deployment. Our main concern is that, instead of a genuine ethical interest for AI, we are witnessing moral diplomacies resulting in moral bureaucracies battling for moral supremacy and political domination. After providing a short overview of what we term (...) ‘ethics washing’ in the AI industry, we analyze the 2021 UNESCO Intergovernmental Meeting of Experts (Category II) tasked with drafting the Recommendation on the Ethics of Artificial Intelligence and show why the term ‘moral diplomacy’ is better suited to explain what is happening in the field of the ethics of AI. Our paper ends with some general considerations regarding the future of the ethics of AI. (shrink)

Examining AI spirituality can illuminate problematic assumptions about human spirituality and AI cognition, suggest possible directions for AI development, reduce uncertainty about future AI, and yield a methodological lens sufficient to investigate human-AI sociotechnical interaction and morality. Incompatible philosophical assumptions about human spirituality and AI limit investigations of both and suggest a vast gulf between them. An emergentist approach can replace dualist assumptions about human spirituality and identify emergent behavior in AI computation to overcome overly reductionist assumptions about computation. Using (...) general systems theory to organize models of human experience yields insight into human morality and spirituality, upon which AI modeling can also draw. In this context, the pragmatist Josiah Royce’s semiotic philosophy of spirituality identifies unanticipated overlap between symbolic AI and spirituality and suggests criteria for a human-AI community focused on modeling morality that would result in an emergent Interpreter-Spirit sufficient to influence the ongoing development of human and AI morality and spirituality. (shrink)

Enhancement ist eine tolle Sache: dieser Begriff ist notwendigerweise positiv (ein bisschen wie der traditionelle Gottbegriff), so dass wenn eine Änderung keine richtige Verbesserung hervorbringt, es auch kein richtiges Enhancement gewesen ist: sehr praktisch. Wie könnte man unter diesen Umständen überhaupt gegen Enhancement sein? Beim Enhancement geht es nicht mal um das plausible aber nicht unumstrittene „mehr ist besser“; vielmehr geht es um das tautologische „besser ist besser“.