This paper explores the ambiguous impact of new information and communications technologies on the cultivation of moral skills in human beings. Just as twentieth century advances in machine automation resulted in the economic devaluation of practical knowledge and skillsets historically cultivated by machinists, artisans, and other highly trained workers , while also driving the cultivation of new skills in a variety of engineering and white collar occupations, ICTs are also recognized as potential causes of a complex pattern of economic deskilling, (...) reskilling, and upskilling. In this paper, I adapt the conceptual apparatus of sociological debates over economic deskilling to illuminate a different potential for technological deskilling/upskilling, namely the ability of ICTs to contribute to the moral deskilling of human users, a potential that exists alongside rich but currently underrealized possibilities for moral reskilling and/or upskilling. I flesh out this general hypothesis by means of examples involving automated weapons technology, new media practices, and social robotics. I conclude that since moral skills are essential prerequisites for the effective development of practical wisdom and virtuous character, and since market and cultural forces are not presently aligned to bring about the more salutary of the ambiguous potentials presented here, the future shape of these developments warrants our close attention—and perhaps active intervention. (shrink)

The increasing complexity and ubiquity of autonomously operating artificially intelligent (AI) systems call for a robust theoretical reconceptualization of responsibility and control. The Meaningful Human Control (MHC) approach to the design and operation of AI systems provides such a framework. However, in its focus on accountability and minimizing harms, it neglects how we may flourish in interaction with such systems. In this chapter, I show how the MHC framework can be expanded to meet this challenge by drawing on the ethics (...) of carebots and embodied design. First, I examine how discussions about flourishing with carebots invite us to consider the extent to which we control our moral character Second, I argue that we can understand the cultivation of moral character in terms of embodied virtues arising from operating in particular ecologies. Third, I demonstrate how this analysis fruitfully informs the design of carebots as supporting reciprocity and empathy. (shrink)

In the early twenty-first century, we stand on the threshold of welcoming robots into domains of human activity that will expand their presence in our lives dramatically. One provocative new frontier in robotics, motivated by a convergence of demographic, economic, cultural, and institutional pressures, is the development of “carebots”—robots intended to assist or replace human caregivers in the practice of caring for vulnerable persons such as the elderly, young, sick, or disabled. I argue here that existing philosophical reflections on the (...) ethical implications of carebots neglect a critical dimension of the issue: namely, the potential moral value of caregiving practices for caregivers. This value, I argue, gives rise to considerations that must be weighed alongside consideration of the likely impact of carebots on care recipients. Focusing on the goods internal to caring practices, I then examine the potential impact of carebots on caregivers by means of three complementary ethical approaches: virtue ethics, care ethics, and the capabilities approach. Each of these, I argue, sheds new light on the contexts in which carebots might deprive potential caregivers of important moral goods central to caring practices, as well as those contexts in which carebots might help caregivers sustain or even enrich those practices, and their attendant goods. (shrink)

With the intensifying shortage of care-providers and mounting financial burden of an aging population in Japan, artificial intelligence (AI) offers a potential solution through AI-driven robots, chatbots, smartphone apps, and other AI medical services. Yet Japanese acceptance of medical AI, especially patient care, largely depends on the degree of ‘humanness’ that can be integrated into intelligent technologies. As empathy is considered a core value in the practice of healthcare workers, artificially intelligent agents must have the ability to perceive human emotions (...) and respond in an affective, human-like manner. This paper presents the results of a nationwide survey in Japan 2023 about the public perception of the use of emotionalized AI (EAI) in healthcare. The sample included 2000 Japanese citizens from 20 to 69 years old with an average age of 45 years. The questionnaire included 65 items in six categories: demographic, perception of the existing healthcare system, attitude towards the use of AI, and EAI in healthcare, trust and privacy concerns and fear of AI, and seeking literacy on new technologies. The analysis of the responses demonstrates that overall, the Japanese population has a limited knowledge of AI, EAI, and smart technologies but trusts the healthcare system, physicians, and staff to use it properly, with little worries over the potential pitfalls related to data security and safety. However, they prefer the use of more human resources and are concerned about privacy and the high cost of new technology, and believe little information is being provided to them through government and media. (shrink)

Questions about robots feeling pain are important because the experience of pain implies sentience and the ability to suffer. Pain is not the same as nociception, a reflex response to an aversive stimulus. The experience of pain in others has to be inferred. Danaher’s (Sci Eng Ethics 26(4):2023–2049, 2020. https://doi.org/10.1007/s11948-019-00119-x) ‘ethical behaviourist’ account claims that if a robot behaves in the same way as an animal that is recognised to have moral status, then its moral status should also be assumed. (...) Similarly, under a precautionary approach (Sebo in Harvard Rev Philos 25:51–70, 2018. https://doi.org/10.5840/harvardreview20185913), entities from foetuses to plants and robots are given the benefit of the doubt and assumed to be sentient. However, there is a growing consensus about the scientific criteria used to indicate pain and the ability to suffer in animals (Birch in Anim Sentience, 2017. https://doi.org/10.51291/2377-7478.1200; Sneddon et al. in Anim Behav 97:201–212, 2014. https://doi.org/10.1016/j.anbehav.2014.09.007). These include the presence of a central nervous system, changed behaviour in response to pain, and the effects of analgesic pain relief. Few of these criteria are met by robots, and there are risks to assuming that they are sentient and capable of suffering pain. Since robots lack nervous systems and living bodies there is little reason to believe that future robots capable of feeling pain could (or should) be developed. (shrink)

Obsession toward technology has a long background of parallel evolution between humans and machines. This obsession became irrevocable when AI began to be a part of our daily lives. However, this AI integration became a subject of controversy when the fear of AI advancement in acquiring consciousness crept among mankind. Artificial consciousness is a long-debated topic in the field of artificial intelligence and neuroscience which has many ethical challenges and threats in society ranging from daily chores to Mars missions. This (...) paper deals with the impact of AI-based science fiction films in society. This study aims to investigate the fascinating AI concept of artificial consciousness in light of posthuman terminology, technological singularity and superintelligence by analyzing the set of science fiction films to project the actual difference between science fictional AI and operational AI. Further, this paper explores the theoretical possibilities of artificial consciousness through a range of neuroscientific theories that are related to AI development. These theories are built toward prospective artificial consciousness in AI. This study discloses the posthuman fallacies that are built around the fear of AI acquiring artificial consciousness and its outcome. (shrink)

Bringing human–robot interaction (HRI) into conversation with scholarship from human geography, this paper considers how socially interactive robots become important agents in the production of social space and explores the utility of core geographic concepts of _scale_ and _place_ to critically examine evolving robotic spatialities. The paper grounds this discussion through reflections on a collaborative, interdisciplinary research project studying the development and deployment of interactive museum tour-guiding robots on a North American university campus. The project is a collaboration among geographers, (...) roboticists, a digital artist, and the directors/curators of two museums, and involves experimentation in the development of a tour-guiding robot with a “socially aware navigation system” alongside ongoing critical reflection into the socio-spatial context of human–robot interactions and their future possibilities. The paper reflects on the tensions between logics of control and contingency in robotic spatiality and argues that concepts of scale and place can help reflect on this tension in a productive way while calling attention to a broader range of stakeholders who should be included in robotic design and deployment. (shrink)

Personal AI is a new type of AI companion, distinct from the prevailing forms of AI companionship. Instead of playing a narrow and well-defined social role, like friend, lover, caretaker, or colleague, with a set of pre-determined responses and behaviors, Personal AI is engineered to tailor itself to the user, including learning to mirror the user’s unique emotional language and attitudes. This paper identifies two issues with Personal AI. First, like other AI companions, it is deceptive about the presence of (...) their emotions, which undermines the moral value of companionship. Second, Personal AI leads to a distinctly new form of deception concerning the origins of its emotions. Its emotional attitudes appear to belong to it, when in fact they are only reflections of the user. This results in what I dub “emotional bubbles”—the false impression that personal emotions are externally validated—which have at least two troubling implications. First, emotional bubbles prevent us from encountering emotional attitudes that differ from our own, which is likely to cripple emotional growth and the ability to form diverse social and emotional relationships. Second, if we assume, as some philosophers claim, that shared emotions are constitutive of shared values, it follows that Personal AI subverts joint moral deliberation. Users believe their personal values are externally validated, when they are only validated by themselves. Because of the absence of technovirtues able to handle this problem, I suggest that we proceed very cautiously with the development and marketing of Personal AI. (shrink)

In this paper, we demonstrate how the language and reasonings that academics, developers, consumers, marketers, and journalists deploy to accept or reject AI as authentic intelligence has far-reaching bearing on how we understand our human intelligence and condition. The discourse on AI is part of what we call the “authenticity negotiation process” through which AI’s “intelligence” is given a particular meaning and value. This has implications for scientific theory, research directions, ethical guidelines, design principles, funding, media attention, and the way (...) people relate to and act upon AI. It also has great impact on humanity’s self-image and the way we negotiate what it means to be human, existentially, culturally, politically, and legally. We use a discourse analysis of academic papers, AI education programs, and online discussions to demonstrate how AI itself, as well as the products, services, and decisions delivered by AI systems are negotiated as authentic or inauthentic intelligence. In this negotiation process, AI stakeholders indirectly define and essentialize what being human(like) means. The main argument we will develop is that this process of indirectly defining and essentializing humans results in an elimination of the space for humans to be indeterminate. By eliminating this space and, hence, denying indeterminacy, the existential condition of the human being is jeopardized. Rather than re-creating humanity in AI, the AI discourse is re-defining what it means to be human and how humanity is valued and should be treated. (shrink)

In this paper we examine how the use of robots in caring for elders can impact the meaningfulness of elders’ lives. We present a framework for understanding ‘meaningfulness in life’, and then apply that framework in discussing ways in which the use of robots to assist in activities of daily living can preserve, enhance or undermine the meaningfulness of elders’ lives. We conclude with a discussion of if and how having false beliefs about companion robots can affect meaningfulness in the (...) life of the person having those false beliefs. (shrink)

Humans often unconsciously perceive social robots involved in their lives as partners rather than mere tools, imbuing them with qualities of companionship. This anthropomorphization can lead to a spectrum of emotional risks, such as deception, disappointment, and reverse manipulation, that existing approaches struggle to address effectively. In this paper, we argue that a Virtual Interactive Environment (VIE) exists between humans and social robots, which plays a crucial role and demands necessary consideration and clarification in order to mitigate potential emotional risks. (...) By analyzing the relational nature of human-social robot interaction, we discuss the connotation of such a virtual interactive environment that is similar to the emotional states aroused when reading novels. Building on this comprehension, we further demonstrate that manufacturers should carry out comprehensive Virtual Interactive Environment Indication (VIEI) measures during human-social robot interaction with a stricter sense of responsibility when applying social robots. Finally, we contemplate the potential contributions of virtual interactive environment indication to existing robot ethics guidelines. (shrink)

Mark Coeckelbergh (Int J Soc Robot 1:217–221, 2009) argues that robot ethics should investigate what interaction with robots can do to humans rather than focusing on the robot’s moral status. We should ask what robots do to our sociality and whether human–robot interaction can contribute to the human good and human flourishing. This paper extends Coeckelbergh’s call and investigate what it means to live with disembodied AI-powered agents. We address the following question: Can the human–AI interaction contribute to our moral (...) development? We present an empirically informed philosophical analysis of how the AI personal assistant Siri changes its users’ way of life, based on the responses obtained from 20 semi-directive individual interviews with Siri users. We identify changes in the users’ social interaction associated with the adoption of Siri. These changes include: (1) the indirect effect of reducing opportunities of human interaction, (2) the second-order effect of diminished expectations toward each other in a community, and (3) the acquired preference to obtain hassle-free interaction with Siri over human interaction. We examine them in relation to concerns that are voiced in the current debates over the rise of AI, namely the suspicion that humans could become overly reliant on AI (Danaher 2019) and the worry that social AI could impede on moral development (Fröding and Peterson, Ethics Inf Technol 23:207–214, 2012; Li, Ethics Inf Technol 23:543–550, 2021). We analyze the ethical costs that come from these changes in light of virtue ethics and address potential objections along the way. We end by offering directions for thinking about how to live with AI personal assistant while preserving favorable conditions for moral development. (shrink)

How could ectogestative technology disrupt gender roles, parenting practices, and concepts such as ‘birth’, ‘body’, or ‘parent’? In this chapter, we situate this emerging technology in the context of the history of reproductive technologies and analyse the potential social and conceptual disruptions to which it could contribute. An ectogestative device, better known as ‘artificial womb’, enables the extra-uterine gestation of a human being, or mammal more generally. It is currently developed with the main goal of improving the survival chances of (...) extremely premature neonates. We argue that the intended use of the technology in neonatal intensive care units, as an alternative to current incubators (’partial-ectogestation’), challenges concepts such as ‘birth’, ‘fetus’, and ‘neonate’, and has several ethico-legal implications. We moreover address a more futuristic scenario where the entire embryological and fetal development could happen within an artificial womb (’full-ectogestation’). Such a scenario reveals the disruption of gender roles, parenting practices, and concepts such as ‘mother’, ‘father’, and ‘parent’. Both full- and partial-ectogestation would have implications for engineering and design, law-making, ethics, and philosophical anthropology. (shrink)

Advancements in artificial intelligence and (social) robotics raise pertinent questions as to how these technologies may help shape the society of the future. The main aim of the chapter is to consider the social and conceptual disruptions that might be associated with social robots, and humanoid social robots in particular. This chapter starts by comparing the concepts of robots and artificial intelligence and briefly explores the origins of these expressions. It then explains the definition of a social robot, as well (...) as the definition of humanoid robots. A key notion in this context is the idea of anthropomorphism: the human tendency to attribute human qualities, not only to our fellow human beings, but also to parts of nature and to technologies. This tendency to anthropomorphize technologies by responding to and interacting with them as if they have human qualities is one of the reasons why social robots (in particular social robots designed to look and behave like human beings) can be socially disruptive. As is explained in the chapter, while some ethics researchers believe that anthropomorphization is a mistake that can lead to various forms of deception, others — including both ethics researchers and social roboticists — believe it can be useful or fitting to treat robots in anthropomorphizing ways. The chapter explores that disagreement by, among other things, considering recent philosophical debates about whether social robots can be moral patients, that is, whether it can make sense to treat them with moral consideration. Where one stands on this issue will depend either on one’s views about whether social robots can have, imitate, or represent morally relevant properties, or on how people relate to social robots in their interactions with them. Lastly, the chapter urges that the ethics of social robots should explore intercultural perspectives, and highlights some recent research on Ubuntu ethics and social robots. (shrink)

Background The worldwide increase in older persons demands technological solutions to combat the shortage of caregiving and to enable aging in place. Smart home health technologies (SHHTs) are promoted and implemented as a possible solution from an economic and practical perspective. However, ethical considerations are equally important and need to be investigated. Methods We conducted a systematic review according to the PRISMA guidelines to investigate if and how ethical questions are discussed in the field of SHHTs in caregiving for older (...) persons. Results 156 peer-reviewed articles published in English, German and French were retrieved and analyzed across 10 electronic databases. Using narrative analysis, 7 ethical categories were mapped: privacy, autonomy, responsibility, human vs. artificial interactions, trust, ageism and stigma, and other concerns. Conclusion The findings of our systematic review show the (lack of) ethical consideration when it comes to the development and implementation of SHHTs for older persons. Our analysis is useful to promote careful ethical consideration when carrying out technology development, research and deployment to care for older persons. Registration We registered our systematic review in the PROSPERO network under CRD42021248543. (shrink)

Abstract:This paper considers novel ethical issues pertaining to near-future artificial intelligence (AI) systems that seek to support, maintain, or enhance the capabilities of older adults as they age and experience cognitive decline. In particular, we focus on smart assistants (SAs) that would seek to provide proactive assistance and mediate social interactions between users and other members of their social or support networks. Such systems would potentially have significant utility for users and their caregivers if they could reduce the cognitive load (...) for tasks that help older adults maintain their autonomy and independence. However, proactively supporting even simple tasks, such as providing the user with a summary of a meeting or a conversation, would require a future SA to engage with ethical aspects of human interactions which computational systems currently have difficulty identifying, tracking, and navigating. If SAs fail to perceive ethically relevant aspects of social interactions, the resulting deficit in moral discernment would threaten important aspects of user autonomy and well-being. After describing the dynamic that generates these ethical challenges, we note how simple strategies for prompting user oversight of such systems might also undermine their utility. We conclude by considering how near-future SAs could exacerbate current worries about privacy, commodification of users, trust calibration and injustice. (shrink)

Although sexual activity among elderly people remains taboo, residents in eldercare institutions often still have sexual desires, and catering for these desires could improve the quality of life for some of society’s most vulnerable – and most depressed – people. I argue that sexbots are apt to provide such a sexual service. I consider the potential benefits and pitfalls of other sexual possibilities, such as having sex with other residents, nurses, or sex workers, or using sexual aids to masturbation, and (...) I suggest that although some of these have potential, the use of sexbots should nevertheless be considered in addition to them. I address some potential criticisms, including moral objections to sexbots, sex not being a physiological necessity, issues of social justice, and the fact that many others in society do not have their sexual needs catered for. I give some suggestions for safety and dexterity modifications to current sexbots to enable their safe use by elderly people. (shrink)

In this paper, we propose a methodology to maximize the benefits of interdisciplinary cooperation in AI research groups. Firstly, we build the case for the importance of interdisciplinarity in research groups as the best means to tackle the social implications brought about by AI systems, against the backdrop of the EU Commission proposal for an Artificial Intelligence Act. As we are an interdisciplinary group, we address the multi-faceted implications of the mass-scale diffusion of AI-driven technologies. The result of our exercise (...) lead us to postulate the necessity of a behavioural theory that standardizes the interaction process of interdisciplinary groups. In light of this, we conduct a review of the existing approaches to interdisciplinary research on AI appliances, leading to the development of methodologies like ethics-by-design and value-sensitive design, evaluating their strengths and weaknesses. We then put forth an iterative process theory hinging on a narrative approach consisting of four phases: definition of the hypothesis space, building-up of a common lexicon, scenario-building, interdisciplinary self-assessment. Finally, we identify the most relevant fields of application for such a methodology and discuss possible case studies. (shrink)

The paper defends the idea that when we evaluate whether agents deserve praise or blame for their actions, we evaluate both whether their action was intentional, and whether it was voluntary. This idea can explain an asymmetry in blameworthiness and praiseworthiness: Agents can be blamed if they have acted either intentionally or voluntarily. However, to merit praise we expect agents to have acted both intentionally and voluntarily. This asymmetry between demands of praise and blame offers an interpretation of the Knobeeffect: (...) in the well-known experiment people blame a company chairman because, although he harmed the environment unintentionally, he did so voluntarily. In turn, praise is withheld, because the chairman did not benefit the environment intentionally. This is a way of rendering the Knobe-effect a rational outcome. It is an advantage of this position, that the distinction between the intentionality and voluntariness of actions can be upheld, whether or not it is the best explanation of the Knobe-effect. (shrink)

Keskustelu tekoälyn soveltamiseen liittyvistä eettisistä ja poliittisista kysymyksistä käy juuri nyt kuumana. Emme halua tässä puheenvuorossa osallistua keskusteluun tarttumalla johonkin tiettyyn eettiseen ongelmaan. Sen sijaan pyrimme sanomaan jotain itsekeskustelusta ja sen vaikeudesta. Haluamme kiinnittää huomiota siihen, kuinka erilaiset ihmismielen ajattelutaipumukset ja virhepäätelmät voivat huomaamattamme vaikuttaa tapaamme hahmottaa ja ymmärtää tekoälyä ja siihen liittyviä eettisiä kysymyksiä. Kun ymmärrämme paremmin sen, kuinka hankalaa näiden kysymysten hahmottaminen arkisen mielemme kategorioilla oikein on, ja kun tunnistamme tästä syntyvät virhepäätelmät ja ajattelun vääristymät, kykenemme entistä korkeatasoisempaan (...) eettiseen arviointiin tekoälyyn liittyvissä kysymyksissä. Tarkoituksemme ei ole tarkastella loogisiavirhepäätelmiä, jotka rikkovat formaalin modus tollensin tai modus ponensin sääntöjä. Sen sijaan esittelemme empiirisiä tutkimustuloksia, jotka havainnollistavat ihmismielen taipumustatehdä systemaattisia virhearviointeja erilaisissa tilanteissa. (shrink)

In this paper we present a theoretical framework to understand the underlying psychological mechanism involved in human-Companion Robot interactions. At first, we take the case of Sexual Robotics, where the psychological dynamics are more evident, to thereafter extend the discussion to Companion Robotics in general. First, we discuss the differences between a sex-toy and a Sexual Robots, concluding that the latter may establish a collusive and confirmative dynamics with the user. We claim that the collusiveness leads to two main consequences, (...) such as the fixation on a specific and atypical type of sexual interaction, called paraphilic, and to the infantilization of the user, which we explain through the theoretical framework of “object-relation theory”. We argue that these dynamics may degrade to an infantile stage the relational abilities of users, extending this argument to Companion Robots in general. Then, we enquire if and how the relational dynamics enacted in HRI may shift to human relations: we discuss the analogy with virtual reality concluding that, under certain condition, a symbolic shift might happen. In the last part of this work, we propose an experimental setup to verify if a collusive and confirmative interaction with a Companion Robot can, over time, impact on the user’s ability to manage relational frustration. (shrink)

Artificial Intelligence (AI) is predicted to have a deep impact on the future of work and employment. The paper outlines a normative framework to understand and protect human freedom and justice in this transition. The proposed framework is based on four main ideas: going beyond the idea of a Basic Income to compensate the losers in the transition towards AI-driven work, towards a Responsible Innovation approach, in which the development of AI technologies is governed by an inclusive and deliberate societal (...) judgment; going beyond a philosophical conceptualisation of social justice only focused on the distribution of ‘primary goods’, towards one focused on the different goals, values, and virtues of various social practices (Walzer’s ‘spheres of justice’) and the different individual capabilities of persons (Sen’s ‘capabilities’); going beyond a classical understanding of capital, towards one explicitly including mental capacities as a source of value for AI-driven activities. In an effort to promote an interdisciplinary approach, the paper combines political and economic theories of freedom, justice and capital with recent approaches in applied ethics of technology, and starts applying its normative framework to some concrete example of AI-based systems: healthcare robotics, ‘citizen science’, social media and platform economy. (shrink)

With robots being introduced into caregiving, particularly for older persons, various ethical concerns are raised. Among them is the fear of replacing human caregiving. While ethical concepts like well-being, autonomy, and capabilities are often used to discuss these concerns, this paper brings forth the concept of social dignity to further develop guidelines concerning the use of robots in caregiving. By social dignity, we mean that a person’s perceived dignity changes in response to certain interactions and experiences with other persons. In (...) this paper, we will first present the concept of social dignity, and then identify a niche where robots can be used in caregiving in an ethical manner. Specifically, we will argue that, because some activities of daily living are performed in solitude to maintain dignity, a care recipient will usually prefer robotic assistance instead of human assistance for these activities. Secondly, we will describe how other philosophical concepts, which have been commonly used to judge robotic assistance in caregiving for the elderly so far, such as well-being, autonomy, and capabilities, are less useful in determining whether robotic assistance in caregiving is ethically problematic or not. To conclude, we will argue that social dignity offers an advantage to the other concepts, as it allows to ask the most pressing questions in caregiving. (shrink)

Artificial Intelligence (AI) is a diverse technology. It is already having significant effects on many jobs and sectors of the economy and over the next ten to twenty years it will drive profound changes in the way New Zealanders live and work. Within the workplace AI will have three dominant effects. This report (funded by the New Zealand Law Foundation) addresses: Chapter 1 Defining the Technology of Interest; Chapter 2 The changing nature and value of work; Chapter 3 AI and (...) the employment relationship; Chapter 4 Consumers, professions and society. The report includes recommendations to the New Zealand Government. (shrink)

Social robots are robots that can interact socially with humans. As social robots and the artificial intelligence that powers them becomes more advanced, they will likely take on more social and work roles. This has many important ethical implications. In this paper, we focus on one of the most central of these, the impacts that social robots can have on human autonomy. We argue that, due to their physical presence and social capacities, there is a strong potential for social robots (...) to enhance human autonomy as well as several ways they can inhibit and disrespect it. We argue that social robots could improve human autonomy by helping us to achieve more valuable ends, make more authentic choices, and improve our autonomy competencies. We also argue that social robots have the potential to harm human autonomy by instead leading us to achieve fewer valuable ends ourselves, make less authentic choices, decrease our autonomy competencies, make our autonomy more vulnerable, and disrespect our autonomy. Whether the impacts of social robots on human autonomy are positive or negative overall will depend on the design, regulation, and use we make of social robots in the future. (shrink)

Socially Assistive Robots are increasingly conceived as applicable tools to be used in aged care. However, the use carries many negative and positive connotations. Negative connotations come forth out of romanticized views of care practices, disregarding their already established technological nature. Positive connotations are formulated out of techno-deterministic views on SAR use, presenting it as an inevitable and necessary next step in technological development to guarantee aged care. Ethical guidance of SAR use inspired by negative connotations tends to be over-restrictive (...) whereas positive connotations tend to provide over-permissive guidance. To avoid these extremes, we report on the development and content of 21 ethical orientations regarding SAR use in aged care. These orientations resulted from a multi-phased project, which consisted of empirical-ethical research focusing on older adults’ intuitions regarding SAR use and philosophical-ethical research focusing on philosophical-ethical argumentations regarding SAR use. This project led to the Socio-historical contextualization of the ethics of SAR use, in which the ethical impact of SAR use is localized on three interrelated analysis levels: societal, organizational, and individual-relational. The 21 novel orientations regarding SAR use are structured according to these levels and further categorized into foundational and applied orientations. The first category leads to critical reflection on SAR use while the latter category inspires decision-making processes regarding this use. While going beyond the care-romantic and techno-deterministic gaze of SAR use in aged care, the described orientations balance themselves between their over-restrictiveness and over-permissiveness. (shrink)

Although some authors claim that deception requires intention, we argue that there can be deception in social robotics, whether or not it is intended. By focusing on the deceived rather than the deceiver, we propose that false beliefs can be created in the absence of intention. Supporting evidence is found in both human and animal examples. Instead of assuming that deception is wrong only when carried out to benefit the deceiver, we propose that deception in social robotics is wrong when (...) it leads to harmful impacts on individuals and society. The appearance and behaviour of a robot can lead to an overestimation of its functionality or to an illusion of sentience or cognition that can promote misplaced trust and inappropriate uses such as care and companionship of the vulnerable. We consider the allocation of responsibility for harmful deception. Finally, we make the suggestion that harmful impacts could be prevented by legislation, and by the development of an assessment framework for sensitive robot applications. (shrink)

Healthcare is becoming increasingly automated with the development and deployment of care robots. There are many benefits to care robots but they also pose many challenging ethical issues. This paper takes care robots for the elderly as the subject of analysis, building on previous literature in the domain of the ethics and design of care robots. Using the value sensitive design approach to technology design, this paper extends its application to care robots by integrating the values of care, values that (...) are specific to AI, and higher-scale values such as the United Nations Sustainable Development Goals. The ethical issues specific to care robots for the elderly are discussed at length alongside examples of specific design requirements that work to ameliorate these ethical concerns. (shrink)

“Care robots” offer technological solutions to increasing needs for care just as economic imperatives increasingly regulate the care sector. Ethical critiques of this technology cannot succeed without situating themselves within the crisis of social reproduction under neoliberal capitalism. What, however, constitutes “care” and its status as a potential critical resource, and how might care robots damage this potential? Although robots might threaten norms of care, I argue that they are by no means necessarily damaging. Critiques of care robots must not (...) entrench exclusionary images of the ideal carer. Instead, critical reflection on their use should trouble dominant paradigms of care. (shrink)

The advent of the so-called Companion Robots is raising many ethical concerns among scholars and in the public opinion. Focusing mainly on robots caring for the elderly, in this paper we analyze these concerns to distinguish which are directly ascribable to robotic, and which are instead preexistent. One of these is the “deception objection”, namely the ethical unacceptability of deceiving the user about the simulated nature of the robot’s behaviors. We argue on the inconsistency of this charge, as today formulated. (...) After that, we underline the risk, for human-robot interaction, to become a hallucinatory relation where the human would subjectify the robot in a dynamic of meaning-overload. Finally, we analyze the definition of “quasi-other” relating to the notion of “uncanny”. The goal of this paper is to argue that the main concern about Companion Robots is the simulation of a human-like interaction in the absence of an autonomous robotic horizon of meaning. In addition, that absence could lead the human to build a hallucinatory reality based on the relation with the robot. (shrink)

Care is more than dispensing pills or cleaning beds. It is about responding to the entire patient. What is called “bedside manner” in medical personnel is a quality of treating the patient not as a mechanism but as a being—much like the caregiver—with desires, ideas, dreams, aspirations, and the gamut of mental and emotional character. As automata, answering an increasing functional need in care, are designed to enact care, the pressure is on their becoming more humanlike to carry out the (...) function more effectively. The question becomes not merely whether the care automaton can effect good bedside manner but whether the patient’s response is not feeling deceived by the humanlikeness. It seems the device must be designed either to effect explicit mere human-“likeness,” thus likely undermining its bedside-manner potential, or to fool the patient completely. Neither option is attractive. This article examines the social problems of designing maximally humanlike care automata and how problems may start to erode the human rights of users/patients. The article then investigates the alternatives for dealing with this problem, whether by industrial and professional self-regulation or public-policy initiatives. It then frames the problem in the broader historical perspective in terms of previous bans, moratoria, and other means of control of hazardous and potentially rights-violating techniques and materials. (shrink)

Since the Nuremberg Code and the first Declaration of Helsinki, globally there has been increasing adoption and adherence to procedures for ensuring that human subjects in research are as well informed as possible of the study’s reasons and risks and voluntarily consent to serving as subject. To do otherwise is essentially viewed as violation of the human research subject’s legal and moral rights. However, with the recent philosophical concerns about responsible robotics, the limits and ambiguities of research-subjects ethical codes become (...) apparent on the matter of constructing automata that maximally resemble human beings (as defined hereunder). In this case, the automata themselves, as products of research and development, are in the very process of their construction subjects of research and development. However, such research faces a paradox: The subjects cannot give their informed consent to this research for their own development, although their consent would be needed for the research. According to ethical codes, this research would be unethical. The article then explores whether the background concepts giving rise to this paradox could be reframed in order to allow such research to proceed ethically. (shrink)

If a robot sends a deceptive signal to a human user, is this always and everywhere an unethical act, or might it sometimes be ethically desirable? Building upon previous work in robot ethics, this article tries to clarify and refine our understanding of the ethics of robotic deception. It does so by making three arguments. First, it argues that we need to distinguish between three main forms of robotic deception (external state deception; superficial state deception; and hidden state deception) in (...) order to think clearly about its ethics. Second, it argues that the second type of deception – superficial state deception – is not best thought of as a form of deception, even though it is frequently criticised as such. And third, it argues that the third type of deception is best understood as a form of betrayal because doing so captures the unique ethical harm to which it gives rise, and justifies special ethical protections against its use. (shrink)

Strong arguments have been formulated that the computational limits of disembodied artificial intelligence (AI) will, sooner or later, be a problem that needs to be addressed. Similarly, convincing cases for how embodied forms of AI can exceed these limits makes for worthwhile research avenues. This paper discusses how embodied cognition brings with it other forms of information integration and decision-making consequences that typically involve discussions of machine cognition and similarly, machine consciousness. N. Katherine Hayles’s novel conception of nonconscious cognition in (...) her analysis of the human cognition-consciousness connection is discussed in relation to how nonconscious cognition can be envisioned and exacerbated in embodied AI. Similarly, this paper offers a way of understanding the concept of suffering in a way that is different than the conventional sense of attributing it to either a purely physical state or a conscious state, instead of grounding at least a type of suffering in this form of cognition. (shrink)

Friendship is an important part of the good life. While many roboticists are eager to create friend-like robots, many philosophers and ethicists are concerned. They argue that robots cannot really be our friends. Robots can only fake the emotional and behavioural cues we associate with friendship. Consequently, we should resist the drive to create robot friends. In this article, I argue that the philosophical critics are wrong. Using the classic virtue-ideal of friendship, I argue that robots can plausibly be considered (...) our virtue friends - that to do so is philosophically reasonable. Furthermore, I argue that even if you do not think that robots can be our virtue friends, they can fulfil other important friendship roles, and can complement and enhance the virtue friendships between human beings. (shrink)

Västvärldens åldrande befolkning anses ofta ställa krav på nya former av vård och omsorg. Olika typer av informations- och kommunikationstekniskt baserat vårdstöd framhålls ofta som en lösning. Tekniken medger en rad olika fördelar, exempelvis tätare tillsyn, kontinuerliga mätningar av vitala funktioner, med möjlighet att kontinuerligt ställa diagnos, och snabb respons på larm, men de tekniska lösningarna får också etiska implikationer. I den här artikeln beskrivs och exemplifieras IKT-baserad vård och omsorg och teknikens påverkan på centrala värden som personlig integritet, autonomi, (...) frivillighet och informerat samtycke diskuteras. Interaktiv etisk teknikvärdering föreslås för att bättre inkorporera alla berörda parters behov av och synpunkter på den här typen av vårdstöd.Nyckelord: autonomi, etik, frivillighet, informerat samtycke, interaktiv etisk teknikvärdering, IKT-baserat vårdstöd, hemvård, personlig integritet, robotteknik, sensorteknik, säkerhet, trygghet, valfrihetEnglish summary: When health care moves in – the ethics of mobile health careAn ageing population in the Western world is typically taken to require novel forms of health care. Different types of Information and Communication based services and functions are presented as a solution. Even if such technology imply benefits in terms of more frequent attendance, continuous monitoring and diagnoses of vital signs and quick response to alarms, the technology also gives raise to ethical concerns. This article describes and exemplifies ICT-based health care and discusses implications on central values like privacy, autonomy, freedom of choice and informed consent. Interactive ethical technology assessment is suggested as a means to better incorporate the needs of all concerned parties and their perspectives on this type of support. (shrink)

As the aim of the responsible robotics initiative is to ensure that responsible practices are inculcated within each stage of design, development and use, this impetus is undergirded by the alignment of ethical and legal considerations towards socially beneficial ends. While every effort should be expended to ensure that issues of responsibility are addressed at each stage of technological progression, irresponsibility is inherent within the nature of robotics technologies from a theoretical perspective that threatens to thwart the endeavour. This is (...) because the concept of responsibility, despite being treated as such, is not monolithic: rather this seemingly unified concept consists of converging and confluent concepts that shape the idea of what we colloquially call responsibility. From a different perspective, robotics will be simultaneously responsible and irresponsible depending on the particular concept of responsibility that is foregrounded: an observation that cuts against the grain of the drive towards responsible robotics. This problem is further compounded by responsible design and development as contrasted to responsible use. From a different perspective, the difficulty in defining the concept of responsibility in robotics is because human responsibility is the main frame of reference. Robotic systems are increasingly expected to achieve the human-level performance, including the capacities associated with responsibility and other criteria which are necessary to act responsibly. This subsists within a larger phenomenon where the difference between humans and non-humans, be it animals or artificial systems, appears to be increasingly blurred, thereby disrupting orthodox understandings of responsibility. This paper seeks to supplement the responsible robotics impulse by proposing a complementary set of human rights directed specifically against the harms arising from robotic and artificial intelligence technologies. The relationship between responsibilities of the agent and the rights of the patient suggest that a rights regime is the other side of responsibility coin. The major distinction of this approach is to invert the power relationship: while human agents are perceived to control robotic patients, the prospect for this to become reversed is beginning. As robotic technologies become ever more sophisticated, and even genuinely complex, asserting human rights directly against robotic harms become increasingly important. Such an approach includes not only developing human rights that ‘protect’ humans but also ‘strengthen’ people against the challenges introduced by robotics and AI [This distinction parallels Berlin’s negative and positive concepts of liberty ], by emphasising the social and reflective character of the notion of humanness as well as the difference between the human and nonhuman. This will allow using the human frame of reference as constitutive of, rather than only subject to, the robotic and AI technologies, where it is human and not technology characteristics that shape the human rights framework in the first place. (shrink)

It should not be a surprise in the near future to encounter either a personal or a professional service robot in our homes and/or our work places: according to the International Federation for Robots, there will be approx 35 million service robots at work by 2018. Given that individuals will interact and even cooperate with these service robots, their design and development demand ethical attention. With this in mind I suggest the use of an approach for incorporating ethics into the (...) design process of robots known as Care Centered Value Sensitive Design. Although this approach was originally and intentionally designed for the healthcare domain, the aim of this paper is to present a preliminary study of how personal and professional service robots might also be evaluated using the CCVSD approach. The normative foundations for CCVSD come from its reliance on the care ethics tradition and in particular the use of care practices for: structuring the analysis and, determining the values of ethical import. To apply CCVSD outside of healthcare one must show that the robot has been integrated into a care practice. Accordingly, the practice into which the robot is to be used must be assessed and shown to meet the conditions of a care practice. By investigating the foundations of the approach I hope to show why it may be applicable for service robots and further to give examples of current robot prototypes that can and cannot be evaluated using CCVSD. (shrink)

Current uses of robots in classrooms are reviewed and used to characterise four scenarios: Robot as Classroom Teacher; Robot as Companion and Peer; Robot as Care-eliciting Companion; and Telepresence Robot Teacher. The main ethical concerns associated with robot teachers are identified as: privacy; attachment, deception, and loss of human contact; and control and accountability. These are discussed in terms of the four identified scenarios. It is argued that classroom robots are likely to impact children’s’ privacy, especially when they masquerade as (...) their friends and companions, when sensors are used to measure children’s responses, and when records are kept. Social robots designed to appear as if they understand and care for humans necessarily involve some deception, and could increase the risk of reduced human contact. Children could form attachments to robot companions, or robot teachers and this could have a deleterious effect on their social development. There are also concerns about the ability, and use of robots to control or make decisions about children’s behaviour in the classroom. It is concluded that there are good reasons not to welcome fully fledged robot teachers, and that robot companions should be given a cautious welcome at best. The limited circumstances in which robots could be used in the classroom to improve the human condition by offering otherwise unavailable educational experiences are discussed. (shrink)

This article reviews the reasons scholars hold that driverless cars and many other AI equipped machines must be able to make ethical decisions, and the difficulties this approach faces. It then shows that cars have no moral agency, and that the term ‘autonomous’, commonly applied to these machines, is misleading, and leads to invalid conclusions about the ways these machines can be kept ethical. The article’s most important claim is that a significant part of the challenge posed by AI-equipped machines (...) can be addressed by the kind of ethical choices made by human beings for millennia. Ergo, there is little need to teach machines ethics even if this could be done in the first place. Finally, the article points out that it is a grievous error to draw on extreme outlier scenarios—such as the Trolley narratives—as a basis for conceptualizing the ethical issues at hand. (shrink)

I argue that the right to sexual satisfaction of severely physically and mentally disabled people and elderly people who suffer from neurodegenerative diseases can be fulfilled by deploying sex robots; this would enable us to satisfy the sexual needs of many who cannot provide for their own sexual satisfaction; without at the same time violating anybody’s right to sexual self-determination. I don’t offer a full-blown moral justification of deploying sex robots in such cases, as not all morally relevant concerns can (...) be addressed here; rather, I put forward a plausible way of fulfilling acute sexual needs without thereby violating anybody’s sexual rights. (shrink)

Service and personal care robots are starting to cross the threshold into the wilderness of everyday life, where they are supposed to interact with inexperienced lay users in a changing environment. In order to function as intended, robots must become independent entities that monitor themselves and improve their own behaviours based on learning outcomes in practice. This poses a great challenge to robotics, which we are calling the “autonomy-safety-paradox” (ASP). The integration of robot applications into society requires the reconciliation of (...) two conflicting aspects: increasing machine autonomy and ensuring safety in end-use. As the level of robot autonomy grows, the risk of accidents will increase, and it will become more and more difficult to identify who is responsible for any damage incurred. However, emphasizing safety impairs the autonomous functioning of the robot. This problem implies the need for a broadened concept of product safety. Our comparative study shows that the institutional framing of the ASP as well as concrete solutions to this problem differs between Europe and Japan in two respects: (1) the understanding of robot agency and (2) the concept of “appropriate” user–robot interaction. (shrink)

This paper offers an ethical framework for the development of robots as home companions that are intended to address the isolation and reduced physical functioning of frail older people with capacity, especially those living alone in a noninstitutional setting. Our ethical framework gives autonomy priority in a list of purposes served by assistive technology in general, and carebots in particular. It first introduces the notion of “presence” and draws a distinction between humanoid multi-function robots and non-humanoid robots to suggest that (...) the former provide a more sophisticated presence than the latter. It then looks at the difference between lower-tech assistive technological support for older people and its benefits, and contrasts these with what robots can offer. This provides some context for the ethical assessment of robotic assistive technology. We then consider what might need to be added to presence to produce care from a companion robot that deals with older people’s reduced functioning and isolation. Finally, we outline and explain our ethical framework. We discuss how it combines sometimes conflicting values that the design of a carebot might incorporate, if informed by an analysis of the different roles that can be served by a companion robot. (shrink)

Ambient assisted living technologies can provide assistance and support to persons with dementia. They might allow them the possibility of living at home for longer whilst maintaining their comfort and security as well as offering a way towards reducing the huge economic and personal costs forecast as the incidence of dementia increases worldwide over coming decades. However, the development, introduction and use of AAL technologies also trigger serious ethical issues. This paper is a systematic literature review of the on-going scholarly (...) debate about these issues. More specifically, we look at the ethical issues involved in research and development, clinical experimentation, and clinical application of AAL technologies for people with dementia and related stakeholders. In the discussion we focus on: the value of the goals of AAL technologies, the special vulnerability of persons with dementia in their private homes, the complex question of informed consent for the usage of AAL technologies. (shrink)

My focus on vulnerability and bioethics – which acknowledges but goes beyond mainstream feminist ethics - will take a phenomenological perspective that understands the self as having no meaning or existence beyond its embodiment. As such we are always open, and therefore vulnerable, to the constant changes of embodied experience. The transformations in embodiment are both necessary for development and continuous over the life course, but it is only when something breaks the cycle of normative development that the intimation of (...) vulnerability and disorder arise. Corporeal disorder operates in a highly individual and differentiated way as it manifests, for example, in the experience of disability, pain, ageing and dying. These are not exceptional moments of vulnerability in a life otherwise secure and predictable, but they do clearly set out the limits of the western imaginary, and more particularly of modern western biomedicine and conventional healthcare. In offering a critique of the positivist enterprise of biomedicine, I want to suggest a different understanding of the embodiment that has radical implications for bioethics. (shrink)

Debates about the moral status of social robots (SRs) currently face a second-order, or metatheoretical impasse. On the one hand, moral individualists argue that the moral status of SRs depends on their possession of morally relevant properties. On the other hand, moral relationalists deny that we ought to attribute moral status on the basis of the properties that SRs instantiate, opting instead for other modes of reflection and critique. This paper develops and defends a pragmatic approach which aims to reconcile (...) these two positions. The core of this proposal is that moral individualism and moral relationalism are best understood as distinct deliberative strategies for attributing moral status to SRs, and that both are worth preserving insofar as they answer to different kinds of practical problems that we face as moral agents. (shrink)

The discourse on the future of work should learn from a turn in philosophy that occurred in the 1980s, one that recognizes the good life towards which ethics strives can only be reached on a foundation of caring relationships (Gillian, 1982; Noddings, 1984). Care ethics recognizes that human well-being is a group project, one that involves strong relationships, and concern for bodies and emotions. Too often, these features are left out of research exploring robotics in the workplace. This paper outlines (...) the main tenets of care ethics, then applies the moral framework to the context of industrial and retail settings using robots. This approach sees these contexts through a relational lens, helping to identify, evaluate, and improve relationships critical to ensuring workers’ well-being. Second, care ethics considers taking care of people’s bodies beyond mere safety, examining how working with robots can exacerbate societal or economic pressures. Lastly, care ethics takes emotions as an important source of knowledge in building and supporting care. Additionally, this paper contributes to the care ethics literature by applying the framework to the context of robotized industrial workplaces, which has yet to be done. (shrink)

In today’s highly dynamic societies, moral norms and values are subject to change. Moral change is partly driven by technological developments. For instance, the introduction of robots in elderly care practices requires caregivers to share moral responsibility with a robot (see van Wynsberghe 2013 ). Since we do not know what elements of morality will change and how they will change (see van der Burg 2003 ), moral education should aim at fostering what has been called “moral resilience” (Swierstra 2013 (...) ). We seek to fill two gaps in the existing literature: (i) research on moral education has not paid enough attention to the development of moral resilience; (ii) the very limited literature on moral resilience does not conceptualise moral resilience in relation to new technological developments. We argue that philosophical accounts of moral education need to do justice to the importance of moral resilience, and that a specific form of moral resilience should be conceptualised as “technomoral resilience” to underline the added value of cultivating moral resilience in relation to technomoral change. We illustrate the role of technomoral resilience in practice by looking at the context of elderly care. To make the first step towards an account of how technomoral resilience can be fostered in moral education, we propose that moral education shall focus on a triangle of capacities: (1) moral imagination, (2) a capacity for critical reflection, and (3) a capacity for maintaining one’s moral agency in the face of disturbances. (shrink)