How can we make sense of the idea of ‘personal’ or ‘social’ relations with robots? Starting from a social and phenomenological approach to human–robot relations, this paper explores how we can better understand and evaluate these relations by attending to the ways our conscious experience of the robot and the human–robot relation is mediated by language. It is argued that our talk about and to robots is not a mere representation of an objective robotic or social-interactive reality, but rather interprets (...) and co-shapes our relation to these artificial quasi-others. Our use of language also changes as a result of our experiences and practices. This happens when people start talking to robots. In addition, this paper responds to the ethical objection that talking to and with robots is both unreal and deceptive. It is concluded that in order to give meaning to human–robot relations, to arrive at a more balanced ethical judgment, and to reflect on our current form of life, we should complement existing objective-scientific methodologies of social robotics and interaction studies with interpretations of the words, conversations, and stories in and about human–robot relations. (shrink)

In the early twenty-first century, we stand on the threshold of welcoming robots into domains of human activity that will expand their presence in our lives dramatically. One provocative new frontier in robotics, motivated by a convergence of demographic, economic, cultural, and institutional pressures, is the development of “carebots”—robots intended to assist or replace human caregivers in the practice of caring for vulnerable persons such as the elderly, young, sick, or disabled. I argue here that existing philosophical reflections on the (...) ethical implications of carebots neglect a critical dimension of the issue: namely, the potential moral value of caregiving practices for caregivers. This value, I argue, gives rise to considerations that must be weighed alongside consideration of the likely impact of carebots on care recipients. Focusing on the goods internal to caring practices, I then examine the potential impact of carebots on caregivers by means of three complementary ethical approaches: virtue ethics, care ethics, and the capabilities approach. Each of these, I argue, sheds new light on the contexts in which carebots might deprive potential caregivers of important moral goods central to caring practices, as well as those contexts in which carebots might help caregivers sustain or even enrich those practices, and their attendant goods. (shrink)

The growing proportion of elderly people in society, together with recent advances in robotics, makes the use of robots in elder care increasingly likely. We outline developments in the areas of robot applications for assisting the elderly and their carers, for monitoring their health and safety, and for providing them with companionship. Despite the possible benefits, we raise and discuss six main ethical concerns associated with: (1) the potential reduction in the amount of human contact; (2) an increase in the (...) feelings of objectification and loss of control; (3) a loss of privacy; (4) a loss of personal liberty; (5) deception and infantilisation; (6) the circumstances in which elderly people should be allowed to control robots. We conclude by balancing the care benefits against the ethical costs. If introduced with foresight and careful guidelines, robots and robotic technology could improve the lives of the elderly, reducing their dependence, and creating more opportunities for social interaction. (shrink)

This paper addresses the issue of whether robots could substitute for human care, given the challenges in aged care induced by the demographic change. The use of robots to provide emotional care has raised ethical concerns, e.g., that people may be deceived and deprived of dignity. In this paper it is argued that these concerns might be mitigated and that it may be sufficient for robots to take part in caring when they behave *as if* they care.

Imagine a man chatting with his AI girlfriend app. He looks at his smartphone and says, ‘Finally, I'm being understood’. Is he deceiving himself? Is there anything morally wrong with it? The human tendency to anthropomorphize AI is well established, and the popularity of AI companions is growing. This article answers three questions: (1) How can being charmed by AI's simulated emotions be considered self‐deception? (2) Why might we have an obligation to avoid harmless self‐deception? (3) When is self‐deception in (...) emotional relationships with AI morally questionable, and can it be blameworthy? Regarding question 1, I describe being seduced by AI's simulated emotions as self‐deception, where desires bias beliefs. In response to question 2, I outline two ways to justify a prima facie obligation to avoid harmless self‐deception – instrumental and autotelic. For question 3, I highlight crucial factors to consider in assessing the blameworthiness of harmless self‐deception, such as the emotional and cognitive competences of the self‐deceiver, reasons for self‐deception, and its consequences for one's predispositions, self‐image, and other people. Moreover, I argue that the ethical requirement to avoid self‐deception does not easily translate into attributing blame to others for being self‐deceived. (shrink)

According to a widespread view, people often anthropomorphize machines such as certain robots and computer and AI systems by erroneously attributing mental states to them. On this view, people almost irresistibly believe, even if only subconsciously, that machines with certain human-like features really have phenomenal or subjective experiences like sadness, happiness, desire, pain, joy, and distress, even though they lack such feelings. This paper questions this view by critiquing common arguments used to support it and by suggesting an alternative explanation. (...) Even if people’s behavior and language regarding human-like machines suggests they believe those machines really have mental states, it is possible that they do not believe that at all. The paper also briefly discusses potential implications of regarding such anthropomorphism as a popular myth. The exercise illuminates the difficult concept of anthropomorphism, helping to clarify possible human relations with or toward machines that increasingly resemble humans and animals. (shrink)

This paper explores the ways in which health care professionals, family carers, and older persons expressed attitudes and opinions on using Paro, a social robot designed to stimulate patients with dementia. Thereafter, we critically evaluate existing prejudicial views toward Paro users to provide recommendations for its future use. Using an exploratory qualitative interview method, we recruited a total of 67 participants in Switzerland. They included 23 care professionals, 17 family carers, and 27 older persons. Data obtained were analyzed thematically. Study (...) findings present general agreement that Paro is an appealing and beneficial social robot, but it is not a tool that everyone feels comfortable with. Because it is perceived as “child play,” it would be demeaning for competent adults to play with such things. Consequently, Paro is appropriate only for persons with dementia. These findings brought forth ethical concerns about deception, infantilization, and respecting older persons' dignity. The idea of who is an appropriate Paro user led to our discussions on predicting future Paro users. The meaning of using social robotics in nursing homes can be conditioned by a rigid interpretation of adulthood and playful behavior. To protect future selves when one is living with dementia from prejudices, it may be useful for older persons and their loved ones to plan their future care situations to ensure that they are treated in accordance with their delineated decisions. (shrink)

Personal AI is a new type of AI companion, distinct from the prevailing forms of AI companionship. Instead of playing a narrow and well-defined social role, like friend, lover, caretaker, or colleague, with a set of pre-determined responses and behaviors, Personal AI is engineered to tailor itself to the user, including learning to mirror the user’s unique emotional language and attitudes. This paper identifies two issues with Personal AI. First, like other AI companions, it is deceptive about the presence of (...) their emotions, which undermines the moral value of companionship. Second, Personal AI leads to a distinctly new form of deception concerning the origins of its emotions. Its emotional attitudes appear to belong to it, when in fact they are only reflections of the user. This results in what I dub “emotional bubbles”—the false impression that personal emotions are externally validated—which have at least two troubling implications. First, emotional bubbles prevent us from encountering emotional attitudes that differ from our own, which is likely to cripple emotional growth and the ability to form diverse social and emotional relationships. Second, if we assume, as some philosophers claim, that shared emotions are constitutive of shared values, it follows that Personal AI subverts joint moral deliberation. Users believe their personal values are externally validated, when they are only validated by themselves. Because of the absence of technovirtues able to handle this problem, I suggest that we proceed very cautiously with the development and marketing of Personal AI. (shrink)

The present paper aims at contributing to the ethical debate on the impacts of artificial intelligence (AI) systems on human autonomy. More specifically, it intends to offer a clearer understanding of the design challenges to the effort of aligning driving automation technologies to this ethical value. After introducing the discussion on the ambiguous impacts that AI systems exert on human autonomy, the analysis zooms in on how the problem has been discussed in the literature on connected and automated vehicles (CAVs). (...) On this basis, it is claimed that the issue has been mainly tackled on a fairly general level, and mostly with reference to the controversial issue of crash-optimization algorithms, so that only limited design insights have been drawn. However, integrating ethical analysis and design practices is critical to pursue the implementation of such an important ethical value into CAV technologies. To this aim, it is argued, a more applied approach targeted at examining the impacts on human autonomy of current CAV functions should also be explored. As an example of the intricacy of this task, the case of automated route planning is discussed in some detail. (shrink)

Background Gerontechnologies are increasingly used in the care for older people. Many studies on their acceptability and ethical implications are conducted, but mainly from the perspective of principlism. This narrows our ethical gaze on the implications the use of these technologies have. Research question How do participants speak about the impact that gerontechnologies have on the different phases of care, and care as a process? What are the moral implications from an ethic of care perspective? Research design Secondary analysis of (...) semi-structure interviews, whose segments on specific technologies were analysed through reflexive thematic analysis. Participants and research context Sixty-seven Swiss stakeholders involved in the use of gerontechnologies, including professional caregivers, informal caregivers, and older persons themselves. Ethical considerations The research study was evaluated by the Ethics Commission of Northwest and Central Switzerland (EKNZ). All participants received an information document before the interview date detailing the purpose, procedure, and anonymization measures. After explaining the study during the agreed upon interview time and upon receiving their written informed consent, the interview process began. Findings/results Four themes are identified: Identifying care needs, Taking responsibility, Hands-on work, Responding to care. As part of these themes, many codes highlighting the ambivalent impact of gerontechnologies are created, ranging from ‘Expanded capacity for…identifying care needs’ to ‘Create new & (un)necessary…hands-on work’. The moral implications of these results from the care ethics perspective are discussed, through the ethical elements of: attentiveness, responsibility, competence, and responsiveness. Conclusions The moral implications of gerontechnologies on care phases from the care ethics perspective open up several questions on whether they actually help give care a central role in social life and provide more competent care. (shrink)

Social isolation and loneliness are growing concerns around the globe that put people at increased risk of disease and early death. One much‐touted approach to addressing them is deploying artificially intelligent agents to serve as companions for socially isolated and lonely people. Focusing on digital humans, we consider evidence and ethical arguments for and against this approach. We set forth and defend public health policies that respond to concerns about replacing humans, establishing inferior relationships, algorithmic bias, distributive justice, and data (...) privacy. (shrink)

In this paper we examine how the use of robots in caring for elders can impact the meaningfulness of elders’ lives. We present a framework for understanding ‘meaningfulness in life’, and then apply that framework in discussing ways in which the use of robots to assist in activities of daily living can preserve, enhance or undermine the meaningfulness of elders’ lives. We conclude with a discussion of if and how having false beliefs about companion robots can affect meaningfulness in the (...) life of the person having those false beliefs. (shrink)

BackgroundSocially assistive devices (care robots, companions, smart screen assistants) have been advocated as a promising tool in elderly care in Western healthcare systems. Ethical debates indicate various challenges. One of the most prevalent arguments in the debate is the double-benefit argument claiming that socially assistive devices may not only provide benefits for autonomy and well-being of their users but might also be more efficient than other caring practices and might help to mitigate scarce resources in healthcare. Against this background, we (...) used a subset of comparative empirical studies from a comprehensive systematic review on effects and perceptions of human-machine interaction with socially assistive devices to gather and appraise all available evidence supporting this argument from the empirical side.MethodsElectronic databases and additional sources were queried using a comprehensive search strategy which generated 9851 records. Studies were screened independently by two authors. Methodological quality of studies was assessed. For 39 reports using a comparative study design, a narrative synthesis was performed.ResultsThe data shows positive evidential support to claim that some socially assistive devices (Paro) might be able to contribute to the well-being and autonomy of their users. However, results also indicate that these positive findings may be heavily dependent on the context of use and the population. In addition, we found evidence that socially assistive devices can have negative effects on certain populations. Evidence regarding the claim of efficiency is scarce. Existing results indicate that socially assistive devices can be more effective than standard of care but are far less effective than plush toys or placebo devices.DiscussionWe suggest using the double-benefit argument with great caution as it is not supported by the currently available evidence. The occurrence of potentially negative effects of socially assistive devices requires more research and indicates a more complex ethical calculus than suggested by the double-benefit argument. (shrink)

Mark Coeckelbergh (Int J Soc Robot 1:217–221, 2009) argues that robot ethics should investigate what interaction with robots can do to humans rather than focusing on the robot’s moral status. We should ask what robots do to our sociality and whether human–robot interaction can contribute to the human good and human flourishing. This paper extends Coeckelbergh’s call and investigate what it means to live with disembodied AI-powered agents. We address the following question: Can the human–AI interaction contribute to our moral (...) development? We present an empirically informed philosophical analysis of how the AI personal assistant Siri changes its users’ way of life, based on the responses obtained from 20 semi-directive individual interviews with Siri users. We identify changes in the users’ social interaction associated with the adoption of Siri. These changes include: (1) the indirect effect of reducing opportunities of human interaction, (2) the second-order effect of diminished expectations toward each other in a community, and (3) the acquired preference to obtain hassle-free interaction with Siri over human interaction. We examine them in relation to concerns that are voiced in the current debates over the rise of AI, namely the suspicion that humans could become overly reliant on AI (Danaher 2019) and the worry that social AI could impede on moral development (Fröding and Peterson, Ethics Inf Technol 23:207–214, 2012; Li, Ethics Inf Technol 23:543–550, 2021). We analyze the ethical costs that come from these changes in light of virtue ethics and address potential objections along the way. We end by offering directions for thinking about how to live with AI personal assistant while preserving favorable conditions for moral development. (shrink)

Advancements in artificial intelligence and (social) robotics raise pertinent questions as to how these technologies may help shape the society of the future. The main aim of the chapter is to consider the social and conceptual disruptions that might be associated with social robots, and humanoid social robots in particular. This chapter starts by comparing the concepts of robots and artificial intelligence and briefly explores the origins of these expressions. It then explains the definition of a social robot, as well (...) as the definition of humanoid robots. A key notion in this context is the idea of anthropomorphism: the human tendency to attribute human qualities, not only to our fellow human beings, but also to parts of nature and to technologies. This tendency to anthropomorphize technologies by responding to and interacting with them as if they have human qualities is one of the reasons why social robots (in particular social robots designed to look and behave like human beings) can be socially disruptive. As is explained in the chapter, while some ethics researchers believe that anthropomorphization is a mistake that can lead to various forms of deception, others — including both ethics researchers and social roboticists — believe it can be useful or fitting to treat robots in anthropomorphizing ways. The chapter explores that disagreement by, among other things, considering recent philosophical debates about whether social robots can be moral patients, that is, whether it can make sense to treat them with moral consideration. Where one stands on this issue will depend either on one’s views about whether social robots can have, imitate, or represent morally relevant properties, or on how people relate to social robots in their interactions with them. Lastly, the chapter urges that the ethics of social robots should explore intercultural perspectives, and highlights some recent research on Ubuntu ethics and social robots. (shrink)

The increasing complexity and ubiquity of autonomously operating artificially intelligent (AI) systems call for a robust theoretical reconceptualization of responsibility and control. The Meaningful Human Control (MHC) approach to the design and operation of AI systems provides such a framework. However, in its focus on accountability and minimizing harms, it neglects how we may flourish in interaction with such systems. In this chapter, I show how the MHC framework can be expanded to meet this challenge by drawing on the ethics (...) of carebots and embodied design. First, I examine how discussions about flourishing with carebots invite us to consider the extent to which we control our moral character Second, I argue that we can understand the cultivation of moral character in terms of embodied virtues arising from operating in particular ecologies. Third, I demonstrate how this analysis fruitfully informs the design of carebots as supporting reciprocity and empathy. (shrink)

In recent years, research in robotics and artificial intelligence (AI) has made rapid progress. It is expected that robots and AI will play a part in the field of nursing and their role might broaden in the future. However, there are areas of nursing practice that cannot or should not be entrusted to robots and AI, because nursing is a highly humane practice, and therefore, there would, perhaps, be some practices that should not be replicated by robots or AI. Therefore, (...) this paper focuses on several ethical concepts (advocacy, accountability, cooperation, and caring) that are considered important in nursing practice, and examines whether it is possible to implement these ethical concepts in robots and AI by analyzing the concepts and the current state of robotics and AI technology. Advocacy: Among the components of advocacy, safeguarding and apprising can be more easily implemented, while elements that require emotional communication with patients, such as valuing and mediating, are difficult to implement. Accountability: Robotic nurses with explainable AI have a certain level of accountability. However, the concept of explanation has problems of infinite regression and attribution of responsibility. Cooperation: If robot nurses are recognized as members of a community, they require the same cooperation as human nurses. Caring: More difficulties are expected in care-receiving than in caregiving. However, the concept of caring itself is ambiguous and should be explored further. Accordingly, our analysis suggests that, although some difficulties can be expected in each of these concepts, it cannot be said that it is impossible to implement them in robots and AI. However, even if it were possible to implement these functions in the future, further study is needed to determine whether such robots or AI should be used for nursing care. In such discussions, it will be necessary to involve not only ethicists and nurses but also an array of society members. (shrink)

Many researchers from robotics, machine ethics, and adjacent fields seem to assume that norms represent good behavior that social robots should learn to benefit their users and society. We would like to complicate this view and present seven key troubles with norm-compliant robots: (1) norm biases, (2) paternalism (3) tyrannies of the majority, (4) pluralistic ignorance, (5) paths of least resistance, (6) outdated norms, and (7) technologically-induced norm change. Because discussions of why norm-compliant robots can be problematic are noticeably absent (...) from the robot and machine ethics literature, this paper fills an important research gap. We argue that it is critical for researchers to take these issues into account if they wish to make norm-compliant robots. (shrink)

The implementation of care robotics in care settings is identified by some authors as a disruptive innovation, in the sense that it will upend the praxis of care. It is an open ethical question whether this alleged disruption will also have a transformative impact on established ethical concepts and principles. One prevalent worry is that the implementation of care robots will turn deception into a routine component of elderly care, at least to the extent that these robots will function as (...) simulacra for something that they are not (i.e. human caregivers). At face value, this may indeed seem to indicate a concern for how this technology may upend existing practices and relationships within a care setting. Yet, on closer inspection, this reaction may rather point to a rediscovery and a revaluation of a particularly well-entrenched value or virtue, i.e. veracity. The virtue of veracity is one of the values that is mobilized to argue against a substitution of human caregivers (while a combination of care robots and human caregivers is much more accepted). The subject of this paper is to explore how the moral panic surrounding care robots should not so much be interpreted as an anticipated and probable disruptor in a care setting, but rather as a sensitizing – in a way conservationist – argument that identifies veracity as an established value that is supposed to be protected and advanced in present day and future care settings. (shrink)

Robots as social companions in close proximity to humans have a strong potential of becoming more and more prevalent in the coming years, especially in the realms of elder day care, child rearing, and education. As human beings, we have the fascinating ability to emotionally bond with various counterparts, not exclusively with other human beings, but also with animals, plants, and sometimes even objects. Therefore, we need to answer the fundamental ethical questions that concern human-robot-interactions per se, and we need (...) to address how we conceive of »good lives«, as more and more of the aspects of our daily lives will be interwoven with social robots. (shrink)

Social robots are designed to perform intelligent, emotional, and autonomous behavior in order to establish intimate relationships with humans, for instance, in the context of elderly care. However, the imitation of qualities usually assumed to be necessary for human reciprocal interaction may impact our understanding of social interaction. Against this background, we compare the technical operations based on which social robots imitate human-like behavior with the concepts of emotionality, intelligence, and autonomy as usually attached to humans. In doing so, we (...) aim at making a conceptual contribution to the intuition that the technical imitation of emotional, intelligent, and autonomous behavior differs qualitatively from human forms of emotionality, intelligence, and autonomy. We conclude that the increasing tendency of social robots to imitate human characteristics and the thus increased human tendency of anthropomorphizing technical systems put forth new forms of human–machine interactions (HMI) that call for a critical examination. Thus, the emerging forms of interaction may lead, for instance, to false, reinforced, and perplexing assumptions regarding reciprocity. Therefore, studies are needed that critically examine the potential consequences and psychological effects that may be associated with the use of social robots, especially with regard to vulnerable groups such as children or the elderly. (shrink)

This chapter discusses three types of sociable robots for older adults: robotic caregivers ; robotic friends ; and sex robots. The central argument holds that society ought to make reasonable efforts to provide these types of robots and that under certain conditions, omitting such support not only harms older adults but poses threats to their dignity. The argument proceeds stepwise. First, the chapter establishes that assisting care-dependent older adults to perform activities of daily living is integral to respecting dignity. Here, (...) the argument establishes the vital role that carebots-of-the-future might play in aged societies as the supply of working age adults falls shy of demand. Next, the chapter extends this analysis to designing friendbots for socially isolated older adults. The argument holds that reasonable efforts to provide access to friendbots for socially isolated adults is also a future societal responsibility. Finally, the chapter applies similar reasoning to show that societies ought to make reasonable efforts to support sexual capabilities for older adults who want to be sexual but are bereft of sex partners. The argument draws on capability accounts of justice to show that when central human capacities, such as bodily integrity; intimate relationships; and the use of senses, imagination and thought, are at risk of falling below a threshold level, society should intercede. (shrink)

In the scenario of growing polarization of promises and dangers that surround artificial intelligence (AI), how to introduce responsible AI and robotics in healthcare? In this paper, we develop an ethical–political approach to introduce democratic mechanisms to technological development, what we call “Caring in the In-Between”. Focusing on the multiple possibilities for action that emerge in the realm of uncertainty, we propose an ethical and responsible framework focused on care actions in between fears and hopes. Using the theoretical perspective of (...) Science and Technology Studies and empirical research, “Caring in the In-Between” is based on three movements: the first is a change of focus from the world of promises and dangers to the world of uncertainties; the second is a conceptual shift from assuming a relationship with robotics based on a Human–Robot Interaction to another focused on the network in which the robot is embedded (the “Robot Embedded in a Network”); and the last is an ethical shift from a general normative framework to a discussion on the context of use. Based on these suggestions, “Caring in the In-Between” implies institutional challenges, as well as new practices in healthcare systems. It is articulated around three simultaneous processes, each of them related to practical actions in the “in-between” dimensions considered: monitoring relations and caring processes, through public engagement and institutional changes; including concerns and priorities of stakeholders, with the organization of participatory processes and alternative forms of representation; and making fears and hopes commensurable, through the choice of progressive and reversible actions. (shrink)

With robots being introduced into caregiving, particularly for older persons, various ethical concerns are raised. Among them is the fear of replacing human caregiving. While ethical concepts like well-being, autonomy, and capabilities are often used to discuss these concerns, this paper brings forth the concept of social dignity to further develop guidelines concerning the use of robots in caregiving. By social dignity, we mean that a person’s perceived dignity changes in response to certain interactions and experiences with other persons. In (...) this paper, we will first present the concept of social dignity, and then identify a niche where robots can be used in caregiving in an ethical manner. Specifically, we will argue that, because some activities of daily living are performed in solitude to maintain dignity, a care recipient will usually prefer robotic assistance instead of human assistance for these activities. Secondly, we will describe how other philosophical concepts, which have been commonly used to judge robotic assistance in caregiving for the elderly so far, such as well-being, autonomy, and capabilities, are less useful in determining whether robotic assistance in caregiving is ethically problematic or not. To conclude, we will argue that social dignity offers an advantage to the other concepts, as it allows to ask the most pressing questions in caregiving. (shrink)

This article explores the implications of what it means to moralize about future technological innovations. Specifically, I have been invited to comment on three papers that attempt to think about what seems to be an impending social reality: the availability of life-like sex robots. In response, I explore what it means to moralize about future technological innovations from a secular perspective, i.e., a perspective grounded in an immanent, socio-historically contingent view. I review the arguments of Nancy Jecker, Mark Howard and (...) Robert Sparrow, and Wang Jue and respond to their arguments concerning the permissible limits of human-robot sexual interaction. I argue that we are in a poor epistemic position regarding what the actual future human response will be towards sex robots and how it affects society generally. Given this poor epistemic position, I argue that moralizing about future trends like human-robot sex is difficult because we do not have the relevant facts to work with. Furthermore, I remain skeptical as to policy recommendations based on socio-historically contingent moral viewpoints both because they do not carry in principle moral authority to say what future others may or may not do with their property and they may not even appeal to future secular others, insofar as secular morality is plural and consistently develops anew. (shrink)

Interactions between humans and machines that include artificial intelligence are increasingly common in nearly all areas of life. Meanwhile, AI-products are increasingly endowed with emotional characteristics. That is, they are designed and trained to elicit emotions in humans, to recognize human emotions and, sometimes, to simulate emotions (EAI). The introduction of such systems in our lives is met with some criticism. There is a rather strong intuition that there is something wrong about getting attached to a machine, about having certain (...) emotions towards it, and about getting involved in a kind of affective relationship with it. In this paper, I want to tackle these worries by focusing on the last aspect: in what sense could it be problematic or even wrong to establish an emotional relationship with EAI-systems? I want to show that the justifications for the widespread intuition concerning the problems are not as strong as they seem at first sight. To do so, I discuss three arguments: the argument from self-deception, the argument from lack of mutuality, and the argument from moral negligence. (shrink)

To integrate social robots in real-life contexts, it is crucial that they are accepted by the users. Acceptance is not only related to the functionality of the robot but also strongly depends on how the user experiences the interaction. Established design principles from usability and user experience research can be applied to the realm of human–robot interaction, to design robot behavior for the comfort and well-being of the user. Focusing the design on these aspects alone, however, comes with certain ethical (...) challenges, especially regarding the user’s privacy and autonomy. Based on an example scenario of human–robot interaction in elder care, this paper discusses how established design principles can be used in social robotic design. It then juxtaposes these with ethical considerations such as privacy and user autonomy. Combining user experience and ethical perspectives, we propose adjustments to the original design principles and canvass our own design recommendations for a positive and ethically acceptable social human–robot interaction design. In doing so, we show that positive user experience and ethical design may be sometimes at odds, but can be reconciled in many cases, if designers are willing to adjust and amend time-tested design principles. (shrink)

What does Artificial Intelligence (AI) have to contribute to health care? And what should we be looking out for if we are worried about its risks? In this paper we offer a survey, and initial evaluation, of hopes and fears about the applications of artificial intelligence in medicine. AI clearly has enormous potential as a research tool, in genomics and public health especially, as well as a diagnostic aid. It’s also highly likely to impact on the organisational and business practices (...) of healthcare systems in ways that are perhaps under-appreciated. Enthusiasts for AI have held out the prospect that it will free physicians up to spend more time attending to what really matters to them and their patients. We will argue that this claim depends upon implausible assumptions about the institutional and economic imperatives operating in contemporary healthcare settings. We will also highlight important concerns about privacy, surveillance, and bias in big data, as well as the risks of over trust in machines, the challenges of transparency, the deskilling of healthcare practitioners, the way AI reframes healthcare, and the implications of AI for the distribution of power in healthcare institutions. We will suggest that two questions, in particular, are deserving of further attention from philosophers and bioethicists. What does care look like when one is dealing with data as much as people? And, what weight should we give to the advice of machines in our own deliberations about medical decisions? (shrink)

Nancy Jecker is right when she says that older persons ought not to be ashamed if they wish to remain sexually active in advanced old age. She offers a useful account of the role that sexuality plays in supporting key human capabilities. However, Jecker assumes an exaggerated account of what sex robots are likely to be able to offer for the foreseeable future when she suggests that we are obligated to make them available to older persons with disabilities. Moreover, whether (...) older persons should be ashamed to desire sex robots—or, more importantly, whether we should be ashamed at the thought that we should respond to the sexual needs of older persons by providing them with sex robots—turns on a range of arguments that Jecker fails to adequately consider. (shrink)

This essay interrogates the common assumption that good care is necessarily human care. It looks to disruptive fictional representations of robot care to assist its development of a theory of posthuman care that jettisons the implied anthropocentrism of ethics of care philosophy but retains care’s foregrounding of entanglement, embodiment and obligation. The essay reads speculative representations of robot care, particularly the Swedish television programme Äkta människor (Real Humans), alongside ethics of care philosophy and critical posthumanism to highlight their synergetic critiques (...) of neoliberal affective economies and humanist hierarchies that treat some bodies and affects as more real than others. These texts and discourses assist me in proposing a theory of care that regards vulnerability as the normative effect of posthuman vital embodiment, as opposed to an anomalous state that can be overcome or corrected via neoliberal practice. (shrink)

Healthcare is becoming increasingly automated with the development and deployment of care robots. There are many benefits to care robots but they also pose many challenging ethical issues. This paper takes care robots for the elderly as the subject of analysis, building on previous literature in the domain of the ethics and design of care robots. Using the value sensitive design approach to technology design, this paper extends its application to care robots by integrating the values of care, values that (...) are specific to AI, and higher-scale values such as the United Nations Sustainable Development Goals. The ethical issues specific to care robots for the elderly are discussed at length alongside examples of specific design requirements that work to ameliorate these ethical concerns. (shrink)

“Care robots” offer technological solutions to increasing needs for care just as economic imperatives increasingly regulate the care sector. Ethical critiques of this technology cannot succeed without situating themselves within the crisis of social reproduction under neoliberal capitalism. What, however, constitutes “care” and its status as a potential critical resource, and how might care robots damage this potential? Although robots might threaten norms of care, I argue that they are by no means necessarily damaging. Critiques of care robots must not (...) entrench exclusionary images of the ideal carer. Instead, critical reflection on their use should trouble dominant paradigms of care. (shrink)

Social isolation and loneliness are ongoing threats to health made worse by the coronavirus disease 2019 pandemic. During the pandemic, half the globe's population have been placed under strict physical distancing orders and many long-term care facilities serving older adults went into lockdown mode, restricting access to all visitors, including family members. Before the pandemic emerged, a 2020 National Academy of Sciences, Engineering and Medicine report warned of the underappreciated adverse effects of social isolation and loneliness on health, especially among (...) older populations. Social isolation and loneliness predict all-cause mortality at rates that rival clinical risk factors, such as obesity and smoking; they are associated with greater incidence of psychological, cognitive, and physical morbidities. This paper sets forth a proposal to design robots to function as companions and friends for socially isolated and lonely older people during pandemic emergencies and in aging societies more generally. “The proposal” section presents and defends the proposal. The “Replies to objections” section answers objections based on coercive design, replacement of humans with robots, privacy incursions, and counterfeit companionship. The “Conclusion” section submits that sociable robots offer a promising avenue for addressing social isolation and loneliness during pandemics and hold promise for aging societies more broadly. (shrink)

Nurses have traditionally been regarded as clinicians that deliver compassionate, safe, and empathetic health care (Nurses again outpace other professions for honesty & ethics, 2018). Caring is a fundamental characteristic, expectation, and moral obligation of the nursing and caregiving professions (Nursing: Scope and standards of practice, American Nurses Association, Silver Spring, MD, 2015). Along with caring, nurses are expected to undertake ever‐expanding duties and complex tasks. In part because of the growing physical, intellectual and emotional demandingness, of nursing as well (...) as technological advances, artificial intelligence (AI) and AI care robots are rapidly changing the healthcare landscape. As technology becomes more advanced, efficient, and economical, opportunities and pressure to introduce AI into nursing care will only increase. In the first part of the article, we review recent and existing applications of AI in nursing and speculate on future use. Second, situate our project within the recent literature on the ethics of nursing and AI. Third, we explore three dominant theories of caring and the two paradigmatic expressions of caring (touch and presence) and conclude that AI—at least for the foreseeable future—is incapable of caring in the sense central to nursing and caregiving ethics. We conclude that for AI to be implemented ethically, it cannot transgress the core values of nursing, usurp aspects of caring that can only meaningfully be carried out by human beings, and it must support, open, or improve opportunities for nurses to provide the uniquely human aspects of care. (shrink)

Research into the ethics of artificial intelligence is often categorized into two subareas—robot ethics and machine ethics. Many of the definitions and classifications of the subject matter of these subfields, as found in the literature, are conflated, which I seek to rectify. In this essay, I infer that using the term ‘machine ethics’ is too broad and glosses over issues that the term computational ethics best describes. I show that the subject of inquiry of computational ethics is of great value (...) and indeed is an important frontier in developing ethical artificial intelligence systems. I also show that computational is a distinct, often neglected field in the ethics of AI. In contrast to much of the literature, I argue that the appellation ‘machine ethics’ does not sufficiently capture the entire project of embedding ethics into AI/S, and hence the need for computational ethics. This essay is unique for two reasons; first, it offers a philosophical analysis of the subject of computational ethics that is not found in the literature. Second, it offers a finely grained analysis that shows the thematic distinction among robot ethics, machine ethics and computational ethics. (shrink)

In this panel, we explore the future of value sensitive design (VSD). The stakes are high. Many in public and private sectors and in civil society are gradually realizing that taking our values seriously implies that we have to ensure that values effectively inform the design of technology which, in turn, shapes people’s lives. Value sensitive design offers a highly developed set of theory, tools, and methods to systematically do so.

Twenty-five years ago, robotics guru Joseph Engelberger had a mission to motivate research teams all over the world to design the ‘Elderly Care Giver’, a multitasking personal robot assistant for everyday care needs in old age. In this article, we discuss how this vision of omnipotent care robots has influenced the design strategies of care robotics, the development of R&D initiatives and ethics research on use of care robots. Despite the expectations of robots revolutionizing care of older people, the role (...) of robots in human care has remained marginal. The value of world trade in service robots, including care robots, is rather small. We argue that the implementation of robots in care is not primarily due to negative user attitudes or ethical problems, but to problems in R&D and manufacturing. The care robots currently available on the market are capable of simple, repetitive tasks or colloquial interaction. Thus far, also research on care robots is mostly conducted using imaginary scenarios or small-scale tests built up for research purposes. To develop useful and affordable robot solutions that are ethically, socially and ecologically sustainable, we suggest that robot initiatives should be evaluated within the framework of care ecosystems. This implies that attention has to be paid to the social, emotional and practical contexts in which care is given and received. Also, the political, economic and ecological realities of organizing care and producing technological commodities have to be acknowledged. It is time to openly discuss the drivers behind care robot initiatives to outline the bigger picture of organizing care under conditions of limited resources. (shrink)

An elderly patient in a care home only wants human nurses to provide her care – not robots. If she selected her carers based on skin colour, it would be seen as racist and morally objectionable, but is choosing a human nurse instead of a robot also morally objectionable and speciesist? A plausible response is that it is not, because humans provide a better standard of care than robots do, making such a choice justifiable. In this paper, I show why (...) this response is incorrect, because robots can theoretically care as well as human nurses can. I differentiate between practical caring and emotional caring, and I argue that robots can match the standard of practical care given by human nurses, and they can simulate emotional care. There is growing evidence that people respond positively to robotic creatures and carebots, and AI software is apt to emotionally support patients in spite of the machine’s own lack of emotions. I make the case that the appearance of emotional care is sufficient, and need not be linked to emotional states within the robot. After all, human nurses undoubtedly ‘fake’ emotional care and compassion sometimes, yet their patients still feel adequately cared for. I show that it is a mistake to claim that ‘the human touch’ is in itself a contributor to a higher standard of care; ‘the robotic touch’ will suffice. Nevertheless, it is not speciesist to favour human nurses over carebots, because carebots do not suffer as the result of such a choice. (shrink)

The advent of the so-called Companion Robots is raising many ethical concerns among scholars and in the public opinion. Focusing mainly on robots caring for the elderly, in this paper we analyze these concerns to distinguish which are directly ascribable to robotic, and which are instead preexistent. One of these is the “deception objection”, namely the ethical unacceptability of deceiving the user about the simulated nature of the robot’s behaviors. We argue on the inconsistency of this charge, as today formulated. (...) After that, we underline the risk, for human-robot interaction, to become a hallucinatory relation where the human would subjectify the robot in a dynamic of meaning-overload. Finally, we analyze the definition of “quasi-other” relating to the notion of “uncanny”. The goal of this paper is to argue that the main concern about Companion Robots is the simulation of a human-like interaction in the absence of an autonomous robotic horizon of meaning. In addition, that absence could lead the human to build a hallucinatory reality based on the relation with the robot. (shrink)

Care is more than dispensing pills or cleaning beds. It is about responding to the entire patient. What is called “bedside manner” in medical personnel is a quality of treating the patient not as a mechanism but as a being—much like the caregiver—with desires, ideas, dreams, aspirations, and the gamut of mental and emotional character. As automata, answering an increasing functional need in care, are designed to enact care, the pressure is on their becoming more humanlike to carry out the (...) function more effectively. The question becomes not merely whether the care automaton can effect good bedside manner but whether the patient’s response is not feeling deceived by the humanlikeness. It seems the device must be designed either to effect explicit mere human-“likeness,” thus likely undermining its bedside-manner potential, or to fool the patient completely. Neither option is attractive. This article examines the social problems of designing maximally humanlike care automata and how problems may start to erode the human rights of users/patients. The article then investigates the alternatives for dealing with this problem, whether by industrial and professional self-regulation or public-policy initiatives. It then frames the problem in the broader historical perspective in terms of previous bans, moratoria, and other means of control of hazardous and potentially rights-violating techniques and materials. (shrink)

There is an urge to introduce high technology and robotics in care settings. Assisted living (AL) is the fastest growing form of older adults’ long-term care. Resident autonomy has become the watchword for good care. This article sheds light on the potential effects of care robotics on the sense of autonomy of older people in AL. Three aspects of the residents’ sense of autonomy are of particular interest: (a) interaction-based sense of autonomy, (b) coping-based sense of autonomy, and (c) potential-based (...) sense of autonomy. Ethnographical data on resident autonomy in an AL facility and existing literature on care robots are utilized in studying what kind of assurances different types of robots would provide to maintain the sense of autonomy in AL. Robots could strengthen the different types of sense of autonomy in multiple ways. Different types of robots could widen the residents’ space of daily movements, sustain their capacities, and help them maintain and even create future expectations. Robots may strengthen the sense of autonomy of older persons in AL; however, they may simultaneously pose a threat. Multi-professional discussions are needed on whether robots are welcomed in care, and if they are, how, for whom, and in what areas. (shrink)

Sex robots are likely to play an important role in shaping public understandings of sex and of relations between the sexes in the future. This paper contributes to the larger project of understanding how they will do so by examining the ethics of the “rape” of robots. I argue that the design of realistic female robots that could explicitly refuse consent to sex in order to facilitate rape fantasy would be unethical because sex with robots in these circumstances is a (...) representation of the rape of a woman, which may increase the rate of rape, expresses disrespect for women, and demonstrates a significant character defect. Even when the intention is not to facilitate rape, the design of robots that can explicitly refuse consent is problematic due to the likelihood that some users will experiment with raping them. Designing robots that lack the capacity to explicitly refuse consent may be morally problematic depending on which of two accounts of the representational content of sex with realistic humanoid robots is correct. (shrink)

In this paper, two central questions will be addressed: ought we to implement medical AI technology in the medical domain? If yes, how ought we to implement this technology? I will critically engage with three options that exist with respect to these central questions: the Neo-Luddite option, the Assistive option, and the Substitutive option. I will first address key objections on behalf of the Neo-Luddite option: the Objection from Bias, the Objection from Artificial Autonomy, the Objection from Status Quo, and (...) the Objection from Inscrutability. I will thereafter present the Demographic Trends Argument and the Human Enhancement Argument in support of alternatives to the Neo-Luddite option. In the second half of the paper, I will argue against the Substitutive option and in favour of the Assistive option, given the existence of two chief formal deficits in medical AI technology: the causality deficit and the care deficit. (shrink)

Emotive artificial intelligences are physically or virtually embodied entities whose behavior is driven by artificial intelligence, and which use expressions usually associated with emotion to enhance communication. These entities are sometimes thought to be deceptive, insofar as their emotive expressions are not connected to genuine underlying emotions. In this paper, I argue that such entities are indeed deceptive, at least given a sufficiently broad construal of deception. But, while philosophers and other commentators have drawn attention to the deceptive threat of (...) emotive artificial intelligences, I argue that such entities also pose an overlooked skeptical threat. In short, the widespread existence of emotive signals disconnected from underlying emotions threatens to encourage skepticism of such signals more generally, including emotive signals used by human persons. Thus, while designing artificially intelligent entities to use emotive signals is thought to facilitate human-AI interaction, this practice runs the risk of compromising human-human interaction. (shrink)

Friendship is an important part of the good life. While many roboticists are eager to create friend-like robots, many philosophers and ethicists are concerned. They argue that robots cannot really be our friends. Robots can only fake the emotional and behavioural cues we associate with friendship. Consequently, we should resist the drive to create robot friends. In this article, I argue that the philosophical critics are wrong. Using the classic virtue-ideal of friendship, I argue that robots can plausibly be considered (...) our virtue friends - that to do so is philosophically reasonable. Furthermore, I argue that even if you do not think that robots can be our virtue friends, they can fulfil other important friendship roles, and can complement and enhance the virtue friendships between human beings. (shrink)

As Artificial Intelligence technology seems poised for a major take-off and changing societal dynamics are creating a high demand for caregivers for elders, children and those infirmed-robotic caregivers, may well be used much more often. This article examines the ethical concerns raised by the use of AI caregivers and concludes that many of these concerns are avoided when AI caregivers operate as partners rather than substitutes. Furthermore, most of the remaining concerns are minor and are faced by human caregivers as (...) well. Nonetheless, because AI caregivers’ systems are learning systems, an AI caregiver could stray from its initial guidelines. Therefore, subjecting AI caregivers to an AI-based oversight system is proposed to ensure that their actions remain both legal and ethical. (shrink)

Scenarios involving the introduction of artificially intelligent (AI) assistive technologies in health care practices raise several ethical issues. In this paper, I discuss four objections to introducing AI assistive technologies in health care practices as replacements of human care. I analyse them as demands for felt care, good care, private care, and real care. I argue that although these objections cannot stand as good reasons for a general and a priori rejection of AI assistive technologies as such or as replacements (...) of human care, they demand us to clarify what is at stake, to develop more comprehensive criteria for good care, and to rethink existing practices of care. In response to these challenges, I propose a (modified) capabilities approach to care and emphasize the inherent social dimension of care. I also discuss the demand for real care by introducing the ‘Care Experience Machine’ thought experiment. I conclude that if we set the standards of care too high when evaluating the introduction of AI assistive technologies in health care, we have to reject many of our existing, low-tech health care practices. (shrink)

The discussion about robots in elderly care is populated by doom scenarios about a totally dehumanized care system in which elderly people are taken care of by machines. Such scenarios are helpful as they attend us to what we think is important with regard to the quality elderly care. However, this article argues that they are misleading in so far as they (1) assume that deception in care is always morally unacceptable, (2) suggest that robots and other information technologies necessarily (...) deceive elderly people by creating a “virtual” world as opposed to a “real” world, (3) assume that elderly people of the future have similar ICT skills and interests as the elderly people of today, and (4) assume a simplistic view of technologies. The article suggests an approach to evaluating care robots and ICT in health care which acknowledges and addresses a number of ethical problems raised by robotic care—for instance disengagement problems—while taking into account that some elderly people may need care that does not treat them as (empirically) autonomous, that many the elderly of the future are likely to be digital natives, and that the task of evaluating technologies in care is more complicated than the discussion of deception suggests. (shrink)

In this paper I describe a future in which persons in advanced old age are cared for entirely by robots and suggest that this would be a dystopia, which we would be well advised to avoid if we can. Paying attention to the objective elements of welfare rather than to people’s happiness reveals the central importance of respect and recognition, which robots cannot provide, to the practice of aged care. A realistic appreciation of the current economics of the aged care (...) sector suggests that the introduction of robots into an aged care setting will most likely threaten rather than enhance these goods. I argue that, as a result, the development of robotics is likely to transform aged care in accordance with a trajectory of development that leads towards this dystopian future even when this is not the intention of the engineers working to develop robots for aged care. While an argument can be made for the use of robots in aged care where the people being cared for have chosen to allow robots in this role, I suggest that over-emphasising this possibility risks rendering it a self-fulfilling prophecy, depriving those being cared for of valuable social recognition, and failing to provide respect for older persons by allowing the options available to them to be shaped by the design choices of others. (shrink)