Ambient assisted living technologies can provide assistance and support to persons with dementia. They might allow them the possibility of living at home for longer whilst maintaining their comfort and security as well as offering a way towards reducing the huge economic and personal costs forecast as the incidence of dementia increases worldwide over coming decades. However, the development, introduction and use of AAL technologies also trigger serious ethical issues. This paper is a systematic literature review of the on-going scholarly (...) debate about these issues. More specifically, we look at the ethical issues involved in research and development, clinical experimentation, and clinical application of AAL technologies for people with dementia and related stakeholders. In the discussion we focus on: the value of the goals of AAL technologies, the special vulnerability of persons with dementia in their private homes, the complex question of informed consent for the usage of AAL technologies. (shrink)

In this paper I investigate the web-rhetoric of companies offering home-based personal health monitoring to patients and elderly people. Two main rhetorical methods are found, namely a reference to practical benefits and a use of prestige words like “quality of life” and “independence”. I interpret the practical benefits in terms of instrumental values and the prestige words in terms of final values. I also reconstruct the arguments on the websites in terms of six different types of argument. Finally, I articulate (...) a general critique of the arguments, namely that the websites neglect the context of use of personal health monitoring technologies. Whether or not a technology is good depends on the use of the technology by a particular individual in a particular context. The technology is not good–or bad–in itself. I support this critique with a number of more specific arguments such as the risk for reduced personal contact. For some elderly people social contact with care providers is more valuable than the independent living made possible by remote monitoring, for others independence is more important. (shrink)

It is a common experience among care professionals that persons with dementia often say ‘no’ to conventional caring measures such as taking medication, eating or having a shower. This tendency to say ‘no’ may also concern the use of assistive technologies such as fall detectors, mobile safety alarms, Internet for social contact and robots. This paper provides practical recommendations for care professionals in home health care and social care about how to respond to such resistiveness towards assistive technologies. Apart from (...) the option of accepting the ‘no’, it discusses a number of methods for influencing persons with dementia in order to overcome the ‘no’. These methods range from various non-coercive measures—including nudging—to coercion. It is argued that while conventional caring measures like those mentioned are essential for survival, health or hygiene, assistive technologies are commonly merely potentially beneficial supplements. With this in mind, it is concluded that care professionals should be more restrictive in using methods of influence involving some degree of pressure regarding assistive technologies than regarding conventional caring measures. (shrink)

This paper surveys the state-of-the-art in machine ethics, that is, considerations of how to implement ethical behaviour in robots, unmanned autonomous vehicles, or software systems. The emphasis is on covering the breadth of ethical theories being considered by implementors, as well as the implementation techniques being used. There is no consensus on which ethical theory is best suited for any particular domain, nor is there any agreement on which technique is best placed to implement a particular theory. Another unresolved problem (...) in these implementations of ethical theories is how to objectively validate the implementations. The paper discusses the dilemmas being used as validating ‘whetstones’ and whether any alternative validation mechanism exists. Finally, it speculates that an intermediate step of creating domain-specific ethics might be a possible stepping stone towards creating machines that exhibit ethical behaviour. (shrink)

If existing or future robots appear to have some capacity, state or property, how can we determine whether they truly have it or whether we are deceived into believing so? John Danaher addresses this question by formulating his approach to what he refers to as superficial state deception (SSD) from the perspective of his theory termed ethical behaviourism (EB), which was initially designed to determine the moral status of robots. In summary, Danaher believes that focusing on behaviour is sufficient to (...) determine whether SSD occurs. My general claim is that Danaher’s approach to SSD based on EB is implausible since it results in the impossibility of conceptualizing SSD, e.g., it does not enable determining whether or not SSD occurs in a particular case. Moreover, I show how Danaher’s approach to SSD needs to be transformed to become plausible. To make my point, I (1) examine the main features of EB and distinguish its two versions by showing how Danaher revised the original EB in response to criticism; (2) discuss Danaher’s approach to the problem of deception from the perspective of EB; (3) criticize that approach by showing that it requires revisions analogous to those that have already been recommended in reference to EB, and (4) propose an alternative method for determining the presence of SSD that covers diverse, plausible approaches to SSD. (shrink)

Personal AI is a new type of AI companion, distinct from the prevailing forms of AI companionship. Instead of playing a narrow and well-defined social role, like friend, lover, caretaker, or colleague, with a set of pre-determined responses and behaviors, Personal AI is engineered to tailor itself to the user, including learning to mirror the user’s unique emotional language and attitudes. This paper identifies two issues with Personal AI. First, like other AI companions, it is deceptive about the presence of (...) their emotions, which undermines the moral value of companionship. Second, Personal AI leads to a distinctly new form of deception concerning the origins of its emotions. Its emotional attitudes appear to belong to it, when in fact they are only reflections of the user. This results in what I dub “emotional bubbles”—the false impression that personal emotions are externally validated—which have at least two troubling implications. First, emotional bubbles prevent us from encountering emotional attitudes that differ from our own, which is likely to cripple emotional growth and the ability to form diverse social and emotional relationships. Second, if we assume, as some philosophers claim, that shared emotions are constitutive of shared values, it follows that Personal AI subverts joint moral deliberation. Users believe their personal values are externally validated, when they are only validated by themselves. Because of the absence of technovirtues able to handle this problem, I suggest that we proceed very cautiously with the development and marketing of Personal AI. (shrink)

Since the Nuremberg Code and the first Declaration of Helsinki, globally there has been increasing adoption and adherence to procedures for ensuring that human subjects in research are as well informed as possible of the study’s reasons and risks and voluntarily consent to serving as subject. To do otherwise is essentially viewed as violation of the human research subject’s legal and moral rights. However, with the recent philosophical concerns about responsible robotics, the limits and ambiguities of research-subjects ethical codes become (...) apparent on the matter of constructing automata that maximally resemble human beings (as defined hereunder). In this case, the automata themselves, as products of research and development, are in the very process of their construction subjects of research and development. However, such research faces a paradox: The subjects cannot give their informed consent to this research for their own development, although their consent would be needed for the research. According to ethical codes, this research would be unethical. The article then explores whether the background concepts giving rise to this paradox could be reframed in order to allow such research to proceed ethically. (shrink)

Care is more than dispensing pills or cleaning beds. It is about responding to the entire patient. What is called “bedside manner” in medical personnel is a quality of treating the patient not as a mechanism but as a being—much like the caregiver—with desires, ideas, dreams, aspirations, and the gamut of mental and emotional character. As automata, answering an increasing functional need in care, are designed to enact care, the pressure is on their becoming more humanlike to carry out the (...) function more effectively. The question becomes not merely whether the care automaton can effect good bedside manner but whether the patient’s response is not feeling deceived by the humanlikeness. It seems the device must be designed either to effect explicit mere human-“likeness,” thus likely undermining its bedside-manner potential, or to fool the patient completely. Neither option is attractive. This article examines the social problems of designing maximally humanlike care automata and how problems may start to erode the human rights of users/patients. The article then investigates the alternatives for dealing with this problem, whether by industrial and professional self-regulation or public-policy initiatives. It then frames the problem in the broader historical perspective in terms of previous bans, moratoria, and other means of control of hazardous and potentially rights-violating techniques and materials. (shrink)

When the social relevance of robotic applications is addressed today, the use of assistive technology in care settings is almost always the first example. So-called care robots are presented as a solution to the nursing crisis, despite doubts about their technological readiness and the lack of concrete usage scenarios in everyday nursing practice. We inquire into this interconnection of social robotics and care. We show how both are made available for each other in three arenas: innovation policy, care organization, and (...) robotic engineering. First, we analyze the discursive “logics” of care robotics within European innovation policy, second, we disclose how care robotics is encountering a historically grown conflict within health care organization, and third we show how care scenarios are being used in robotic engineering. From this diagnosis, we derive a threefold critique of robotics in healthcare, which calls attention to the politics, historicity, and social situatedness of care robotics in elderly care. (shrink)

As the aim of the responsible robotics initiative is to ensure that responsible practices are inculcated within each stage of design, development and use, this impetus is undergirded by the alignment of ethical and legal considerations towards socially beneficial ends. While every effort should be expended to ensure that issues of responsibility are addressed at each stage of technological progression, irresponsibility is inherent within the nature of robotics technologies from a theoretical perspective that threatens to thwart the endeavour. This is (...) because the concept of responsibility, despite being treated as such, is not monolithic: rather this seemingly unified concept consists of converging and confluent concepts that shape the idea of what we colloquially call responsibility. From a different perspective, robotics will be simultaneously responsible and irresponsible depending on the particular concept of responsibility that is foregrounded: an observation that cuts against the grain of the drive towards responsible robotics. This problem is further compounded by responsible design and development as contrasted to responsible use. From a different perspective, the difficulty in defining the concept of responsibility in robotics is because human responsibility is the main frame of reference. Robotic systems are increasingly expected to achieve the human-level performance, including the capacities associated with responsibility and other criteria which are necessary to act responsibly. This subsists within a larger phenomenon where the difference between humans and non-humans, be it animals or artificial systems, appears to be increasingly blurred, thereby disrupting orthodox understandings of responsibility. This paper seeks to supplement the responsible robotics impulse by proposing a complementary set of human rights directed specifically against the harms arising from robotic and artificial intelligence technologies. The relationship between responsibilities of the agent and the rights of the patient suggest that a rights regime is the other side of responsibility coin. The major distinction of this approach is to invert the power relationship: while human agents are perceived to control robotic patients, the prospect for this to become reversed is beginning. As robotic technologies become ever more sophisticated, and even genuinely complex, asserting human rights directly against robotic harms become increasingly important. Such an approach includes not only developing human rights that ‘protect’ humans but also ‘strengthen’ people against the challenges introduced by robotics and AI [This distinction parallels Berlin’s negative and positive concepts of liberty ], by emphasising the social and reflective character of the notion of humanness as well as the difference between the human and nonhuman. This will allow using the human frame of reference as constitutive of, rather than only subject to, the robotic and AI technologies, where it is human and not technology characteristics that shape the human rights framework in the first place. (shrink)

The discourse on the future of work should learn from a turn in philosophy that occurred in the 1980s, one that recognizes the good life towards which ethics strives can only be reached on a foundation of caring relationships (Gillian, 1982; Noddings, 1984). Care ethics recognizes that human well-being is a group project, one that involves strong relationships, and concern for bodies and emotions. Too often, these features are left out of research exploring robotics in the workplace. This paper outlines (...) the main tenets of care ethics, then applies the moral framework to the context of industrial and retail settings using robots. This approach sees these contexts through a relational lens, helping to identify, evaluate, and improve relationships critical to ensuring workers’ well-being. Second, care ethics considers taking care of people’s bodies beyond mere safety, examining how working with robots can exacerbate societal or economic pressures. Lastly, care ethics takes emotions as an important source of knowledge in building and supporting care. Additionally, this paper contributes to the care ethics literature by applying the framework to the context of robotized industrial workplaces, which has yet to be done. (shrink)

Although sexual activity among elderly people remains taboo, residents in eldercare institutions often still have sexual desires, and catering for these desires could improve the quality of life for some of society’s most vulnerable – and most depressed – people. I argue that sexbots are apt to provide such a sexual service. I consider the potential benefits and pitfalls of other sexual possibilities, such as having sex with other residents, nurses, or sex workers, or using sexual aids to masturbation, and (...) I suggest that although some of these have potential, the use of sexbots should nevertheless be considered in addition to them. I address some potential criticisms, including moral objections to sexbots, sex not being a physiological necessity, issues of social justice, and the fact that many others in society do not have their sexual needs catered for. I give some suggestions for safety and dexterity modifications to current sexbots to enable their safe use by elderly people. (shrink)

Intelligent environments aim to provide context-sensitive services to humans in the physical spaces in which they work and live. While the ethical dimensions of these systems have been considered, this is an aspect which requires further analysis. A literature review shows that these approaches are disconnected from each other, and that they are making little impact on real systems being built. This article provides a solution to both of these problems. It synthesises the ethical issues addressed by previous work and (...) highlights other important concerns which have been overlooked so far. Furthermore, it proposes an alternative, more holistic approach that can be used to guide the development of intelligent environments. The validity of the framework is demonstrated by its integration into an actual project. (shrink)

The anticipated social capabilities of robots may allow them to serve in authority roles as part of human-machine teams. To date, it is unclear if, and to what extent, human team members will comply with requests from their robotic teammates, and how such compliance compares to requests from human teammates. This research examined how the human-likeness and physical embodiment of a robot affect compliance to a robot's request to perseverate utilizing a novel task paradigm. Across a set of two studies, (...) participants performed a visual search task while receiving ambiguous performance feedback. Compliance was evaluated when the participant requested to stop the task and the coach urged the participant to keep practicing multiple times. In the first study, the coach was either physically co-located with the participant or located remotely via a live-video. Coach type varied in human-likeness and included either a real human, a Nao robot, or a modified Roomba robot. The second study expanded on the first by including a Baxter robot as a coach and replicated the findings in a different sample population with a strict chain of command culture. Results from both studies showed that participants comply with the requests of a robot for up to 11 min. Compliance is less than to a human and embodiment and human-likeness on had weak effects on compliance. (shrink)

BackgroundArtificial intelligence has been described as the “fourth industrial revolution” with transformative and global implications, including in healthcare, public health, and global health. AI approaches hold promise for improving health systems worldwide, as well as individual and population health outcomes. While AI may have potential for advancing health equity within and between countries, we must consider the ethical implications of its deployment in order to mitigate its potential harms, particularly for the most vulnerable. This scoping review addresses the following question: (...) What ethical issues have been identified in relation to AI in the field of health, including from a global health perspective?MethodsEight electronic databases were searched for peer reviewed and grey literature published before April 2018 using the concepts of health, ethics, and AI, and their related terms. Records were independently screened by two reviewers and were included if they reported on AI in relation to health and ethics and were written in the English language. Data was charted on a piloted data charting form, and a descriptive and thematic analysis was performed.ResultsUpon reviewing 12,722 articles, 103 met the predetermined inclusion criteria. The literature was primarily focused on the ethics of AI in health care, particularly on carer robots, diagnostics, and precision medicine, but was largely silent on ethics of AI in public and population health. The literature highlighted a number of common ethical concerns related to privacy, trust, accountability and responsibility, and bias. Largely missing from the literature was the ethics of AI in global health, particularly in the context of low- and middle-income countries.ConclusionsThe ethical issues surrounding AI in the field of health are both vast and complex. While AI holds the potential to improve health and health systems, our analysis suggests that its introduction should be approached with cautious optimism. The dearth of literature on the ethics of AI within LMICs, as well as in public health, also points to a critical need for further research into the ethical implications of AI within both global and public health, to ensure that its development and implementation is ethical for everyone, everywhere. (shrink)

“Care robots” offer technological solutions to increasing needs for care just as economic imperatives increasingly regulate the care sector. Ethical critiques of this technology cannot succeed without situating themselves within the crisis of social reproduction under neoliberal capitalism. What, however, constitutes “care” and its status as a potential critical resource, and how might care robots damage this potential? Although robots might threaten norms of care, I argue that they are by no means necessarily damaging. Critiques of care robots must not (...) entrench exclusionary images of the ideal carer. Instead, critical reflection on their use should trouble dominant paradigms of care. (shrink)

To integrate social robots in real-life contexts, it is crucial that they are accepted by the users. Acceptance is not only related to the functionality of the robot but also strongly depends on how the user experiences the interaction. Established design principles from usability and user experience research can be applied to the realm of human–robot interaction, to design robot behavior for the comfort and well-being of the user. Focusing the design on these aspects alone, however, comes with certain ethical (...) challenges, especially regarding the user’s privacy and autonomy. Based on an example scenario of human–robot interaction in elder care, this paper discusses how established design principles can be used in social robotic design. It then juxtaposes these with ethical considerations such as privacy and user autonomy. Combining user experience and ethical perspectives, we propose adjustments to the original design principles and canvass our own design recommendations for a positive and ethically acceptable social human–robot interaction design. In doing so, we show that positive user experience and ethical design may be sometimes at odds, but can be reconciled in many cases, if designers are willing to adjust and amend time-tested design principles. (shrink)

Social robots are robots that can interact socially with humans. As social robots and the artificial intelligence that powers them becomes more advanced, they will likely take on more social and work roles. This has many important ethical implications. In this paper, we focus on one of the most central of these, the impacts that social robots can have on human autonomy. We argue that, due to their physical presence and social capacities, there is a strong potential for social robots (...) to enhance human autonomy as well as several ways they can inhibit and disrespect it. We argue that social robots could improve human autonomy by helping us to achieve more valuable ends, make more authentic choices, and improve our autonomy competencies. We also argue that social robots have the potential to harm human autonomy by instead leading us to achieve fewer valuable ends ourselves, make less authentic choices, decrease our autonomy competencies, make our autonomy more vulnerable, and disrespect our autonomy. Whether the impacts of social robots on human autonomy are positive or negative overall will depend on the design, regulation, and use we make of social robots in the future. (shrink)

Background: The surge in the development of social robots gives rise to an increased need for systematic methods of assessing attitudes towards robots. Aim: This study presents the development of a questionnaire for assessing attitudinal stance towards social robots: the ASOR. Methods: The 37-item ASOR questionnaire was developed by a task-force with members from different disciplines. It was founded on theoretical considerations of how social robots could influence five different aspects of relatedness. Results: Three hundred thirty-nine people responded to the (...) survey. Factor analysis of the ASOR yielded a three-factor solution consisting of a total of 25 items: “ascription of mental capacities”, “ascription of socio-practical capacities”, and “ascription of socio-moral status”. This data was further triangulated with data from interviews (n = 10). Conclusion: the ASOR allows for assessment of three distinct facets of ascription of capacities to social robots and offers a new type of assessment of attitudes towards social robots. It appeared that ASOR not only assesses ascription of capacities to social robots but it also gauged overall positive attitudes towards social robots. (shrink)

In this paper, we discuss the development of robot use cases in an elderly care facility in the context of exploring the method of Integrative Social Robotics when used on top of a user-centered design approach. Integrative Social Robotics is a new proposal for how to generate responsible, i.e. culturally and ethically sustainable, social robotics applications. Starting point for the discussion are the five principles that characterize an ISR approach, which are discussed in application to the three use cases for (...) robot support in a Danish elderly care facility developed within the smooth project. The discussion by an interdisciplinary design team explores what attention to the five principles of ISR can offer for use case development. We report on the consequences of this short-time exposure to the basic ideas of ISR for use case development and discuss the value of approaching robot development from an ISR perspective. (shrink)

With robots being introduced into caregiving, particularly for older persons, various ethical concerns are raised. Among them is the fear of replacing human caregiving. While ethical concepts like well-being, autonomy, and capabilities are often used to discuss these concerns, this paper brings forth the concept of social dignity to further develop guidelines concerning the use of robots in caregiving. By social dignity, we mean that a person’s perceived dignity changes in response to certain interactions and experiences with other persons. In (...) this paper, we will first present the concept of social dignity, and then identify a niche where robots can be used in caregiving in an ethical manner. Specifically, we will argue that, because some activities of daily living are performed in solitude to maintain dignity, a care recipient will usually prefer robotic assistance instead of human assistance for these activities. Secondly, we will describe how other philosophical concepts, which have been commonly used to judge robotic assistance in caregiving for the elderly so far, such as well-being, autonomy, and capabilities, are less useful in determining whether robotic assistance in caregiving is ethically problematic or not. To conclude, we will argue that social dignity offers an advantage to the other concepts, as it allows to ask the most pressing questions in caregiving. (shrink)

Background The worldwide increase in older persons demands technological solutions to combat the shortage of caregiving and to enable aging in place. Smart home health technologies (SHHTs) are promoted and implemented as a possible solution from an economic and practical perspective. However, ethical considerations are equally important and need to be investigated. Methods We conducted a systematic review according to the PRISMA guidelines to investigate if and how ethical questions are discussed in the field of SHHTs in caregiving for older (...) persons. Results 156 peer-reviewed articles published in English, German and French were retrieved and analyzed across 10 electronic databases. Using narrative analysis, 7 ethical categories were mapped: privacy, autonomy, responsibility, human vs. artificial interactions, trust, ageism and stigma, and other concerns. Conclusion The findings of our systematic review show the (lack of) ethical consideration when it comes to the development and implementation of SHHTs for older persons. Our analysis is useful to promote careful ethical consideration when carrying out technology development, research and deployment to care for older persons. Registration We registered our systematic review in the PROSPERO network under CRD42021248543. (shrink)

As Artificial Intelligence technology seems poised for a major take-off and changing societal dynamics are creating a high demand for caregivers for elders, children and those infirmed-robotic caregivers, may well be used much more often. This article examines the ethical concerns raised by the use of AI caregivers and concludes that many of these concerns are avoided when AI caregivers operate as partners rather than substitutes. Furthermore, most of the remaining concerns are minor and are faced by human caregivers as (...) well. Nonetheless, because AI caregivers’ systems are learning systems, an AI caregiver could stray from its initial guidelines. Therefore, subjecting AI caregivers to an AI-based oversight system is proposed to ensure that their actions remain both legal and ethical. (shrink)

This article reviews the reasons scholars hold that driverless cars and many other AI equipped machines must be able to make ethical decisions, and the difficulties this approach faces. It then shows that cars have no moral agency, and that the term ‘autonomous’, commonly applied to these machines, is misleading, and leads to invalid conclusions about the ways these machines can be kept ethical. The article’s most important claim is that a significant part of the challenge posed by AI-equipped machines (...) can be addressed by the kind of ethical choices made by human beings for millennia. Ergo, there is little need to teach machines ethics even if this could be done in the first place. Finally, the article points out that it is a grievous error to draw on extreme outlier scenarios—such as the Trolley narratives—as a basis for conceptualizing the ethical issues at hand. (shrink)

Values such as respect for autonomy, safety, enablement, independence, privacy and social connectedness should be reflected in the design of social robots. The same values should affect the process by which robots are introduced into the homes of older people to support independent living. These values may, however, be in tension. We explored what potential users thought about these values, and how the tensions between them could be resolved. With the help of partners in the ACCOMPANY project, 21 focus groups (...) were convened in France, the Netherlands and the UK. These groups consisted of: older people, informal carers and formal carers of older people. The participants were asked to discuss scenarios in which there is a conflict between older people and others over how a robot should be used, these conflicts reflecting tensions between values. Participants favoured compromise, persuasion and negotiation as a means of reaching agreement. Roles and related role-norms for the robot were thought relevant to resolving tensions, as were hypothetical agreements between users and robot-providers before the robot is introduced into the home. Participants’ understanding of each of the values—autonomy, safety, enablement, independence, privacy and social connectedness—is reported. Participants tended to agree that autonomy often has priority over the other values, with the exception in certain cases of safety. The second part of the paper discusses how the values could be incorporated into the design of social robots and operationalised in line with the views expressed by the participants. (shrink)

When should we use care robots? In this paper we endorse the shift from a simple normative approach to care robots ethics to a complex one: we think that one main task of a care robot ethics is that of analysing the different ways in which different care robots may affect the different values at stake in different care practices. We start filling a gap in the literature by showing how the philosophical analysis of the nature of healthcare activities can (...) contribute to robot ethics. We rely on the nature-of-activities approach recently proposed in the debate on human enhancement, and we apply it to the ethics of care robots. The nature-of-activities approach will help us to understand why certain practice-oriented activities in healthcare should arguably be left to humans, but certain goal-directed activities in healthcare can be fulfilled with the assistance of a robot. In relation to the latter, we aim to show that even though all healthcare activities can be considered as practice-oriented, when we understand the activity in terms of different legitimate ‘fine-grained’ descriptions, the same activities or at least certain components of them can be seen as clearly goal-directed. Insofar as it allows us to ethically assess specific functionalities of specific robots to be deployed in well-defined circumstances, we hold the nature-of-activities approach to be particularly helpful also from a design perspective, i.e. to realize the Value Sensitive Design approach. (shrink)

This essay interrogates the common assumption that good care is necessarily human care. It looks to disruptive fictional representations of robot care to assist its development of a theory of posthuman care that jettisons the implied anthropocentrism of ethics of care philosophy but retains care’s foregrounding of entanglement, embodiment and obligation. The essay reads speculative representations of robot care, particularly the Swedish television programme Äkta människor (Real Humans), alongside ethics of care philosophy and critical posthumanism to highlight their synergetic critiques (...) of neoliberal affective economies and humanist hierarchies that treat some bodies and affects as more real than others. These texts and discourses assist me in proposing a theory of care that regards vulnerability as the normative effect of posthuman vital embodiment, as opposed to an anomalous state that can be overcome or corrected via neoliberal practice. (shrink)

Service robotics has increasingly become the focus of reflective research on new technologies over the last decade. The current state of technology is characterized by prototypical robot systems developed for specific application scenarios outside factories. This has enabled context-based Science and Technology Studies and technology assessments of service robotic systems. This contribution describes the status quo of this reflective research as the starting point for interdisciplinary technology assessment (TA), taking account of TA studies and, in particular, of publications from the (...) ethical and empirical social science perspective. Finally, based on this status quo, evaluation criteria for service robots are developed, which are relevant for further reflective research. (shrink)

If a robot sends a deceptive signal to a human user, is this always and everywhere an unethical act, or might it sometimes be ethically desirable? Building upon previous work in robot ethics, this article tries to clarify and refine our understanding of the ethics of robotic deception. It does so by making three arguments. First, it argues that we need to distinguish between three main forms of robotic deception (external state deception; superficial state deception; and hidden state deception) in (...) order to think clearly about its ethics. Second, it argues that the second type of deception – superficial state deception – is not best thought of as a form of deception, even though it is frequently criticised as such. And third, it argues that the third type of deception is best understood as a form of betrayal because doing so captures the unique ethical harm to which it gives rise, and justifies special ethical protections against its use. (shrink)

Our study presents an overview of the issues that were brought forward by participants of a moral case deliberation (MCD) project in two elderly care organizations. The overview was inductively derived from all case descriptions (N = 202) provided by participants of seven mixed MCD groups, consisting of care providers from various professional backgrounds, from nursing assistant to physician. The MCD groups were part of a larger MCD project within two care institutions (residential homes and nursing homes). Care providers are (...) confronted with a wide variety of largely everyday ethical issues. We distinguished three main categories: ‘resident’s behavior’, ‘divergent perspectives on good care’ and ‘organizational context’. The overview can be used for agendasetting when institutions wish to stimulate reflection and deliberation. It is important that an agenda is constructed from the bottom-up and open to a variety of issues. In addition, organizing reflection and deliberation requires effort to identify moral questions in practice whilst at the same time maintaining the connection with the organizational context and existing communication structures. Once care providers are used to dealing with divergent perspectives, inviting different perspectives (e.g. family members) to take part in the deliberation, might help to identify and address ethical ‘blind spots’. (shrink)

The discussion about robots in elderly care is populated by doom scenarios about a totally dehumanized care system in which elderly people are taken care of by machines. Such scenarios are helpful as they attend us to what we think is important with regard to the quality elderly care. However, this article argues that they are misleading in so far as they (1) assume that deception in care is always morally unacceptable, (2) suggest that robots and other information technologies necessarily (...) deceive elderly people by creating a “virtual” world as opposed to a “real” world, (3) assume that elderly people of the future have similar ICT skills and interests as the elderly people of today, and (4) assume a simplistic view of technologies. The article suggests an approach to evaluating care robots and ICT in health care which acknowledges and addresses a number of ethical problems raised by robotic care—for instance disengagement problems—while taking into account that some elderly people may need care that does not treat them as (empirically) autonomous, that many the elderly of the future are likely to be digital natives, and that the task of evaluating technologies in care is more complicated than the discussion of deception suggests. (shrink)

The use of robots in therapy for children with autism spectrum disorder raises issues concerning the ethical and social acceptability of this technology and, more generally, about human–robot interaction. However, usually philosophical papers on the ethics of human–robot-interaction do not take into account stakeholders’ views; yet it is important to involve stakeholders in order to render the research responsive to concerns within the autism and autism therapy community. To support responsible research and innovation in this field, this paper identifies a (...) range of ethical, social and therapeutic concerns, and presents and discusses the results of an exploratory survey that investigated these issues and explored stakeholders’ expectations about this kind of therapy. We conclude that although in general stakeholders approve of using robots in therapy for children with ASD, it is wise to avoid replacing therapists by robots and to develop and use robots that have what we call supervised autonomy. This is likely to create more trust among stakeholders and improve the quality of the therapy. Moreover, our research suggests that issues concerning the appearance of the robot need to be adequately dealt with by the researchers and therapists. For instance, our survey suggests that zoomorphic robots may be less problematic than robots that look too much like humans. (shrink)

When is it ethically acceptable to use artificial agents in health care? This article articulates some criteria for good care and then discusses whether machines as artificial agents that take over care tasks meet these criteria. Particular attention is paid to intuitions about the meaning of ‘care’, ‘agency’, and ‘taking over’, but also to the care process as a labour process in a modern organizational and financial-economic context. It is argued that while there is in principle no objection to using (...) machines in medicine and health care, the idea of them functioning and appearing as ‘artificial agents’ is problematic and attends us to problems in human care which were already present before visions of machine care entered the stage. It is recommended that the discussion about care machines be connected to a broader discussion about the impact of technology on human relations in the context of modernity. (shrink)

The article examines the challenges involved in the process of developing artificial ethical agents. The process involves the creators or designing professionals, the procedures to develop an ethical agent and the artificial systems. There are two possibilities available to create artificial ethical agents: (a) programming ethical guidance in the artificial Intelligence (AI)-equipped machines and/or (b) allowing AI-equipped machines to learn ethical decision-making by observing humans. However, it is difficult to fulfil these possibilities due to the subjective nature of ethical decision-making. (...) The challenge related to the developers is that they themselves lack training in ethical skills. The creators who develop an artificial ethical agent should be able to foresee the ethical issues and have knowledge about ethical decision-making to improve the ethical use of AI-equipped machines. The suggestion is that the focus should be on training professionals involved in the process of developing these artificial systems in ethics rather than developing artificial ethical agents and thereby attributing ethical agency to it. (shrink)

The article examines the challenges involved in the process of developing artificial ethical agents. The process involves the creators or designing professionals, the procedures to develop an ethical agent and the artificial systems. There are two possibilities available to create artificial ethical agents: (a) programming ethical guidance in the artificial Intelligence (AI)-equipped machines and/or (b) allowing AI-equipped machines to learn ethical decision-making by observing humans. However, it is difficult to fulfil these possibilities due to the subjective nature of ethical decision-making. (...) The challenge related to the developers is that they themselves lack training in ethical skills. The creators who develop an artificial ethical agent should be able to foresee the ethical issues and have knowledge about ethical decision-making to improve the ethical use of AI-equipped machines. The suggestion is that the focus should be on training professionals involved in the process of developing these artificial systems in ethics rather than developing artificial ethical agents and thereby attributing ethical agency to it. (shrink)

One of the objectives in the field of artificial intelligence for some decades has been the development of artificial agents capable of coexisting in harmony with people and other systems. The computing research community has made efforts to design artificial agents capable of doing tasks the way people do, tasks requiring cognitive mechanisms such as planning, decision-making, and learning. The application domains of such software agents are evident nowadays. Humans are experiencing the inclusion of artificial agents in their environment as (...) unmanned vehicles, intelligent houses, and humanoid robots capable of caring for people. In this context, research in the field of machine ethics has become more than a hot topic. Machine ethics focuses on developing ethical mechanisms for artificial agents to be capable of engaging in moral behavior. However, there are still crucial challenges in the development of truly Artificial Moral Agents. This paper aims to show the current status of Artificial Moral Agents by analyzing models proposed over the past two decades. As a result of this review, a taxonomy to classify Artificial Moral Agents according to the strategies and criteria used to deal with ethical problems is proposed. The presented review aims to illustrate (1) the complexity of designing and developing ethical mechanisms for this type of agent, and (2) that there is a long way to go (from a technological perspective) before this type of artificial agent can replace human judgment in difficult, surprising or ambiguous moral situations. (shrink)

The use of drones in public healthcare is suggested as a means to improve efficiency under constrained resources and personnel. This paper begins by framing drones in healthcare as a social experiment where ethical guidelines are needed to protect those impacted while fully realizing the benefits the technology offers. Then we propose an ethical framework to facilitate the design, development, implementation, and assessment of drones used in public healthcare. Given the healthcare context, we structure the framework according to the four (...) bioethics principles: beneficence, non-maleficence, autonomy, and justice, plus a fifth principle from artificial intelligence ethics: explicability. These principles are abstract which makes operationalization a challenge; therefore, we suggest an approach of translation according to a values hierarchy whereby the top-level ethical principles are translated into relevant human values within the domain. The resulting framework is an applied ethics tool that facilitates awareness of relevant ethical issues during the design, development, implementation, and assessment of drones in public healthcare. (shrink)

Artificial moral agents raise complex ethical questions both in terms of the potential decisions they may make as well as the inputs that create their cognitive architecture. There are multiple differences between human and artificial cognition which create potential barriers for artificial moral agency, at least as understood anthropocentrically and it is unclear that artificial moral agents should emulate human cognition and decision-making. It is conceptually possible for artificial moral agency to emerge that reflects alternative ethical methodologies without creating ontological (...) challenges or existential crises for human moral agents. (shrink)

In this paper, we propose a methodology to maximize the benefits of interdisciplinary cooperation in AI research groups. Firstly, we build the case for the importance of interdisciplinarity in research groups as the best means to tackle the social implications brought about by AI systems, against the backdrop of the EU Commission proposal for an Artificial Intelligence Act. As we are an interdisciplinary group, we address the multi-faceted implications of the mass-scale diffusion of AI-driven technologies. The result of our exercise (...) lead us to postulate the necessity of a behavioural theory that standardizes the interaction process of interdisciplinary groups. In light of this, we conduct a review of the existing approaches to interdisciplinary research on AI appliances, leading to the development of methodologies like ethics-by-design and value-sensitive design, evaluating their strengths and weaknesses. We then put forth an iterative process theory hinging on a narrative approach consisting of four phases: definition of the hypothesis space, building-up of a common lexicon, scenario-building, interdisciplinary self-assessment. Finally, we identify the most relevant fields of application for such a methodology and discuss possible case studies. (shrink)

In today’s highly dynamic societies, moral norms and values are subject to change. Moral change is partly driven by technological developments. For instance, the introduction of robots in elderly care practices requires caregivers to share moral responsibility with a robot (see van Wynsberghe 2013 ). Since we do not know what elements of morality will change and how they will change (see van der Burg 2003 ), moral education should aim at fostering what has been called “moral resilience” (Swierstra 2013 (...) ). We seek to fill two gaps in the existing literature: (i) research on moral education has not paid enough attention to the development of moral resilience; (ii) the very limited literature on moral resilience does not conceptualise moral resilience in relation to new technological developments. We argue that philosophical accounts of moral education need to do justice to the importance of moral resilience, and that a specific form of moral resilience should be conceptualised as “technomoral resilience” to underline the added value of cultivating moral resilience in relation to technomoral change. We illustrate the role of technomoral resilience in practice by looking at the context of elderly care. To make the first step towards an account of how technomoral resilience can be fostered in moral education, we propose that moral education shall focus on a triangle of capacities: (1) moral imagination, (2) a capacity for critical reflection, and (3) a capacity for maintaining one’s moral agency in the face of disturbances. (shrink)

Rescue operations taking place in disaster settings can be fraught with ethical challenges. Further ethical challenges will likely be introduced by the use of robots, which are expected to soon become commonplace in search and rescue missions and disaster recovery efforts. To help focus timely reflection on the ethical considerations associated with the deployment of rescue robots, we have conducted a scoping review exploring the relevant academic literature following a widely recognized scoping review framework. Of the 429 papers identified by (...) the first screening, six fulfilled the selection criteria of our literature review. Quantitative data synthesis showed that a subset of the papers includes a qualitative experimental exploration of the ethical issues at hand, with workshops involving both experts and potential users. Most use simulations or scenarios to anticipate the ethical implications and other consequences of using robots in search and rescue missions. Qualitative text analysis identified seven core ethically relevant themes: fairness and discrimination; false or excessive expectations; labor replacement; privacy; responsibility; safety; trust. Our results suggest that the literature on ethics in rescue robotics is scant and disparate, but the papers identified uniformly endorsed a proactive approach to handling the ethical concerns associated with the use of robots in disaster scenarios. (shrink)

The increasing complexity and ubiquity of autonomously operating artificially intelligent (AI) systems call for a robust theoretical reconceptualization of responsibility and control. The Meaningful Human Control (MHC) approach to the design and operation of AI systems provides such a framework. However, in its focus on accountability and minimizing harms, it neglects how we may flourish in interaction with such systems. In this chapter, I show how the MHC framework can be expanded to meet this challenge by drawing on the ethics (...) of carebots and embodied design. First, I examine how discussions about flourishing with carebots invite us to consider the extent to which we control our moral character Second, I argue that we can understand the cultivation of moral character in terms of embodied virtues arising from operating in particular ecologies. Third, I demonstrate how this analysis fruitfully informs the design of carebots as supporting reciprocity and empathy. (shrink)

I argue that the right to sexual satisfaction of severely physically and mentally disabled people and elderly people who suffer from neurodegenerative diseases can be fulfilled by deploying sex robots; this would enable us to satisfy the sexual needs of many who cannot provide for their own sexual satisfaction; without at the same time violating anybody’s right to sexual self-determination. I don’t offer a full-blown moral justification of deploying sex robots in such cases, as not all morally relevant concerns can (...) be addressed here; rather, I put forward a plausible way of fulfilling acute sexual needs without thereby violating anybody’s sexual rights. (shrink)

Abstract:This paper considers novel ethical issues pertaining to near-future artificial intelligence (AI) systems that seek to support, maintain, or enhance the capabilities of older adults as they age and experience cognitive decline. In particular, we focus on smart assistants (SAs) that would seek to provide proactive assistance and mediate social interactions between users and other members of their social or support networks. Such systems would potentially have significant utility for users and their caregivers if they could reduce the cognitive load (...) for tasks that help older adults maintain their autonomy and independence. However, proactively supporting even simple tasks, such as providing the user with a summary of a meeting or a conversation, would require a future SA to engage with ethical aspects of human interactions which computational systems currently have difficulty identifying, tracking, and navigating. If SAs fail to perceive ethically relevant aspects of social interactions, the resulting deficit in moral discernment would threaten important aspects of user autonomy and well-being. After describing the dynamic that generates these ethical challenges, we note how simple strategies for prompting user oversight of such systems might also undermine their utility. We conclude by considering how near-future SAs could exacerbate current worries about privacy, commodification of users, trust calibration and injustice. (shrink)

The advent of the so-called Companion Robots is raising many ethical concerns among scholars and in the public opinion. Focusing mainly on robots caring for the elderly, in this paper we analyze these concerns to distinguish which are directly ascribable to robotic, and which are instead preexistent. One of these is the “deception objection”, namely the ethical unacceptability of deceiving the user about the simulated nature of the robot’s behaviors. We argue on the inconsistency of this charge, as today formulated. (...) After that, we underline the risk, for human-robot interaction, to become a hallucinatory relation where the human would subjectify the robot in a dynamic of meaning-overload. Finally, we analyze the definition of “quasi-other” relating to the notion of “uncanny”. The goal of this paper is to argue that the main concern about Companion Robots is the simulation of a human-like interaction in the absence of an autonomous robotic horizon of meaning. In addition, that absence could lead the human to build a hallucinatory reality based on the relation with the robot. (shrink)

How could ectogestative technology disrupt gender roles, parenting practices, and concepts such as ‘birth’, ‘body’, or ‘parent’? In this chapter, we situate this emerging technology in the context of the history of reproductive technologies and analyse the potential social and conceptual disruptions to which it could contribute. An ectogestative device, better known as ‘artificial womb’, enables the extra-uterine gestation of a human being, or mammal more generally. It is currently developed with the main goal of improving the survival chances of (...) extremely premature neonates. We argue that the intended use of the technology in neonatal intensive care units, as an alternative to current incubators (’partial-ectogestation’), challenges concepts such as ‘birth’, ‘fetus’, and ‘neonate’, and has several ethico-legal implications. We moreover address a more futuristic scenario where the entire embryological and fetal development could happen within an artificial womb (’full-ectogestation’). Such a scenario reveals the disruption of gender roles, parenting practices, and concepts such as ‘mother’, ‘father’, and ‘parent’. Both full- and partial-ectogestation would have implications for engineering and design, law-making, ethics, and philosophical anthropology. (shrink)