Values such as respect for autonomy, safety, enablement, independence, privacy and social connectedness should be reflected in the design of social robots. The same values should affect the process by which robots are introduced into the homes of older people to support independent living. These values may, however, be in tension. We explored what potential users thought about these values, and how the tensions between them could be resolved. With the help of partners in the ACCOMPANY project, 21 focus groups (...) were convened in France, the Netherlands and the UK. These groups consisted of: older people, informal carers and formal carers of older people. The participants were asked to discuss scenarios in which there is a conflict between older people and others over how a robot should be used, these conflicts reflecting tensions between values. Participants favoured compromise, persuasion and negotiation as a means of reaching agreement. Roles and related role-norms for the robot were thought relevant to resolving tensions, as were hypothetical agreements between users and robot-providers before the robot is introduced into the home. Participants’ understanding of each of the values—autonomy, safety, enablement, independence, privacy and social connectedness—is reported. Participants tended to agree that autonomy often has priority over the other values, with the exception in certain cases of safety. The second part of the paper discusses how the values could be incorporated into the design of social robots and operationalised in line with the views expressed by the participants. (shrink)

BackgroundSocially assistive devices (care robots, companions, smart screen assistants) have been advocated as a promising tool in elderly care in Western healthcare systems. Ethical debates indicate various challenges. One of the most prevalent arguments in the debate is the double-benefit argument claiming that socially assistive devices may not only provide benefits for autonomy and well-being of their users but might also be more efficient than other caring practices and might help to mitigate scarce resources in healthcare. Against this background, we (...) used a subset of comparative empirical studies from a comprehensive systematic review on effects and perceptions of human-machine interaction with socially assistive devices to gather and appraise all available evidence supporting this argument from the empirical side.MethodsElectronic databases and additional sources were queried using a comprehensive search strategy which generated 9851 records. Studies were screened independently by two authors. Methodological quality of studies was assessed. For 39 reports using a comparative study design, a narrative synthesis was performed.ResultsThe data shows positive evidential support to claim that some socially assistive devices (Paro) might be able to contribute to the well-being and autonomy of their users. However, results also indicate that these positive findings may be heavily dependent on the context of use and the population. In addition, we found evidence that socially assistive devices can have negative effects on certain populations. Evidence regarding the claim of efficiency is scarce. Existing results indicate that socially assistive devices can be more effective than standard of care but are far less effective than plush toys or placebo devices.DiscussionWe suggest using the double-benefit argument with great caution as it is not supported by the currently available evidence. The occurrence of potentially negative effects of socially assistive devices requires more research and indicates a more complex ethical calculus than suggested by the double-benefit argument. (shrink)

Although some authors claim that deception requires intention, we argue that there can be deception in social robotics, whether or not it is intended. By focusing on the deceived rather than the deceiver, we propose that false beliefs can be created in the absence of intention. Supporting evidence is found in both human and animal examples. Instead of assuming that deception is wrong only when carried out to benefit the deceiver, we propose that deception in social robotics is wrong when (...) it leads to harmful impacts on individuals and society. The appearance and behaviour of a robot can lead to an overestimation of its functionality or to an illusion of sentience or cognition that can promote misplaced trust and inappropriate uses such as care and companionship of the vulnerable. We consider the allocation of responsibility for harmful deception. Finally, we make the suggestion that harmful impacts could be prevented by legislation, and by the development of an assessment framework for sensitive robot applications. (shrink)

The article develops and justifies, on the basis of the epistemological argumentation theory, two central pieces of the theory of evaluative argumentation interpretation: 1. criteria for recognizing argument types and 2. rules for adding reasons to create ideal arguments. Ad 1: The criteria for identifying argument types are a selection of essential elements from the definitions of the respective argument types. Ad 2: After presenting the general principles for adding reasons (benevolence, authenticity, immanence, optimization), heuristics are proposed for finding missing (...) reasons, for deductive arguments, e.g., semantic tableaux are suggested. (shrink)

Socially assistive devices such as care robots or companions have been advocated as a promising tool in elderly care in Western healthcare systems. Ethical debates indicate various challenges. An important part of the ethical evaluation is to understand how users interact with these devices and how interaction influences users’ perceptions and their ability to express themselves. In this review, we report and critically appraise findings of non-comparative empirical studies with regard to these effects from an ethical perspective.Electronic databases and other (...) sources were queried using a comprehensive search strategy generating 9851 records. Studies were screened independently by two authors. Methodological quality of studies was assessed. For 22 reports on 21 datasets using a non-comparative design a narrative synthesis was performed.Data shows positive findings in regard to attitudes and emotional reactions of users. Varying perception of a social relation and social presence are the most commonly observed traits of interaction. Users struggle with understanding technical complexities while functionality of the devices is limited. This leads to a behavioral alignment of users towards the requirements of the devices to be able to make use of them.This evidence adds to three important ethical debates on the use of socially assistive devices in healthcare in regard to (1) reliability of existing empirical evidence to inform normative judgements, (2) ethical significance of the social presence of devices and (3) user autonomy in regard to behavioral alignment. (shrink)

Personal AI is a new type of AI companion, distinct from the prevailing forms of AI companionship. Instead of playing a narrow and well-defined social role, like friend, lover, caretaker, or colleague, with a set of pre-determined responses and behaviors, Personal AI is engineered to tailor itself to the user, including learning to mirror the user’s unique emotional language and attitudes. This paper identifies two issues with Personal AI. First, like other AI companions, it is deceptive about the presence of (...) their emotions, which undermines the moral value of companionship. Second, Personal AI leads to a distinctly new form of deception concerning the origins of its emotions. Its emotional attitudes appear to belong to it, when in fact they are only reflections of the user. This results in what I dub “emotional bubbles”—the false impression that personal emotions are externally validated—which have at least two troubling implications. First, emotional bubbles prevent us from encountering emotional attitudes that differ from our own, which is likely to cripple emotional growth and the ability to form diverse social and emotional relationships. Second, if we assume, as some philosophers claim, that shared emotions are constitutive of shared values, it follows that Personal AI subverts joint moral deliberation. Users believe their personal values are externally validated, when they are only validated by themselves. Because of the absence of technovirtues able to handle this problem, I suggest that we proceed very cautiously with the development and marketing of Personal AI. (shrink)

Socially Assistive Robots are increasingly conceived as applicable tools to be used in aged care. However, the use carries many negative and positive connotations. Negative connotations come forth out of romanticized views of care practices, disregarding their already established technological nature. Positive connotations are formulated out of techno-deterministic views on SAR use, presenting it as an inevitable and necessary next step in technological development to guarantee aged care. Ethical guidance of SAR use inspired by negative connotations tends to be over-restrictive (...) whereas positive connotations tend to provide over-permissive guidance. To avoid these extremes, we report on the development and content of 21 ethical orientations regarding SAR use in aged care. These orientations resulted from a multi-phased project, which consisted of empirical-ethical research focusing on older adults’ intuitions regarding SAR use and philosophical-ethical research focusing on philosophical-ethical argumentations regarding SAR use. This project led to the Socio-historical contextualization of the ethics of SAR use, in which the ethical impact of SAR use is localized on three interrelated analysis levels: societal, organizational, and individual-relational. The 21 novel orientations regarding SAR use are structured according to these levels and further categorized into foundational and applied orientations. The first category leads to critical reflection on SAR use while the latter category inspires decision-making processes regarding this use. While going beyond the care-romantic and techno-deterministic gaze of SAR use in aged care, the described orientations balance themselves between their over-restrictiveness and over-permissiveness. (shrink)

Keskustelu tekoälyn soveltamiseen liittyvistä eettisistä ja poliittisista kysymyksistä käy juuri nyt kuumana. Emme halua tässä puheenvuorossa osallistua keskusteluun tarttumalla johonkin tiettyyn eettiseen ongelmaan. Sen sijaan pyrimme sanomaan jotain itsekeskustelusta ja sen vaikeudesta. Haluamme kiinnittää huomiota siihen, kuinka erilaiset ihmismielen ajattelutaipumukset ja virhepäätelmät voivat huomaamattamme vaikuttaa tapaamme hahmottaa ja ymmärtää tekoälyä ja siihen liittyviä eettisiä kysymyksiä. Kun ymmärrämme paremmin sen, kuinka hankalaa näiden kysymysten hahmottaminen arkisen mielemme kategorioilla oikein on, ja kun tunnistamme tästä syntyvät virhepäätelmät ja ajattelun vääristymät, kykenemme entistä korkeatasoisempaan (...) eettiseen arviointiin tekoälyyn liittyvissä kysymyksissä. Tarkoituksemme ei ole tarkastella loogisiavirhepäätelmiä, jotka rikkovat formaalin modus tollensin tai modus ponensin sääntöjä. Sen sijaan esittelemme empiirisiä tutkimustuloksia, jotka havainnollistavat ihmismielen taipumustatehdä systemaattisia virhearviointeja erilaisissa tilanteissa. (shrink)