The number of people with dementia is increasing worldwide. At the same time, family and professional caregivers’ resources are limited. A promising approach to relieve these carers’ burden and assist people with dementia is assistive technology. In order to be useful and accepted, such technologies need to respect the values and needs of their intended users. We applied the value sensitive design approach to identify values and needs of patients with dementia and family and professional caregivers in respect to assistive (...) technologies to assist people with dementia in institutionalized care. Based on semi-structured interviews of residents/patients with cognitive impairment, relatives, and healthcare professionals (10 each), we identified 44 values summarized by 18 core values. From these values, we created a values’ network to demonstrate the interplay between the values. The core of this network was caring and empathy as most strongly interacting value. Furthermore, we found 36 needs for assistance belonging to the four action fields of activity, care, management/administration, and nursing. Based on these values and needs for assistance, we created possible use cases for assistive technologies in each of the identified four action fields. All these use cases already are technologically feasible today but are not currently being used in healthcare facilities. This underlines the need for development of value-based technologies to ensure not only technological feasibility but also acceptance and implementation of assistive technologies. Our results help balance conflicting values and provide concrete suggestions for how engineers and designers can incorporate values into assistive technologies. (shrink)

In this paper, we propose a methodology to maximize the benefits of interdisciplinary cooperation in AI research groups. Firstly, we build the case for the importance of interdisciplinarity in research groups as the best means to tackle the social implications brought about by AI systems, against the backdrop of the EU Commission proposal for an Artificial Intelligence Act. As we are an interdisciplinary group, we address the multi-faceted implications of the mass-scale diffusion of AI-driven technologies. The result of our exercise (...) lead us to postulate the necessity of a behavioural theory that standardizes the interaction process of interdisciplinary groups. In light of this, we conduct a review of the existing approaches to interdisciplinary research on AI appliances, leading to the development of methodologies like ethics-by-design and value-sensitive design, evaluating their strengths and weaknesses. We then put forth an iterative process theory hinging on a narrative approach consisting of four phases: definition of the hypothesis space, building-up of a common lexicon, scenario-building, interdisciplinary self-assessment. Finally, we identify the most relevant fields of application for such a methodology and discuss possible case studies. (shrink)

Most engineers Fwork within social structures governing and governed by a set of values that primarily emphasise economic concerns. The majority of innovations derive from these loci. Given the effects of these innovations on various communities, it is imperative that the values they embody are aligned with those societies. Like other transformative technologies, artificial intelligence systems can be designed by a single organisation but be diffused globally, demonstrating impacts over time. This paper argues that in order to design for this (...) broad stakeholder group, engineers must adopt a systems thinking approach that allows them to understand the sociotechnicity of artificial intelligence systems across sociocultural domains. It claims that value sensitive design, and envisioning cards in particular, provides a solid first step towards helping designers harmonise human values, understood across spatiotemporal boundaries, with economic values, rather than the former coming at the opportunity cost of the latter. (shrink)

Ethicists, policy-makers, and the general public have questioned whether artificial entities such as robots warrant rights or other forms of moral consideration. There is little synthesis of the research on this topic so far. We identify 294 relevant research or discussion items in our literature review of this topic. There is widespread agreement among scholars that some artificial entities could warrant moral consideration in the future, if not also the present. The reasoning varies, such as concern for the effects on (...) artificial entities and concern for the effects on human society. Beyond the conventional consequentialist, deontological, and virtue ethicist ethical frameworks, some scholars encourage “information ethics” and “social-relational” approaches, though there are opportunities for more in-depth ethical research on the nuances of moral consideration of artificial entities. There is limited relevant empirical data collection, primarily in a few psychological studies on current moral and social attitudes of humans towards robots and other artificial entities. This suggests an important gap for psychological, sociological, economic, and organizational research on how artificial entities will be integrated into society and the factors that will determine how the interests of artificial entities are considered. (shrink)

Profit-oriented service sectors such as tourism, hospitality, and entertainment are increasingly looking at how professional service robots can be integrated into the workplace to perform socio-cognitive tasks that were previously reserved for humans. This is a work in which social and labor sciences recognize the principle role of emotions. However, the models and narratives of emotions that drive research, design, and deployment of service robots in human–robot interaction differ considerably from how emotions are framed in the sociology of labor and (...) feminist studies of service work. In this paper, we explore these tensions through the concepts of affective and emotional labor, and outline key insights these concepts offer for the design and evaluation of professional service robots. Taken together, an emphasis on interactionist approaches to emotions and on the demands of affective labor, leads us to argue that service employees are under-represented in existing studies in human–robot interaction. To address this, we outline how participatory design and value-sensitive design approaches can be applied as complimentary methodological frameworks that include service employees as vital stakeholders. (shrink)

This article presents the framework Capability Sensitive Design (CSD), which consists of merging the design methodology Value Sensitive Design (VSD) with Martha Nussbaum's capability theory. CSD aims to normatively assess technology design in general, and technology design for health and wellbeing in particular. Unique to CSD is its ability to account for human diversity and to counter (structural) injustices that manifest in technology design. The basic framework of CSD is demonstrated by applying it to the hypothetical design case of a (...) therapy chatbot for mental health. By applying CSD to a design case, the merits of this new framework over the standard VSD approach become apparent. Also, the application demonstrates what a technology design would look like when attention is paid to capabilities right from the start of the design process. (shrink)

In this article, we develop the concept of Transparency by Design that serves as practical guidance in helping promote the beneficial functions of transparency while mitigating its challenges in automated-decision making environments. With the rise of artificial intelligence and the ability of AI systems to make automated and self-learned decisions, a call for transparency of how such systems reach decisions has echoed within academic and policy circles. The term transparency, however, relates to multiple concepts, fulfills many functions, and holds different (...) promises that struggle to be realized in concrete applications. Indeed, the complexity of transparency for ADM shows tension between transparency as a normative ideal and its translation to practical application. To address this tension, we first conduct a review of transparency, analyzing its challenges and limitations concerning automated decision-making practices. We then look at the lessons learned from the development of Privacy by Design, as a basis for developing the Transparency by Design principles. Finally, we propose a set of nine principles to cover relevant contextual, technical, informational, and stakeholder-sensitive considerations. Transparency by Design is a model that helps organizations design transparent AI systems, by integrating these principles in a step-by-step manner and as an ex-ante value, not as an afterthought. (shrink)

Background: The surge in the development of social robots gives rise to an increased need for systematic methods of assessing attitudes towards robots. Aim: This study presents the development of a questionnaire for assessing attitudinal stance towards social robots: the ASOR. Methods: The 37-item ASOR questionnaire was developed by a task-force with members from different disciplines. It was founded on theoretical considerations of how social robots could influence five different aspects of relatedness. Results: Three hundred thirty-nine people responded to the (...) survey. Factor analysis of the ASOR yielded a three-factor solution consisting of a total of 25 items: “ascription of mental capacities”, “ascription of socio-practical capacities”, and “ascription of socio-moral status”. This data was further triangulated with data from interviews (n = 10). Conclusion: the ASOR allows for assessment of three distinct facets of ascription of capacities to social robots and offers a new type of assessment of attitudes towards social robots. It appeared that ASOR not only assesses ascription of capacities to social robots but it also gauged overall positive attitudes towards social robots. (shrink)

This paper looks at philosophical questions that arise in the context of AI alignment. It defends three propositions. First, normative and technical aspects of the AI alignment problem are interrelated, creating space for productive engagement between people working in both domains. Second, it is important to be clear about the goal of alignment. There are significant differences between AI that aligns with instructions, intentions, revealed preferences, ideal preferences, interests and values. A principle-based approach to AI alignment, which combines these elements (...) in a systematic way, has considerable advantages in this context. Third, the central challenge for theorists is not to identify ‘true’ moral principles for AI; rather, it is to identify fair principles for alignment that receive reflective endorsement despite widespread variation in people’s moral beliefs. The final part of the paper explores three ways in which fair principles for AI alignment could potentially be identified. (shrink)

Healthcare is becoming increasingly automated with the development and deployment of care robots. There are many benefits to care robots but they also pose many challenging ethical issues. This paper takes care robots for the elderly as the subject of analysis, building on previous literature in the domain of the ethics and design of care robots. Using the value sensitive design approach to technology design, this paper extends its application to care robots by integrating the values of care, values that (...) are specific to AI, and higher-scale values such as the United Nations Sustainable Development Goals. The ethical issues specific to care robots for the elderly are discussed at length alongside examples of specific design requirements that work to ameliorate these ethical concerns. (shrink)

Many industry leaders and academics from the field of machine ethics would have us believe that the inevitability of robots coming to have a larger role in our lives demands that robots be endowed with moral reasoning capabilities. Robots endowed in this way may be referred to as artificial moral agents. Reasons often given for developing AMAs are: the prevention of harm, the necessity for public trust, the prevention of immoral use, such machines are better moral reasoners than humans, and (...) building these machines would lead to a better understanding of human morality. Although some scholars have challenged the very initiative to develop AMAs, what is currently missing from the debate is a closer examination of the reasons offered by machine ethicists to justify the development of AMAs. This closer examination is especially needed because of the amount of funding currently being allocated to the development of AMAs coupled with the amount of attention researchers and industry leaders receive in the media for their efforts in this direction. The stakes in this debate are high because moral robots would make demands on society; answers to a host of pending questions about what counts as an AMA and whether they are morally responsible for their behavior or not. This paper shifts the burden of proof back to the machine ethicists demanding that they give good reasons to build AMAs. The paper argues that until this is done, the development of commercially available AMAs should not proceed further. (shrink)

This 44-chapter volume tackles a quickly-evolving field of inquiry, mapping the existing discourse as part of a general attempt to place current developments in historical context; at the same time, breaking new ground in taking on novel subjects and pursuing fresh approaches. The term "A.I." is used to refer to a broad range of phenomena, from machine learning and data mining to artificial general intelligence. The recent advent of more sophisticated AI systems, which function with partial or full autonomy and (...) are capable of tasks which require learning and 'intelligence', presents difficult ethical questions, and has drawn concerns from many quarters about individual and societal welfare, democratic decision-making, moral agency, and the prevention of harm. This work ranges from explorations of normative constraints on specific applications of machine learning algorithms today-in everyday medical practice, for instance-to reflections on the (potential) status of AI as a form of consciousness with attendant rights and duties and, more generally still, on the conceptual terms and frameworks necessarily to understand tasks requiring intelligence, whether "human" or "A.I.". (shrink)

This paper addresses the issue of whether robots could substitute for human care, given the challenges in aged care induced by the demographic change. The use of robots to provide emotional care has raised ethical concerns, e.g., that people may be deceived and deprived of dignity. In this paper it is argued that these concerns might be mitigated and that it may be sufficient for robots to take part in caring when they behave *as if* they care.

This chapter proposed a novel design methodology called Value-Sensitive Design and its potential application to the field of artificial intelligence research and design. It discusses the imperatives in adopting a design philosophy that embeds values into the design of artificial agents at the early stages of AI development. Because of the high risk stakes in the unmitigated design of artificial agents, this chapter proposes that even though VSD may turn out to be a less-than-optimal design methodology, it currently provides a (...) framework that has the potential to embed stakeholder values and incorporate current design methods. The reader should begin to take away the importance of a proactive design approach to intelligent agents. (shrink)

As Artificial Intelligence technology seems poised for a major take-off and changing societal dynamics are creating a high demand for caregivers for elders, children and those infirmed-robotic caregivers, may well be used much more often. This article examines the ethical concerns raised by the use of AI caregivers and concludes that many of these concerns are avoided when AI caregivers operate as partners rather than substitutes. Furthermore, most of the remaining concerns are minor and are faced by human caregivers as (...) well. Nonetheless, because AI caregivers’ systems are learning systems, an AI caregiver could stray from its initial guidelines. Therefore, subjecting AI caregivers to an AI-based oversight system is proposed to ensure that their actions remain both legal and ethical. (shrink)

Current uses of robots in classrooms are reviewed and used to characterise four scenarios: Robot as Classroom Teacher; Robot as Companion and Peer; Robot as Care-eliciting Companion; and Telepresence Robot Teacher. The main ethical concerns associated with robot teachers are identified as: privacy; attachment, deception, and loss of human contact; and control and accountability. These are discussed in terms of the four identified scenarios. It is argued that classroom robots are likely to impact children’s’ privacy, especially when they masquerade as (...) their friends and companions, when sensors are used to measure children’s responses, and when records are kept. Social robots designed to appear as if they understand and care for humans necessarily involve some deception, and could increase the risk of reduced human contact. Children could form attachments to robot companions, or robot teachers and this could have a deleterious effect on their social development. There are also concerns about the ability, and use of robots to control or make decisions about children’s behaviour in the classroom. It is concluded that there are good reasons not to welcome fully fledged robot teachers, and that robot companions should be given a cautious welcome at best. The limited circumstances in which robots could be used in the classroom to improve the human condition by offering otherwise unavailable educational experiences are discussed. (shrink)

This paper provides an empirically informed perspective on the notion of responsibility using an ethical framework that has received little attention in the engineering-related literature to date: ethics of care. In this work, we ground conceptual explorations of engineering responsibility in empirical findings from engineering student’s writing on the human health and environmental impacts of “backyard” electronic waste recycling/disposal. Our findings, from a purposefully diverse sample of engineering students in an introductory electrical engineering course, indicate that most of these engineers (...) of tomorrow associated engineers with responsibility for the electronic waste problem in some way. However, a number of responses suggested attempts to deflect responsibility away from engineers towards, for example, the government or the companies for whom engineers work. Still other students associated both engineers and non-engineers with responsibility, demonstrating the distributed/collective nature of responsibility that will be required to achieve a solution to the global problem of excessive e-waste. Building upon one element of a framework for care ethics adopted from the wider literature, these empirical findings are used to facilitate a preliminary, conceptual exploration of care-ethical responsibility within the context of engineering and e-waste recycling/disposal. The objective of this exploration is to provide a first step toward understanding how care-ethical responsibility applies to engineering. We also hope to seed dialogue within the engineering community about its ethical responsibilities on the issue. We conclude the paper with a discussion of its implications for engineering education and engineering ethics that suggests changes for educational policy and the practice of engineering. (shrink)

In this paper I describe a future in which persons in advanced old age are cared for entirely by robots and suggest that this would be a dystopia, which we would be well advised to avoid if we can. Paying attention to the objective elements of welfare rather than to people’s happiness reveals the central importance of respect and recognition, which robots cannot provide, to the practice of aged care. A realistic appreciation of the current economics of the aged care (...) sector suggests that the introduction of robots into an aged care setting will most likely threaten rather than enhance these goods. I argue that, as a result, the development of robotics is likely to transform aged care in accordance with a trajectory of development that leads towards this dystopian future even when this is not the intention of the engineers working to develop robots for aged care. While an argument can be made for the use of robots in aged care where the people being cared for have chosen to allow robots in this role, I suggest that over-emphasising this possibility risks rendering it a self-fulfilling prophecy, depriving those being cared for of valuable social recognition, and failing to provide respect for older persons by allowing the options available to them to be shaped by the design choices of others. (shrink)

This paper explores the relationship between dignity and robot care for older people. It highlights the disquiet that is often expressed about failures to maintain the dignity of vulnerable older people, but points out some of the contradictory uses of the word ‘dignity’. Certain authors have resolved these contradictions by identifying different senses of dignity; contrasting the inviolable dignity inherent in human life to other forms of dignity which can be present to varying degrees. The Capability Approach (CA) is introduced (...) as a different but tangible account of what it means to live a life worthy of human dignity. It is used here as a framework for the assessment of the possible effects of eldercare robots on human dignity. The CA enables the identification of circumstances in which robots could enhance dignity by expanding the set of capabilities that are accessible to frail older people. At the same time, it is also possible within its framework to identify ways in which robots could have a negative impact, by impeding the access of older people to essential capabilities. It is concluded that the CA has some advantages over other accounts of dignity, but that further work and empirical study is needed in order to adapt it to the particular circumstances and concerns of those in the latter part of their lives. (shrink)

This paper explores the ambiguous impact of new information and communications technologies on the cultivation of moral skills in human beings. Just as twentieth century advances in machine automation resulted in the economic devaluation of practical knowledge and skillsets historically cultivated by machinists, artisans, and other highly trained workers , while also driving the cultivation of new skills in a variety of engineering and white collar occupations, ICTs are also recognized as potential causes of a complex pattern of economic deskilling, (...) reskilling, and upskilling. In this paper, I adapt the conceptual apparatus of sociological debates over economic deskilling to illuminate a different potential for technological deskilling/upskilling, namely the ability of ICTs to contribute to the moral deskilling of human users, a potential that exists alongside rich but currently underrealized possibilities for moral reskilling and/or upskilling. I flesh out this general hypothesis by means of examples involving automated weapons technology, new media practices, and social robotics. I conclude that since moral skills are essential prerequisites for the effective development of practical wisdom and virtuous character, and since market and cultural forces are not presently aligned to bring about the more salutary of the ambiguous potentials presented here, the future shape of these developments warrants our close attention—and perhaps active intervention. (shrink)

A growing number of consumer technology companies are aiming to convince older people that humanoid robots make helpful tools to support aging-in-place. As hybrid devices, socially assistive robots (SARs) are situated between health monitoring tools, familiar digital assistants, security aids, and more advanced AI-powered devices. Consequently, they implicate older people’s privacy in complex ways. Such devices are marketed to perform functions common to smart speakers (e.g., Amazon Echo) and smart home platforms (e.g., Google Home), while other functions are more specific (...) to older people, including health and safety monitoring and serving as companions to mitigate loneliness. Privacy is a key value central to debates about the ethics of using SARs in aged care, yet there has been very little interchange between these debates and the robust theoretical discussion in the legal literature about the future of privacy and AI governance. Drawing on two qualitative studies of older people’s views on consumer SARs, the paper contributes novel findings about older people’s thinking on privacy and data governance at the intersection of their experiences with present day digital technologies and projections for future AI systems, and places their views in dialogue with debates about the future of privacy protection and AI governance. (shrink)

Digital contact tracing is used in different countries to help contain the COVID-19 pandemic. It raises challenging empirical and ethical questions due to its complexity and widespread effects calling for a broader approach in ethical evaluation. However, existing approaches often fail to include all relevant value perspectives or lack reference to empirical data on the artifact in question. In this paper, we describe the development of an interdisciplinary framework to analyze digital contact tracing from an empirical and ethical perspective. Starting (...) with an analysis of methodological tensions in the attempt to analyze digital contact tracing, we, firstly, set out three methodological premises regarding (a) a specific view of technology, (b) a fruitful normative perspective, and (c) ways to gather empirical knowledge about the object under investigation. Secondly, we inspect consequences of these premises to develop our research methodology. In doing so, we argue for a postphenomenological perspective on technology, solidarity as an important concept to guide the ethical perspective, and an empirical approach based on qualitative social science research and the concept of affordances. We illustrate these considerations by referring to our analysis of the German Corona-Warn-App as an instance of contact tracing based on the Exposure Notification Framework by Google and Apple. We then discuss the implications of using such a framework, including considerations concerning future developments of technologies similar to or inspired by the current concepts of contact tracing. (shrink)

Current national and international guidelines for the ethical design and development of artificial intelligence (AI) and robotics emphasize ethical theory. Various governing and advisory bodies have generated sets of broad ethical principles, which institutional decisionmakers are encouraged to apply to particular practical decisions. Although much of this literature examines the ethics of designing and developing AI and robotics, medical institutions typically must make purchase and deployment decisions about technologies that have already been designed and developed. The primary problem facing medical (...) institutions is not one of ethical design but of ethical deployment. The purpose of this paper is to develop a practical model by which medical institutions may make ethical deployment decisions about ready-made advanced technologies. Our slogan is “more process, less principles.” Ethically sound decisionmaking requires that the process by which medical institutions make such decisions include participatory, deliberative, and conservative elements. We argue that our model preserves the strengths of existing frameworks, avoids their shortcomings, and delivers its own moral, practical, and epistemic advantages. (shrink)

As automation in artificial intelligence is increasing, we will need to automate a growing amount of ethical decision making. However, ethical decision- making raises novel challenges for engineers, ethicists and policymakers, who will have to explore new ways to realize this task. The presented work focuses on the development and formalization of models that aim at ensuring a correct ethical behaviour of artificial intelligent agents, in a provable way, extending and implementing a logic-based proving calculus that is based on argumentation (...) reasoning with support and attack arguments. This leads to a formal theoretical framework of ethical competence that could be implemented in artificial intelligent systems in order to best formalize certain parameters of ethical decision-making to ensure safety and justified trust. (shrink)

Recent developments in theories for responsible innovation have focused on the importance of actively accounting for values in our technological designs. Leading among these theories is that of Value Sensitive Design which attempts to guide the design process on the basis of evaluative analysis. However, values often come into conflict and VSD has been criticized for not providing a proper method to resolve such inevitable conflicts. This paper examines three such methods and argues that although each has its merits, they (...) all fail to account for a common source of value conflicts known as value incommensurability. Drawing on literature from the field of axiology, this paper argues that by incorporating the evaluative relation of ‘parity’ each of these three methods, and the VSD framework in general, will be able to properly understand the relation which holds between conflicting design options stemming from the incommensurable of values and be able to guide designers in making rational decision in the face of such conflicts. (shrink)

In the scenario of growing polarization of promises and dangers that surround artificial intelligence (AI), how to introduce responsible AI and robotics in healthcare? In this paper, we develop an ethical–political approach to introduce democratic mechanisms to technological development, what we call “Caring in the In-Between”. Focusing on the multiple possibilities for action that emerge in the realm of uncertainty, we propose an ethical and responsible framework focused on care actions in between fears and hopes. Using the theoretical perspective of (...) Science and Technology Studies and empirical research, “Caring in the In-Between” is based on three movements: the first is a change of focus from the world of promises and dangers to the world of uncertainties; the second is a conceptual shift from assuming a relationship with robotics based on a Human–Robot Interaction to another focused on the network in which the robot is embedded (the “Robot Embedded in a Network”); and the last is an ethical shift from a general normative framework to a discussion on the context of use. Based on these suggestions, “Caring in the In-Between” implies institutional challenges, as well as new practices in healthcare systems. It is articulated around three simultaneous processes, each of them related to practical actions in the “in-between” dimensions considered: monitoring relations and caring processes, through public engagement and institutional changes; including concerns and priorities of stakeholders, with the organization of participatory processes and alternative forms of representation; and making fears and hopes commensurable, through the choice of progressive and reversible actions. (shrink)

Interactions between humans and machines that include artificial intelligence are increasingly common in nearly all areas of life. Meanwhile, AI-products are increasingly endowed with emotional characteristics. That is, they are designed and trained to elicit emotions in humans, to recognize human emotions and, sometimes, to simulate emotions. The introduction of such systems in our lives is met with some criticism. There is a rather strong intuition that there is something wrong about getting attached to a machine, about having certain emotions (...) towards it, and about getting involved in a kind of affective relationship with it. In this paper, I want to tackle these worries by focusing on the last aspect: in what sense could it be problematic or even wrong to establish an emotional relationship with EAI-systems? I want to show that the justifications for the widespread intuition concerning the problems are not as strong as they seem at first sight. To do so, I discuss three arguments: the argument from self-deception, the argument from lack of mutuality, and the argument from moral negligence. (shrink)

Background:The debate over the ethical implications of care robots has raised a range of concerns, including the possibility that such technologies could disrupt caregiving as a core human moral activity. At the same time, academics in information ethics have argued that we should extend our ideas of moral agency and rights to include intelligent machines.Research objectives:This article explores issues of the moral status and limitations of machines in the context of care.Design:A conceptual argument is developed, through a four-part scheme derived (...) from the work of Alasdair MacIntyre. No empirical data are used.Ethical consideration:No primary data were gathered for this study. Secondary sources and authorship have been acknowledged throughout.Findings / discussion:Certain kinds of social experience, including the narrative unity of a life, and the giving and receiving of care, are essential for moral development. Machines, no matter how advanced, cannot participate in such experiences in key respects, and thus cannot develop as practical reasoners.Conclusion:It follows that they cannot be moral agents and that they cannot care. There are, it seems, no such things as care robots. In view of the institutional power of tech companies and commissioning bodies, care practitioners need to take more of a lead in developing new assistive technologies which are appropriate to their practice. (shrink)

In this paper, two central questions will be addressed: ought we to implement medical AI technology in the medical domain? If yes, how ought we to implement this technology? I will critically engage with three options that exist with respect to these central questions: the Neo-Luddite option, the Assistive option, and the Substitutive option. I will first address key objections on behalf of the Neo-Luddite option: the Objection from Bias, the Objection from Artificial Autonomy, the Objection from Status Quo, and (...) the Objection from Inscrutability. I will thereafter present the Demographic Trends Argument and the Human Enhancement Argument in support of alternatives to the Neo-Luddite option. In the second half of the paper, I will argue against the Substitutive option and in favour of the Assistive option, given the existence of two chief formal deficits in medical AI technology: the causality deficit and the care deficit. (shrink)

This paper addresses ethical challenges posed by a robot acting as both a general type of system and a discrete, particular machine. Using the philosophical distinction between “type” and “token,” we locate type-token ambiguity within a larger field of indefinite robotic identity, which can include networked systems or multiple bodies under a single control system. The paper explores three specific areas where the type-token tension might affect human–robot interaction, including how a robot demonstrates the highly personalized recounting of information, how (...) a robot makes moral appeals and justifies its decisions, and how the possible need for replacement of a particular robot shapes its ongoing role. We also consider how a robot might regard itself as a replaceable token of a general robotic type and take extraordinary actions on that basis. For human–robot interaction robotic type-token identity is not an ontological problem that has a single solution, but a range of possible interactions that responsible design must take into account, given how people stand to gain and lose from the shifting identities social robots will present. (shrink)

Many industry leaders and academics from the field of machine ethics would have us believe that the inevitability of robots coming to have a larger role in our lives demands that robots be endowed with moral reasoning capabilities. Robots endowed in this way may be referred to as artificial moral agents. Reasons often given for developing AMAs are: the prevention of harm, the necessity for public trust, the prevention of immoral use, such machines are better moral reasoners than humans, and (...) building these machines would lead to a better understanding of human morality. Although some scholars have challenged the very initiative to develop AMAs, what is currently missing from the debate is a closer examination of the reasons offered by machine ethicists to justify the development of AMAs. This closer examination is especially needed because of the amount of funding currently being allocated to the development of AMAs coupled with the amount of attention researchers and industry leaders receive in the media for their efforts in this direction. The stakes in this debate are high because moral robots would make demands on society; answers to a host of pending questions about what counts as an AMA and whether they are morally responsible for their behavior or not. This paper shifts the burden of proof back to the machine ethicists demanding that they give good reasons to build AMAs. The paper argues that until this is done, the development of commercially available AMAs should not proceed further. (shrink)

This paper provides a systematic literature review, analysis and discussion of methods that are proposed to practise ethics in research and innovation. Ethical considerations concerning the impacts of R&I are increasingly important, due to the quickening pace of technological innovation and the ubiquitous use of the outcomes of R&I processes in society. For this reason, several methods for practising ethics have been developed in different fields of R&I. The paper first of all presents a systematic search of academic sources that (...) present and discuss such methods. Secondly, it provides a categorisation of these methods according to three main kinds: ex ante methods, dealing with emerging technologies, intra methods, dealing with technology design, and ex post methods, dealing with ethical analysis of existing technologies. Thirdly, it discusses the methods by considering problems in the way they deal with the uncertainty of technological change, ethical technology design, the identification, analysis and resolving of ethical impacts of technologies and stakeholder participation. The results and discussion of our literature review are valuable for gaining an overview of the state of the art and serve as an outline of a future research agenda of methods for practising ethics in R&I. (shrink)

When should we use care robots? In this paper we endorse the shift from a simple normative approach to care robots ethics to a complex one: we think that one main task of a care robot ethics is that of analysing the different ways in which different care robots may affect the different values at stake in different care practices. We start filling a gap in the literature by showing how the philosophical analysis of the nature of healthcare activities can (...) contribute to robot ethics. We rely on the nature-of-activities approach recently proposed in the debate on human enhancement, and we apply it to the ethics of care robots. The nature-of-activities approach will help us to understand why certain practice-oriented activities in healthcare should arguably be left to humans, but certain goal-directed activities in healthcare can be fulfilled with the assistance of a robot. In relation to the latter, we aim to show that even though all healthcare activities can be considered as practice-oriented, when we understand the activity in terms of different legitimate ‘fine-grained’ descriptions, the same activities or at least certain components of them can be seen as clearly goal-directed. Insofar as it allows us to ethically assess specific functionalities of specific robots to be deployed in well-defined circumstances, we hold the nature-of-activities approach to be particularly helpful also from a design perspective, i.e. to realize the Value Sensitive Design approach. (shrink)

Critics currently argue that applied ethics approaches to artificial intelligence (AI) are too principles-oriented and entail a theory–practice gap. Several applied ethical approaches try to prevent such a gap by conceptually translating ethical theory into practice. In this article, we explore how the currently most prominent approaches of AI ethics translate ethics into practice. Therefore, we examine three approaches to applied AI ethics: the embedded ethics approach, the ethically aligned approach, and the Value Sensitive Design (VSD) approach. We analyze each (...) of these three approaches by asking how they understand and conceptualize theory and practice. We outline the conceptual strengths as well as their shortcomings: an embedded ethics approach is context-oriented but risks being biased by it; ethically aligned approaches are principles-oriented but lack justification theories to deal with trade-offs between competing principles; and the interdisciplinary Value Sensitive Design approach is based on stakeholder values but needs linkage to political, legal, or social governance aspects. Against this background, we develop a meta-framework for applied AI ethics conceptions with three dimensions. Based on critical theory, we suggest these dimensions as starting points to critically reflect on the conceptualization of theory and practice. We claim, first, that the inclusion of the dimension of affects and emotions in the ethical decision-making process stimulates reflections on vulnerabilities, experiences of disregard, and marginalization already within the AI development process. Second, we derive from our analysis that considering the dimension of justifying normative background theories provides both standards and criteria as well as guidance for prioritizing or evaluating competing principles in cases of conflict. Third, we argue that reflecting the governance dimension in ethical decision-making is an important factor to reveal power structures as well as to realize ethical AI and its application because this dimension seeks to combine social, legal, technical, and political concerns. This meta-framework can thus serve as a reflective tool for understanding, mapping, and assessing the theory–practice conceptualizations within AI ethics approaches to address and overcome their blind spots. (shrink)

This article introduces Designing for Care (D4C), a distinctive approach to project management and technological design informed by Care Ethics. We propose to conceptualize “care” as both the foundational value of D4C and as its guiding mid-level principle. As a value, care provides moral grounding. As a principle, it equips D4C with moral guidance to enact a caring process. The latter is made of a set of concrete, and often recursive, caring practices. One of the key assumption of D4C is (...) a relational ontology of individual and group identities, which fosters the actualization of caring practices as essentially relational and (often) reciprocal. Moreover, D4C adopts the “ecological turn” in CE and stresses the ecological situatedness and impact of concrete projects, envisioning an extension of caring from intra-species to inter-species relations. We argue that care and caring can influence directly some of the phases and practices within the management of (energy) projects and the design of sociotechnical (energy) artefacts and systems. When issues related to “value change” emerge as problematic (e.g., values trade-offs, conflicts), the mid-level guiding principle of care helps evaluate and prioritize different values at stake within specific projects. Although there may be several actors and stakeholders involved in project management and technological design, here we will focus on the professionals in charge of imagining, designing, and carrying out these processes (i.e., project managers, designers, engineers). We suggest that adopting D4C would improve their ability to capture and assess stakeholders’ values, critically reflect on and evaluate their own values, and judge which values prioritize. Although D4C may be adaptable to different fields and design contexts, we recommend its use especially within small and medium-scale (energy) projects. To show the benefits of adopting it, we envisage the application of D4C within the project management and the technological design of a community battery. The adoption of D4C can have multiple positive effects: transforming the mentality and practice of managing a project and designing technologies; enhancing caring relationships between managers, designers, and users as well as among users; achieving better communication, more inclusive participation, and more just decision-making. This is an initial attempt to articulate the structure and the procedural character of D4C. The application of D4C in a concrete project is needed to assess its actual impact, benefits, and limitations. (shrink)

Care is more than dispensing pills or cleaning beds. It is about responding to the entire patient. What is called “bedside manner” in medical personnel is a quality of treating the patient not as a mechanism but as a being—much like the caregiver—with desires, ideas, dreams, aspirations, and the gamut of mental and emotional character. As automata, answering an increasing functional need in care, are designed to enact care, the pressure is on their becoming more humanlike to carry out the (...) function more effectively. The question becomes not merely whether the care automaton can effect good bedside manner but whether the patient’s response is not feeling deceived by the humanlikeness. It seems the device must be designed either to effect explicit mere human-“likeness,” thus likely undermining its bedside-manner potential, or to fool the patient completely. Neither option is attractive. This article examines the social problems of designing maximally humanlike care automata and how problems may start to erode the human rights of users/patients. The article then investigates the alternatives for dealing with this problem, whether by industrial and professional self-regulation or public-policy initiatives. It then frames the problem in the broader historical perspective in terms of previous bans, moratoria, and other means of control of hazardous and potentially rights-violating techniques and materials. (shrink)

Developing technology that accounts for values has been achieved in many areas, including security, gaming, finance, engineering, and many more. The main methodological approach has been that of value sensitive design. But most of the work to date has been on the first of its three stages. The focus of this article is on advances related to its second stage, empirical investigation, and in particular the impact of contextual understanding in that stage. Although lessons can be learnt from other domains, (...) the specific context of dementia means that there are nuances to understanding values, including justice and autonomy, that differ from other areas. The integration of value considerations in the development of assistive technology in dementia is explored in two broad categories: the traditional and ongoing need for fixed decision support, and adaptable decision support technologies. For fixed decision support the A&D Benchmark is particularly useful in design. But for adaptable technologies, that benchmark requires further development, including consideration of the values of additional stakeholders, such as the general public. (shrink)

“Integrative Social Robotics” (ISR) is a new approach or general method for generating social robotics applications in a responsible and “culturally sustainable” fashion. Currently social robotics is caught in a basic difficulty we call the “triple gridlock of description, evaluation, and regulation”. We briefly recapitulate this problem and then present the core ideas of ISR in the form of five principles that should guide the development of applications in social robotics. Characteristic of ISR is to intertwine a mixed method approach (...) (i.e., conducting experimental, quantitative, qualitative, and phenomenological research for the same envisaged application) with conceptual and axiological analysis as required in professional studies in applied ethics; moreover, ISR is value-driven and abides by the “Non-Replacement Principle”: Social robots may only do what humans should but cannot do. We briefly compare ISR to other value-sensitive or value-directed design models, with a view to the task of overcoming the triple gridlock. Finally, working from an advanced classification of pluridiscplinary research, we argue that ISR establishes a research format that can turn social robotics into a new transdiscipline. (shrink)

Quality of life is an important outcome measure in mental health care. Currently, QoL is mainly measured with paper and pencil questionnaires. To contribute to the evaluation of treatment, and to enhance substantiated policy decisions in the allocation of resources, a web-based, personalized, patient-friendly and easy to administer QoL instrument has been developed: the QoL-ME. While human values play a significant role in shaping future use practices of technologies, it is important to anticipate on them during the design of the (...) QoL-instrument. The value sensitive design approach offers a theory and method for addressing these values in a systematic and principled manner in the design of technologies. While the VSD approach has been applied in the field of somatic care, we extended the VSD approach to the field of mental healthcare with the aim to enable developers of the QoL-instrument to reflect on important human values and anticipate potential value conflicts in its design. We therefore explored how VSD can be used by investigating the human values that are relevant for the design of the QoL-ME. Our exploration reveals that the values autonomy, efficiency, empowerment, universal usability, privacy, redifinition of roles, of responsibilites, reliability, solidarity, surveillance and trust are at stake for the future users of the technology. However, we argue that theoretical reflections on the potential ethical impact of a technology in the design phase can only go so far. To be able to comprehensively evaluate the usability the VSD approach, a supplementary study of the use practices of the technology is needed. (shrink)

It should not be a surprise in the near future to encounter either a personal or a professional service robot in our homes and/or our work places: according to the International Federation for Robots, there will be approx 35 million service robots at work by 2018. Given that individuals will interact and even cooperate with these service robots, their design and development demand ethical attention. With this in mind I suggest the use of an approach for incorporating ethics into the (...) design process of robots known as Care Centered Value Sensitive Design. Although this approach was originally and intentionally designed for the healthcare domain, the aim of this paper is to present a preliminary study of how personal and professional service robots might also be evaluated using the CCVSD approach. The normative foundations for CCVSD come from its reliance on the care ethics tradition and in particular the use of care practices for: structuring the analysis and, determining the values of ethical import. To apply CCVSD outside of healthcare one must show that the robot has been integrated into a care practice. Accordingly, the practice into which the robot is to be used must be assessed and shown to meet the conditions of a care practice. By investigating the foundations of the approach I hope to show why it may be applicable for service robots and further to give examples of current robot prototypes that can and cannot be evaluated using CCVSD. (shrink)

Robot ethics encompasses ethical questions about how humans should design, deploy, and treat robots; machine morality encompasses questions about what moral capacities a robot should have and how these capacities could be computationally implemented. Publications on both of these topics have doubled twice in the past 10 years but have often remained separate from one another. In an attempt to better integrate the two, I offer a framework for what a morally competent robot would look like and discuss a number (...) of ethical questions about the design, use, and treatment of such moral robots in society. Instead of searching for a fixed set of criteria of a robot’s moral competence I identify the multiple elements that make up human moral competence and probe the possibility of designing robots that have one or more of these human elements, which include: moral vocabulary; a system of norms; moral cognition and affect; moral decision making and action; moral communication. Juxtaposing empirical research, philosophical debates, and computational challenges, this article adopts an optimistic perspective: if robotic design truly commits to building morally competent robots, then those robots could be trustworthy and productive partners, caretakers, educators, and members of the human community. Moral competence does not resolve all ethical concerns over robots in society, but it may be a prerequisite to resolve at least some of them. (shrink)

In today’s highly dynamic societies, moral norms and values are subject to change. Moral change is partly driven by technological developments. For instance, the introduction of robots in elderly care practices requires caregivers to share moral responsibility with a robot (see van Wynsberghe 2013 ). Since we do not know what elements of morality will change and how they will change (see van der Burg 2003 ), moral education should aim at fostering what has been called “moral resilience” (Swierstra 2013 (...) ). We seek to fill two gaps in the existing literature: (i) research on moral education has not paid enough attention to the development of moral resilience; (ii) the very limited literature on moral resilience does not conceptualise moral resilience in relation to new technological developments. We argue that philosophical accounts of moral education need to do justice to the importance of moral resilience, and that a specific form of moral resilience should be conceptualised as “technomoral resilience” to underline the added value of cultivating moral resilience in relation to technomoral change. We illustrate the role of technomoral resilience in practice by looking at the context of elderly care. To make the first step towards an account of how technomoral resilience can be fostered in moral education, we propose that moral education shall focus on a triangle of capacities: (1) moral imagination, (2) a capacity for critical reflection, and (3) a capacity for maintaining one’s moral agency in the face of disturbances. (shrink)

In this paper, we argue that the characteristics of digital platforms challenge the fundamental assumptions of value sensitive design (VSD). Traditionally, VSD methods assume that we can identify relevant values during the design phase of new technologies. The underlying assumption is that there is onlyepistemic uncertaintyabout which values will be impacted by a technology. VSD methods suggest that one can predict which values will be affected by new technologies by increasing knowledge about how values are interpreted or understood in context. (...) In contrast, digital platforms exhibit a novel form of uncertainty, namely,ontological uncertainty: even with full information and overview, it cannot be foreseen what users or developers will do with digital platforms. Hence, predictions about which values are affected might not hold. In this paper, we suggest expanding VSD methods to account for value dynamism resulting from ontological uncertainty. Our expansions involve (1) extending VSD to the entire lifecycle of a platform, (2) broadening VSD through the addition of reflexivity, i.e. second-order learning about what values to aim at, and (3) adding specific tools of moral sandboxing and moral prototyping to enhance such reflexivity. While we illustrate our approach with a short case study about ride-sharing platforms such as Uber, our approach is relevant for other technologies exhibiting ontological uncertainty as well, such as machine learning, robotics and artificial intelligence. (shrink)

In this paper, we discuss the development of robot use cases in an elderly care facility in the context of exploring the method of Integrative Social Robotics when used on top of a user-centered design approach. Integrative Social Robotics is a new proposal for how to generate responsible, i.e. culturally and ethically sustainable, social robotics applications. Starting point for the discussion are the five principles that characterize an ISR approach, which are discussed in application to the three use cases for (...) robot support in a Danish elderly care facility developed within the smooth project. The discussion by an interdisciplinary design team explores what attention to the five principles of ISR can offer for use case development. We report on the consequences of this short-time exposure to the basic ideas of ISR for use case development and discuss the value of approaching robot development from an ISR perspective. (shrink)

Robots are leaving factories and entering urban spaces. In this paper, I will explore how we can integrate robots of various types into the urban landscape. I will distinguish between two perspectives: the responsible design and use of urban robots and robots as part of responsible urban innovations. The first viewpoint considers issues arising from the use of a robot in an urban environment. To develop a substantive understanding of Responsible Urban Robotics, we need to focus on normative implications of (...) city life as the context in which in robots are being used. I will refer to the desirable qualities of city life as “cityness” and will argue that we should design for cityness. The second approach asks how robots might be used to address challenges specific to cities. From the perspective of RRI, this may require participatory approaches in which the needs of the stakeholders are addressed. But we may also find inspiration in the work undertaken in architecture on expanding the concept and field to ensure that architects not only provide services to the lucky few but also create useful and beautiful spaces for the many. A dialogue with architects, urban designers, and urban planners may also be needed to successfully address the spatial issues raised by the presence of robots in the city. (shrink)

Community acceptance still remains a challenge for wind energy projects. The most popular explanation for local opposition, the Not in My Backyard effect, has received fierce criticism in the past decade. Critics argue that opposition is not merely a matter of selfishness or ignorance, but that moral, ecological and aesthetic values play an important role. In order to better take such values into account, a more bottom-up, participatory decision process is usually proposed. Research on this topic focusses on either stakeholder (...) motivations/attitudes, or their behavior during project implementation. This paper proposes a third research focus, namely the ‘objects’ which elicit certain behavioral responses and attitudes—the wind turbine and parks. More concretely, this paper explores Value Sensitive Design as way to arrive at wind turbines and parks that better embed or reflect key values. After a critical discussion of the notion of acceptance versus acceptability and support, the paper discusses existing literature on ecology and aesthetics in relation to wind turbine/park design, which could serve as ‘building blocks’ of a more integral VSD approach of the topic. It also discusses the challenge of demarcating wind park projects as VSD projects. A further challenge is that VSD has been applied mainly at the level of technical artifacts, whereas wind parks can best be conceptualized as socio-technical system. This new application would therefore expand the current practice of VSD, and may as a consequence also lead to interesting new insights for the VSD community. The paper concludes that such an outcome-oriented approach of wind turbines and park is worth exploring further, as a supplement to rather than a replacement of the process-oriented approach that is promoted by the current literature on community acceptance of wind parks. (shrink)

Contemporary literature investigating the significant impact of technology on our lives leads many to conclude that ethics must be a part of the discussion at an earlier stage in the design process i.e., before a commercial product is developed and introduced. The problem, however, is the question regarding how ethics can be incorporated into an earlier stage of technological development and it is this question that we argue has not yet been answered adequately. There is no consensus amongst scholars as (...) to the kind of ethics that should be practiced, nor the individual selected to perform this ethical analysis. One school of thought holds that ethics should have pragmatic value in research and design and that it should be implemented by the engineers and/or scientists themselves, while another school of thought holds that ethics need not be so pragmatic. For the latter, the ethical reflection can aim at a variety of goals, and be carried out by an ethicist. None of the approaches resulting from these lines of thinking have been adopted on a wide-scale basis. To that end, the approach presented here is intended to bridge the gap between these schools of thought. It is our contention that ethics ought to be pragmatic and to provide utility for the design process and we maintain that adequate ethical reflection, and all that it entails, ought to be conducted by an ethicist. Thus, we propose a novel role for the ethicist—the ethicist as designer—who subscribes to a pragmatic view of ethics in order to bring ethics into the research and design of artifacts—no matter the stage of development. In this paper we outline the series of steps that a pragmatic value analysis entails: uncovering relevant values, scrutinizing these values and, working towards the translation of values into technical content. In conclusion, we present a list of tasks for the ethicist in his/her role as designer on the interdisciplinary team. (shrink)

This paper aims to show that dominant conceptions of intelligence used in artificial intelligence (AI) are biased by normative assumptions that originate from the Global North, making it questionable if AI can be uncritically applied elsewhere without risking serious harm to vulnerable people. After the introduction in Sect. 1 we shortly present the history of IQ testing in Sect. 2, focusing on its multiple discriminatory biases. To determine how these biases came into existence, we define intelligence ontologically and underline its (...) constructed and culturally variable character. Turning to AI, specifically the Turing Test (TT), in Sect. 3, we critically examine its underlying intelligence conceptions. The test has been of central influence in AI research and remains an important point of orientation. We argue that both the test itself and how it is used in practice risk promoting a limited conception of intelligence which solely originated in the Global North. Hence, this conception should be critically assessed in relation to the different global contexts in which AI technologies are and will be used. In Sect. 4, we highlight how unequal power relations in AI research are a real threat, rather than just philosophical sophistry while considering the history of IQ testing and the TT’s practical biases. In the last section, we examine the limits of our account and identify fields for further investigation. Tracing colonial continuities in AI intelligence research, this paper points to a more diverse and historically aware approach to the design, development, and use of AI. (shrink)