We live in a world of technical systems, designed in accordance with technical disciplines and operated by a personnel trained in those disciplines. This is a unique form of social organization without historical precedent. It overshadows traditional democratic institutions and largely determines our way of life. Technosystem: The Social Life of Reason reconstructs the idea of democracy for this brave new world. The author draws on the tradition of radical social criticism represented by Herbert Marcuse and the Frankfurt School as (...) well as contemporary Science and Technology Studies. The social critics recognized the role of instrumental rationality in modern societies, but they did not analyze any actual technologies in detail, nor did they develop a convincing theory of democratic resistance to the new forms of domination by rational systems. STS has developed methods of analysis for a fine-grained study of technology. Technosystem brings these methods to bear on the resistances emerging in the world described by the radical social critics of the Frankfurt School.--. (shrink)

How can we best identify, understand, and deal with ethical and societal issues raised by healthcare robotics? This paper argues that next to ethical analysis, classic technology assessment, and philosophical speculation we need forms of reflection, dialogue, and experiment that come, quite literally, much closer to innovation practices and contexts of use. The authors discuss a number of ways how to achieve that. Informed by their experience with “embedded” ethics in technical projects and with various tools and methods of responsible (...) research and innovation, the paper identifies “internal” and “external” forms of dialogical research and innovation, reflections on the possibilities and limitations of these forms of ethical–technological innovation, and explores a number of ways how they can be supported by policy at national and supranational level. (shrink)

It should not be a surprise in the near future to encounter either a personal or a professional service robot in our homes and/or our work places: according to the International Federation for Robots, there will be approx 35 million service robots at work by 2018. Given that individuals will interact and even cooperate with these service robots, their design and development demand ethical attention. With this in mind I suggest the use of an approach for incorporating ethics into the (...) design process of robots known as Care Centered Value Sensitive Design. Although this approach was originally and intentionally designed for the healthcare domain, the aim of this paper is to present a preliminary study of how personal and professional service robots might also be evaluated using the CCVSD approach. The normative foundations for CCVSD come from its reliance on the care ethics tradition and in particular the use of care practices for: structuring the analysis and, determining the values of ethical import. To apply CCVSD outside of healthcare one must show that the robot has been integrated into a care practice. Accordingly, the practice into which the robot is to be used must be assessed and shown to meet the conditions of a care practice. By investigating the foundations of the approach I hope to show why it may be applicable for service robots and further to give examples of current robot prototypes that can and cannot be evaluated using CCVSD. (shrink)

A critically important ethical issue facing the AI research community is how AI research and AI products can be responsibly conceptualised and presented to the public. A good deal of fear and concern about uncontrollable AI is now being displayed in public discourse. Public understanding of AI is being shaped in a way that may ultimately impede AI research. The public discourse as well as discourse among AI researchers leads to at least two problems: a confusion about the notion of (...) ‘autonomy’ that induces people to attribute to machines something comparable to human autonomy, and a ‘sociotechnical blindness’ that hides the essential role played by humans at every stage of the design and deployment of an AI system. Here our purpose is to develop and use a language with the aim to reframe the discourse in AI and shed light on the real issues in the discipline. (shrink)

This paper treats the political and ethical issues associated with the new caretaking technologies. Given the number of feminists who have raised serious concerns about the future of care work in the United States, and who have been critical of the degree to which society “free rides” on women's caretaking labor, I consider whether technology may provide a solution to this problem. Certainly, if we can create machines and robots to take on particular tasks, we may lighten the care burden (...) that women currently face, much of which is heavy and repetitious, and which results in injury and care “burnout” for many female caretakers. Yet, in some contexts, I argue that high-tech robotic care may undermine social relationships, cutting individuals off from the possibility of social connectedness with others. (shrink)

Scenarios involving the introduction of artificially intelligent (AI) assistive technologies in health care practices raise several ethical issues. In this paper, I discuss four objections to introducing AI assistive technologies in health care practices as replacements of human care. I analyse them as demands for felt care, good care, private care, and real care. I argue that although these objections cannot stand as good reasons for a general and a priori rejection of AI assistive technologies as such or as replacements (...) of human care, they demand us to clarify what is at stake, to develop more comprehensive criteria for good care, and to rethink existing practices of care. In response to these challenges, I propose a (modified) capabilities approach to care and emphasize the inherent social dimension of care. I also discuss the demand for real care by introducing the ‘Care Experience Machine’ thought experiment. I conclude that if we set the standards of care too high when evaluating the introduction of AI assistive technologies in health care, we have to reject many of our existing, low-tech health care practices. (shrink)

The discussion about robots in elderly care is populated by doom scenarios about a totally dehumanized care system in which elderly people are taken care of by machines. Such scenarios are helpful as they attend us to what we think is important with regard to the quality elderly care. However, this article argues that they are misleading in so far as they (1) assume that deception in care is always morally unacceptable, (2) suggest that robots and other information technologies necessarily (...) deceive elderly people by creating a “virtual” world as opposed to a “real” world, (3) assume that elderly people of the future have similar ICT skills and interests as the elderly people of today, and (4) assume a simplistic view of technologies. The article suggests an approach to evaluating care robots and ICT in health care which acknowledges and addresses a number of ethical problems raised by robotic care—for instance disengagement problems—while taking into account that some elderly people may need care that does not treat them as (empirically) autonomous, that many the elderly of the future are likely to be digital natives, and that the task of evaluating technologies in care is more complicated than the discussion of deception suggests. (shrink)

In this paper I describe a future in which persons in advanced old age are cared for entirely by robots and suggest that this would be a dystopia, which we would be well advised to avoid if we can. Paying attention to the objective elements of welfare rather than to people’s happiness reveals the central importance of respect and recognition, which robots cannot provide, to the practice of aged care. A realistic appreciation of the current economics of the aged care (...) sector suggests that the introduction of robots into an aged care setting will most likely threaten rather than enhance these goods. I argue that, as a result, the development of robotics is likely to transform aged care in accordance with a trajectory of development that leads towards this dystopian future even when this is not the intention of the engineers working to develop robots for aged care. While an argument can be made for the use of robots in aged care where the people being cared for have chosen to allow robots in this role, I suggest that over-emphasising this possibility risks rendering it a self-fulfilling prophecy, depriving those being cared for of valuable social recognition, and failing to provide respect for older persons by allowing the options available to them to be shaped by the design choices of others. (shrink)

This article analyzes the moral relevance of technological artifacts and its possible role in ethical theory, by taking the postphenomenological approach that has developed around the work of Don Ihde into the domain of ethics. By elaborating a postphenomenological analysis of the mediating role of ultrasound in moral decisions about abortion, the article argues that technologies embody morality and help to constitute moral subjectivity. This technological mediation of the moral subject is subsequently addressed in terms of Michel Foucault’s ethical position, (...) in which ethics is about actively co-shaping one’s moral subjectivity. Integrating Foucauldian ethics and postphenomenology, the article argues that the technological mediation of moral subjectivity should be at the heart of an ethical approach that takes the moral dimensions of technology seriously. (shrink)

When should we use care robots? In this paper we endorse the shift from a simple normative approach to care robots ethics to a complex one: we think that one main task of a care robot ethics is that of analysing the different ways in which different care robots may affect the different values at stake in different care practices. We start filling a gap in the literature by showing how the philosophical analysis of the nature of healthcare activities can (...) contribute to robot ethics. We rely on the nature-of-activities approach recently proposed in the debate on human enhancement, and we apply it to the ethics of care robots. The nature-of-activities approach will help us to understand why certain practice-oriented activities in healthcare should arguably be left to humans, but certain goal-directed activities in healthcare can be fulfilled with the assistance of a robot. In relation to the latter, we aim to show that even though all healthcare activities can be considered as practice-oriented, when we understand the activity in terms of different legitimate ‘fine-grained’ descriptions, the same activities or at least certain components of them can be seen as clearly goal-directed. Insofar as it allows us to ethically assess specific functionalities of specific robots to be deployed in well-defined circumstances, we hold the nature-of-activities approach to be particularly helpful also from a design perspective, i.e. to realize the Value Sensitive Design approach. (shrink)

This paper offers an ethical framework for the development of robots as home companions that are intended to address the isolation and reduced physical functioning of frail older people with capacity, especially those living alone in a noninstitutional setting. Our ethical framework gives autonomy priority in a list of purposes served by assistive technology in general, and carebots in particular. It first introduces the notion of “presence” and draws a distinction between humanoid multi-function robots and non-humanoid robots to suggest that (...) the former provide a more sophisticated presence than the latter. It then looks at the difference between lower-tech assistive technological support for older people and its benefits, and contrasts these with what robots can offer. This provides some context for the ethical assessment of robotic assistive technology. We then consider what might need to be added to presence to produce care from a companion robot that deals with older people’s reduced functioning and isolation. Finally, we outline and explain our ethical framework. We discuss how it combines sometimes conflicting values that the design of a carebot might incorporate, if informed by an analysis of the different roles that can be served by a companion robot. (shrink)

First Published in 1993. Routledge is an imprint of Taylor & Francis, an informa company.

"... Dr. Ihde brings an enlightening and deeply humanistic perspective to major technological developments, both past and present." —Science Books & Films "Don Ihde is a pleasure to read.... The material is full of nice suggestions and details, empirical materials, fun variations which engage the reader in the work... the overall points almost sneak up on you, they are so gently and gradually offered." —John Compton "A sophisticated celebration of cultural diversity and of its enabling technologies.... perhaps the best single (...) volume relating the philosophical tradition to the broad issues raised by contemporary technologies." —Choice "... important and challenging... " —Review of Metaphysics "... a range of rich historical, cultural, philosophical, and psychological insights, woven together in an intriguing and clear exposition... The book is really a pleasure to read, for its style, immense learning and sanity." —Teaching Philosophy The role of tools and instruments in our relation to the earth and the ways in which technologies are culturally embedded provide the foci of this thought-provoking book. (shrink)

The growing proportion of elderly people in society, together with recent advances in robotics, makes the use of robots in elder care increasingly likely. We outline developments in the areas of robot applications for assisting the elderly and their carers, for monitoring their health and safety, and for providing them with companionship. Despite the possible benefits, we raise and discuss six main ethical concerns associated with: (1) the potential reduction in the amount of human contact; (2) an increase in the (...) feelings of objectification and loss of control; (3) a loss of privacy; (4) a loss of personal liberty; (5) deception and infantilisation; (6) the circumstances in which elderly people should be allowed to control robots. We conclude by balancing the care benefits against the ethical costs. If introduced with foresight and careful guidelines, robots and robotic technology could improve the lives of the elderly, reducing their dependence, and creating more opportunities for social interaction. (shrink)

It is remarkable how much robotics research is promoted by appealing to the idea that the only way to deal with a looming demographic crisis is to develop robots to look after older persons. This paper surveys and assesses the claims made on behalf of robots in relation to their capacity to meet the needs of older persons. We consider each of the roles that has been suggested for robots in aged care and attempt to evaluate how successful robots might (...) be in these roles. We do so from the perspective of writers concerned primarily with the quality of aged care, paying particular attention to the social and ethical implications of the introduction of robots, rather than from the perspective of robotics, engineering, or computer science. We emphasis the importance of the social and emotional needs of older persons—which, we argue, robots are incapable of meeting—in almost any task involved in their care. Even if robots were to become capable of filling some service roles in the aged-care sector, economic pressures on the sector would most likely ensure that the result was a decrease in the amount of human contact experienced by older persons being cared for, which itself would be detrimental to their well-being. This means that the prospects for the ethical use of robots in the aged-care sector are far fewer than first appears. More controversially, we believe that it is not only misguided, but actually unethical, to attempt to substitute robot simulacra for genuine social interaction. A subsidiary goal of this paper is to draw attention to the discourse about aged care and robotics and locate it in the context of broader social attitudes towards older persons. We conclude by proposing a deliberative process involving older persons as a test for the ethics of the use of robots in aged care. (shrink)

The idea of developing robot companions and caregivers for the elderly is taking hold. Elderly people are often lonely and in need of companionship and social contact. Some hold that a robot could be a friend substitute and, at the same time, reassure absent families about the well-being of their elderly relative by monitoring and reporting on their health. Alzheimer's disease leaves many elderly confused so that they need help with routine activities and someone to answer their questions. It has (...) been suggested that a robot could fulfill this role. Young children need constant care and supervision, but busy parents do not always have the time to provide it. In this article, we have probed the ethics of designing robots that promote the illusion of being able to form meaningful relationships with humans. (shrink)

Autonomous robots are increasingly interacting with users who have limited knowledge of robotics and are likely to have an erroneous mental model of the robot’s workings, capabilities, and internal structure. The robot’s real capabilities may diverge from this mental model to the extent that one might accuse the robot’s manufacturer of deceiving the user, especially in cases where the user naturally tends to ascribe exaggerated capabilities to the machine (e.g. conversational systems in elder-care contexts, or toy robots in child care). (...) This poses the question, whether misleading or even actively deceiving the user of an autonomous artifact about the capabilities of the machine is morally bad and why. By analyzing trust, autonomy, and the erosion of trust in communicative acts as consequences of deceptive robot behavior, we formulate four criteria that must be fulfilled in order for robot deception to be morally permissible, and in some cases even morally indicated. (shrink)

The debate about the use of robots in the care of older adults has often been dominated by either overly optimistic visions (coming particularly from Japan), in which robots are seamlessly incorporated into society thereby enhancing quality of life for everyone; or by extremely pessimistic scenarios that paint such a future as horrifying. We reject this dichotomy and argue for a more differentiated ethical evaluation of the possibilities and risks involved with the use of social robots. In a critical discussion (...) surrounding the capabilities approach to the ethical evaluation of quality of life, we develop an ethical framework that is more appropriate to the situation of the oldest old. We urge employment of a context-dependent approach to the ethical evaluation of new technologies in the care and therapy of older adults, and using the example of the robotic seal Paro, we show how this can be accomplished in a sensible and practical way. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

Environmental scientists and engineers have been exploring research and monitoring applications of robotics, as well as exploring ways of integrating robotics into ecosystems to aid in responses to accelerating environmental, climatic, and biodiversity changes. These emerging applications of robots and other autonomous technologies present novel ethical and practical challenges. Yet, the critical applications of robots for environmental research, engineering, protection and remediation have received next to no attention in the ethics of robotics literature to date. This paper seeks to fill (...) that void, and promote the study of environmental robotics. It provides key resources for further critical examination of the issues environmental robots present by explaining and differentiating the sorts of environmental robotics that exist to date and identifying unique conceptual, ethical, and practical issues they present. (shrink)

Environmental scientists and engineers have been exploring research and monitoring applications of robotics, as well as exploring ways of integrating robotics into ecosystems to aid in responses to accelerating environmental, climatic, and biodiversity changes. These emerging applications of robots and other autonomous technologies present novel ethical and practical challenges. Yet, the critical applications of robots for environmental research, engineering, protection and remediation have received next to no attention in the ethics of robotics literature to date. This paper seeks to fill (...) that void, and promote the study of environmental robotics. It provides key resources for further critical examination of the issues environmental robots present by explaining and differentiating the sorts of environmental robotics that exist to date and identifying unique conceptual, ethical, and practical issues they present. (shrink)

Many contexts shape and limit moral thinking in philosophy and life. Human conditions of vulnerability and interdependency, of limited awareness and control, of imperfect insight into ourselves and others are inevitable contexts that neither moral thought nor theory should forget. To be truly reflective, moral thinking and moral philosophy must become aware of the contexts that bind our thinking about how to live. This collection of essays by Margaret Urban Walker seek to show how to do this, and why it (...) makes a difference. Contingent and changeable contexts that shape moral thinking include our individual histories, our social positions, and institutional roles, relationships, cultural settings, and social arrangements, and the specific moral idioms we pick up along the way. The paradigms and specialized language of ethical theory are contexts, too; they shape how moral theory looks and what or whom it looks at. Ethical theory and practice are meaningless without these Moral Contexts. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

To be truly reflective, moral thinking and moral philosophy must become aware of the contexts that bind our thinking about how to live. These essays show how to do this, and why it makes a difference.

As we near a time when robots may serve a vital function by becoming caregivers, it is important to examine the ethical implications of this development. By applying the capabilities approach as a guide to both the design and use of robot caregivers, we hope that this will maximize opportunities to preserve or expand freedom for care recipients. We think the use of the capabilities approach will be especially valuable for improving the ability of impaired persons to interface more effectively (...) with their physical and social environments. (shrink)

Autonomous robots that are capable of learning are being developed to make it easier for human actors to achieve their goals. As such, robots are primarily a means to an end and replace human actions. An interdisciplinary technology assessment was carried out to determine the extent to which a replacement of this kind makes ethical sense in terms of technology, economics and legal aspects. Proceeding from an ethical perspective, derived from Kant’s formula of humanity, in this article we analyse the (...) use of robots in the care of the elderly or infirm and then examine robot learning in the context of this kind of cooperation. (shrink)

When is it ethically acceptable to use artificial agents in health care? This article articulates some criteria for good care and then discusses whether machines as artificial agents that take over care tasks meet these criteria. Particular attention is paid to intuitions about the meaning of ‘care’, ‘agency’, and ‘taking over’, but also to the care process as a labour process in a modern organizational and financial-economic context. It is argued that while there is in principle no objection to using (...) machines in medicine and health care, the idea of them functioning and appearing as ‘artificial agents’ is problematic and attends us to problems in human care which were already present before visions of machine care entered the stage. It is recommended that the discussion about care machines be connected to a broader discussion about the impact of technology on human relations in the context of modernity. (shrink)