As information systems transform our world, computer scientists design affordances that influence the uses and impacts of these technological objects. This article describes how the practices of design affect the social values materialized in emerging technologies, and explores how design practices can encourage ethical reflection and action. The article presents an ethnography of a laboratory that engineered software for mobile phones to track users’ locations, habits, and behaviors. This technical work raised a number of ethical challenges, particularly around questions of (...) data use and surveillance. The ethnography suggests that particular activities within laboratories can help engineers agree on social values as important to design. It characterizes these activities as values levers: practices that open new conversations about social values and encourage consensus around those values as design criteria. Laboratory leaders and advocates can enable and strengthen these levers to encourage ethical reflection and action as an explicit part of design practice. (shrink)

The prospect of increasingly autonomous military robots has raised concerns about the obfuscation of human responsibility. This papers argues that whether or not and to what extent human actors are and will be considered to be responsible for the behavior of robotic systems is and will be the outcome of ongoing negotiations between the various human actors involved. These negotiations are about what technologies should do and mean, but they are also about how responsibility should be interpreted and how it (...) can be best assigned or ascribed. The notion of responsibility practices, as the paper shows, provides a conceptual tool to examine these negotiations as well as the interplay between technological development and the ascription of responsibility. To illustrate the dynamics of responsibility practices the paper explores how the introduction of unmanned aerial vehicles has led to (re)negotiations about responsibility practices, focusing particularly on negotiations within the US Armed Forces. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

This article is a reply to the three reviews of my book What Things Do: Philosophical Reflections on Technology, Agency, and Design (Verbeek 2005 ) in this symposium. It discusses the remarks made by the reviewers along five lines. The first is methodological and concerns the question of how to develop a philosophical approach to technology. The second line discusses the philosophical orientation of the book, and the relations between analytic and continental approaches. Third, I will discuss the metaphysical aspects (...) of the book, in particular the nature and value of the non-modernist approach it aims to set out. Fourth, I will discuss the social and political relevance of the book. Fifth, this will bring me to some concluding remarks about how the postphenomenological perspective developed in the book relates to liberalism, focusing on its suggestions to deliberately design our material environment in terms of mediation. (shrink)

The convergence of computing, sensing, and communication technology will soon permit large-scale deployment of self-driving vehicles. This will in turn permit a radical transformation of traffic control technology. This paper makes a case for the importance of addressing questions of social justice in this transformation, and sketches a preliminary framework for doing so. We explain how new forms of traffic control technology have potential implications for several dimensions of social justice, including safety, sustainability, privacy, efficiency, and equal access. Our central (...) focus is on efficiency and equal access as desiderata for traffic control design. We explain the limitations of conventional traffic control in meeting these desiderata, and sketch a preliminary vision for a next-generation traffic control tailored to address better the demands of social justice. One component of this vision is cooperative, hierarchically distributed self-organization among vehicles. Another component of this vision is a priority system enabling selection of priority levels by the user for each vehicle trip in the network, based on the supporting structure of non-monetary credits. (shrink)

This article is a reply to the three reviews of my book What Things Do: Philosophical Reflections on Technology, Agency, and Design in this symposium. It discusses the remarks made by the reviewers along five lines. The first is methodological and concerns the question of how to develop a philosophical approach to technology. The second line discusses the philosophical orientation of the book, and the relations between analytic and continental approaches. Third, I will discuss the metaphysical aspects of the book, (...) in particular the nature and value of the non-modernist approach it aims to set out. Fourth, I will discuss the social and political relevance of the book. Fifth, this will bring me to some concluding remarks about how the postphenomenological perspective developed in the book relates to liberalism, focusing on its suggestions to deliberately design our material environment in terms of mediation. (shrink)

Philosophers have talked to each other about moral issues concerning technology, but few of them have talked about issues of technology and the good life, and even fewer have talked about technology and the good life with the public in the form of recommendation. In effect, recommendations for various technologies are often left to technologists and gurus. Given the potential benefits of informing the public on their impacts on the good life, however, this is a curious state of affairs. In (...) the present paper, I will examine why philosophers are seemingly reluctant to offer recommendations to the public. While there are many reasons for philosophers to refrain from offering recommendations, I shall focus on a specific normative reason. More specifically, it appears that, according to a particular definition, offering recommendations can be viewed as paternalistic, and therefore is prima facie wrong to do so. I will provide an argument to show that the worry about paternalism is unfounded, because a form of paternalism engendered by technology is inevitable. Given the inevitability of paternalism, I note that philosophers should accept the duty to offer recommendations to the public. I will then briefly turn to design ethics, which has reconceptualised the role of philosophers and, in my mind, fitted well with the inevitability of paternalism. Finally, I shall argue that design ethics has to be supplemented by the practice of recommendation if it is to sustain its objective. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

This paper aims to review the empirical and theoretical research on engineering ethics education, by focusing on the challenges reported in the literature. The analysis is conducted at four levels of the engineering education system. First, the individual level is dedicated to findings about teaching practices reported by instructors. Second, the institutional level brings together findings about the implementation and presence of ethics within engineering programmes. Third, the level of policy situates findings about engineering ethics education in the context of (...) accreditation. Finally, there is the level of the culture of engineering education. The multi-level analysis allows us to address some of the limitations of higher education research which tends to focus on individual actors such as instructors or remains focused on the levels of policy and practice without examining the deeper levels of paradigm and purpose guiding them. Our approach links some of the challenges of engineering ethics education with wider debates about its guiding paradigms. The main contribution of the paper is to situate the analysis of the theoretical and empirical findings reported in the literature on engineering ethics education in the context of broader discussions about the purpose of engineering education and the aims of reform programmes. We conclude by putting forward a series of recommendations for a socio-technical oriented reform of engineering education for ethics. (shrink)

Being more than mere passive objects used at human will, technologies co-determine the values and structures that shape the EU agricultural system. Technologies actively shape human interpretation, human action and co-shape our moral standards and routines. It is therefore important to account for the moral significance of agricultural technologies when characterising the structures in place within EU agriculture as well as when trying to understand why a particular agricultural technology is favoured or strongly opposed. From this perspective on technology, an (...) interesting question to pose, is how, within their current use context, genetically modified crops mediate human interpretation and human practice? This technology is of particular interest, because after more than 30 years, the debate on GM crops is still profound and highly polarised within EU society. Yet, too often, this debate is devalued as being irrational or irrelevant, while we show in this article, based on a technological mediation analysis, how ethical concerns about agricultural practices have co-evolved with the technological development of GM crops. This qualifies public debate on GM crops in the EU as both legitimate and relevant, as, from this perspective on technology, it can be seen as an important way to both characterise and discuss how EU agriculture is and should be organised. Analysing technology in terms of the myriad ways in which it mediates the relationship between humans and their world, further allows us to make some suggestions about how to broaden the ongoing EU discussion beyond the current dichotomous Yes/No framing. (shrink)

Knowing that technologies are inherently value-laden and systemically interwoven with society, the question is how individual engineers can take up the challenge of accepting the responsibility for their work? This paper will argue that engineers have no institutional structure at the level of society that allows them to recognize, reflect upon, and actively integrate the value-laden character of their designs. Instead, engineers have to tap on the different institutional realms of market, science, and state, making their work a ‘hybrid’ activity (...) combining elements from the different institutional realms. To deal with this institutional hybridity, engineers develop routines and heuristics in their professional network, which do not allow societal values to be expressed in a satisfactory manner. To allow forms of ‘active’ responsibility, there have to be so-called ‘accountability forums’ that guide moral reflections of individual actors. The paper will subsequently look at the methodologies of value-sensitive design and constructive technology assessment and explore whether and how these methodologies allow engineers to integrate societal values into the design technological artifacts and systems. As VSD and CTA are methodologies that look at the process of technological design, whereas the focus of this paper is on the designer, they can only be used indirectly, namely as frameworks which help to identify the contours of a framework for active responsibility of engineers. (shrink)

In his article In Between Us, Yoni van den Eede expands existing theories of mediation into the realm of the social and the political, focusing on the notions of opacity and transparency. His approach is rich and promising, but two pitfalls should be avoided. First, his concept of ‘in-between’ runs the risk to conceptualize mediation as a process ‘between’ pre-given entities. On the basis of current work in postphenomenology and actor-network theory, though, mediation should rather be seen as the origin (...) of entities, not as an intermediary between them. Second, Van den Eede’s separate discussion of transparency and opacity in ‘use’ and in ‘context’ runs the risk to make invisible the complementarity of the two dimensions. While transparency of use embodies an experiential form of the distinction between transparency and opacity, transparency of context embodies a more cognitive dimension of the distinction. Only by linking the two it becomes possible to take responsibility for the impact that technological mediations can have. Users and designers need a ‘double vision’ to simultaneously see the transparency of both use and context. (shrink)

This paper will address the question of the morality of technology. I believe this is an important question for our contemporary society in which technology, especially information technology, is increasingly becoming the default mode of social ordering. I want to suggest that the conventional manner of conceptualising the morality of technology is inadequate – even dangerous. The conventional view of technology is that technology represents technical means to achieve social ends. Thus, the moral problem of technology, from this perspective, is (...) the way in which the given technical means are applied to particular (good or bad) social ends. In opposition to this I want to suggest that the assumed separation, of this approach, between technical means and social ends are inappropriate. It only serves to hide the most important political and ethical dimensions of technology. I want to suggest that the morality of technology is much more embedded and implicit than such a view would suggest. In order to critique this approach I will draw on phenomenology and the more recent work of Bruno Latour. With these intellectual resources in mind I will propose disclosive ethics as a way to make the morality of technology visible. I will give a brief account of this approach and show how it might guide our␣understanding of the ethics and politics of technology by considering two examples of contemporary information technology: search engines and plagiarism detection systems. (shrink)

Why does a cell phone have a screen? From televisions and cell phones to refrigerators, many contemporary technologies come with a screen. The article aims at answering this question by employing Emmanuel Levinas’ notions of the Other and the face. This article also engages with Don Ihde’s conceptualization of alterity relations, in which the technological acts as quasi-other with which we maintain relations. If technology is a quasi-other, then, I claim, the screen is the quasi-face. By exploring Levinas’ ontology, specifically (...) what can be identified as his tool analysis, as well as his notion of the face, a new understanding of contemporary technologies can be extracted. Some of these technologies hardly fit into the Heideggerian notion of the hand as the main interface to artifacts. Instead they require the face. Levinas’ notion of the face is analyzed from an ontological perspective and developed in conjunction with the screen. As the screen serves as a quasi-face, it enables the construction of quasi-other technological artifacts. (shrink)

Among ethicists and engineers within robotics there is an ongoing discussion as to whether ethical robots are possible or even desirable. We answer both of these questions in the positive, based on an extensive literature study of existing arguments. Our contribution consists in bringing together and reinterpreting pieces of information from a variety of sources. One of the conclusions drawn is that artifactual morality must come in degrees and depend on the level of agency, autonomy and intelligence of the machine. (...) Moral concerns for agents such as intelligent search machines are relatively simple, while highly intelligent and autonomous artifacts with significant impact and complex modes of agency must be equipped with more advanced ethical capabilities. Systems like cognitive robots are being developed that are expected to become part of our everyday lives in future decades. Thus, it is necessary to ensure that their behaviour is adequate. In an analogy with artificial intelligence, which is the ability of a machine to perform activities that would require intelligence in humans, artificial morality is considered to be the ability of a machine to perform activities that would require morality in humans. The capacity for artificial (artifactual) morality, such as artifactual agency, artifactual responsibility, artificial intentions, artificial (synthetic) emotions, etc., come in varying degrees and depend on the type of agent. As an illustration, we address the assurance of safety in modern High Reliability Organizations through responsibility distribution. In the same way that the concept of agency is generalized in the case of artificial agents, the concept of moral agency, including responsibility, is generalized too. We propose to look at artificial moral agents as having functional responsibilities within a network of distributed responsibilities in a socio-technological system. This does not take away the responsibilities of the other stakeholders in the system, but facilitates an understanding and regulation of such networks. It should be pointed out that the process of development must assume an evolutionary form with a number of iterations because the emergent properties of artifacts must be tested in real world situations with agents of increasing intelligence and moral competence. We see this paper as a contribution to the macro-level Requirement Engineering through discussion and analysis of general requirements for design of ethical robots. (shrink)

In What Things Do , Verbeek (What things do: philosophical reflections on technology, agency and design. Penn State University Press, University Park, 2005a ) develops a vocabulary for understanding the social role of technological artifacts in our culture and in our daily lives. He understands this role in terms of the technological mediation of human behavior and perception. To explain mediation, he levels out the modernist separation of subjects and objects by decreasing the autonomy of humans and increasing the activity (...) of things. His approach consists primarily within a clever integration of the theories of Latour and Ihde, which provides a comprehensive understanding of the social role of technological artifacts. Despite the fact that Verbeek’s book is carefully thought out and already quite influential in the field of philosophy of technology, his approach raises some conceptual and pragmatic questions. The conceptual questions concern (a) the precise meaning of the concept of mediation and the possibility of distinguishing between different forms of mediation, and (b) the differences and similarities between human and technological agency and intentionality. The pragmatic questions concern the application of his theory to the realm of engineering ethics. Particularly pressing is the question of how to assign (moral) responsibility to humans when technological artifacts are mediating the outcomes of human actions. With this article, I will raise these issues, and look forward to Verbeek’s reply. (shrink)

Persistent public distrust of food additives is often explained in terms of safety and health issues. The broad variety of ethical, aesthetic, and cultural concerns tends to be structurally ignored by food engineers and occasionally even by consumers themselves. The public controversy of food additives—commonly known as “E-numbers”—in the Netherlands is a case in point. Two discursive mechanisms prevent these concerns from becoming legitimate public issues: irrationalization and privatization. But these consumer concerns may not be as unreasonable as they seem, (...) and they may even turn out to be not that private. As long as ethical, aesthetic and cultural concerns are not recognized by food engineers as legitimate issues, the controversy of food additives is not likely to find closure. Moreover, this lack of recognition blocks the opportunity for meaningful dialogue and trust building between food technology developers, policy makers, citizens and consumers. (shrink)

In response to widespread policy prescriptions for responsible innovation, social scientists and engineering ethicists, among others, have sought to engage natural scientists and engineers at the ‘midstream’: building interdisciplinary collaborations to integrate social and ethical considerations with research and development processes. Two ‘laboratory engagement studies’ have explored how applying the framework of midstream modulation could enhance the reflections of natural scientists on the socio-ethical context of their work. The results of these interdisciplinary collaborations confirm the utility of midstream modulation in (...) encouraging both first- and second-order reflective learning. The potential for second-order reflective learning, in which underlying value systems become the object of reflection, is particularly significant with respect to addressing social responsibility in research practices. Midstream modulation served to render the socio-ethical context of research visible in the laboratory and helped enable research participants to more critically reflect on this broader context. While lab-based collaborations would benefit from being carried out in concert with activities at institutional and policy levels, midstream modulation could prove a valuable asset in the toolbox of interdisciplinary methods aimed at responsible innovation. (shrink)

In this paper, we explore how the definition of life takes on an essential character in the ethical debates around health technologies, with life thus being manufactured in the tensions and conflicts around the use of such artefacts and devices. We introduce concepts from science and technology studies (STS) to approach bioethics, overcoming the dualistic conception that separates the natural and the technological and questioning the dominant rationality that divides life into dualities. Drawing on two research projects in which we (...) have been involved in recent years, one regarding biobanks and the other regarding social care robots, we explore how the ethical discussions about biobanks and robots imply particular notions of life. We argue that the contemporary epistemic category of life is a manufactured life in which various rationalities coexist: one rationality based on a separation between the technological and the human, focused on pragmatism and functionalities that tend towards a dualized notion of life divided into qualified and non-qualified life, and another rationality based on a non-essentialist ontology, focused on the mediating role of health technologies, that entails a distributed life appearing as a precarious effect of a network. Each of these rationalities allows the emergence of different issues and ethical concerns, thus enriching the bioethical debate. (shrink)

Technologies fulfill a social role in the sense that they influence the moral actions of people, often in unintended and unforeseen ways. Scientists and engineers are already accepting much responsibility for the technological, economical and environmental aspects of their work. This article asks them to take an extra step, and now also consider the social role of their products. The aim is to enable engineers to take a prospective responsibility for the future social roles of their technologies by providing them (...) with a matrix that helps to explore in advance how emerging technologies might plausibly affect the reasons behind people’s (moral) actions. On the horizontal axis of the matrix, we distinguished the three basic types of reasons that play a role in practical judgment: what is the case, what can be done and what should be done. On the vertical axis we distinguished the morally relevant classes of issues: stakeholders, consequences and the good life. To illustrate how this matrix may work in practice, the final section applies the matrix to the case of the Google PowerMeter. (shrink)

In this essay several virtues are discussed that are needed in people who work in participatory design (PD). The term PD is used here to refer specifically to an approach in designing information systems with its roots in Scandinavia in the 1970s and 1980s. Through the lens of virtue ethics and based on key texts in PD, the virtues of cooperation, curiosity, creativity, empowerment and reflexivity are discussed. Cooperation helps people in PD projects to engage in cooperative curiosity and cooperative (...) creativity. Curiosity helps them to empathize with others and their experiences, and to engage in joint learning. Creativity helps them to envision, try out and materialize ideas, and to jointly create new products and services. Empowerment helps them to share power and to enable other people to flourish. Moreover, reflexivity helps them to perceive and to modify their own thoughts, feelings and actions. In the spirit of virtue ethics—which focuses on specific people in concrete situations—several examples from one PD project are provided. Virtue ethics is likely to appeal to people in PD projects because it is practice-oriented, provides room for exploration and experimentation, and promotes professional and personal development. In closing, some ideas for practical application, for education and for further research are discussed. (shrink)

The technical details of Internet architecture affect social debates about privacy and autonomy, intellectual property, cybersecurity, and the basic performance and reliability of Internet services. This paper explores one method for practicing anticipatory ethics in order to understand how a new infrastructure for the Internet might impact these social debates. This paper systematically examines values expressed by an Internet architecture engineering team—the Named Data Networking project—based on data gathered from publications and internal documents. Networking engineers making technical choices also weigh (...) non-technical values when working on Internet infrastructure. Analysis of the team’s documents reveals both values invoked in response to technical constraints and possibilities, such as efficiency and dynamism, as well as values, including privacy, security and anonymity, which stem from a concern for personal liberties. More peripheral communitarian values espoused by the engineers include democratization and trust. The paper considers the contextual and social origins of these values, and then uses them as a method of practicing anticipatory ethics: considering the impact such priorities may have on a future Internet. (shrink)

This article identifies limitations in traditional approaches to engineering ethics pedagogy, reflected in an overreliance on disaster case studies. Researchers in the field have pointed out that these approaches tend to occlude ethically significant aspects of day-to-day engineering practice and thus reductively individualize and decontextualize ethical decision-making. Some have proposed, as a remedy for these defects, the use of research and theory from Science and Technology Studies to enrich our understanding of the ways in which technology and engineering practice are (...) intricated in social and institutional contexts. While endorsing this approach, this article also argues that STS scholarship may not sufficiently address the kinds of questions about normativity and agency that are essential to engineering ethics. It proposes making use of the growing body of research in a field called “postphenomenology,” an approach that combines STS research with the traditional phenomenological concern with the standpoint of lived-experience. Postphenomenology offers a method of inquiry that combines STS’s investigation into social and institutional dimensions of technology with phenomenological reflection on our lived experience of embodied engagement with technical objects and sociotechnical systems, particularly the ways in which these involvements affect our moral perception and agency. The aim in using this approach in engineering ethics is thus to illuminate moral dimensions of everyday professional life of which practitioners may not typically be aware. The article concludes with some concrete curricular interventions for engineering ethics classrooms. (shrink)

The paper deals with the introduction of nanotechnology in biochips. Based on interviews and theoretical reflections, it explores blind spots left by technology assessment and ethical investigations. These have focused on possible consequences of increased diffusability of a diagnostic device, neglecting both the context of research as well as increased accuracy, despite it being a more essential feature of nanobiochip projects. Also, rather than one of many parallel aspects in innovation processes, ethics is considered here as a ubiquitous system of (...) choices between sometimes antagonistic values. Thus, the paper investigates what is at stake when accuracy is balanced with other practical values in different contexts. Dramatic nanotechnological increase of accuracy in biochips can raise ethical issues, since it is at odds with other values such as diffusability and reliability. But those issues will not be as revolutionary as is often claimed: neither in diagnostics, because accuracy of measurements is not accuracy of diagnostics; nor in research, because a boost in measurement accuracy is not sufficient to overcome significance-chasing malpractices. The conclusion extends to methodological recommendations. (shrink)