Most engineers Fwork within social structures governing and governed by a set of values that primarily emphasise economic concerns. The majority of innovations derive from these loci. Given the effects of these innovations on various communities, it is imperative that the values they embody are aligned with those societies. Like other transformative technologies, artificial intelligence systems can be designed by a single organisation but be diffused globally, demonstrating impacts over time. This paper argues that in order to design for this (...) broad stakeholder group, engineers must adopt a systems thinking approach that allows them to understand the sociotechnicity of artificial intelligence systems across sociocultural domains. It claims that value sensitive design, and envisioning cards in particular, provides a solid first step towards helping designers harmonise human values, understood across spatiotemporal boundaries, with economic values, rather than the former coming at the opportunity cost of the latter. (shrink)

Healthcare is becoming increasingly automated with the development and deployment of care robots. There are many benefits to care robots but they also pose many challenging ethical issues. This paper takes care robots for the elderly as the subject of analysis, building on previous literature in the domain of the ethics and design of care robots. Using the value sensitive design approach to technology design, this paper extends its application to care robots by integrating the values of care, values that (...) are specific to AI, and higher-scale values such as the United Nations Sustainable Development Goals. The ethical issues specific to care robots for the elderly are discussed at length alongside examples of specific design requirements that work to ameliorate these ethical concerns. (shrink)

A new book by Batya Friedman and David G. Hendry, Value Sensitive Design: Shaping Technology with Moral Imagination, is reviewed. Value Sensitive Design is a project into the ethical and design issues that emerge during the engineering programs of new technologies. This book is intended to build on the over two decades of value sensitive design research, however with a greater emphasis on the developments of the theoretical underpinnings of the approach as well as initial steps that designers can employ (...) to put the method into practice. (shrink)

Safe-by-Design (SBD) frameworks for the development of emerging technologies have become an ever more popular means by which scholars argue that transformative emerging technologies can safely incorporate human values. One such popular SBD methodology is called Value Sensitive Design (VSD). A central tenet of this design methodology is to investigate stakeholder values and design those values into technologies during early stage research and development (R&D). To accomplish this, the VSD framework mandates that designers consult the philosophical and ethical literature to (...) best determine how to weigh moral trade-offs. However, the VSD framework also concedes the universalism of moral values, particularly the values of freedom, autonomy, equality trust and privacy justice. This paper argues that the VSD methodology, particularly applied to nano-bio-info-cogno (NBIC) technologies, has an insufficient grounding for the determination of moral values. As such, an exploration of the value-investigations of VSD are deconstructed to illustrate both its strengths and weaknesses. This paper also provides possible modalities for the strengthening of the VSD methodology, particularly through the application of moral imagination and how moral imagination exceed the boundaries of moral intuitions in the development of novel technologies. (shrink)

Value Sensitive Design (VSD) is a design methodology developed by Batya Friedman and Peter Kahn (2003) that brings in moral deliberations in an early stage of a design process. It assumes that neither technology itself is value neutral, nor shifts the value-ladennes to the sole usage of technology. This paper adds to emerging literature onVSD for autonomous weapons systems development and discusses extant literature on values in autonomous systems development in general and in autonomous weapons development in particular. I identify (...) opportunities, such as public debates, and threats, such as the classified nature of the design process, for VSD in autonomous weapons development. This paper contributes to academic debates about the non-neutrality of technology by pointing out that values have been and can be explicitly designed into autonomous systems. It is informative for policy makers and designers who are tasked with developing actual autonomous weapons or policies around such systems, as they learn about an established design methodology that is sensitive to societal concerns and industry needs and that can be applied to autonomous weapons systems. (shrink)

This article reviews the academic literature that emerged under value sensitive design. It investigates those VSD projects that employed the tripartite methodology, examining the use of VSD methodological elements, and illustrating common practices and identifying shortcomings. The article provides advice for VSD researchers on how to complete and enhance their methodological approach as the research community moves forward.

Implicit in the value sensitive design (VSD) approach is a concern for understanding, and where possible, disrupting problematic power relationships. Yet an awareness of the issues and ethics of power relations is a pre-requisite for such a concern to bear fruit. This article provides some insight into the issues, and through a case study of technology design to support care arrangements for age-related cognitive decline, illustrates how finding a satisfactory resolution can be particularly troublesome.

While the ethics of technology is analyzed across disciplines from science and technology studies, engineering, computer science, critical management studies, and law, less attention is paid to the role that firms and managers play in the design, development, and dissemination of technology across communities and within their firm. Although firms play an important role in the development of technology, and make associated value judgments around its use, it remains open how we should understand the contours of what firms owe society (...) as the rate of technological development accelerates. We focus here on digital technologies: devices that rely on rapidly accelerating digital sensing, storage, and transmission capabilities to intervene in human processes. This symposium focuses on how firms should engage ethical choices in developing and deploying these technologies. In this introduction, we, first, identify themes the symposium articles share and discuss how the set of articles illuminate diverse facets of the intersection of technology and business ethics. Second, we use these themes to explore what business ethics offers to the study of technology and, third, what technology studies offers to the field of business ethics. Each field brings expertise that, together, improves our understanding of the ethical implications of technology. Finally we introduce each of the five papers, suggest future research directions, and interpret their implications for business ethics. (shrink)

Design for Values (DfV) philosophies are a series of design approaches that aim to incorporate human values into the early phases of technological design to direct innovation into beneficial outcomes. The difficulty and necessity of directing advantageous futures for transformative technologies through the application and adoption of value-based design approaches are apparent. However, questions of whose values to design are of critical importance. DfV philosophies typically aim to enrol the stakeholders who may be affected by the emergence of such a (...) technology. However, regardless of which design approach is adopted, all enrolled stakeholders are human ones who propose human values. Contemporary scholarship on metahumanisms, particularly those on posthumanism, have decentred the human from its traditionally privileged position among other forms of life. Arguments that the humanist position is not (and has never been) tenable are persuasive. As such, scholarship has begun to provide a more encompassing ontology for the investigation of nonhuman values. Given the potentially transformative nature of future technologies as relates to the earth and its many assemblages, it is clear that the value investigations of these design approaches fail to account for all relevant stakeholders (i.e., nonhuman animals). This paper has two primary objectives: (1) to argue for the cogency of a posthuman ethics in the design of technologies; and (2) to describe how existing DfV approaches can begin to envision principled and methodological ways of incorporating non-human values into design. To do this, the paper provides a rudimentary outline of what constitutes DfV approaches. It then takes up a unique design approach called Value Sensitive Design (VSD) as an illustrative example. Out of all the other DfV frameworks, VSD most clearly illustrates a principled approach to the integration of values in design. (shrink)

This article introduces Designing for Care (D4C), a distinctive approach to project management and technological design informed by Care Ethics. We propose to conceptualize “care” as both the foundational value of D4C and as its guiding mid-level principle. As a value, care provides moral grounding. As a principle, it equips D4C with moral guidance to enact a caring process. The latter is made of a set of concrete, and often recursive, caring practices. One of the key assumption of D4C is (...) a relational ontology of individual and group identities, which fosters the actualization of caring practices as essentially relational and (often) reciprocal. Moreover, D4C adopts the “ecological turn” in CE and stresses the ecological situatedness and impact of concrete projects, envisioning an extension of caring from intra-species to inter-species relations. We argue that care and caring can influence directly some of the phases and practices within the management of (energy) projects and the design of sociotechnical (energy) artefacts and systems. When issues related to “value change” emerge as problematic (e.g., values trade-offs, conflicts), the mid-level guiding principle of care helps evaluate and prioritize different values at stake within specific projects. Although there may be several actors and stakeholders involved in project management and technological design, here we will focus on the professionals in charge of imagining, designing, and carrying out these processes (i.e., project managers, designers, engineers). We suggest that adopting D4C would improve their ability to capture and assess stakeholders’ values, critically reflect on and evaluate their own values, and judge which values prioritize. Although D4C may be adaptable to different fields and design contexts, we recommend its use especially within small and medium-scale (energy) projects. To show the benefits of adopting it, we envisage the application of D4C within the project management and the technological design of a community battery. The adoption of D4C can have multiple positive effects: transforming the mentality and practice of managing a project and designing technologies; enhancing caring relationships between managers, designers, and users as well as among users; achieving better communication, more inclusive participation, and more just decision-making. This is an initial attempt to articulate the structure and the procedural character of D4C. The application of D4C in a concrete project is needed to assess its actual impact, benefits, and limitations. (shrink)

In this article, we first offer a model of design knowledge types and their interrelationships in value sensitive design. Then we demonstrate that value sensitive design is a formative framework, which provides a shaping influence on practice, enables creative appropriation, and supports theory and method development.

Developing and implementing artificial intelligence (AI) systems in an ethical manner faces several challenges specific to the kind of technology at hand, including ensuring that decision-making systems making use of machine learning are just, fair, and intelligible, and are aligned with our human values. Given that values vary across cultures, an additional ethical challenge is to ensure that these AI systems are not developed according to some unquestioned but questionable assumption of universal norms but are in fact compatible with the (...) societies in which they operate. This is particularly pertinent for AI research and implementation across Africa, a ground where AI systems are and will be used but also a place with a history of imposition of outside values. In this paper, we thus critically examine one proposal for ensuring that decision-making systems are just, fair, and intelligible—that we adopt a principle of explicability to generate specific recommendations—to assess whether the principle should be adopted in an African research context. We argue that a principle of explicability not only can contribute to responsible and thoughtful development of AI that is sensitive to African interests and values, but can also advance tackling some of the computational challenges in machine learning research. In this way, the motivation for ensuring that a machine learning-based system is just, fair, and intelligible is not only to meet ethical requirements, but also to make effective progress in the field itself. (shrink)

Social media use is pervasive and demographically diverse; thus, researchers can investigate the social media behavior of a target population to extract its values as expressed in a web-based network. This article posits that social media is a relatively untapped resource for researchers engaged in value sensitive design. It proposes methods and ethical considerations for researchers during value sensitive design conceptual, technical, and empirical investigations.

Profit-oriented service sectors such as tourism, hospitality, and entertainment are increasingly looking at how professional service robots can be integrated into the workplace to perform socio-cognitive tasks that were previously reserved for humans. This is a work in which social and labor sciences recognize the principle role of emotions. However, the models and narratives of emotions that drive research, design, and deployment of service robots in human–robot interaction differ considerably from how emotions are framed in the sociology of labor and (...) feminist studies of service work. In this paper, we explore these tensions through the concepts of affective and emotional labor, and outline key insights these concepts offer for the design and evaluation of professional service robots. Taken together, an emphasis on interactionist approaches to emotions and on the demands of affective labor, leads us to argue that service employees are under-represented in existing studies in human–robot interaction. To address this, we outline how participatory design and value-sensitive design approaches can be applied as complimentary methodological frameworks that include service employees as vital stakeholders. (shrink)

This article advocates for a hermeneutic model for children-AI interactions in which the desirable purpose of children’s interaction with artificial intelligence systems is children's growth. The article perceives AI systems with machine-learning components as having a recursive element when interacting with children. They can learn from an encounter with children and incorporate data from interaction, not only from prior programming. Given the purpose of growth and this recursive element of AI, the article argues for distinguishing the interpretation of bias within (...) the artificial intelligence ethics and responsible AI discourse. Interpreting bias as a preference and distinguishing between positive and negative bias is needed as this would serve children's healthy psychological and moral development. The human-centric AI discourse advocates for an alignment of capacities of humans and capabilities of machines by a focus both on the purpose of humans and on the purpose of machines for humans. The emphasis on mitigating negative biases through data protection, AI law, and certain value-sensitive design frameworks demonstrates that the purpose of the machine for humans is prioritized over the purpose of humans. These top–down frameworks often narrow down the purpose of machines to do-no-harm and they miss accounting for the bottom-up views and developmental needs of children. Therefore, applying a growth model for children-AI interactions that incorporates learning from negative AI-mediated biases and amplifying positive ones would positively benefit children’s development and children-centric AI innovation. Consequently, the article explores: What challenges arise from mitigating negative biases and amplifying positive biases in children-AI interactions and how can a growth model address these? To answer this, the article recommends applying a growth model in open AI co-creational spaces with and for children. In such spaces human–machine and human–human value alignment methods can be collectively applied in such a manner that children can become sensitized toward the effects of AI-mediated negative biases on themselves and others; enable children to appropriate and imbue top-down values of diversity, and non-discrimination with their meanings; enforce children’s right to identity and non-discrimination; guide children in developing an inclusive mindset; inform top-down normative AI frameworks by children’s bottom-up views; contribute to design criteria for children-centric AI. Applying such methods under a growth model in AI co-creational spaces with children could yield an inclusive co-evolution between responsible young humans in the loop and children-centric AI systems. (shrink)

Quality of life is an important outcome measure in mental health care. Currently, QoL is mainly measured with paper and pencil questionnaires. To contribute to the evaluation of treatment, and to enhance substantiated policy decisions in the allocation of resources, a web-based, personalized, patient-friendly and easy to administer QoL instrument has been developed: the QoL-ME. While human values play a significant role in shaping future use practices of technologies, it is important to anticipate on them during the design of the (...) QoL-instrument. The value sensitive design approach offers a theory and method for addressing these values in a systematic and principled manner in the design of technologies. While the VSD approach has been applied in the field of somatic care, we extended the VSD approach to the field of mental healthcare with the aim to enable developers of the QoL-instrument to reflect on important human values and anticipate potential value conflicts in its design. We therefore explored how VSD can be used by investigating the human values that are relevant for the design of the QoL-ME. Our exploration reveals that the values autonomy, efficiency, empowerment, universal usability, privacy, redifinition of roles, of responsibilites, reliability, solidarity, surveillance and trust are at stake for the future users of the technology. However, we argue that theoretical reflections on the potential ethical impact of a technology in the design phase can only go so far. To be able to comprehensively evaluate the usability the VSD approach, a supplementary study of the use practices of the technology is needed. (shrink)

A core activity promoted by the value sensitive design approach is the iterative and integrative performance of conceptual, empirical and technical investigations. In this essay, I will contribute and reflect on a method for conceptual mapping through which such tripartite investigations can be supported in ways that are open to stakeholder participation.

Biobased production has been promoted as a sustainable alternative to fossil resources. However, controversies over its impact on sustainability highlight societal concerns, value tensions and uncertainties that have not been taken into account during its development. In this work, the consideration of stakeholders’ values in a biorefinery design project is investigated. Value sensitive design is a promising approach to the design of technologies with consideration of stakeholders’ values, however, it is not directly applicable for complex systems like biorefineries. Therefore, some (...) elements of VSD, such as the identification of relevant values and their connection to a technology’s features, are brought into biorefinery design practice. Midstream modulation, an approach to promoting the consideration of societal aspects during research and development activities, is applied to promote reflection and value considerations during the design decision making. As result, it is shown that MM interventions during the design process led to new design alternatives in support of stakeholders' values, and allowed to recognize and respond to emerging value tensions within the scope of the project. In this way, the present work shows a novel approach for the technical investigation of VSD, especially for biorefineries. Also, based on this work it is argued that not only reflection, but also flexibility and openness are important for the application of VSD in the context of biorefinery design. (shrink)

Despite the many turns that philosophy of technology has undergone in recent decades, the question of the nature and limits of technological determinism (TD) has been neglected, because it was considered as solved and overcome, and therefore not worth further discussion. This paper once again raises the problem of TD, by trying to save the opposing, but complementary elements of truth of the two main forms of TD that I shall call “nomological” and “normative”: (a) technology is all-pervasive and has (...) an inexorable capacity for extending itself into every field of human life, and (b) we have a capacity to counteract and orient technology, at least in some measure. In order to reconcile these seemingly inconsistent claims, the key move for my argument is a brief analysis of the notion of scientific experiment from the perspective of the distinction between the context of discovery and the context of justification. As a result, two senses of technology are distinguished, which I shall call respectively “reflective” and “methodological.” From the point of view of this distinction, the all-pervasiveness and inexorability of technology and the in principle irreducibility of human persons to technology—which nomological and normative TD assert dialectically one against the other—can be reconciled. Among other things, this requires the rejection (in one fundamental sense) of the widely held assumption, made both by nomological and normative TD, that technology is a cultural field whose contents can be neatly separated from the rest of human culture. This thesis should be replaced by the more qualified claim of the reflective unity and the methodological multiplicity of technology. (shrink)

Ethical, legal and social implications are widely regarded as important considerations with respect to technological developments. Agile Worth-Oriented Systems Engineering is an innovative approach to incorporating ethically relevant criteria during agile development processes through a flexibly applicable methodology. First, a predefined model for the ethical evaluation of socio-technical systems is used to assess ethical issues according to different dimensions. The second part of AWOSE ensures that ethical issues are not only identified, but also systematically considered during the design of systems (...) based on information and communication technology. For this purpose, the findings from the first step are integrated with approaches from worth-centered development into a process model that, unlike previous approaches to ethical system development, is thoroughly compatible with agile methodologies like Scrum or Extreme Programming. Artifacts of worth-centered development called Worth Maps have been improved to guide the prioritization of development tasks as well as choices among design alternatives with respect to ethical implications. Furthermore, the improved Worth Maps facilitate the identification of suitable criteria for system evaluations in association to ethical concerns and desired positive outcomes of system usage. The potential of the AWOSE methodology has been demonstrated in the context of a technical system that supports elderly and people with particular handicaps. (shrink)