Traditional medical practices and relationships are changing given the widespread adoption of AI-driven technologies across the various domains of health and healthcare. In many cases, these new technologies are not specific to the field of healthcare. Still, they are existent, ubiquitous, and commercially available systems upskilled to integrate these novel care practices. Given the widespread adoption, coupled with the dramatic changes in practices, new ethical and social issues emerge due to how these systems nudge users into making decisions and changing (...) behaviours. This article discusses how these AI-driven systems pose particular ethical challenges with regards to nudging. To confront these issues, the value sensitive design approach is adopted as a principled methodology that designers can adopt to design these systems to avoid harming and contribute to the social good. The AI for Social Good factors are adopted as the norms constraining maleficence. In contrast, higher-order values specific to AI, such as those from the EU High-Level Expert Group on AI and the United Nations Sustainable Development Goals, are adopted as the values to be promoted as much as possible in design. The use case of Amazon Alexa's Healthcare Skills is used to illustrate this design approach. It provides an exemplar of how designers and engineers can begin to orientate their design programs of these technologies towards the social good. (shrink)

Value Sensitive Design (VSD) is a design methodology developed by Batya Friedman and Peter Kahn (2003) that brings in moral deliberations in an early stage of a design process. It assumes that neither technology itself is value neutral, nor shifts the value-ladennes to the sole usage of technology. This paper adds to emerging literature onVSD for autonomous weapons systems development and discusses extant literature on values in autonomous systems development in general and in autonomous weapons development in particular. I identify (...) opportunities, such as public debates, and threats, such as the classified nature of the design process, for VSD in autonomous weapons development. This paper contributes to academic debates about the non-neutrality of technology by pointing out that values have been and can be explicitly designed into autonomous systems. It is informative for policy makers and designers who are tasked with developing actual autonomous weapons or policies around such systems, as they learn about an established design methodology that is sensitive to societal concerns and industry needs and that can be applied to autonomous weapons systems. (shrink)

Critics currently argue that applied ethics approaches to artificial intelligence (AI) are too principles-oriented and entail a theory–practice gap. Several applied ethical approaches try to prevent such a gap by conceptually translating ethical theory into practice. In this article, we explore how the currently most prominent approaches of AI ethics translate ethics into practice. Therefore, we examine three approaches to applied AI ethics: the embedded ethics approach, the ethically aligned approach, and the Value Sensitive Design (VSD) approach. We analyze each (...) of these three approaches by asking how they understand and conceptualize theory and practice. We outline the conceptual strengths as well as their shortcomings: an embedded ethics approach is context-oriented but risks being biased by it; ethically aligned approaches are principles-oriented but lack justification theories to deal with trade-offs between competing principles; and the interdisciplinary Value Sensitive Design approach is based on stakeholder values but needs linkage to political, legal, or social governance aspects. Against this background, we develop a meta-framework for applied AI ethics conceptions with three dimensions. Based on critical theory, we suggest these dimensions as starting points to critically reflect on the conceptualization of theory and practice. We claim, first, that the inclusion of the dimension of affects and emotions in the ethical decision-making process stimulates reflections on vulnerabilities, experiences of disregard, and marginalization already within the AI development process. Second, we derive from our analysis that considering the dimension of justifying normative background theories provides both standards and criteria as well as guidance for prioritizing or evaluating competing principles in cases of conflict. Third, we argue that reflecting the governance dimension in ethical decision-making is an important factor to reveal power structures as well as to realize ethical AI and its application because this dimension seeks to combine social, legal, technical, and political concerns. This meta-framework can thus serve as a reflective tool for understanding, mapping, and assessing the theory–practice conceptualizations within AI ethics approaches to address and overcome their blind spots. (shrink)

Embedding ethics modules within computer science courses has become a popular response to the growing recognition that CS programs need to better equip their students to navigate the ethical dimensions of computing technologies like AI, machine learning, and big data analytics. However, the popularity of this approach has outpaced the evidence of its positive outcomes. To help close that gap, this empirical study reports positive results from Northeastern’s program that embeds values analysis modules into CS courses. The resulting data suggest (...) that such modules have a positive effect on students’ moral attitudes and that students leave the modules believing they are more prepared to navigate the ethical dimensions they’ll likely face in their eventual careers. Importantly, these gains were accomplished at an institution without a philosophy doctoral program, suggesting this strategy can be effectively employed by a wider range of institutions than many have thought. (shrink)

Value sensitive design aims at creating better technology based on social and ethical values. However, VSD has not been applied to long-term and uncertain future developments, such as societal planning for climate change. This paper describes a new method that combines elements from VSD with scenario planning. The method was developed for and applied to a case study of adaptation to sea level rise in southern Sweden in a series of workshops. The participants of the workshops found that the method (...) provided a framework for discussing long-term planning, enabled identification of essential values, challenged established planning practices, helped find creative solutions, and served as a reminder that we do not know what will happen in the future. Finally, we reflect on the limitations of the method and suggest further research on how it can be improved for value sensitive design of adaptation measures to manage uncertain future sea level rise. (shrink)

Innovations permeate healthcare settings on an ever-increasing scale. Health technology innovations impact our perceptions and experiences of health, care, disease, etc. Because of the fast pace these HTIs are being introduced in different healthcare settings, there is a growing societal consensus that these HTIs need to be governed by ethical reflection. This paper reports a systematic review of argument-based literature which focused on articles reporting on ethical frameworks to screen or evaluate HTIs. To do this a four step methodology was (...) followed: Literature search conducted in five electronic literature databases; Identification of relevant articles; Development of data-extraction tool to analyze the included articles; Analysis, synthesis of data and reporting of results. Fifty-seven articles were included, each reporting on a specific ethical framework. These ethical frameworks existed out of characteristics which were grouped into five common ones: Motivations for development and use of frameworks; Objectives of using frameworks; Specific characteristics of frameworks ; Ethical approaches and concepts used in the frameworks; Methods to use the frameworks. Although this multiplicity of ethical frameworks shows an increasing importance of ethically analyzing HTIs, it remains unclear what the specific role is of these analyses. An ethics of caution, on which ethical frameworks rely, guides HTIs in their design, development, implementation, without questioning their technological paradigm. An ethics of desirability questions this paradigm, without guiding HTIs. In the end, a place needs to be found in-between, to critically assess HTIs. (shrink)

A new book by Batya Friedman and David G. Hendry, Value Sensitive Design: Shaping Technology with Moral Imagination, is reviewed. Value Sensitive Design is a project into the ethical and design issues that emerge during the engineering programs of new technologies. This book is intended to build on the over two decades of value sensitive design research, however with a greater emphasis on the developments of the theoretical underpinnings of the approach as well as initial steps that designers can employ (...) to put the method into practice. (shrink)

In their article, Char et al. have created a model intended to tidy up the messy landscape of ethical concerns arising from machine-learning health care applications. The novel con...

Synthetic biologists design and engineer organisms for a better and more sustainable future. While the manifold prospects are encouraging, concerns about the uncertain risks of genome editing affect public opinion as well as local regulations. As a consequence, biosafety and associated concepts, such as the Safe-by-design framework and genetic safeguard technologies, have gained notoriety and occupy a central position in the conversation about genetically modified organisms. Yet, as regulatory interest and academic research in genetic safeguard technologies advance, the implementation in (...) industrial biotechnology, a sector that is already employing engineered microorganisms, lags behind. The main goal of this work is to explore the utilization of genetic safeguard technologies for designing biosafety in industrial biotechnology. Based on our results, we posit that biosafety is a case of a changing value, by means of further specification of how to realize biosafety. Our investigation is inspired by the Value Sensitive Design framework, to investigate scientific and technological choices in their appropriate social context. Our findings discuss stakeholder norms for biosafety, reasonings about genetic safeguards, and how these impact the practice of designing for biosafety. We show that tensions between stakeholders occur at the level of norms, and that prior stakeholder alignment is crucial for value specification to happen in practice. Finally, we elaborate in different reasonings about genetic safeguards for biosafety and conclude that, in absence of a common multi-stakeholder effort, the differences in informal biosafety norms and the disparity in biosafety thinking could end up leading to design requirements for compliance instead of for safety. (shrink)

Quality of life is an important outcome measure in mental health care. Currently, QoL is mainly measured with paper and pencil questionnaires. To contribute to the evaluation of treatment, and to enhance substantiated policy decisions in the allocation of resources, a web-based, personalized, patient-friendly and easy to administer QoL instrument has been developed: the QoL-ME. While human values play a significant role in shaping future use practices of technologies, it is important to anticipate on them during the design of the (...) QoL-instrument. The value sensitive design approach offers a theory and method for addressing these values in a systematic and principled manner in the design of technologies. While the VSD approach has been applied in the field of somatic care, we extended the VSD approach to the field of mental healthcare with the aim to enable developers of the QoL-instrument to reflect on important human values and anticipate potential value conflicts in its design. We therefore explored how VSD can be used by investigating the human values that are relevant for the design of the QoL-ME. Our exploration reveals that the values autonomy, efficiency, empowerment, universal usability, privacy, redifinition of roles, of responsibilites, reliability, solidarity, surveillance and trust are at stake for the future users of the technology. However, we argue that theoretical reflections on the potential ethical impact of a technology in the design phase can only go so far. To be able to comprehensively evaluate the usability the VSD approach, a supplementary study of the use practices of the technology is needed. (shrink)

Recent developments in theories for responsible innovation have focused on the importance of actively accounting for values in our technological designs. Leading among these theories is that of Value Sensitive Design which attempts to guide the design process on the basis of evaluative analysis. However, values often come into conflict and VSD has been criticized for not providing a proper method to resolve such inevitable conflicts. This paper examines three such methods and argues that although each has its merits, they (...) all fail to account for a common source of value conflicts known as value incommensurability. Drawing on literature from the field of axiology, this paper argues that by incorporating the evaluative relation of ‘parity’ each of these three methods, and the VSD framework in general, will be able to properly understand the relation which holds between conflicting design options stemming from the incommensurable of values and be able to guide designers in making rational decision in the face of such conflicts. (shrink)

The public’s trust in the technology sector is waning and, in response, technology companies and state governments have started to champion “tech ethics”. That is, they have pledged to design, develop, distribute, and employ new technologies in an ethical manner. In this paper, I observe that tech ethics is already subject to a widespread pathology in that technology companies, the primary executors of tech ethics, are incentivized to pursue it half-heartedly or even disingenuously. Next, I highlight two emerging strategies which (...) might be used to combat this problem, but argue that both are subject to practical limitations. In response, I suggest an additional way of augmenting the practice of tech ethics. This is to employ “trust audits,” a new form of public participation in the socio-technical environment. In the remainder of the paper, I offer a description of how trust audits work, what they might look like in practice, and how they can fit in alongside those other strategies for improving tech ethics. (shrink)

This article presents a systematic literature review documenting how technical investigations have been adapted in value sensitive design (VSD) studies from 1996 to 2023. We present a systematic review, including theoretical and applied studies that either discuss or conduct technical investigations in VSD. This systematic review contributes to the VSD community when seeking to further refine the methodological framework for carrying out technical investigations in VSD.

This article introduces Designing for Care (D4C), a distinctive approach to project management and technological design informed by Care Ethics. We propose to conceptualize “care” as both the foundational value of D4C and as its guiding mid-level principle. As a value, care provides moral grounding. As a principle, it equips D4C with moral guidance to enact a caring process. The latter is made of a set of concrete, and often recursive, caring practices. One of the key assumption of D4C is (...) a relational ontology of individual and group identities, which fosters the actualization of caring practices as essentially relational and (often) reciprocal. Moreover, D4C adopts the “ecological turn” in CE and stresses the ecological situatedness and impact of concrete projects, envisioning an extension of caring from intra-species to inter-species relations. We argue that care and caring can influence directly some of the phases and practices within the management of (energy) projects and the design of sociotechnical (energy) artefacts and systems. When issues related to “value change” emerge as problematic (e.g., values trade-offs, conflicts), the mid-level guiding principle of care helps evaluate and prioritize different values at stake within specific projects. Although there may be several actors and stakeholders involved in project management and technological design, here we will focus on the professionals in charge of imagining, designing, and carrying out these processes (i.e., project managers, designers, engineers). We suggest that adopting D4C would improve their ability to capture and assess stakeholders’ values, critically reflect on and evaluate their own values, and judge which values prioritize. Although D4C may be adaptable to different fields and design contexts, we recommend its use especially within small and medium-scale (energy) projects. To show the benefits of adopting it, we envisage the application of D4C within the project management and the technological design of a community battery. The adoption of D4C can have multiple positive effects: transforming the mentality and practice of managing a project and designing technologies; enhancing caring relationships between managers, designers, and users as well as among users; achieving better communication, more inclusive participation, and more just decision-making. This is an initial attempt to articulate the structure and the procedural character of D4C. The application of D4C in a concrete project is needed to assess its actual impact, benefits, and limitations. (shrink)

The field of artificial intelligence (AI) ethics has exploded in recent years, with countless academics, organizations, and influencers rushing to consider how AI technology can be developed and im...

The ethics of technology has primarily focused on what values are and how they can be embedded in technologies through design. In this context, some work has been done to show the efficacy of a number of design approaches. However, existing studies have not clearly pointed out the ways in which design-for-values approaches can be used by design team managers to properly organize and use technologies in practice. This chapter attempts to fill this gap by discussing the value sensitive design (...) (VSD) approach as a useful means of co-designing technologies as a toolkit for existing workflow management, in this case, Agile. It will be demonstrated that VSD shows promise as a way of democratically designing technologies as well as fostering democratic technology policy innovation. (shrink)

The last decade has witnessed the mass distribution and adoption of smart home systems and devices powered by artificial intelligence systems ranging from household appliances like fridges and toasters to more background systems such as air and water quality controllers. The pervasiveness of these sociotechnical systems makes analyzing their ethical implications necessary during the design phases of these devices to ensure not only sociotechnical resilience, but to design them for human values in mind and thus preserve meaningful human control over (...) them. This paper engages in a conceptual investigations of how meaningful human control over smart home devices can be attained through design. The value sensitive design (VSD) approach is proposed as a way of attaining this level of control. In the proposed framework, values are identified and defined, stakeholder groups are investigated and brought into the design process and the technical constraints of the technologies in question are considered. The paper concludes with some initial examples that illustrate a more adoptable way forward for both ethicists and engineers of smart home devices. (shrink)

Although artificial intelligence has been given an unprecedented amount of attention in both the public and academic domains in the last few years, its convergence with other transformative technologies like cloud computing, robotics, and augmented/virtual reality is predicted to exacerbate its impacts on society. The adoption and integration of these technologies within industry and manufacturing spaces is a fundamental part of what is called Industry 4.0, or the Fourth Industrial Revolution. The impacts of this paradigm shift on the human operators (...) who continue to work alongside and symbiotically with these technologies in the industry bring with it novel ethical issues. Therefore, how to design these technologies for human values becomes the critical area of intervention. This paper takes up the case study of robotic AI-based assistance systems to explore the potential value implications that emerge due to current design practices and use. The design methodology known as Value Sensitive Design (VSD) is proposed as a sufficient starting point for designing these technologies for human values to address these issues. (shrink)

The international debate on the ethics and legality of autonomous weapon systems (AWS) as well as the call for a ban are primarily focused on the nebulous concept of fully autonomous AWS. More specifically, on AWS that are capable of target selection and engagement without human supervision or control. This thesis argues that such a conception of autonomy is divorced both from military planning and decision-making operations as well as the design requirements that govern AWS engineering and subsequently the tracking (...) and tracing of moral responsibility. To do this, this thesis marries two different levels of meaningful human control (MHC), termed levels of abstraction, to couple military operations with design ethics. In doing so, this thesis argues that the contentious notion of ‘full’ autonomy is not problematic under this two-tiered understanding of MHC. It proceeds to propose the value sensitive design (VSD) approach as a means for designing for MHC. (shrink)

Manufacturing and industry practices are undergoing an unprecedented revolution as a consequence of the convergence of emerging technologies such as artificial intelligence, robotics, cloud computing, virtual and augmented reality, among others. This fourth industrial revolution is similarly changing the practices and capabilities of operators in their industrial environments. This paper introduces and explores the notion of the Operator 4.0 as well as how this novel way of conceptualizing the human operator necessarily implicates human values in the technologies that constitute it. (...) The design approach known as value sensitive design (VSD) is used to explore how these Operator 4.0 technologies can be designed for human values. Expert elicitation surveys were used to determine the values of industry stakeholders and examples of how the VSD methodology can be adopted by engineers in order to design for these values is illustrated. The results provide preliminary adoption strategies that industrial teams can take to Operator 4.0 technology for human values. (shrink)