The international debate on the ethics and legality of autonomous weapon systems (AWS) as well as the call for a ban are primarily focused on the nebulous concept of fully autonomous AWS. More specifically, on AWS that are capable of target selection and engagement without human supervision or control. This thesis argues that such a conception of autonomy is divorced both from military planning and decision-making operations as well as the design requirements that govern AWS engineering and subsequently the tracking (...) and tracing of moral responsibility. To do this, this thesis marries two different levels of meaningful human control (MHC), termed levels of abstraction, to couple military operations with design ethics. In doing so, this thesis argues that the contentious notion of ‘full’ autonomy is not problematic under this two-tiered understanding of MHC. It proceeds to propose the value sensitive design (VSD) approach as a means for designing for MHC. (shrink)

In this panel, we explore the future of value sensitive design (VSD). The stakes are high. Many in public and private sectors and in civil society are gradually realizing that taking our values seriously implies that we have to ensure that values effectively inform the design of technology which, in turn, shapes people’s lives. Value sensitive design offers a highly developed set of theory, tools, and methods to systematically do so.

The last decade has witnessed the mass distribution and adoption of smart home systems and devices powered by artificial intelligence systems ranging from household appliances like fridges and toasters to more background systems such as air and water quality controllers. The pervasiveness of these sociotechnical systems makes analyzing their ethical implications necessary during the design phases of these devices to ensure not only sociotechnical resilience, but to design them for human values in mind and thus preserve meaningful human control over (...) them. This paper engages in a conceptual investigations of how meaningful human control over smart home devices can be attained through design. The value sensitive design (VSD) approach is proposed as a way of attaining this level of control. In the proposed framework, values are identified and defined, stakeholder groups are investigated and brought into the design process and the technical constraints of the technologies in question are considered. The paper concludes with some initial examples that illustrate a more adoptable way forward for both ethicists and engineers of smart home devices. (shrink)

Value Sensitive Design (VSD) is an established method for integrating values into technical design. It has been applied to different technologies and, more recently, to artificial intelligence (AI). We argue that AI poses a number of challenges specific to VSD that require a somewhat modified VSD approach. Machine learning (ML), in particular, poses two challenges. First, humans may not understand how an AI system learns certain things. This requires paying attention to values such as transparency, explicability, and accountability. Second, ML (...) may lead to AI systems adapting in ways that ‘disembody’ the values embedded in them. To address this, we propose a threefold modified VSD approach: 1) integrating a known set of VSD principles (AI4SG) as design norms from which more specific design requirements can be derived; 2) distinguishing between values that are promoted and respected by the design to ensure outcomes that not only do no harm but also contribute to good; and 3) extending the VSD process to encompass the whole life cycle of an AI technology in order to monitor unintended value consequences and redesign as needed. We illustrate our VSD for AI approach with an example use case of a SARS-CoV-2 contact tracing app. (shrink)

Design for Values (DfV) philosophies are a series of design approaches that aim to incorporate human values into the early phases of technological design to direct innovation into beneficial outcomes. The difficulty and necessity of directing advantageous futures for transformative technologies through the application and adoption of value-based design approaches are apparent. However, questions of whose values to design are of critical importance. DfV philosophies typically aim to enrol the stakeholders who may be affected by the emergence of such a (...) technology. However, regardless of which design approach is adopted, all enrolled stakeholders are human ones who propose human values. Contemporary scholarship on metahumanisms, particularly those on posthumanism, have decentred the human from its traditionally privileged position among other forms of life. Arguments that the humanist position is not (and has never been) tenable are persuasive. As such, scholarship has begun to provide a more encompassing ontology for the investigation of nonhuman values. Given the potentially transformative nature of future technologies as relates to the earth and its many assemblages, it is clear that the value investigations of these design approaches fail to account for all relevant stakeholders (i.e., nonhuman animals). This paper has two primary objectives: (1) to argue for the cogency of a posthuman ethics in the design of technologies; and (2) to describe how existing DfV approaches can begin to envision principled and methodological ways of incorporating non-human values into design. To do this, the paper provides a rudimentary outline of what constitutes DfV approaches. It then takes up a unique design approach called Value Sensitive Design (VSD) as an illustrative example. Out of all the other DfV frameworks, VSD most clearly illustrates a principled approach to the integration of values in design. (shrink)

One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents (IAs). This paper explores how decision matrix algorithms, via the belief-desire-intention model for (...) autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles. (shrink)

Safe-by-Design (SBD) frameworks for the development of emerging technologies have become an ever more popular means by which scholars argue that transformative emerging technologies can safely incorporate human values. One such popular SBD methodology is called Value Sensitive Design (VSD). A central tenet of this design methodology is to investigate stakeholder values and design those values into technologies during early stage research and development (R&D). To accomplish this, the VSD framework mandates that designers consult the philosophical and ethical literature to (...) best determine how to weigh moral trade-offs. However, the VSD framework also concedes the universalism of moral values, particularly the values of freedom, autonomy, equality trust and privacy justice. This paper argues that the VSD methodology, particularly applied to nano-bio-info-cogno (NBIC) technologies, has an insufficient grounding for the determination of moral values. As such, an exploration of the value-investigations of VSD are deconstructed to illustrate both its strengths and weaknesses. This paper also provides possible modalities for the strengthening of the VSD methodology, particularly through the application of moral imagination and how moral imagination exceed the boundaries of moral intuitions in the development of novel technologies. (shrink)

Atomically precise manufacturing (APM) is the assembly of materials with atomic precision. APM does not currently exist, and may not be feasible, but if it is feasible, then the societal impacts could be dramatic. This paper assesses the net societal impacts of APM across the full range of important APM sectors: general material wealth, environmental issues, military affairs, surveillance, artificial intelligence, and space travel. Positive effects were found for material wealth, the environment, military affairs (specifically nuclear disarmament), and space travel. (...) Negative effects were found for military affairs (specifically rogue actor violence and AI. The net effect for surveillance was ambiguous. The effects for the environment, military affairs, and AI appear to be the largest, with the environment perhaps being the largest of these, suggesting that APM would be net beneficial to society. However, these factors are not well quantified and no definitive conclusion can be made. One conclusion that can be reached is that if APM R&D is pursued, it should go hand-in-hand with effective governance strategies to increase the benefits and reduce the harms. (shrink)

This paper argues that although moral intuitions are insufficient for making judgments on new technological innovations, they maintain great utility for informing responsible innovation. To do this, this paper employs the Value Sensitive Design (VSD) methodology as an illustrative example of how stakeholder values can be better distilled to inform responsible innovation. Further, it is argued that moral intuitions are necessary for determining stakeholder values required for the design of responsible technologies. This argument is supported by the claim that the (...) moral intuitions of stakeholders allow designers to conceptualize stakeholder values and incorporate them into the early phases of design. It is concluded that design-for-values (DFV) frameworks like the VSD methodology can remain potent if developers adopt heuristic tools to diminish the influence of cognitive biases thus strengthening the reliability of moral intuitions. (shrink)

This chapter proposed a novel design methodology called Value-Sensitive Design and its potential application to the field of artificial intelligence research and design. It discusses the imperatives in adopting a design philosophy that embeds values into the design of artificial agents at the early stages of AI development. Because of the high risk stakes in the unmitigated design of artificial agents, this chapter proposes that even though VSD may turn out to be a less-than-optimal design methodology, it currently provides a (...) framework that has the potential to embed stakeholder values and incorporate current design methods. The reader should begin to take away the importance of a proactive design approach to intelligent agents. (shrink)

Nanomedicine is yielding new and improved treatments and diagnostics for a range of diseases and disorders. Nanomedicine applications incorporate materials and components with nanoscale dimensions where novel physiochemical properties emerge as a result of size-dependent phenomena and high surface-to-mass ratio. Nanotherapeutics and in vivo nanodiagnostics are a subset of nanomedicine products that enter the human body. These include drugs, biological products, implantable medical devices, and combination products that are designed to function in the body in ways unachievable at larger scales. (...) Nanotherapeutics andin vivonanodiagnostics incorporate materials that are engineered at the nanoscale to express novel properties that are medicinally useful. These nanomedicine applications can also contain nanomaterials that are biologically active, producing interactions that depend on biological triggers. Examples include nanoscale formulations of insoluble drugs to improve bioavailability and pharmacokinetics, drugs encapsulated in hollow nanoparticles with the ability to target and cross cellular and tissue membranes and to release their payload at a specific time or location, imaging agents that demonstrate novel optical properties to aid in locating micrometastases, and antimicrobial and drug-eluting components or coatings of implantable medical devices such as stents. (shrink)

Various approaches have emerged over the last several decades to meet the challenges and complexities of anticipating and responding to the potential impacts of emerging technologies. Although many of the existing approaches share similarities, they each have shortfalls. This paper takes as the object of its study Anticipatory Ethics for Emerging Technologies (ATE) to technology assessment, given that it was formatted to address many of the privations characterising parallel approaches. The ATE approach, also in practice, presents certain areas for retooling, (...) such as how it characterises levels and objects of analysis. This paper results from the work done with the TechEthos Horizon 2020 project in evaluating the ethical, legal, and social impacts of climate engineering, digital extended reality, and neurotechnologies. To meet the challenges these technology families present, this paper aims to enhance the ATE framework to encompass the variety of human processes and material forms, functions, and applications that comprise the socio-technical systems in which these technologies are embedded. (shrink)

Critics currently argue that applied ethics approaches to artificial intelligence (AI) are too principles-oriented and entail a theory–practice gap. Several applied ethical approaches try to prevent such a gap by conceptually translating ethical theory into practice. In this article, we explore how the currently most prominent approaches of AI ethics translate ethics into practice. Therefore, we examine three approaches to applied AI ethics: the embedded ethics approach, the ethically aligned approach, and the Value Sensitive Design (VSD) approach. We analyze each (...) of these three approaches by asking how they understand and conceptualize theory and practice. We outline the conceptual strengths as well as their shortcomings: an embedded ethics approach is context-oriented but risks being biased by it; ethically aligned approaches are principles-oriented but lack justification theories to deal with trade-offs between competing principles; and the interdisciplinary Value Sensitive Design approach is based on stakeholder values but needs linkage to political, legal, or social governance aspects. Against this background, we develop a meta-framework for applied AI ethics conceptions with three dimensions. Based on critical theory, we suggest these dimensions as starting points to critically reflect on the conceptualization of theory and practice. We claim, first, that the inclusion of the dimension of affects and emotions in the ethical decision-making process stimulates reflections on vulnerabilities, experiences of disregard, and marginalization already within the AI development process. Second, we derive from our analysis that considering the dimension of justifying normative background theories provides both standards and criteria as well as guidance for prioritizing or evaluating competing principles in cases of conflict. Third, we argue that reflecting the governance dimension in ethical decision-making is an important factor to reveal power structures as well as to realize ethical AI and its application because this dimension seeks to combine social, legal, technical, and political concerns. This meta-framework can thus serve as a reflective tool for understanding, mapping, and assessing the theory–practice conceptualizations within AI ethics approaches to address and overcome their blind spots. (shrink)

Innovations permeate healthcare settings on an ever-increasing scale. Health technology innovations impact our perceptions and experiences of health, care, disease, etc. Because of the fast pace these HTIs are being introduced in different healthcare settings, there is a growing societal consensus that these HTIs need to be governed by ethical reflection. This paper reports a systematic review of argument-based literature which focused on articles reporting on ethical frameworks to screen or evaluate HTIs. To do this a four step methodology was (...) followed: Literature search conducted in five electronic literature databases; Identification of relevant articles; Development of data-extraction tool to analyze the included articles; Analysis, synthesis of data and reporting of results. Fifty-seven articles were included, each reporting on a specific ethical framework. These ethical frameworks existed out of characteristics which were grouped into five common ones: Motivations for development and use of frameworks; Objectives of using frameworks; Specific characteristics of frameworks ; Ethical approaches and concepts used in the frameworks; Methods to use the frameworks. Although this multiplicity of ethical frameworks shows an increasing importance of ethically analyzing HTIs, it remains unclear what the specific role is of these analyses. An ethics of caution, on which ethical frameworks rely, guides HTIs in their design, development, implementation, without questioning their technological paradigm. An ethics of desirability questions this paradigm, without guiding HTIs. In the end, a place needs to be found in-between, to critically assess HTIs. (shrink)

Quality of life is an important outcome measure in mental health care. Currently, QoL is mainly measured with paper and pencil questionnaires. To contribute to the evaluation of treatment, and to enhance substantiated policy decisions in the allocation of resources, a web-based, personalized, patient-friendly and easy to administer QoL instrument has been developed: the QoL-ME. While human values play a significant role in shaping future use practices of technologies, it is important to anticipate on them during the design of the (...) QoL-instrument. The value sensitive design approach offers a theory and method for addressing these values in a systematic and principled manner in the design of technologies. While the VSD approach has been applied in the field of somatic care, we extended the VSD approach to the field of mental healthcare with the aim to enable developers of the QoL-instrument to reflect on important human values and anticipate potential value conflicts in its design. We therefore explored how VSD can be used by investigating the human values that are relevant for the design of the QoL-ME. Our exploration reveals that the values autonomy, efficiency, empowerment, universal usability, privacy, redifinition of roles, of responsibilites, reliability, solidarity, surveillance and trust are at stake for the future users of the technology. However, we argue that theoretical reflections on the potential ethical impact of a technology in the design phase can only go so far. To be able to comprehensively evaluate the usability the VSD approach, a supplementary study of the use practices of the technology is needed. (shrink)

PurposeThe purpose of this paper is to develop a critique of value sensitive design (VSD) and to propose an alternative approach that does not depart from a heuristic of value(s), but from virtue ethics, called virtuous practice design (VPD).Design/methodology/approachThis paper develops a philosophical argument, draws from a philosophical method (i.e. virtue ethics) and applies this method to a particular case study that draws from a narrative interview.FindingsIn this paper, authors show how an approach that takes virtue instead of value as (...) the central notion for aiming at a design that is sensitive to ethical concerns can be fruitful both in theory and in practice.Originality/valueThis paper presents the first attempt to ground an approach aimed at ethical technology design on the tradition of virtue ethics. As such, it presents VPD as a potentially fruitful alternative to VSD. (shrink)

Earth’s life-support system is facing megaproblems of sustainability. One important way of how these problems can be addressed is through innovation. This paper argues that responsible innovation that contributes to sustainable development consists of three dimensions: innovations avoid harming people and the planet, innovations ‘do good’ by offering new products, services, or technologies that foster SD, and global governance schemes are in place that facilitate innovations that avoid harm and ‘do good.’ The paper discusses global governance schemes based on deliberation (...) as a means to foster such responsible innovation. These schemes can provide voluntary soft-law regulations that complement and extend national and international hard-law regulations and facilitate collective innovation that contributes to SD goals. The article addresses the facilitative role of governments and international organizations in overcoming problems of deliberation and offers illustrative examples of such governance schemes. (shrink)

It is increasingly recognized that human values play an essential role in engineering design. Recent literature in the ethics of technology has focused on spelling out the role of values in different fields of engineering. Value Sensitive Design, as a well-established approach, aims to systematically integrate human values into technologies and engineering products. Although there is significant attention to stakeholders in VSD, how contexts may affect what stakeholders perceive as values deserves more attention. It seems that there is an implicit (...) tendency to universality in the studies of VSD and it is often assumed implicitly that values have the same meaning in different contexts and in different cultures. Therefore, while the concept of cultural relativism and its difference to universalism has been taken into account, we propose paying explicit attention to the contextual sense of values, namely the interpretation, prioritization and perception of values that have their basis in the specific contexts in which they are implemented, for instance, in a specific cultural or religious setting. Building on the proposed categorization of contextual sense of values in which their evolution has shown, we aim to shed light on what these contextual senses entail and how an explicit focus on contextuality could improve VSD. It will be argued that contextually looking at VSD may make it more flexible in dealing with the different contexts/cultures. (shrink)

This paper presents results of a systematic literature review of RRI practices which aimed to gather insights to further both the theoretical and practical development of RRI. Analysing practices of RRI and mapping out main approaches as well as the values, dimensions or characteristics pursued with those practices, can add to understanding of the more conceptual discussions of RRI and enhance the academic debate. The results, based on a corpus of 52 articles, show that practices already reflect the rich variety (...) of values, dimensions and characteristics provided in the main definitions in use, although not all are addressed yet. In fact, articles dealing with uptake of RRI practices may be improved by including more methodological information. RRI practices may further the conceptual debate by including more reflection, and these may foster mutual responsiveness between theory and practice by early anticipating impacts. (shrink)

The article analyses European regulations concerning the health protection at work with nanomaterials in the context of the Christian vision of human work. The increasingly widespread presence of nanotechnology in workplaces requires serious reflection on the adequacy of employers’ measures to protect workers’ health from the risks in the workplace. The lack of clear guidance in European legislation directly concerning work with nanoparticles is problematic. Moreover, the health consequences for workers using nanomaterials in the work process are not fully explored (...) in science. It is therefore essential to consider what values should accompany employers in shaping working conditions and what values should be legislated when creating occupational health and safety law. First of all, how should the employers deal with the unknown? Should they abandon nanomaterials for which they do not have adequate information at all until the consequences for workers’ health have been established? Should such action be limited to situations where studies indicate the toxicity of the nanomaterials present in the working environment? In this context, the article analyses values and objectives indicated by the teaching of the Catholic Church. The publication presents a Christian vision on the protection of workers’ health and their place in the work process. Europe has been under the influence of Christianity for many centuries now. The Catholic Church’s view of human labour continues to be present in public debates in Europe. The Christian view of human labour is focused on the working man and his dignity. Irrespective of other concepts of labour, Christianity assumes the priority of a human being over capital. The Catholic Church analyses the working man as going beyond the Earthly context, which is not typical for such doctrines as liberalism or Marxism. The author’s article is an attempt in answering the question about how up to date the Catholic Church’s views on human labour are in the light of nanotechnology development in the workplace. (shrink)