Ethical, legal and social implications are widely regarded as important considerations with respect to technological developments. Agile Worth-Oriented Systems Engineering is an innovative approach to incorporating ethically relevant criteria during agile development processes through a flexibly applicable methodology. First, a predefined model for the ethical evaluation of socio-technical systems is used to assess ethical issues according to different dimensions. The second part of AWOSE ensures that ethical issues are not only identified, but also systematically considered during the design of systems (...) based on information and communication technology. For this purpose, the findings from the first step are integrated with approaches from worth-centered development into a process model that, unlike previous approaches to ethical system development, is thoroughly compatible with agile methodologies like Scrum or Extreme Programming. Artifacts of worth-centered development called Worth Maps have been improved to guide the prioritization of development tasks as well as choices among design alternatives with respect to ethical implications. Furthermore, the improved Worth Maps facilitate the identification of suitable criteria for system evaluations in association to ethical concerns and desired positive outcomes of system usage. The potential of the AWOSE methodology has been demonstrated in the context of a technical system that supports elderly and people with particular handicaps. (shrink)

Artificial Intelligence (AI) seems to be impacting all industry sectors, while becoming a motor for innovation. The diffusion of AI from the civilian sector to the defense sector, and AI’s dual-use potential has drawn attention from security and ethics scholars. With the publication of the ethical guideline Trustworthy AI by the European Union (EU), normative questions on the application of AI have been further evaluated. In order to draw conclusions on Trustworthy AI as a point of reference for responsible research (...) and development (R&D), we approach the diffusion of AI across both civilian and military spheres in the EU. We capture the extent of technological diffusion and derive European and German patent citation networks. Both networks indicate a low degree of diffusion of AI between civilian and defense sectors. A qualitative investigation of project descriptions of a research institute’s work in both civilian and military fields shows that military AI applications stress accuracy or robustness, while civilian AI reflects a focus on human-centric values. Our work represents a first approach by linking processes of technology diffusion with normative evaluations of R&D. (shrink)

The increasing implementation of and reliance on machine-learning (ML) algorithms to perform tasks, deliver services and make decisions in health and healthcare have made the need for fairness in ML, and more specifically in healthcare ML algorithms (HMLA), a very important and urgent task. However, while the debate on fairness in the ethics of artificial intelligence (AI) and in HMLA has grown significantly over the last decade, the very concept of fairness as an ethical value has not yet been sufficiently (...) explored. Our paper aims to fill this gap and address the AI ethics principle of fairness from a conceptual standpoint, drawing insights from accounts of fairness elaborated in moral philosophy and using them to conceptualise fairness as an ethical value and to redefine fairness in HMLA accordingly. To achieve our goal, following a first section aimed at clarifying the background, methodology and structure of the paper, in the second section, we provide an overview of the discussion of the AI ethics principle of fairness in HMLA and show that the concept of fairness underlying this debate is framed in purely distributive terms and overlaps with non-discrimination, which is defined in turn as the absence of biases. After showing that this framing is inadequate, in the third section, we pursue an ethical inquiry into the concept of fairness and argue that fairness ought to be conceived of as an ethical value. Following a clarification of the relationship between fairness and non-discrimination, we show that the two do not overlap and that fairness requires much more than just non-discrimination. Moreover, we highlight that fairness not only has a distributive but also a socio-relational dimension. Finally, we pinpoint the constitutive components of fairness. In doing so, we base our arguments on a renewed reflection on the concept of respect, which goes beyond the idea of equal respect to include respect for individual persons. In the fourth section, we analyse the implications of our conceptual redefinition of fairness as an ethical value in the discussion of fairness in HMLA. Here, we claim that fairness requires more than non-discrimination and the absence of biases as well as more than just distribution; it needs to ensure that HMLA respects persons both as persons and as particular individuals. Finally, in the fifth section, we sketch some broader implications and show how our inquiry can contribute to making HMLA and, more generally, AI promote the social good and a fairer society. (shrink)

This article presents a systematic literature review documenting how technical investigations have been adapted in value sensitive design (VSD) studies from 1996 to 2023. We present a systematic review, including theoretical and applied studies that either discuss or conduct technical investigations in VSD. This systematic review contributes to the VSD community when seeking to further refine the methodological framework for carrying out technical investigations in VSD.

Fundamental questions in value sensitive design include whether and how high-tech products/artefacts could embody values and ethical ideals, and how plural and incommensurable values of ethical and social importance could be chosen rationally and objectively at a collective level. By using a humanitarian cargo drone study as a starting point, this paper tackles the challenges that VSD’s lack of commitment to a specific ethical theory generates in practical applications. Besides, it highlights how mainstream ethical approaches usually related to VSD are (...) incapable of solving main ethical dilemmas raised by technological design for well-being in democratic settings. Accordingly, it is argued that VSD’s ethical-democratic import would substantially be enhanced by the espousal of a procedural ethics stance and the deliberative approach to value and welfare entailed by Amartya Sen’s capability approach. Differently from rival ethical–political theories, its normative and meta-ethical foundations better handle human diversity, value-goal pluralism, conflicting vested interests as well as the epistemic-moral disagreements typical of contemporary complex democracies. Particularly, Sen’s capability approach procedural-deliberative tenets result in an “objective-impartial” choice procedure selecting a “hierarchy” of plural incommensurable values and rational goals thus, suitable to validate an applied science such as welfare-oriented technological design in concrete social environments. Conclusions suggest that refining VSD with a capability-based procedural approach to ethics fosters the concern for democracy and social justice while preserving vital scientific-technical standards. Major advantages are at an applied level to delivering ethically and socially justified, but yet highly functional technologies and high-tech products/artefacts. (shrink)

Despite the many turns that philosophy of technology has undergone in recent decades, the question of the nature and limits of technological determinism (TD) has been neglected, because it was considered as solved and overcome, and therefore not worth further discussion. This paper once again raises the problem of TD, by trying to save the opposing, but complementary elements of truth of the two main forms of TD that I shall call “nomological” and “normative”: (a) technology is all-pervasive and has (...) an inexorable capacity for extending itself into every field of human life, and (b) we have a capacity to counteract and orient technology, at least in some measure. In order to reconcile these seemingly inconsistent claims, the key move for my argument is a brief analysis of the notion of scientific experiment from the perspective of the distinction between the context of discovery and the context of justification. As a result, two senses of technology are distinguished, which I shall call respectively “reflective” and “methodological.” From the point of view of this distinction, the all-pervasiveness and inexorability of technology and the in principle irreducibility of human persons to technology—which nomological and normative TD assert dialectically one against the other—can be reconciled. Among other things, this requires the rejection (in one fundamental sense) of the widely held assumption, made both by nomological and normative TD, that technology is a cultural field whose contents can be neatly separated from the rest of human culture. This thesis should be replaced by the more qualified claim of the reflective unity and the methodological multiplicity of technology. (shrink)

Critics currently argue that applied ethics approaches to artificial intelligence (AI) are too principles-oriented and entail a theory–practice gap. Several applied ethical approaches try to prevent such a gap by conceptually translating ethical theory into practice. In this article, we explore how the currently most prominent approaches of AI ethics translate ethics into practice. Therefore, we examine three approaches to applied AI ethics: the embedded ethics approach, the ethically aligned approach, and the Value Sensitive Design (VSD) approach. We analyze each (...) of these three approaches by asking how they understand and conceptualize theory and practice. We outline the conceptual strengths as well as their shortcomings: an embedded ethics approach is context-oriented but risks being biased by it; ethically aligned approaches are principles-oriented but lack justification theories to deal with trade-offs between competing principles; and the interdisciplinary Value Sensitive Design approach is based on stakeholder values but needs linkage to political, legal, or social governance aspects. Against this background, we develop a meta-framework for applied AI ethics conceptions with three dimensions. Based on critical theory, we suggest these dimensions as starting points to critically reflect on the conceptualization of theory and practice. We claim, first, that the inclusion of the dimension of affects and emotions in the ethical decision-making process stimulates reflections on vulnerabilities, experiences of disregard, and marginalization already within the AI development process. Second, we derive from our analysis that considering the dimension of justifying normative background theories provides both standards and criteria as well as guidance for prioritizing or evaluating competing principles in cases of conflict. Third, we argue that reflecting the governance dimension in ethical decision-making is an important factor to reveal power structures as well as to realize ethical AI and its application because this dimension seeks to combine social, legal, technical, and political concerns. This meta-framework can thus serve as a reflective tool for understanding, mapping, and assessing the theory–practice conceptualizations within AI ethics approaches to address and overcome their blind spots. (shrink)

It is increasingly recognized that human values play an essential role in engineering design. Recent literature in the ethics of technology has focused on spelling out the role of values in different fields of engineering. Value Sensitive Design, as a well-established approach, aims to systematically integrate human values into technologies and engineering products. Although there is significant attention to stakeholders in VSD, how contexts may affect what stakeholders perceive as values deserves more attention. It seems that there is an implicit (...) tendency to universality in the studies of VSD and it is often assumed implicitly that values have the same meaning in different contexts and in different cultures. Therefore, while the concept of cultural relativism and its difference to universalism has been taken into account, we propose paying explicit attention to the contextual sense of values, namely the interpretation, prioritization and perception of values that have their basis in the specific contexts in which they are implemented, for instance, in a specific cultural or religious setting. Building on the proposed categorization of contextual sense of values in which their evolution has shown, we aim to shed light on what these contextual senses entail and how an explicit focus on contextuality could improve VSD. It will be argued that contextually looking at VSD may make it more flexible in dealing with the different contexts/cultures. (shrink)

The international debate on the ethics and legality of autonomous weapon systems (AWS) as well as the call for a ban are primarily focused on the nebulous concept of fully autonomous AWS. More specifically, on AWS that are capable of target selection and engagement without human supervision or control. This thesis argues that such a conception of autonomy is divorced both from military planning and decision-making operations as well as the design requirements that govern AWS engineering and subsequently the tracking (...) and tracing of moral responsibility. To do this, this thesis marries two different levels of meaningful human control (MHC), termed levels of abstraction, to couple military operations with design ethics. In doing so, this thesis argues that the contentious notion of ‘full’ autonomy is not problematic under this two-tiered understanding of MHC. It proceeds to propose the value sensitive design (VSD) approach as a means for designing for MHC. (shrink)