Recommender Systems (RecSys) have been around since the early days of the Internet, helping users navigate the vast ocean of information and the increasingly available options that have been available for us ever since. The range of tasks for which one could use a RecSys is expanding as the technical capabilities grow, with the disruption of Machine Learning representing a tipping point in this domain, as in many others. However, the increase of the technical capabilities of AI-powered RecSys did not (...) come with a thorough consideration of their ethical implications and, despite being a well-established technical domain, the potential impacts of RecSys on their users are still under-assessed. This paper aims at filling this gap in regards to one of the main impacts of RecSys: personal autonomy. We first describe how technology can affect human values and a suitable methodology to identify these effects and mitigate potential harms: Value Sensitive Design (VSD). We use VSD to carry out a conceptual investigation of personal autonomy in the context of a generic RecSys and draw on a nuanced account of procedural autonomy to focus on two components: competence and authenticity. We provide the results of our inquiry as a value hierarchy and apply it to the design of a speculative RecSys as an example. (shrink)

There is growing need for hybrid curricula that integrate constructivist methods from Science and Technology Studies (STS) into both engineering and policy courses at the undergraduate and graduate levels. However, institutional and disciplinary barriers have made implementing such curricula difficult at many institutions. While several programs have recently been launched that mix technical training with consideration of “societal” or “ethical issues,” these programs often lack a constructivist element, leaving newly-minted practitioners entering practical fields ill-equipped to unpack the politics of knowledge (...) and technology or engage with skeptical publics. This paper presents a novel format for designing interdisciplinary coursework that combines conceptual content from STS with training in engineering and policy. Courses following this format would ideally be team taught by instructors with advanced training in diverse fields, and hence co-learning between instructors and disciplines is a key element of the format. Several instruments for facilitating both student and instructor collaborative learning are introduced. The format is also designed for versatility: in addition to being adaptable to both technical and policy training environments, topics are modularized around a conceptual core so that issues ranging from biotech to nuclear security can be incorporated to fit programmatic needs and resources. (shrink)

That technologies may raise ethical issues is now widely recognised. The ‘responsible innovation’ literature – as well as, to a lesser extent, the applied ethics and bioethics literature – has responded to the need for ethical reflection on technologies by developing a number of tools and approaches to facilitate such reflection. Some of these instruments consist of lists of questions that people are encouraged to ask about technologies – a methodology known as the ‘Socratic approach’. However, to date, these instruments (...) have often not adequately acknowledged various political impacts of technologies, which are, I suggest, essential to a proper account of the ethical issues they raise. New technologies can make some people richer and some people poorer, empower some and disempower others, have dramatic implications for relationships between different social groups and impact on social understandings and experiences that are central to the lives, and narratives, of denizens of technological societies. The distinctive contribution of this paper, then, is to offer a revised and updated version of the Socratic approach that highlights the political, as well as the more traditionally ethical, issues raised by the development of new technologies. (shrink)

This volume bridges contemporary philosophical conceptions of risk and responsibility and offers an extensive examination of the topic. It shows that risk and responsibility combine in ways that give rise to new philosophical questions and problems. Philosophical interest in the relationship between risk and responsibility continues to rise, due in no small part due to environmental crises, emerging technologies, legal developments, and new medical advances. Despite such interest, scholars are just now working out how to conceive of the links between (...) risk and responsibility, the implications that risks may have to conceptions of responsibility (and vice versa), as well as how such theorizing might play out in applied cases. With contributions from leading scholars, this volume brings together new work examining the interplay between risk and responsibility, exploring its varied philosophical aspects and applications to contemporary issues in law, bioethics, technology, and environmental ethics. Risk and Responsibility in Context will be of interest to philosophers working in ethics, bioethics, philosophy of law, and philosophy of technology, as well as scholars and practitioners in law, health and science management, public policy, and environmental studies. (shrink)

Embedding ethics modules within computer science courses has become a popular response to the growing recognition that CS programs need to better equip their students to navigate the ethical dimensions of computing technologies like AI, machine learning, and big data analytics. However, the popularity of this approach has outpaced the evidence of its positive outcomes. To help close that gap, this empirical study reports positive results from Northeastern’s program that embeds values analysis modules into CS courses. The resulting data suggest (...) that such modules have a positive effect on students’ moral attitudes and that students leave the modules believing they are more prepared to navigate the ethical dimensions they’ll likely face in their eventual careers. Importantly, these gains were accomplished at an institution without a philosophy doctoral program, suggesting this strategy can be effectively employed by a wider range of institutions than many have thought. (shrink)

In this paper, we propose a methodology to maximize the benefits of interdisciplinary cooperation in AI research groups. Firstly, we build the case for the importance of interdisciplinarity in research groups as the best means to tackle the social implications brought about by AI systems, against the backdrop of the EU Commission proposal for an Artificial Intelligence Act. As we are an interdisciplinary group, we address the multi-faceted implications of the mass-scale diffusion of AI-driven technologies. The result of our exercise (...) lead us to postulate the necessity of a behavioural theory that standardizes the interaction process of interdisciplinary groups. In light of this, we conduct a review of the existing approaches to interdisciplinary research on AI appliances, leading to the development of methodologies like ethics-by-design and value-sensitive design, evaluating their strengths and weaknesses. We then put forth an iterative process theory hinging on a narrative approach consisting of four phases: definition of the hypothesis space, building-up of a common lexicon, scenario-building, interdisciplinary self-assessment. Finally, we identify the most relevant fields of application for such a methodology and discuss possible case studies. (shrink)

Most engineers Fwork within social structures governing and governed by a set of values that primarily emphasise economic concerns. The majority of innovations derive from these loci. Given the effects of these innovations on various communities, it is imperative that the values they embody are aligned with those societies. Like other transformative technologies, artificial intelligence systems can be designed by a single organisation but be diffused globally, demonstrating impacts over time. This paper argues that in order to design for this (...) broad stakeholder group, engineers must adopt a systems thinking approach that allows them to understand the sociotechnicity of artificial intelligence systems across sociocultural domains. It claims that value sensitive design, and envisioning cards in particular, provides a solid first step towards helping designers harmonise human values, understood across spatiotemporal boundaries, with economic values, rather than the former coming at the opportunity cost of the latter. (shrink)

The international debate on the ethics and legality of autonomous weapon systems (AWS) as well as the call for a ban are primarily focused on the nebulous concept of fully autonomous AWS. More specifically, on AWS that are capable of target selection and engagement without human supervision or control. This thesis argues that such a conception of autonomy is divorced both from military planning and decision-making operations as well as the design requirements that govern AWS engineering and subsequently the tracking (...) and tracing of moral responsibility. To do this, this thesis marries two different levels of meaningful human control (MHC), termed levels of abstraction, to couple military operations with design ethics. In doing so, this thesis argues that the contentious notion of ‘full’ autonomy is not problematic under this two-tiered understanding of MHC. It proceeds to propose the value sensitive design (VSD) approach as a means for designing for MHC. (shrink)

Healthcare is becoming increasingly automated with the development and deployment of care robots. There are many benefits to care robots but they also pose many challenging ethical issues. This paper takes care robots for the elderly as the subject of analysis, building on previous literature in the domain of the ethics and design of care robots. Using the value sensitive design approach to technology design, this paper extends its application to care robots by integrating the values of care, values that (...) are specific to AI, and higher-scale values such as the United Nations Sustainable Development Goals. The ethical issues specific to care robots for the elderly are discussed at length alongside examples of specific design requirements that work to ameliorate these ethical concerns. (shrink)

In this panel, we explore the future of value sensitive design (VSD). The stakes are high. Many in public and private sectors and in civil society are gradually realizing that taking our values seriously implies that we have to ensure that values effectively inform the design of technology which, in turn, shapes people’s lives. Value sensitive design offers a highly developed set of theory, tools, and methods to systematically do so.

Ethical, legal and social implications are widely regarded as important considerations with respect to technological developments. Agile Worth-Oriented Systems Engineering is an innovative approach to incorporating ethically relevant criteria during agile development processes through a flexibly applicable methodology. First, a predefined model for the ethical evaluation of socio-technical systems is used to assess ethical issues according to different dimensions. The second part of AWOSE ensures that ethical issues are not only identified, but also systematically considered during the design of systems (...) based on information and communication technology. For this purpose, the findings from the first step are integrated with approaches from worth-centered development into a process model that, unlike previous approaches to ethical system development, is thoroughly compatible with agile methodologies like Scrum or Extreme Programming. Artifacts of worth-centered development called Worth Maps have been improved to guide the prioritization of development tasks as well as choices among design alternatives with respect to ethical implications. Furthermore, the improved Worth Maps facilitate the identification of suitable criteria for system evaluations in association to ethical concerns and desired positive outcomes of system usage. The potential of the AWOSE methodology has been demonstrated in the context of a technical system that supports elderly and people with particular handicaps. (shrink)

In this article, we discuss the importance of emotions for ethical reflection on technological developments, as well as the role that art can play in this. We review literature that argues that emotions can and should play an important role in the assessment and acceptance of technological risk and in designing morally responsible technologies. We then investigate how technologically engagedartcan contribute to critical, emotional-moral reflection on technological risks. The role of art that engages with technology is unexplored territory and gives (...) rise to many fascinating philosophical questions that have not yet been sufficiently addressed in the literature. (shrink)

Digital media has become an integral part of people’s lives, and its ubiquity and pervasiveness in our everyday lives raise new ethical, social, cultural, political, economic and legal issues. Many of these issues have primarily been dealt with in terms of what is ‘right’ or ‘just’ with digital media and digitally-mediated practices, and questions about the relations between digital media and the good life are often left in the background. In short, what is often missing is an explicit discussion of (...) the relations between digital media and the good life. Under the label of ‘Net recommendation’, the present study aims to offer a balanced and constructive normative analysis of digital media, focusing on the relations between digital media and the good life. The project of Net recommendation aims to (re)assert the importance of actual discourses in our normative analysis of the relations between digital media and the good life. I pursue this project with a Walzerian approach to digital media and the good life that takes seriously (and, ideally, also interacts with) actual discourses. This approach allows us to have a better understanding of our normative judgements on the impacts of digital media has (or will have) on the good life and, at the same time, allows us to answer the question of ‘how should we live with digital media?’ more adequately. Moreover, the Walzerian approach is useful in both an intra-cultural and an inter¬cultural context. Using China’s Internet as a case study, I show that the relations between digital media and the good life in each culture should be examined in its own right. Together, I hope, this study provides an adequate illustration and defence of the project of Net recommendation that does not start with the assumption of digital media being a source of moral problem and strives to recommending specific ways to reform and/or transform digital media and digitally-mediated practices that allow us to have better relations with digital media and enable us to live better lives with them. (shrink)

Lethal Autonomous Weapons (LAWs) are robotic weapons systems, primarily of value to the military, that could engage in offensive or defensive actions without human intervention. This paper assesses and engages the current arguments for and against the use of LAWs through the lens of achieving more ethical warfare. Specific interest is given particularly to ethical LAWs, which are artificially intelligent weapons systems that make decisions within the bounds of their ethics-based code. To ensure that a wide, but not exhaustive, survey (...) of the implications of employing such ethical devices to replace humans in warfare is taken into account, this paper will engage on matters related to current scholarship on the rejection or acceptance of LAWs—including contemporary technological shortcomings of LAWs to differentiate between targets and the behavioral and psychological volatility of humans—and current and proposed regulatory infrastructures for developing and using such devices. After careful consideration of these factors, this paper will conclude that only ethical LAWs should be used to replace human involvement in war, and, by extension of their consistent abilities, should remove humans from war until a more formidable discovery is made in conducting ethical warfare. (shrink)

Living labs represent an important step in the development of research solutions based on the inclusive design paradigm. To ensure participants' rights and the adoption of an ethical approach to technological research, this paper presents some tools and strategies that comply with the needs and rights of those less advantaged groups to ensure that their rights and demands are taken into account. There is a gap in the construction and development of norms for a living lab. This article summarizes the (...) efforts made to achieve the goals of ethical awareness, enumerates the issues related to the ethical problems that may arise during participatory design and living labs environments, describes working routines, and outlines recommendations for achieving this objective. This paper attempts to focus on those aspects of research development that directly or indirectly come into contact with issues of ethics, privacy, and security related to participants in the context of any research conducted using a living lab approach. It also includes thoughts about the importance of information and communication technologies on the public domain and their implications for privacy. The importance of ethical awareness is even more evident in the case of enterprises where elderly and disabled users are present. For that reason, there are several legal tools that can be applied in a living lab setting, tools that are pertinent even though they may not have been conceived specifically to regulate this environment, may be used in a precarious way and might be temporary as well, just to proceed with the setting up of the living lab. However, the specificity and idiosyncrasy of this research environment demands further efforts to establish procedures that will facilitate both the proper set-up and smooth running of the living lab. (shrink)

Philosophers have talked to each other about moral issues concerning technology, but few of them have talked about issues of technology and the good life, and even fewer have talked about technology and the good life with the public in the form of recommendation. In effect, recommendations for various technologies are often left to technologists and gurus. Given the potential benefits of informing the public on their impacts on the good life, however, this is a curious state of affairs. In (...) the present paper, I will examine why philosophers are seemingly reluctant to offer recommendations to the public. While there are many reasons for philosophers to refrain from offering recommendations, I shall focus on a specific normative reason. More specifically, it appears that, according to a particular definition, offering recommendations can be viewed as paternalistic, and therefore is prima facie wrong to do so. I will provide an argument to show that the worry about paternalism is unfounded, because a form of paternalism engendered by technology is inevitable. Given the inevitability of paternalism, I note that philosophers should accept the duty to offer recommendations to the public. I will then briefly turn to design ethics, which has reconceptualised the role of philosophers and, in my mind, fitted well with the inevitability of paternalism. Finally, I shall argue that design ethics has to be supplemented by the practice of recommendation if it is to sustain its objective. (shrink)

Critics currently argue that applied ethics approaches to artificial intelligence (AI) are too principles-oriented and entail a theory–practice gap. Several applied ethical approaches try to prevent such a gap by conceptually translating ethical theory into practice. In this article, we explore how the currently most prominent approaches of AI ethics translate ethics into practice. Therefore, we examine three approaches to applied AI ethics: the embedded ethics approach, the ethically aligned approach, and the Value Sensitive Design (VSD) approach. We analyze each (...) of these three approaches by asking how they understand and conceptualize theory and practice. We outline the conceptual strengths as well as their shortcomings: an embedded ethics approach is context-oriented but risks being biased by it; ethically aligned approaches are principles-oriented but lack justification theories to deal with trade-offs between competing principles; and the interdisciplinary Value Sensitive Design approach is based on stakeholder values but needs linkage to political, legal, or social governance aspects. Against this background, we develop a meta-framework for applied AI ethics conceptions with three dimensions. Based on critical theory, we suggest these dimensions as starting points to critically reflect on the conceptualization of theory and practice. We claim, first, that the inclusion of the dimension of affects and emotions in the ethical decision-making process stimulates reflections on vulnerabilities, experiences of disregard, and marginalization already within the AI development process. Second, we derive from our analysis that considering the dimension of justifying normative background theories provides both standards and criteria as well as guidance for prioritizing or evaluating competing principles in cases of conflict. Third, we argue that reflecting the governance dimension in ethical decision-making is an important factor to reveal power structures as well as to realize ethical AI and its application because this dimension seeks to combine social, legal, technical, and political concerns. This meta-framework can thus serve as a reflective tool for understanding, mapping, and assessing the theory–practice conceptualizations within AI ethics approaches to address and overcome their blind spots. (shrink)

The paper has two goals. The first is presenting the main results of the recent report Ethics of Connected and Automated Vehicles: recommendations on road safety, privacy, fairness, explainability and responsibility written by the Horizon 2020 European Commission Expert Group to advise on specific ethical issues raised by driverless mobility, of which the author of this paper has been member and rapporteur. The second is presenting some broader ethical and philosophical implications of these recommendations, and using these to contribute to (...) the establishment of Ethics of Transportation as an independent branch of applied ethics. The recent debate on the ethics of Connected and Automated Vehicles presents a paradox and an opportunity. The paradox is the presence of a flourishing debate on the ethics of one very specific transportation technology without ethics of transportation being in itself a well-established academic discipline. The opportunity is that now that a spotlight has been switched on the ethical dimensions of CAVs it may be easier to establish a broader debate on ethics of transportation. While the 20 recommendations of the EU report are grouped in three macro-areas: road safety, data ethics, and responsibility, in this paper they will be grouped according to eight philosophical themes: Responsible Innovation, road justice, road safety, freedom, human control, privacy, data fairness, responsibility. These are proposed as the first topics for a new ethics of transportation. (shrink)

This paper provides a systematic literature review, analysis and discussion of methods that are proposed to practise ethics in research and innovation. Ethical considerations concerning the impacts of R&I are increasingly important, due to the quickening pace of technological innovation and the ubiquitous use of the outcomes of R&I processes in society. For this reason, several methods for practising ethics have been developed in different fields of R&I. The paper first of all presents a systematic search of academic sources that (...) present and discuss such methods. Secondly, it provides a categorisation of these methods according to three main kinds: ex ante methods, dealing with emerging technologies, intra methods, dealing with technology design, and ex post methods, dealing with ethical analysis of existing technologies. Thirdly, it discusses the methods by considering problems in the way they deal with the uncertainty of technological change, ethical technology design, the identification, analysis and resolving of ethical impacts of technologies and stakeholder participation. The results and discussion of our literature review are valuable for gaining an overview of the state of the art and serve as an outline of a future research agenda of methods for practising ethics in R&I. (shrink)

Developers and designers make all sorts of moral decisions throughout an innovation project. In this article, we describe how teams of developers and designers engaged with ethics in the early phases of innovation based on case studies in the SUBCOP project. For that purpose, Value Sensitive Design will be used as a reference. Specifically, we focus on the following two research questions: How can researchers/developers learn about users’ perspectives and values during the innovation process? and How can researchers/developers take into (...) account these values, and related design criteria, in their decision-making during the innovation process? Based on a case study of several innovation processes in this project, we conclude the researchers/developers involved are able to do something similar to VSD, supported by relatively simple exercises in the project, e.g., meetings with potential end-users and discussions with members of the Ethical Advisory Board of the project. Furthermore, we also found—possibly somewhat counterintuitively—that a commercial, with its focus on understanding and satisfying customers’ needs, can promote VSD. (shrink)

Knowing that technologies are inherently value-laden and systemically interwoven with society, the question is how individual engineers can take up the challenge of accepting the responsibility for their work? This paper will argue that engineers have no institutional structure at the level of society that allows them to recognize, reflect upon, and actively integrate the value-laden character of their designs. Instead, engineers have to tap on the different institutional realms of market, science, and state, making their work a ‘hybrid’ activity (...) combining elements from the different institutional realms. To deal with this institutional hybridity, engineers develop routines and heuristics in their professional network, which do not allow societal values to be expressed in a satisfactory manner. To allow forms of ‘active’ responsibility, there have to be so-called ‘accountability forums’ that guide moral reflections of individual actors. The paper will subsequently look at the methodologies of value-sensitive design and constructive technology assessment and explore whether and how these methodologies allow engineers to integrate societal values into the design technological artifacts and systems. As VSD and CTA are methodologies that look at the process of technological design, whereas the focus of this paper is on the designer, they can only be used indirectly, namely as frameworks which help to identify the contours of a framework for active responsibility of engineers. (shrink)

Contemporary literature investigating the significant impact of technology on our lives leads many to conclude that ethics must be a part of the discussion at an earlier stage in the design process i.e., before a commercial product is developed and introduced. The problem, however, is the question regarding how ethics can be incorporated into an earlier stage of technological development and it is this question that we argue has not yet been answered adequately. There is no consensus amongst scholars as (...) to the kind of ethics that should be practiced, nor the individual selected to perform this ethical analysis. One school of thought holds that ethics should have pragmatic value in research and design and that it should be implemented by the engineers and/or scientists themselves, while another school of thought holds that ethics need not be so pragmatic. For the latter, the ethical reflection can aim at a variety of goals, and be carried out by an ethicist. None of the approaches resulting from these lines of thinking have been adopted on a wide-scale basis. To that end, the approach presented here is intended to bridge the gap between these schools of thought. It is our contention that ethics ought to be pragmatic and to provide utility for the design process and we maintain that adequate ethical reflection, and all that it entails, ought to be conducted by an ethicist. Thus, we propose a novel role for the ethicist—the ethicist as designer—who subscribes to a pragmatic view of ethics in order to bring ethics into the research and design of artifacts—no matter the stage of development. In this paper we outline the series of steps that a pragmatic value analysis entails: uncovering relevant values, scrutinizing these values and, working towards the translation of values into technical content. In conclusion, we present a list of tasks for the ethicist in his/her role as designer on the interdisciplinary team. (shrink)

Artificial placenta technologies (also termed ‘artificial wombs’) for use in place of conventional neonatal intensive care are increasingly closer to first-in-human use. There is growing ethical interest in partial ectogestation (the use of an artificial placenta to continue gestation of an underdeveloped human entity extra uterum), however, there has been little reflection on the ethical issues in the design of the technology. While some have noted the importance of such reflection, and others have noted that a ‘value sensitive design’ approach (...) should be preferred, they have not elaborated on what this means. In this article, we consider what a value sensitive design approach to artificial placenta design might encompass. We believe that applying this framework to the topic at hand raises theoretical and substantive ethical questions that merit further elucidation. Highlighting that there is a careful need to separate preferences from values and that our intervention should be considered only a starting point, we explore some of the values that could be used to make ethical design choices about the artificial placenta: efficacy, compassion and accessibility. (shrink)

Large language models (LLMs) structure the linguistic landscape by reflecting certain beliefs and assumptions. In this paper, we address the risk of people unthinkingly adopting and being determined by the values or worldviews embedded in LLMs. We provide a Nietzschean critique of LLMs and, based on the concept of will to power, consider LLMs as will-to-power organisations. This allows us to conceptualise the interaction between self and LLMs as power struggles, which we understand as negotiation. Currently, the invisibility and incomprehensibility (...) of LLMs make it difficult, if not impossible, to engage in such negotiations. This bears the danger that LLMs make reality increasingly homogeneous by recycling beliefs and creating feedback loops that ultimately freeze power struggles and thus consolidate the status quo. In view of this, LLMs constrain self-formation. Based on our critique, we provide some recommendations on how to develop interactions with LLMs that enable negotiations that allow for different ways of being. (shrink)

Previous Responsible Innovation (RI) research has provided valuable insights on the value conflicts inherent to societally desirable innovation. By observing the responses of firms to these conflicts, Value-sensitive Absorptive Capacity (VAC) captures the organizational capabilities to become sensitive to these value conflicts and thus, innovate more responsibly. In this article, we construct a survey instrument to assess VAC, based on previous work by CSR and RI scholars. The construct and concurrent validity of the instrument were tested in an empirical study, (...) including 109 employees of 30 food manufacturing firms. The results from the survey were then compared with the conceptual VAC dimensions. With this comparison, we do not only contribute to the substantiation of the VAC construct, but we also show how inductive and deductive approaches can be combined to build theory regarding RI in a transdisciplinary manner. (shrink)

This article reviews the academic literature that emerged under value sensitive design. It investigates those VSD projects that employed the tripartite methodology, examining the use of VSD methodological elements, and illustrating common practices and identifying shortcomings. The article provides advice for VSD researchers on how to complete and enhance their methodological approach as the research community moves forward.

When should we use care robots? In this paper we endorse the shift from a simple normative approach to care robots ethics to a complex one: we think that one main task of a care robot ethics is that of analysing the different ways in which different care robots may affect the different values at stake in different care practices. We start filling a gap in the literature by showing how the philosophical analysis of the nature of healthcare activities can (...) contribute to robot ethics. We rely on the nature-of-activities approach recently proposed in the debate on human enhancement, and we apply it to the ethics of care robots. The nature-of-activities approach will help us to understand why certain practice-oriented activities in healthcare should arguably be left to humans, but certain goal-directed activities in healthcare can be fulfilled with the assistance of a robot. In relation to the latter, we aim to show that even though all healthcare activities can be considered as practice-oriented, when we understand the activity in terms of different legitimate ‘fine-grained’ descriptions, the same activities or at least certain components of them can be seen as clearly goal-directed. Insofar as it allows us to ethically assess specific functionalities of specific robots to be deployed in well-defined circumstances, we hold the nature-of-activities approach to be particularly helpful also from a design perspective, i.e. to realize the Value Sensitive Design approach. (shrink)

The introduction of new energy technologies may lead to public resistance and contestation. It is often argued that this phenomenon is caused by an inadequate inclusion of relevant public values in the design of technology. In this paper we examine the applicability of the value sensitive design approach. While VSD was primarily introduced for incorporating values in technological design, our focus in this paper is expanded towards the design of the institutions surrounding these technologies, as well as the design of (...) stakeholder participation. One important methodological challenge of VSD is to identify the relevant values related to new technological developments. In this paper, we argue that the public debate can form a rich source from which to retrieve the values at stake. To demonstrate this, we have examined the arguments used in the public debate regarding the exploration and exploitation of shale gas in the Netherlands. We identified two important sets of the underlying values, namely substantive and procedural values. This paper concludes with two key findings. Firstly, contrary to what is often suggested in the literature, both proponents and opponents seem to endorse the same values. Secondly, contestation seems to arise in the precise operationalization of these values among the different stakeholders. In other words, contestation in the Dutch shale gas debate does not arise from inter-value conflict but rather from intra-value conflicts. This multi-interpretability should be incorporated in VSD processes. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

This article introduces Designing for Care (D4C), a distinctive approach to project management and technological design informed by Care Ethics. We propose to conceptualize “care” as both the foundational value of D4C and as its guiding mid-level principle. As a value, care provides moral grounding. As a principle, it equips D4C with moral guidance to enact a caring process. The latter is made of a set of concrete, and often recursive, caring practices. One of the key assumption of D4C is (...) a relational ontology of individual and group identities, which fosters the actualization of caring practices as essentially relational and (often) reciprocal. Moreover, D4C adopts the “ecological turn” in CE and stresses the ecological situatedness and impact of concrete projects, envisioning an extension of caring from intra-species to inter-species relations. We argue that care and caring can influence directly some of the phases and practices within the management of (energy) projects and the design of sociotechnical (energy) artefacts and systems. When issues related to “value change” emerge as problematic (e.g., values trade-offs, conflicts), the mid-level guiding principle of care helps evaluate and prioritize different values at stake within specific projects. Although there may be several actors and stakeholders involved in project management and technological design, here we will focus on the professionals in charge of imagining, designing, and carrying out these processes (i.e., project managers, designers, engineers). We suggest that adopting D4C would improve their ability to capture and assess stakeholders’ values, critically reflect on and evaluate their own values, and judge which values prioritize. Although D4C may be adaptable to different fields and design contexts, we recommend its use especially within small and medium-scale (energy) projects. To show the benefits of adopting it, we envisage the application of D4C within the project management and the technological design of a community battery. The adoption of D4C can have multiple positive effects: transforming the mentality and practice of managing a project and designing technologies; enhancing caring relationships between managers, designers, and users as well as among users; achieving better communication, more inclusive participation, and more just decision-making. This is an initial attempt to articulate the structure and the procedural character of D4C. The application of D4C in a concrete project is needed to assess its actual impact, benefits, and limitations. (shrink)

This article presents a systematic literature review documenting how technical investigations have been adapted in value sensitive design (VSD) studies from 1996 to 2023. We present a systematic review, including theoretical and applied studies that either discuss or conduct technical investigations in VSD. This systematic review contributes to the VSD community when seeking to further refine the methodological framework for carrying out technical investigations in VSD.

Fundamental questions in value sensitive design include whether and how high-tech products/artefacts could embody values and ethical ideals, and how plural and incommensurable values of ethical and social importance could be chosen rationally and objectively at a collective level. By using a humanitarian cargo drone study as a starting point, this paper tackles the challenges that VSD’s lack of commitment to a specific ethical theory generates in practical applications. Besides, it highlights how mainstream ethical approaches usually related to VSD are (...) incapable of solving main ethical dilemmas raised by technological design for well-being in democratic settings. Accordingly, it is argued that VSD’s ethical-democratic import would substantially be enhanced by the espousal of a procedural ethics stance and the deliberative approach to value and welfare entailed by Amartya Sen’s capability approach. Differently from rival ethical–political theories, its normative and meta-ethical foundations better handle human diversity, value-goal pluralism, conflicting vested interests as well as the epistemic-moral disagreements typical of contemporary complex democracies. Particularly, Sen’s capability approach procedural-deliberative tenets result in an “objective-impartial” choice procedure selecting a “hierarchy” of plural incommensurable values and rational goals thus, suitable to validate an applied science such as welfare-oriented technological design in concrete social environments. Conclusions suggest that refining VSD with a capability-based procedural approach to ethics fosters the concern for democracy and social justice while preserving vital scientific-technical standards. Major advantages are at an applied level to delivering ethically and socially justified, but yet highly functional technologies and high-tech products/artefacts. (shrink)

The majority of studies on absorptive capacity (AC) underscore the importance of absorbing technological knowledge from other firms to create economic value. However, to preserve moral legitimacy and create social value, firms must also discern and adapt to (shifts in) societal values. A comparative case study of eight firms in the food industry reveals how organizations prioritize and operationalize the societal value health in product innovation while navigating inter- and intravalue conflicts. The value-sensitive framework induced in this article extends AC (...) by explaining how technically savvy, economic value–creating firms diverge in their receptivity, articulation, and reflexivity of societal values. (shrink)

This article presents the framework Capability Sensitive Design (CSD), which consists of merging the design methodology Value Sensitive Design (VSD) with Martha Nussbaum's capability theory. CSD aims to normatively assess technology design in general, and technology design for health and wellbeing in particular. Unique to CSD is its ability to account for human diversity and to counter (structural) injustices that manifest in technology design. The basic framework of CSD is demonstrated by applying it to the hypothetical design case of a (...) therapy chatbot for mental health. By applying CSD to a design case, the merits of this new framework over the standard VSD approach become apparent. Also, the application demonstrates what a technology design would look like when attention is paid to capabilities right from the start of the design process. (shrink)

Machine learning is fundamental to multiple visions of health care’s future, from precision medicine 2020) to a model of health delivery and research...

Along with potential benefits to healthcare delivery, machine learning healthcare applications raise a number of ethical concerns. Ethical evaluations of ML-HCAs will need to structure th...

Recent years have seen numerous sociological disagreements devolve into heated debates, with scholars openly accusing their peers of being both empirically wrong and morally misguided. While social scientists routinely reflect on the ethical implications of certain research assumptions and data collection methods, the sociology of knowledge production has said little about how moral debates over scholarship shape subsequent research trajectories. Drawing on the new French pragmatic sociology, this article examines how sociologists respond to criticisms of the moral worth of their (...) research. The article outlines three typical responses: (1) accepting the criticism and changing direction completely; (2) accepting the criticism but changing discursive framing to incorporate existing research without being subject to critique; and (3) navigating through the debate by devising new research directions that do not trigger such criticism. To demonstrate, the article looks at how sociologists of religion responded, in their published scholarship, to criticisms of secularization theory as depreciating religious people and spiritual experience. Across the responses, we show that sociologists have included moral considerations in their empirical investigations, and have switched among several diverse moral justifications to address—and also avoid—criticism. We conclude by demonstrating that this model can be extended to other domains of sociological inquiry, including the study of gender-based wage inequality and methodological nationalism. The article highlights the importance of mapping the moral frameworks sociologists use for the sociology of knowledge and the sociology of morality. (shrink)

PurposeThe purpose of this paper is to develop a critique of value sensitive design (VSD) and to propose an alternative approach that does not depart from a heuristic of value(s), but from virtue ethics, called virtuous practice design (VPD).Design/methodology/approachThis paper develops a philosophical argument, draws from a philosophical method (i.e. virtue ethics) and applies this method to a particular case study that draws from a narrative interview.FindingsIn this paper, authors show how an approach that takes virtue instead of value as (...) the central notion for aiming at a design that is sensitive to ethical concerns can be fruitful both in theory and in practice.Originality/valueThis paper presents the first attempt to ground an approach aimed at ethical technology design on the tradition of virtue ethics. As such, it presents VPD as a potentially fruitful alternative to VSD. (shrink)

In this paper we present the perceptions of those engagedin a digital research project. We explored participants’ ethical knowledge,understanding and feelings about the whole process. We also tried toimplement a plan in order to see if certain proactive actions will benefitthe understanding of ethical issues among those stakeholders.The investigation presented here explored the need for ethical awarenessamong stakeholders in technology research projects.1 The Project tried to overcome the existing accessibility barriers faced by people unfamiliarwith ICT, people with disabilities and older (...) people when interactingwith Public Digital Terminals, such as ATMs and Ticket VendingMachines. As part of the research an investigation was conducted aboutthe ethical issues that rose on the use of digital technologies and, moreimportantly, about stakeholders ethical issues awareness.In this report the results from the field research carried out on ethicalissues are presented. At the beginning of the project a need for researchinto ethical awareness among project stakeholders was identified. As partof the project´s legal and ethical awareness and compliance, a limitedresearch was carried out on ethical issues. The research carried out encompassedtesting the validity and adequacy of the information providedon a purpose-made guide that also included more ethical awareness questionsto explore.During the testing sessions carried out in the pilot the questionnairewas presented to volunteers. Another questionnaire was presented todevelopers, and to the APSIS4 all project personnel. The expresion ofethical concerns was also encouraged from both the staff working in theproject and volunteers participating in the trials.Results showed that the information provided on the documentationwas adequate and, likewise, that both volunteers and consortium personnelwere aware of volunteers’ rights and personnel obligations. (shrink)

It should not be a surprise in the near future to encounter either a personal or a professional service robot in our homes and/or our work places: according to the International Federation for Robots, there will be approx 35 million service robots at work by 2018. Given that individuals will interact and even cooperate with these service robots, their design and development demand ethical attention. With this in mind I suggest the use of an approach for incorporating ethics into the (...) design process of robots known as Care Centered Value Sensitive Design. Although this approach was originally and intentionally designed for the healthcare domain, the aim of this paper is to present a preliminary study of how personal and professional service robots might also be evaluated using the CCVSD approach. The normative foundations for CCVSD come from its reliance on the care ethics tradition and in particular the use of care practices for: structuring the analysis and, determining the values of ethical import. To apply CCVSD outside of healthcare one must show that the robot has been integrated into a care practice. Accordingly, the practice into which the robot is to be used must be assessed and shown to meet the conditions of a care practice. By investigating the foundations of the approach I hope to show why it may be applicable for service robots and further to give examples of current robot prototypes that can and cannot be evaluated using CCVSD. (shrink)

In the value sensitive design literature, there has been little attention for how values may change during the adoption and use of a sociotechnical system, and what that implies for design. A value change taxonomy is proposed, as well as a number of technical features that allow dealing with value change.

Developing technology that accounts for values has been achieved in many areas, including security, gaming, finance, engineering, and many more. The main methodological approach has been that of value sensitive design. But most of the work to date has been on the first of its three stages. The focus of this article is on advances related to its second stage, empirical investigation, and in particular the impact of contextual understanding in that stage. Although lessons can be learnt from other domains, (...) the specific context of dementia means that there are nuances to understanding values, including justice and autonomy, that differ from other areas. The integration of value considerations in the development of assistive technology in dementia is explored in two broad categories: the traditional and ongoing need for fixed decision support, and adaptable decision support technologies. For fixed decision support the A&D Benchmark is particularly useful in design. But for adaptable technologies, that benchmark requires further development, including consideration of the values of additional stakeholders, such as the general public. (shrink)

Applications of artificial intelligence/machine learning in health care are dynamic and rapidly growing. One strategy for anticipating and addressing ethical challenges related to AI/ml for health care is patient and public involvement in the design of those technologies – often referred to as ‘co-design’. Co-design has a diverse intellectual and practical history, however, and has been conceptualized in many different ways. Moreover, AI/ml introduces challenges to co-design that are often underappreciated. Informed by perspectives from critical data studies and critical digital (...) health studies, we review the research literature on involvement in health care, and involvement in design, and examine the extent to which co-design as commonly conceptualized is capable of addressing the range of normative issues raised by AI/ml for health care. We suggest that AI/ml technologies have amplified and modified existing challenges related to patient and public involvement, and created entirely new challenges. We outline three pitfalls associated with co-design for ethical AI/ml for health care and conclude with suggestions for addressing these practical and conceptual challenges. (shrink)

In the applied sciences and in engineering there is often a significant overlap between work at universities and in industry. For the individual scholar, this may lead to serious conflicts when working on joint university–industry projects. Differences in goals, such as the university’s aim to disseminate knowledge while industry aims to appropriate knowledge, might lead to complicated situations and conflicts of interest. The detailed cases of two electrical engineers and two architects working at two different universities of technology illustrate the (...) kinds of problems individual scholars face in university–business collaborations. These cases are based on qualitative interviews and additional data and demonstrate that, while value conflicts emerge on the organizational level, it is primarily the individual researcher who must deal with such conflicts. This analysis adds to existing studies in two ways: first, it explicitly addresses normative issues framed in terms of ethical and social values, thereby going beyond the common social-science perspective of university–business collaboration. Secondly, it provides qualitative insights, thereby identifying details and issues not apparent in quantitative studies. In particular, it is evident that university–industry collaborations are prone to value conflicts not only in research but also in education and job training. (shrink)

The public’s trust in the technology sector is waning and, in response, technology companies and state governments have started to champion “tech ethics”. That is, they have pledged to design, develop, distribute, and employ new technologies in an ethical manner. In this paper, I observe that tech ethics is already subject to a widespread pathology in that technology companies, the primary executors of tech ethics, are incentivized to pursue it half-heartedly or even disingenuously. Next, I highlight two emerging strategies which (...) might be used to combat this problem, but argue that both are subject to practical limitations. In response, I suggest an additional way of augmenting the practice of tech ethics. This is to employ “trust audits,” a new form of public participation in the socio-technical environment. In the remainder of the paper, I offer a description of how trust audits work, what they might look like in practice, and how they can fit in alongside those other strategies for improving tech ethics. (shrink)

In this article, we report on eight grand challenges for value sensitive design, which were developed at a one-week workshop, Value Sensitive Design: Charting the Next Decade, Lorentz Center, Leiden, The Netherlands, November 14–18, 2016. A grand challenge is a substantial problem, opportunity, or question that motives sustained research and design activity. The eight grand challenges are: Accounting for Power, Evaluating Value Sensitive Design, Framing and Prioritizing Values, Professional and Industry Appropriation, Tech policy, Values and Human Emotions, Value Sensitive Design (...) and Intelligent Algorithms, and Value Tensions. Each grand challenge consists of a discussion of its importance and a set of tractable key questions. (shrink)

Contemporary design practices, such as participatory design, human-centered design, and codesign, have inherent ethical qualities, which often remain implicit and unexamined. Three design projects in the high-tech industry were studied using three ethical traditions as lenses. Virtue ethics helped to understand cooperation, curiosity, creativity, and empowerment as virtues that people in PD need to cultivate, so that they can engage, for example, in mutual learning and collaborative prototyping. Ethics of alterity helped to understand human-centered design as a fragile encounter between (...) project team members and prospective users, and foregrounds the ethics in these encounters: our tendencies to “grasp the other” and to “program invention.” And pragmatist ethics helped to understand codesign as a process of joint inquiry and imagination, involving the organization of iterative processes of problem setting and solution finding, with moral qualities. When we open the “black boxes” of design practices, we find them filled with ethics. Moreover, it is proposed that design practitioners need to make explicit their practices’ inherent ethical qualities and that they can do that by embracing reflexivity. (shrink)

Stakeholder involvement in design is desirable from both a practical and an ethical point of view. It is difficult to do well, however, and some problems recur again and again, both of a practical nature, e.g. stakeholders acting strategically rather than openly, and of an ethical nature, e.g. power imbalances unduly affecting the outcome of the process. Hidden Design has been proposed as a method to deal with the practical problems of stakeholder involvement. It aims to do so by taking (...) the observation of stakeholder actions, rather than the outcomes of a deliberative process, as its input. Furthermore, it hides from stakeholders the fact that a design process is taking place so that they will not behave differently than they otherwise would. Both aspects of Hidden Design have raised ethical worries. In this paper I make an ethical analysis of what it means for a design process to leave participants uninformed or deceived rather than acquiring their informed consent beforehand, and to use observation of actions rather than deliberation as input for design, using Hidden Design as a case study. This analysis is based on two sets of normative guidelines: the ethical guidelines for psychological research involving deception or uninformed participants from two professional psychological organisations, and Habermasian norms for a fair and just process. It supports the conclusion that stakeholder involvement in design organised in this way can be ethically acceptable, though under a number of conditions and constraints. (shrink)

The adverse effects of artificial nighttime lighting, known as light pollution, are emerging as an important environmental issue. To address these effects, current scientific research focuses mainly on identifying what is bad or undesirable about certain types and uses of lighting at night. This paper adopts a value-sensitive approach, focusing instead on what is good about darkness at night. In doing so, it offers a first comprehensive analysis of the environmental value of darkness at night from within applied ethics. A (...) design for values orientation is utilized to conceptualize, define, and categorize the ways in which value is derived from darkness. Nine values are identified and categorized via their type of good, temporal outlook, and spatial characteristics. Furthermore, these nine values are translated into prima facie moral obligations that should be incorporated into future design choices, policy-making, and innovations to nighttime lighting. Thus, the value of darkness is analyzed with the practical goal of informing future decision-making about urban nighttime lighting. (shrink)