For smart cities, data-driven innovation promises societal benefits and increased well-being for residents and visitors. At the same time, the deployment of data-driven innovation poses significant ethical challenges. Although cities and other public-sector actors have increasingly adopted ethical principles, employing them in practice remains challenging. In this commentary, we use a virtue-based approach that bridges the gap between abstract principles and the daily work of practitioners who engage in and with data-driven innovation processes. Inspired by Aristotle, we describe practices of (...) data-driven innovation in a smart city applying the concepts of virtue and phronêsis, meaning good judgment of and sensitivity to ethical issues. We use a dialogic case-study approach to study two cases of data-driven innovation in the city of Helsinki. We then describe as an illustration of how our approach can help bridge the gap between concrete practices of data-driven innovation and high-level principles. Overall, we advance a theoretically grounded, virtue-based approach, which is practice oriented and linked to the daily work of data scientists and other practitioners of data-driven innovation. Further, this approach helps understand the need for and importance of individual application of phronêsis, which is particularly important in public-sector organizations that can experience gaps between principle and practice. This importance is further intensified in cases of data-driven innovation in which, by definition, novel and unknown contexts are explored. (shrink)

Embedding ethics modules within computer science courses has become a popular response to the growing recognition that CS programs need to better equip their students to navigate the ethical dimensions of computing technologies like AI, machine learning, and big data analytics. However, the popularity of this approach has outpaced the evidence of its positive outcomes. To help close that gap, this empirical study reports positive results from Northeastern’s program that embeds values analysis modules into CS courses. The resulting data suggest (...) that such modules have a positive effect on students’ moral attitudes and that students leave the modules believing they are more prepared to navigate the ethical dimensions they’ll likely face in their eventual careers. Importantly, these gains were accomplished at an institution without a philosophy doctoral program, suggesting this strategy can be effectively employed by a wider range of institutions than many have thought. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

Philosophers have talked to each other about moral issues concerning technology, but few of them have talked about issues of technology and the good life, and even fewer have talked about technology and the good life with the public in the form of recommendation. In effect, recommendations for various technologies are often left to technologists and gurus. Given the potential benefits of informing the public on their impacts on the good life, however, this is a curious state of affairs. In (...) the present paper, I will examine why philosophers are seemingly reluctant to offer recommendations to the public. While there are many reasons for philosophers to refrain from offering recommendations, I shall focus on a specific normative reason. More specifically, it appears that, according to a particular definition, offering recommendations can be viewed as paternalistic, and therefore is prima facie wrong to do so. I will provide an argument to show that the worry about paternalism is unfounded, because a form of paternalism engendered by technology is inevitable. Given the inevitability of paternalism, I note that philosophers should accept the duty to offer recommendations to the public. I will then briefly turn to design ethics, which has reconceptualised the role of philosophers and, in my mind, fitted well with the inevitability of paternalism. Finally, I shall argue that design ethics has to be supplemented by the practice of recommendation if it is to sustain its objective. (shrink)

This article reviews the academic literature that emerged under value sensitive design. It investigates those VSD projects that employed the tripartite methodology, examining the use of VSD methodological elements, and illustrating common practices and identifying shortcomings. The article provides advice for VSD researchers on how to complete and enhance their methodological approach as the research community moves forward.

It should not be a surprise in the near future to encounter either a personal or a professional service robot in our homes and/or our work places: according to the International Federation for Robots, there will be approx 35 million service robots at work by 2018. Given that individuals will interact and even cooperate with these service robots, their design and development demand ethical attention. With this in mind I suggest the use of an approach for incorporating ethics into the (...) design process of robots known as Care Centered Value Sensitive Design. Although this approach was originally and intentionally designed for the healthcare domain, the aim of this paper is to present a preliminary study of how personal and professional service robots might also be evaluated using the CCVSD approach. The normative foundations for CCVSD come from its reliance on the care ethics tradition and in particular the use of care practices for: structuring the analysis and, determining the values of ethical import. To apply CCVSD outside of healthcare one must show that the robot has been integrated into a care practice. Accordingly, the practice into which the robot is to be used must be assessed and shown to meet the conditions of a care practice. By investigating the foundations of the approach I hope to show why it may be applicable for service robots and further to give examples of current robot prototypes that can and cannot be evaluated using CCVSD. (shrink)

This paper introduces the design principle of legibility as means to examine the epistemic and ethical conditions of sensing technologies. Emerging sensing technologies create new possibilities regarding what to measure, as well as how to analyze, interpret, and communicate said measurements. In doing so, they create ethical challenges for designers to navigate, specifically how the interpretation and communication of complex data affect moral values such as autonomy. Contemporary sensing technologies require layers of mediation and exposition to render what they sense (...) as intelligible and constructive to the end user, which is a value-laden design act. Legibility is positioned as both an evaluative lens and a design criterion, making it complimentary to existing frameworks such as value sensitive design. To concretize the notion of legibility, and understand how it could be utilized in both evaluative and anticipatory contexts, the case study of a vest embedded with sensors and an accompanying app for patients with chronic obstructive pulmonary disease is analyzed. (shrink)

Contemporary literature investigating the significant impact of technology on our lives leads many to conclude that ethics must be a part of the discussion at an earlier stage in the design process i.e., before a commercial product is developed and introduced. The problem, however, is the question regarding how ethics can be incorporated into an earlier stage of technological development and it is this question that we argue has not yet been answered adequately. There is no consensus amongst scholars as (...) to the kind of ethics that should be practiced, nor the individual selected to perform this ethical analysis. One school of thought holds that ethics should have pragmatic value in research and design and that it should be implemented by the engineers and/or scientists themselves, while another school of thought holds that ethics need not be so pragmatic. For the latter, the ethical reflection can aim at a variety of goals, and be carried out by an ethicist. None of the approaches resulting from these lines of thinking have been adopted on a wide-scale basis. To that end, the approach presented here is intended to bridge the gap between these schools of thought. It is our contention that ethics ought to be pragmatic and to provide utility for the design process and we maintain that adequate ethical reflection, and all that it entails, ought to be conducted by an ethicist. Thus, we propose a novel role for the ethicist—the ethicist as designer—who subscribes to a pragmatic view of ethics in order to bring ethics into the research and design of artifacts—no matter the stage of development. In this paper we outline the series of steps that a pragmatic value analysis entails: uncovering relevant values, scrutinizing these values and, working towards the translation of values into technical content. In conclusion, we present a list of tasks for the ethicist in his/her role as designer on the interdisciplinary team. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

In the value sensitive design literature, there has been little attention for how values may change during the adoption and use of a sociotechnical system, and what that implies for design. A value change taxonomy is proposed, as well as a number of technical features that allow dealing with value change.

Lethal Autonomous Weapons (LAWs) are robotic weapons systems, primarily of value to the military, that could engage in offensive or defensive actions without human intervention. This paper assesses and engages the current arguments for and against the use of LAWs through the lens of achieving more ethical warfare. Specific interest is given particularly to ethical LAWs, which are artificially intelligent weapons systems that make decisions within the bounds of their ethics-based code. To ensure that a wide, but not exhaustive, survey (...) of the implications of employing such ethical devices to replace humans in warfare is taken into account, this paper will engage on matters related to current scholarship on the rejection or acceptance of LAWs—including contemporary technological shortcomings of LAWs to differentiate between targets and the behavioral and psychological volatility of humans—and current and proposed regulatory infrastructures for developing and using such devices. After careful consideration of these factors, this paper will conclude that only ethical LAWs should be used to replace human involvement in war, and, by extension of their consistent abilities, should remove humans from war until a more formidable discovery is made in conducting ethical warfare. (shrink)

Most engineers Fwork within social structures governing and governed by a set of values that primarily emphasise economic concerns. The majority of innovations derive from these loci. Given the effects of these innovations on various communities, it is imperative that the values they embody are aligned with those societies. Like other transformative technologies, artificial intelligence systems can be designed by a single organisation but be diffused globally, demonstrating impacts over time. This paper argues that in order to design for this (...) broad stakeholder group, engineers must adopt a systems thinking approach that allows them to understand the sociotechnicity of artificial intelligence systems across sociocultural domains. It claims that value sensitive design, and envisioning cards in particular, provides a solid first step towards helping designers harmonise human values, understood across spatiotemporal boundaries, with economic values, rather than the former coming at the opportunity cost of the latter. (shrink)

Healthcare is becoming increasingly automated with the development and deployment of care robots. There are many benefits to care robots but they also pose many challenging ethical issues. This paper takes care robots for the elderly as the subject of analysis, building on previous literature in the domain of the ethics and design of care robots. Using the value sensitive design approach to technology design, this paper extends its application to care robots by integrating the values of care, values that (...) are specific to AI, and higher-scale values such as the United Nations Sustainable Development Goals. The ethical issues specific to care robots for the elderly are discussed at length alongside examples of specific design requirements that work to ameliorate these ethical concerns. (shrink)

Ethical, legal and social implications are widely regarded as important considerations with respect to technological developments. Agile Worth-Oriented Systems Engineering is an innovative approach to incorporating ethically relevant criteria during agile development processes through a flexibly applicable methodology. First, a predefined model for the ethical evaluation of socio-technical systems is used to assess ethical issues according to different dimensions. The second part of AWOSE ensures that ethical issues are not only identified, but also systematically considered during the design of systems (...) based on information and communication technology. For this purpose, the findings from the first step are integrated with approaches from worth-centered development into a process model that, unlike previous approaches to ethical system development, is thoroughly compatible with agile methodologies like Scrum or Extreme Programming. Artifacts of worth-centered development called Worth Maps have been improved to guide the prioritization of development tasks as well as choices among design alternatives with respect to ethical implications. Furthermore, the improved Worth Maps facilitate the identification of suitable criteria for system evaluations in association to ethical concerns and desired positive outcomes of system usage. The potential of the AWOSE methodology has been demonstrated in the context of a technical system that supports elderly and people with particular handicaps. (shrink)

The adverse effects of artificial nighttime lighting, known as light pollution, are emerging as an important environmental issue. To address these effects, current scientific research focuses mainly on identifying what is bad or undesirable about certain types and uses of lighting at night. This paper adopts a value-sensitive approach, focusing instead on what is good about darkness at night. In doing so, it offers a first comprehensive analysis of the environmental value of darkness at night from within applied ethics. A (...) design for values orientation is utilized to conceptualize, define, and categorize the ways in which value is derived from darkness. Nine values are identified and categorized via their type of good, temporal outlook, and spatial characteristics. Furthermore, these nine values are translated into prima facie moral obligations that should be incorporated into future design choices, policy-making, and innovations to nighttime lighting. Thus, the value of darkness is analyzed with the practical goal of informing future decision-making about urban nighttime lighting. (shrink)

Contemporary design practices, such as participatory design, human-centered design, and codesign, have inherent ethical qualities, which often remain implicit and unexamined. Three design projects in the high-tech industry were studied using three ethical traditions as lenses. Virtue ethics helped to understand cooperation, curiosity, creativity, and empowerment as virtues that people in PD need to cultivate, so that they can engage, for example, in mutual learning and collaborative prototyping. Ethics of alterity helped to understand human-centered design as a fragile encounter between (...) project team members and prospective users, and foregrounds the ethics in these encounters: our tendencies to “grasp the other” and to “program invention.” And pragmatist ethics helped to understand codesign as a process of joint inquiry and imagination, involving the organization of iterative processes of problem setting and solution finding, with moral qualities. When we open the “black boxes” of design practices, we find them filled with ethics. Moreover, it is proposed that design practitioners need to make explicit their practices’ inherent ethical qualities and that they can do that by embracing reflexivity. (shrink)

Applications of artificial intelligence/machine learning in health care are dynamic and rapidly growing. One strategy for anticipating and addressing ethical challenges related to AI/ml for health care is patient and public involvement in the design of those technologies – often referred to as ‘co-design’. Co-design has a diverse intellectual and practical history, however, and has been conceptualized in many different ways. Moreover, AI/ml introduces challenges to co-design that are often underappreciated. Informed by perspectives from critical data studies and critical digital (...) health studies, we review the research literature on involvement in health care, and involvement in design, and examine the extent to which co-design as commonly conceptualized is capable of addressing the range of normative issues raised by AI/ml for health care. We suggest that AI/ml technologies have amplified and modified existing challenges related to patient and public involvement, and created entirely new challenges. We outline three pitfalls associated with co-design for ethical AI/ml for health care and conclude with suggestions for addressing these practical and conceptual challenges. (shrink)

The paper has two goals. The first is presenting the main results of the recent report Ethics of Connected and Automated Vehicles: recommendations on road safety, privacy, fairness, explainability and responsibility written by the Horizon 2020 European Commission Expert Group to advise on specific ethical issues raised by driverless mobility, of which the author of this paper has been member and rapporteur. The second is presenting some broader ethical and philosophical implications of these recommendations, and using these to contribute to (...) the establishment of Ethics of Transportation as an independent branch of applied ethics. The recent debate on the ethics of Connected and Automated Vehicles presents a paradox and an opportunity. The paradox is the presence of a flourishing debate on the ethics of one very specific transportation technology without ethics of transportation being in itself a well-established academic discipline. The opportunity is that now that a spotlight has been switched on the ethical dimensions of CAVs it may be easier to establish a broader debate on ethics of transportation. While the 20 recommendations of the EU report are grouped in three macro-areas: road safety, data ethics, and responsibility, in this paper they will be grouped according to eight philosophical themes: Responsible Innovation, road justice, road safety, freedom, human control, privacy, data fairness, responsibility. These are proposed as the first topics for a new ethics of transportation. (shrink)

Living labs represent an important step in the development of research solutions based on the inclusive design paradigm. To ensure participants' rights and the adoption of an ethical approach to technological research, this paper presents some tools and strategies that comply with the needs and rights of those less advantaged groups to ensure that their rights and demands are taken into account. There is a gap in the construction and development of norms for a living lab. This article summarizes the (...) efforts made to achieve the goals of ethical awareness, enumerates the issues related to the ethical problems that may arise during participatory design and living labs environments, describes working routines, and outlines recommendations for achieving this objective. This paper attempts to focus on those aspects of research development that directly or indirectly come into contact with issues of ethics, privacy, and security related to participants in the context of any research conducted using a living lab approach. It also includes thoughts about the importance of information and communication technologies on the public domain and their implications for privacy. The importance of ethical awareness is even more evident in the case of enterprises where elderly and disabled users are present. For that reason, there are several legal tools that can be applied in a living lab setting, tools that are pertinent even though they may not have been conceived specifically to regulate this environment, may be used in a precarious way and might be temporary as well, just to proceed with the setting up of the living lab. However, the specificity and idiosyncrasy of this research environment demands further efforts to establish procedures that will facilitate both the proper set-up and smooth running of the living lab. (shrink)

Developers and designers make all sorts of moral decisions throughout an innovation project. In this article, we describe how teams of developers and designers engaged with ethics in the early phases of innovation based on case studies in the SUBCOP project. For that purpose, Value Sensitive Design will be used as a reference. Specifically, we focus on the following two research questions: How can researchers/developers learn about users’ perspectives and values during the innovation process? and How can researchers/developers take into (...) account these values, and related design criteria, in their decision-making during the innovation process? Based on a case study of several innovation processes in this project, we conclude the researchers/developers involved are able to do something similar to VSD, supported by relatively simple exercises in the project, e.g., meetings with potential end-users and discussions with members of the Ethical Advisory Board of the project. Furthermore, we also found—possibly somewhat counterintuitively—that a commercial, with its focus on understanding and satisfying customers’ needs, can promote VSD. (shrink)

In this article, we discuss the importance of emotions for ethical reflection on technological developments, as well as the role that art can play in this. We review literature that argues that emotions can and should play an important role in the assessment and acceptance of technological risk and in designing morally responsible technologies. We then investigate how technologically engagedartcan contribute to critical, emotional-moral reflection on technological risks. The role of art that engages with technology is unexplored territory and gives (...) rise to many fascinating philosophical questions that have not yet been sufficiently addressed in the literature. (shrink)

This paper provides a systematic literature review, analysis and discussion of methods that are proposed to practise ethics in research and innovation. Ethical considerations concerning the impacts of R&I are increasingly important, due to the quickening pace of technological innovation and the ubiquitous use of the outcomes of R&I processes in society. For this reason, several methods for practising ethics have been developed in different fields of R&I. The paper first of all presents a systematic search of academic sources that (...) present and discuss such methods. Secondly, it provides a categorisation of these methods according to three main kinds: ex ante methods, dealing with emerging technologies, intra methods, dealing with technology design, and ex post methods, dealing with ethical analysis of existing technologies. Thirdly, it discusses the methods by considering problems in the way they deal with the uncertainty of technological change, ethical technology design, the identification, analysis and resolving of ethical impacts of technologies and stakeholder participation. The results and discussion of our literature review are valuable for gaining an overview of the state of the art and serve as an outline of a future research agenda of methods for practising ethics in R&I. (shrink)

PurposeThe purpose of this paper is to develop a critique of value sensitive design (VSD) and to propose an alternative approach that does not depart from a heuristic of value(s), but from virtue ethics, called virtuous practice design (VPD).Design/methodology/approachThis paper develops a philosophical argument, draws from a philosophical method (i.e. virtue ethics) and applies this method to a particular case study that draws from a narrative interview.FindingsIn this paper, authors show how an approach that takes virtue instead of value as (...) the central notion for aiming at a design that is sensitive to ethical concerns can be fruitful both in theory and in practice.Originality/valueThis paper presents the first attempt to ground an approach aimed at ethical technology design on the tradition of virtue ethics. As such, it presents VPD as a potentially fruitful alternative to VSD. (shrink)

Stakeholder involvement in design is desirable from both a practical and an ethical point of view. It is difficult to do well, however, and some problems recur again and again, both of a practical nature, e.g. stakeholders acting strategically rather than openly, and of an ethical nature, e.g. power imbalances unduly affecting the outcome of the process. Hidden Design has been proposed as a method to deal with the practical problems of stakeholder involvement. It aims to do so by taking (...) the observation of stakeholder actions, rather than the outcomes of a deliberative process, as its input. Furthermore, it hides from stakeholders the fact that a design process is taking place so that they will not behave differently than they otherwise would. Both aspects of Hidden Design have raised ethical worries. In this paper I make an ethical analysis of what it means for a design process to leave participants uninformed or deceived rather than acquiring their informed consent beforehand, and to use observation of actions rather than deliberation as input for design, using Hidden Design as a case study. This analysis is based on two sets of normative guidelines: the ethical guidelines for psychological research involving deception or uninformed participants from two professional psychological organisations, and Habermasian norms for a fair and just process. It supports the conclusion that stakeholder involvement in design organised in this way can be ethically acceptable, though under a number of conditions and constraints. (shrink)

Knowing that technologies are inherently value-laden and systemically interwoven with society, the question is how individual engineers can take up the challenge of accepting the responsibility for their work? This paper will argue that engineers have no institutional structure at the level of society that allows them to recognize, reflect upon, and actively integrate the value-laden character of their designs. Instead, engineers have to tap on the different institutional realms of market, science, and state, making their work a ‘hybrid’ activity (...) combining elements from the different institutional realms. To deal with this institutional hybridity, engineers develop routines and heuristics in their professional network, which do not allow societal values to be expressed in a satisfactory manner. To allow forms of ‘active’ responsibility, there have to be so-called ‘accountability forums’ that guide moral reflections of individual actors. The paper will subsequently look at the methodologies of value-sensitive design and constructive technology assessment and explore whether and how these methodologies allow engineers to integrate societal values into the design technological artifacts and systems. As VSD and CTA are methodologies that look at the process of technological design, whereas the focus of this paper is on the designer, they can only be used indirectly, namely as frameworks which help to identify the contours of a framework for active responsibility of engineers. (shrink)

Community acceptance still remains a challenge for wind energy projects. The most popular explanation for local opposition, the Not in My Backyard effect, has received fierce criticism in the past decade. Critics argue that opposition is not merely a matter of selfishness or ignorance, but that moral, ecological and aesthetic values play an important role. In order to better take such values into account, a more bottom-up, participatory decision process is usually proposed. Research on this topic focusses on either stakeholder (...) motivations/attitudes, or their behavior during project implementation. This paper proposes a third research focus, namely the ‘objects’ which elicit certain behavioral responses and attitudes—the wind turbine and parks. More concretely, this paper explores Value Sensitive Design as way to arrive at wind turbines and parks that better embed or reflect key values. After a critical discussion of the notion of acceptance versus acceptability and support, the paper discusses existing literature on ecology and aesthetics in relation to wind turbine/park design, which could serve as ‘building blocks’ of a more integral VSD approach of the topic. It also discusses the challenge of demarcating wind park projects as VSD projects. A further challenge is that VSD has been applied mainly at the level of technical artifacts, whereas wind parks can best be conceptualized as socio-technical system. This new application would therefore expand the current practice of VSD, and may as a consequence also lead to interesting new insights for the VSD community. The paper concludes that such an outcome-oriented approach of wind turbines and park is worth exploring further, as a supplement to rather than a replacement of the process-oriented approach that is promoted by the current literature on community acceptance of wind parks. (shrink)

The majority of studies on absorptive capacity (AC) underscore the importance of absorbing technological knowledge from other firms to create economic value. However, to preserve moral legitimacy and create social value, firms must also discern and adapt to (shifts in) societal values. A comparative case study of eight firms in the food industry reveals how organizations prioritize and operationalize the societal value health in product innovation while navigating inter- and intravalue conflicts. The value-sensitive framework induced in this article extends AC (...) by explaining how technically savvy, economic value–creating firms diverge in their receptivity, articulation, and reflexivity of societal values. (shrink)

There is growing need for hybrid curricula that integrate constructivist methods from Science and Technology Studies (STS) into both engineering and policy courses at the undergraduate and graduate levels. However, institutional and disciplinary barriers have made implementing such curricula difficult at many institutions. While several programs have recently been launched that mix technical training with consideration of “societal” or “ethical issues,” these programs often lack a constructivist element, leaving newly-minted practitioners entering practical fields ill-equipped to unpack the politics of knowledge (...) and technology or engage with skeptical publics. This paper presents a novel format for designing interdisciplinary coursework that combines conceptual content from STS with training in engineering and policy. Courses following this format would ideally be team taught by instructors with advanced training in diverse fields, and hence co-learning between instructors and disciplines is a key element of the format. Several instruments for facilitating both student and instructor collaborative learning are introduced. The format is also designed for versatility: in addition to being adaptable to both technical and policy training environments, topics are modularized around a conceptual core so that issues ranging from biotech to nuclear security can be incorporated to fit programmatic needs and resources. (shrink)

The very existence of explicit techno-scientific controversies in the “nano” arena is often denied on behalf of a conception of science, risks, public engagement and responsibility which borders on a disembodied idealism and merits at least serious discussion. The recurrence of this view prompted us to clarify our position regarding our common field of research, in order to avoid being trapped in the seemingly clear divide between the universal and neutral pursuit of pure science, on the one hand, and on (...) the other hand the infinite variety of values and opinions that lead to the horrors throes of pure relativism. We therefore launched an internal trans-disciplinary project, in order to overhaul the premises underpinning both this idealistic standpoint and our own work, and to find a better definition of our approach to the exploration of the real policy implications of NST research initiatives. Indeed, the debates surrounding NST clearly have wider implications for the examination of issues of Science, Technology and Society as a whole. A first step in this clarification process was taken in Paris, at the conference which has now been published in this issue of Foundations of Chemistry. We further develop it in this paper, in the hope that it will contribute to the joint construction of a better nano-future. (shrink)

Recent developments in theories for responsible innovation have focused on the importance of actively accounting for values in our technological designs. Leading among these theories is that of Value Sensitive Design which attempts to guide the design process on the basis of evaluative analysis. However, values often come into conflict and VSD has been criticized for not providing a proper method to resolve such inevitable conflicts. This paper examines three such methods and argues that although each has its merits, they (...) all fail to account for a common source of value conflicts known as value incommensurability. Drawing on literature from the field of axiology, this paper argues that by incorporating the evaluative relation of ‘parity’ each of these three methods, and the VSD framework in general, will be able to properly understand the relation which holds between conflicting design options stemming from the incommensurable of values and be able to guide designers in making rational decision in the face of such conflicts. (shrink)

Currently, value sensitive design (VSD) does not commit to a particular ethical theory. Critiques contend that without such an explicit commitment, VSD lacks a methodology for distinguishing genuine moral values from mere stakeholders-preferences and runs the risk of attending to a set of values that is unprincipled or unbounded. We argue that VSD practitioners need to complement it with an ethical theory. We argue in favour of a mid-level ethical theory to fulfil this role.

This article presents the framework Capability Sensitive Design (CSD), which consists of merging the design methodology Value Sensitive Design (VSD) with Martha Nussbaum's capability theory. CSD aims to normatively assess technology design in general, and technology design for health and wellbeing in particular. Unique to CSD is its ability to account for human diversity and to counter (structural) injustices that manifest in technology design. The basic framework of CSD is demonstrated by applying it to the hypothetical design case of a (...) therapy chatbot for mental health. By applying CSD to a design case, the merits of this new framework over the standard VSD approach become apparent. Also, the application demonstrates what a technology design would look like when attention is paid to capabilities right from the start of the design process. (shrink)

In the applied sciences and in engineering there is often a significant overlap between work at universities and in industry. For the individual scholar, this may lead to serious conflicts when working on joint university–industry projects. Differences in goals, such as the university’s aim to disseminate knowledge while industry aims to appropriate knowledge, might lead to complicated situations and conflicts of interest. The detailed cases of two electrical engineers and two architects working at two different universities of technology illustrate the (...) kinds of problems individual scholars face in university–business collaborations. These cases are based on qualitative interviews and additional data and demonstrate that, while value conflicts emerge on the organizational level, it is primarily the individual researcher who must deal with such conflicts. This analysis adds to existing studies in two ways: first, it explicitly addresses normative issues framed in terms of ethical and social values, thereby going beyond the common social-science perspective of university–business collaboration. Secondly, it provides qualitative insights, thereby identifying details and issues not apparent in quantitative studies. In particular, it is evident that university–industry collaborations are prone to value conflicts not only in research but also in education and job training. (shrink)

In the applied sciences and in engineering there is often a significant overlap between work at universities and in industry. For the individual scholar, this may lead to serious conflicts when working on joint university–industry projects. Differences in goals, such as the university’s aim to disseminate knowledge while industry aims to appropriate knowledge, might lead to complicated situations and conflicts of interest. The detailed cases of two electrical engineers and two architects working at two different universities of technology illustrate the (...) kinds of problems individual scholars face in university–business collaborations. These cases are based on qualitative interviews and additional data and demonstrate that, while value conflicts emerge on the organizational level, it is primarily the individual researcher who must deal with such conflicts. This analysis adds to existing studies in two ways: first, it explicitly addresses normative issues framed in terms of ethical and social values, thereby going beyond the common social-science perspective of university–business collaboration. Secondly, it provides qualitative insights, thereby identifying details and issues not apparent in quantitative studies. In particular, it is evident that university–industry collaborations are prone to value conflicts not only in research but also in education and job training. (shrink)

The public’s trust in the technology sector is waning and, in response, technology companies and state governments have started to champion “tech ethics”. That is, they have pledged to design, develop, distribute, and employ new technologies in an ethical manner. In this paper, I observe that tech ethics is already subject to a widespread pathology in that technology companies, the primary executors of tech ethics, are incentivized to pursue it half-heartedly or even disingenuously. Next, I highlight two emerging strategies which (...) might be used to combat this problem, but argue that both are subject to practical limitations. In response, I suggest an additional way of augmenting the practice of tech ethics. This is to employ “trust audits,” a new form of public participation in the socio-technical environment. In the remainder of the paper, I offer a description of how trust audits work, what they might look like in practice, and how they can fit in alongside those other strategies for improving tech ethics. (shrink)

This article presents a systematic literature review documenting how technical investigations have been adapted in value sensitive design (VSD) studies from 1996 to 2023. We present a systematic review, including theoretical and applied studies that either discuss or conduct technical investigations in VSD. This systematic review contributes to the VSD community when seeking to further refine the methodological framework for carrying out technical investigations in VSD.

In this article, we report on eight grand challenges for value sensitive design, which were developed at a one-week workshop, Value Sensitive Design: Charting the Next Decade, Lorentz Center, Leiden, The Netherlands, November 14–18, 2016. A grand challenge is a substantial problem, opportunity, or question that motives sustained research and design activity. The eight grand challenges are: Accounting for Power, Evaluating Value Sensitive Design, Framing and Prioritizing Values, Professional and Industry Appropriation, Tech policy, Values and Human Emotions, Value Sensitive Design (...) and Intelligent Algorithms, and Value Tensions. Each grand challenge consists of a discussion of its importance and a set of tractable key questions. (shrink)

This article introduces Designing for Care (D4C), a distinctive approach to project management and technological design informed by Care Ethics. We propose to conceptualize “care” as both the foundational value of D4C and as its guiding mid-level principle. As a value, care provides moral grounding. As a principle, it equips D4C with moral guidance to enact a caring process. The latter is made of a set of concrete, and often recursive, caring practices. One of the key assumption of D4C is (...) a relational ontology of individual and group identities, which fosters the actualization of caring practices as essentially relational and (often) reciprocal. Moreover, D4C adopts the “ecological turn” in CE and stresses the ecological situatedness and impact of concrete projects, envisioning an extension of caring from intra-species to inter-species relations. We argue that care and caring can influence directly some of the phases and practices within the management of (energy) projects and the design of sociotechnical (energy) artefacts and systems. When issues related to “value change” emerge as problematic (e.g., values trade-offs, conflicts), the mid-level guiding principle of care helps evaluate and prioritize different values at stake within specific projects. Although there may be several actors and stakeholders involved in project management and technological design, here we will focus on the professionals in charge of imagining, designing, and carrying out these processes (i.e., project managers, designers, engineers). We suggest that adopting D4C would improve their ability to capture and assess stakeholders’ values, critically reflect on and evaluate their own values, and judge which values prioritize. Although D4C may be adaptable to different fields and design contexts, we recommend its use especially within small and medium-scale (energy) projects. To show the benefits of adopting it, we envisage the application of D4C within the project management and the technological design of a community battery. The adoption of D4C can have multiple positive effects: transforming the mentality and practice of managing a project and designing technologies; enhancing caring relationships between managers, designers, and users as well as among users; achieving better communication, more inclusive participation, and more just decision-making. This is an initial attempt to articulate the structure and the procedural character of D4C. The application of D4C in a concrete project is needed to assess its actual impact, benefits, and limitations. (shrink)

Recent years have seen numerous sociological disagreements devolve into heated debates, with scholars openly accusing their peers of being both empirically wrong and morally misguided. While social scientists routinely reflect on the ethical implications of certain research assumptions and data collection methods, the sociology of knowledge production has said little about how moral debates over scholarship shape subsequent research trajectories. Drawing on the new French pragmatic sociology, this article examines how sociologists respond to criticisms of the moral worth of their (...) research. The article outlines three typical responses: (1) accepting the criticism and changing direction completely; (2) accepting the criticism but changing discursive framing to incorporate existing research without being subject to critique; and (3) navigating through the debate by devising new research directions that do not trigger such criticism. To demonstrate, the article looks at how sociologists of religion responded, in their published scholarship, to criticisms of secularization theory as depreciating religious people and spiritual experience. Across the responses, we show that sociologists have included moral considerations in their empirical investigations, and have switched among several diverse moral justifications to address—and also avoid—criticism. We conclude by demonstrating that this model can be extended to other domains of sociological inquiry, including the study of gender-based wage inequality and methodological nationalism. The article highlights the importance of mapping the moral frameworks sociologists use for the sociology of knowledge and the sociology of morality. (shrink)

The introduction of new energy technologies may lead to public resistance and contestation. It is often argued that this phenomenon is caused by an inadequate inclusion of relevant public values in the design of technology. In this paper we examine the applicability of the value sensitive design approach. While VSD was primarily introduced for incorporating values in technological design, our focus in this paper is expanded towards the design of the institutions surrounding these technologies, as well as the design of (...) stakeholder participation. One important methodological challenge of VSD is to identify the relevant values related to new technological developments. In this paper, we argue that the public debate can form a rich source from which to retrieve the values at stake. To demonstrate this, we have examined the arguments used in the public debate regarding the exploration and exploitation of shale gas in the Netherlands. We identified two important sets of the underlying values, namely substantive and procedural values. This paper concludes with two key findings. Firstly, contrary to what is often suggested in the literature, both proponents and opponents seem to endorse the same values. Secondly, contestation seems to arise in the precise operationalization of these values among the different stakeholders. In other words, contestation in the Dutch shale gas debate does not arise from inter-value conflict but rather from intra-value conflicts. This multi-interpretability should be incorporated in VSD processes. (shrink)

When should we use care robots? In this paper we endorse the shift from a simple normative approach to care robots ethics to a complex one: we think that one main task of a care robot ethics is that of analysing the different ways in which different care robots may affect the different values at stake in different care practices. We start filling a gap in the literature by showing how the philosophical analysis of the nature of healthcare activities can (...) contribute to robot ethics. We rely on the nature-of-activities approach recently proposed in the debate on human enhancement, and we apply it to the ethics of care robots. The nature-of-activities approach will help us to understand why certain practice-oriented activities in healthcare should arguably be left to humans, but certain goal-directed activities in healthcare can be fulfilled with the assistance of a robot. In relation to the latter, we aim to show that even though all healthcare activities can be considered as practice-oriented, when we understand the activity in terms of different legitimate ‘fine-grained’ descriptions, the same activities or at least certain components of them can be seen as clearly goal-directed. Insofar as it allows us to ethically assess specific functionalities of specific robots to be deployed in well-defined circumstances, we hold the nature-of-activities approach to be particularly helpful also from a design perspective, i.e. to realize the Value Sensitive Design approach. (shrink)

Recommender Systems (RecSys) have been around since the early days of the Internet, helping users navigate the vast ocean of information and the increasingly available options that have been available for us ever since. The range of tasks for which one could use a RecSys is expanding as the technical capabilities grow, with the disruption of Machine Learning representing a tipping point in this domain, as in many others. However, the increase of the technical capabilities of AI-powered RecSys did not (...) come with a thorough consideration of their ethical implications and, despite being a well-established technical domain, the potential impacts of RecSys on their users are still under-assessed. This paper aims at filling this gap in regards to one of the main impacts of RecSys: personal autonomy. We first describe how technology can affect human values and a suitable methodology to identify these effects and mitigate potential harms: Value Sensitive Design (VSD). We use VSD to carry out a conceptual investigation of personal autonomy in the context of a generic RecSys and draw on a nuanced account of procedural autonomy to focus on two components: competence and authenticity. We provide the results of our inquiry as a value hierarchy and apply it to the design of a speculative RecSys as an example. (shrink)

Along with potential benefits to healthcare delivery, machine learning healthcare applications raise a number of ethical concerns. Ethical evaluations of ML-HCAs will need to structure th...

Machine learning is fundamental to multiple visions of health care’s future, from precision medicine 2020) to a model of health delivery and research...

Fundamental questions in value sensitive design include whether and how high-tech products/artefacts could embody values and ethical ideals, and how plural and incommensurable values of ethical and social importance could be chosen rationally and objectively at a collective level. By using a humanitarian cargo drone study as a starting point, this paper tackles the challenges that VSD’s lack of commitment to a specific ethical theory generates in practical applications. Besides, it highlights how mainstream ethical approaches usually related to VSD are (...) incapable of solving main ethical dilemmas raised by technological design for well-being in democratic settings. Accordingly, it is argued that VSD’s ethical-democratic import would substantially be enhanced by the espousal of a procedural ethics stance and the deliberative approach to value and welfare entailed by Amartya Sen’s capability approach. Differently from rival ethical–political theories, its normative and meta-ethical foundations better handle human diversity, value-goal pluralism, conflicting vested interests as well as the epistemic-moral disagreements typical of contemporary complex democracies. Particularly, Sen’s capability approach procedural-deliberative tenets result in an “objective-impartial” choice procedure selecting a “hierarchy” of plural incommensurable values and rational goals thus, suitable to validate an applied science such as welfare-oriented technological design in concrete social environments. Conclusions suggest that refining VSD with a capability-based procedural approach to ethics fosters the concern for democracy and social justice while preserving vital scientific-technical standards. Major advantages are at an applied level to delivering ethically and socially justified, but yet highly functional technologies and high-tech products/artefacts. (shrink)

Designing security measures often involves trade-offs between various types of objectives. Multiple stakeholders may have conflicting demands and may have different ideas on how to resolve the resulting design conflicts. This paper reports on an application of value-sensitive design. Based on argumentation theory and social values, the paper develops a structured approach for discussing design conflicts, called value-based argumentation. The application domain examined in the paper is concerned with physical safety and security issues that arise in cross-border shipments. We first (...) identify the kinds of dialogues that take place in this domain, in particular, audit dialogues to determine whether security measures comply with regulations. Based on argumentation theory we develop a formal language and a diagramming approach intended to facilitate parties in identifying, discussing and reaching agreement about security risks and corresponding mitigation measures. Trade-offs can be dealt with by making underlying values explicit. Using a stylized example, the approach was successfully taught to practitioners working with EU customs regulations. Practitioners generally found the approach helpful, in particular to bring out implicit underlying motivations. We conclude by discussing how our approach can be generalized to other kinds of dialogues involving design conflicts. (shrink)

Developing technology that accounts for values has been achieved in many areas, including security, gaming, finance, engineering, and many more. The main methodological approach has been that of value sensitive design. But most of the work to date has been on the first of its three stages. The focus of this article is on advances related to its second stage, empirical investigation, and in particular the impact of contextual understanding in that stage. Although lessons can be learnt from other domains, (...) the specific context of dementia means that there are nuances to understanding values, including justice and autonomy, that differ from other areas. The integration of value considerations in the development of assistive technology in dementia is explored in two broad categories: the traditional and ongoing need for fixed decision support, and adaptable decision support technologies. For fixed decision support the A&D Benchmark is particularly useful in design. But for adaptable technologies, that benchmark requires further development, including consideration of the values of additional stakeholders, such as the general public. (shrink)

Critics currently argue that applied ethics approaches to artificial intelligence (AI) are too principles-oriented and entail a theory–practice gap. Several applied ethical approaches try to prevent such a gap by conceptually translating ethical theory into practice. In this article, we explore how the currently most prominent approaches of AI ethics translate ethics into practice. Therefore, we examine three approaches to applied AI ethics: the embedded ethics approach, the ethically aligned approach, and the Value Sensitive Design (VSD) approach. We analyze each (...) of these three approaches by asking how they understand and conceptualize theory and practice. We outline the conceptual strengths as well as their shortcomings: an embedded ethics approach is context-oriented but risks being biased by it; ethically aligned approaches are principles-oriented but lack justification theories to deal with trade-offs between competing principles; and the interdisciplinary Value Sensitive Design approach is based on stakeholder values but needs linkage to political, legal, or social governance aspects. Against this background, we develop a meta-framework for applied AI ethics conceptions with three dimensions. Based on critical theory, we suggest these dimensions as starting points to critically reflect on the conceptualization of theory and practice. We claim, first, that the inclusion of the dimension of affects and emotions in the ethical decision-making process stimulates reflections on vulnerabilities, experiences of disregard, and marginalization already within the AI development process. Second, we derive from our analysis that considering the dimension of justifying normative background theories provides both standards and criteria as well as guidance for prioritizing or evaluating competing principles in cases of conflict. Third, we argue that reflecting the governance dimension in ethical decision-making is an important factor to reveal power structures as well as to realize ethical AI and its application because this dimension seeks to combine social, legal, technical, and political concerns. This meta-framework can thus serve as a reflective tool for understanding, mapping, and assessing the theory–practice conceptualizations within AI ethics approaches to address and overcome their blind spots. (shrink)

In this paper, we propose a methodology to maximize the benefits of interdisciplinary cooperation in AI research groups. Firstly, we build the case for the importance of interdisciplinarity in research groups as the best means to tackle the social implications brought about by AI systems, against the backdrop of the EU Commission proposal for an Artificial Intelligence Act. As we are an interdisciplinary group, we address the multi-faceted implications of the mass-scale diffusion of AI-driven technologies. The result of our exercise (...) lead us to postulate the necessity of a behavioural theory that standardizes the interaction process of interdisciplinary groups. In light of this, we conduct a review of the existing approaches to interdisciplinary research on AI appliances, leading to the development of methodologies like ethics-by-design and value-sensitive design, evaluating their strengths and weaknesses. We then put forth an iterative process theory hinging on a narrative approach consisting of four phases: definition of the hypothesis space, building-up of a common lexicon, scenario-building, interdisciplinary self-assessment. Finally, we identify the most relevant fields of application for such a methodology and discuss possible case studies. (shrink)