Experimental design is one aspect of a scientific method. A well-designed, properly conducted experiment aims to control variables in order to isolate and manipulate causal effects and thereby maximize internal validity, support causal inferences, and guarantee reliable results. Traditionally employed in the natural sciences, experimental design has become an important part of research in the social and behavioral sciences. Experimental methods are also endorsed as the most reliable guides to policy effectiveness. Through a discussion of some of the (...) central concepts associated with experimental design, including controlled variation and randomization, this chapter will provide a summary of key ethical issues that tend to arise in experimental contexts. In addition, by exploring assumptions about the nature of causation and by analyzing features of causal relationships, systems, and inferences in social contexts, this chapter will summarize the ways in which experimental design can undermine the integrity of not only social and behavioral research but policies implemented on the basis of such research. (shrink)

The sustainability movement, currently gathering considerable attention from architects, derives much of its moral foundation from the theoretical initiatives of environmental ethics. How is the value of sustainability to mesh with architecture’s time-tested values? The idea that an ethic of sustainability might serve architects’ efforts to reground their practices in something that opposes consumer values of the marketplace has intuitive appeal and makes a certain amount of sense. However, it is far from obvious that the sustainability movement provides a (...) strong enough conceptual framework for an entire designphilosophy. This issue is complicated by two different sustainable design outlooks which parallel two conceptions of environmental ethics: the practical and the radical. Neverthleless, sustainability need not resort to the philosophical excess of its radical branch to help foster a new public-spiritedness. (shrink)

The conjunction of wireless computing, ubiquitous Internet access, and the miniaturisation of sensors have opened the door for technological applications that can monitor health and well-being outside of formal healthcare systems. The health-related Internet of Things (H-IoT) increasingly plays a key role in health management by providing real-time tele-monitoring of patients, testing of treatments, actuation of medical devices, and fitness and well-being monitoring. Given its numerous applications and proposed benefits, adoption by medical and social care institutions and consumers may be (...) rapid. However, a host of ethical concerns are also raised that must be addressed. The inherent sensitivity of health-related data being generated and latent risks of Internet-enabled devices pose serious challenges. Users, already in a vulnerable position as patients, face a seemingly impossible task to retain control over their data due to the scale, scope and complexity of systems that create, aggregate, and analyse personal health data. In response, the H-IoT must be designed to be technologically robust and scientifically reliable, while also remaining ethically responsible, trustworthy, and respectful of user rights and interests. To assist developers of the H-IoT, this paper describes nine principles and nine guidelines for ethical design of H-IoT devices and data protocols. (shrink)

Design for Values (DfV) philosophies are a series of design approaches that aim to incorporate human values into the early phases of technological design to direct innovation into beneficial outcomes. The difficulty and necessity of directing advantageous futures for transformative technologies through the application and adoption of value-based design approaches are apparent. However, questions of whose values to design are of critical importance. DfV philosophies typically aim to enrol the stakeholders who may be affected by (...) the emergence of such a technology. However, regardless of which design approach is adopted, all enrolled stakeholders are human ones who propose human values. Contemporary scholarship on metahumanisms, particularly those on posthumanism, have decentred the human from its traditionally privileged position among other forms of life. Arguments that the humanist position is not (and has never been) tenable are persuasive. As such, scholarship has begun to provide a more encompassing ontology for the investigation of nonhuman values. Given the potentially transformative nature of future technologies as relates to the earth and its many assemblages, it is clear that the value investigations of these design approaches fail to account for all relevant stakeholders (i.e., nonhuman animals). This paper has two primary objectives: (1) to argue for the cogency of a posthuman ethics in the design of technologies; and (2) to describe how existing DfV approaches can begin to envision principled and methodological ways of incorporating non-human values into design. To do this, the paper provides a rudimentary outline of what constitutes DfV approaches. It then takes up a unique design approach called Value Sensitive Design (VSD) as an illustrative example. Out of all the other DfV frameworks, VSD most clearly illustrates a principled approach to the integration of values in design. (shrink)

Toleration is one of the fundamental principles that inform the design of a democratic and liberal society. Unfortunately, its adoption seems inconsistent with the adoption of paternalistically benevolent policies, which represent a valuable mechanism to improve individuals’ well-being. In this paper, I refer to this tension as the dilemma of toleration. The dilemma is not new. It arises when an agent A would like to be tolerant and respectful towards another agent B’s choices but, at the same time, A (...) is altruistically concerned that a particular course of action would harm, or at least not improve, B’s well-being, so A would also like to be helpful and seeks to ensure that B does not pursue such course of action, for B’s sake and even against B’s consent. In the article, I clarify the specific nature of the dilemma and show that several forms of paternalism, including those based on ethics by design and structural nudging, may not be suitable to resolve it. I then argue that one form of paternalism, based on pro-ethical design, can be compatible with toleration and hence with the respect for B’s choices, by operating only at the informational and not at the structural level of a choice architecture. This provides a successful resolution of the dilemma, showing that tolerant paternalism is not an oxymoron but a viable approach to the design of a democratic and liberal society. (shrink)

This research project aims to accomplish two primary objectives: (1) propose an argument that a posthuman ethics in the design of technologies is sound and thus warranted and, (2) how can existent SBD approaches begin to envision principled and methodological ways of incorporating nonhuman values into design. In order to do this this MRP will provide a rudimentary outline of what constitutes SBD approaches. A particular design approach - Value Sensitive Design (VSD) - is taken (...) up as an illustrative example given that it, among the other SBD frameworks, most clearly illustrates a principled approach to the integration of values in design. -/- This explication will be followed by the strongest arguments for a posthumanist ethic, primarily drawing from the works of the Italian philosophers Leonardo Caffo and Roberto Marchesini and Francesa Ferrando. In doing so I will show how the human imperative to account for nonhuman values is a duty and as such must be continually ready-to-hand when making value-critical decision. (shrink)

Designing in Ethics provides a compilation of well-curated essays that tackle the ethical issues that surround technological design and argue that ethics must form a constitutive part of the designing process and a foundation in our institutions and practices. The appropriation of a design approach to applied ethics is argued as a means by which ethical issues that implicate technological artifact may be achieved.

Technologies cannot simply be understood as neutral tools or instruments; they embody the values of their creators and may unconsciously reinforce systematic patterns of inequality, discrimination, and oppression. -/- Technology Ethics shows how responsible innovation can be achieved. Demonstrating how design and philosophy converge, the book delves into the intricate narratives that shape our understanding of technology – from instrumentalist views to social constructivism. Yet, at its core, it champions interactionalism as the most promising and responsible narrative. Through (...) compelling examples and actionable tools, this book unravels the nuances of these philosophical positions tailored to foster responsible innovation and thoughtful design. As our everyday lives further intertwine with technology, understanding and implementing these design principles becomes not just beneficial, but essential. -/- This concise and accessible introduction is essential reading for students and scholars of philosophy of technology, engineering ethics, science and technology studies, human-machine communication, as well as policymakers. (shrink)

Manufacturing and industry practices are undergoing an unprecedented revolution as a consequence of the convergence of emerging technologies such as artificial intelligence, robotics, cloud computing, virtual and augmented reality, among others. This fourth industrial revolution is similarly changing the practices and capabilities of operators in their industrial environments. This paper introduces and explores the notion of the Operator 4.0 as well as how this novel way of conceptualizing the human operator necessarily implicates human values in the technologies that constitute it. (...) The design approach known as value sensitive design (VSD) is used to explore how these Operator 4.0 technologies can be designed for human values. Expert elicitation surveys were used to determine the values of industry stakeholders and examples of how the VSD methodology can be adopted by engineers in order to design for these values is illustrated. The results provide preliminary adoption strategies that industrial teams can take to Operator 4.0 technology for human values. (shrink)

Purpose This paper discusses ethical principles that are implicit in second-order cybernetics, with the aim of arriving at a better understanding of how second-order cybernetics frames living in a world with others. It further investigates implications for second-order cybernetics approaches to architectural design, i.e. the activity of designing frameworks for living. -/- Design/methodology/approach The paper investigates the terminology in the second-order cybernetics literature with specific attention to terms that suggest that there are ethical principles at work. It further (...) relates second-order cybernetics to selected notions in phenomenology, pragmatism and transcendental idealism. The comparison allows for conclusions about the specificity of a second-order inquiry. In line with the thematic focus of this journal issue on the framing of shared worlds, the paper further elaborates on questions relating to the activity of designing “worlds” in which people live with others. -/- Findings The paper highlights that a radical openness toward the future and toward the agency of others is inscribed in the conception of second-order cybernetics. It creates a frame of reference for conceiving social systems of all kinds, including environments that are designed to be inhabited. -/- Originality/value The paper identifies an aesthetics grounded in the process of living-with-others as an ethical principle implicit in second-order cybernetics thought. It is an aesthetics that is radically open for the agency of others. Linking aesthetics and ethics, the paper’s contributions will be of specific value for practitioners and theoreticians of design. Considering second-order cybernetics as a practice generally dealing with designing, it also contributes to the wider second-order cybernetics discourse. (shrink)

With the emergence of quantum technologies such as quantum computing, quantum communications, and quantum sensing, new potential has emerged for smart manufacturing and Industry 4.0. These technologies, however, present ethical concerns that must be addressed in order to ensure they are developed and used responsibly. This article outlines some of the ethical challenges that quantum technologies may raise for Industry 4.0 and presents the value sensitive design methodology as a strategy for ethics-by-design of quantum computing in Industry (...) 4.0. This research further investigates the potential ethical difficulties that may come from the use of quantum technologies in Industry 4.0, such as concerns about privacy, security, accountability, and the influence of these technologies on workers and society as a whole. The article argues, based on current literature, that these issues necessitate a proactive and comprehensive approach to ethics-by-design. (shrink)

The value sensitive design (VSD) approach to designing transformative technologies for human values is taken as the object of study in this chapter. VSD has traditionally been conceptualized as another type of technology or instrumentally as a tool. The various parts of VSD’s principled approach would then aim to discern the various policy requirements that any given technological artifact under consideration would implicate. Yet, little to no consideration has been given to how laws, regulations, policies and social norms engage (...) within VSD practices. Similarly, how the interactive nature of the VSD approach can, in turn, influence those directives. This is exacerbated when we consider machine ethics policy that have global consequences outside their development spheres. What constructs and models will position AI designers to engage in policy concerns? How can the design of AI policy be integrated with technical design? How might VSD be used to develop AI policy? How might law, regulations, social norms, and other kinds of policy regarding AI systems be engaged within value sensitive design? This chapter takes the VSD as its starting point and aims to determine how laws, regulations and policies come to influence how value trade-offs can be managed within VSD practices. It shows that the iterative and interactional nature of VSD both permits and encourages existing policies to be integrated both early on and throughout the design process. The chapter concludes with some potential future research programs. (shrink)

This paper explores how participation and sustainability are being addressed by architects within the Building Schools for the Future (BSF) programme in the UK. The intentions promoted by the programme are certainly ambitious, but the ways to fulfil these aims are ill-explored. Simply focu- sing on providing innovative learning technologies, or indeed teaching young people about phy- sical sustainability features in buildings, will not necessarily teach them the skills they will need to respond to the environmental and social challenges of (...) a rapidly changing world. However, anticipating those skills is one of the most problematic issues of the programme. The involve- ment of young people in the design of schools is used to suggest empowerment, place-making and to promote social cohesion but this is set against government design literature which advo- cates for exemplars, standard layouts and best practice, all leading to forms of standardisation. The potentials for tokenistic student involvement and conflict with policy aims are evident. This paper explores two issues: how to foster in young people an ethic towards future generations, and the role of co-design practices in this process. Michael Oakeshott calls teaching the conver- sation of mankind. In this paper, I look at the philosophy of Hannah Arendt, Emmanuel Levinas, Maurice Merleau-Ponty and Luce Irigaray to argue that investigating the ethical dilemmas of the programme through critical dialogue with students offers an approach to meeting government objectives, building sustainable schools, and fostering sustainable citizenship. (shrink)

One recent priority of the U.S. government is developing autonomous robotic systems. The U.S. Army has funded research to design a metric of evil to support military commanders with ethical decision-making and, in the future, allow robotic military systems to make autonomous ethical judgments. We use this particular project as a case study for efforts that seek to frame morality in quantitative terms. We report preliminary results from this research, describing the assumptions and limitations of a program that assesses (...) the relative evil of two courses of action. We compare this program to other attempts to simulate ethical decision-making, assess possibilities for overcoming the trade-off between input simplification and output reliability, and discuss the responsibilities of users and designers in implementing such programs. We conclude by discussing the implications that this project highlights for the successes and challenges of developing automated mechanisms for ethical decision making. (shrink)

Caregiving robots are often lauded for their potential to assist with geriatric care. While seniors can be wise and mature, possessing valuable life experience, they can also present a variety of ethical challenges, from prevalence of racism and sexism, to troubled relationships, histories of abusive behavior, and aggression, mood swings and impulsive behavior associated with cognitive decline. I draw on Confucian ethics, especially the concept of filial piety, to address these issues. Confucian scholars have developed a rich set of (...) theoretical resources for dealing with beloved but imperfect elders, and navigating the challenges of supporting seniors whose ethical commitments are unreliable. These resources provide a way to reconcile two important but conflicting desiderata: to value and care for seniors, but also to clear-mindedly deal with their moral shortcomings. In particular, they articulate a duty to remonstrate with our elders when they err. Confucian filial piety can helpfully inform robot design and use in geriatric care. They can be used to strengthen and protect emotional connections in important relationships, but should not be used to reinforce patient preferences when doing so damages relationships or their ability to act morally. Rather than conceive of patient wellbeing as in tension with moral behavior, and care as a burden for caregivers, not a source of value and meaning, Confucian accounts of filial piety help identify both new areas of concern and new potential in the development of caregiving technologies, ones which see these goods as complementary. (shrink)

Philosophers have talked to each other about moral issues concerning technology, but few of them have talked about issues of technology and the good life, and even fewer have talked about technology and the good life with the public in the form of recommendation. In effect, recommendations for various technologies are often left to technologists and gurus. Given the potential benefits of informing the public on their impacts on the good life, however, this is a curious state of affairs. In (...) the present paper, I will examine why philosophers are seemingly reluctant to offer recommendations to the public. While there are many reasons for philosophers to refrain from offering recommendations, I shall focus on a specific normative reason. More specifically, it appears that, according to a particular definition, offering recommendations can be viewed as paternalistic, and therefore is prima facie wrong to do so. I will provide an argument to show that the worry about paternalism is unfounded, because a form of paternalism engendered by technology is inevitable. Given the inevitability of paternalism, I note that philosophers should accept the duty to offer recommendations to the public. I will then briefly turn to design ethics, which has reconceptualised the role of philosophers and, in my mind, fitted well with the inevitability of paternalism. Finally, I shall argue that design ethics has to be supplemented by the practice of recommendation if it is to sustain its objective. (shrink)

One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents (IAs). This paper explores how decision matrix algorithms, via the belief-desire-intention model (...) for autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles. (shrink)

Friendship is an important bond in the personal and social growth of an individual and plays a prominent role during youth. Most scales to measure it are aimed at children and adolescents but none measure character friendship, a type of selfless friendship with ethical traits an d Aristotelian roots. Therefore, the aim of the research is to design and validate the youth Character Friendship Scale (CFS) in a sample of 1587 young Spanish people. The final version of the CFS (...) is composed of 35 items distributed over three dimensions: "Selfless love and intimacy" (21), "Trust" (7) and "Respect and forgiveness" (7) with ordinal reliability coefficients of 0.94, 0.79 and 0.7 respectively and good model fits (CFI = 0.986; TLI = 0.986; RMSEA = 0.043; SRMR = 0.054; GFI = 0.997). It is concluded that the CFS is a scale with good psychometric properties for measuring character friendship in young adults. The results obtained from its application will lead to a better understanding of the importance of character friendship for the socioemotional development or happiness of young adults and will enable the development of intervention programmes that enhance aspects of friendship such as trust, respect, forgiveness or mutual knowledge, which can facilitate collaborative relationships and contribute to social cohesion. (shrink)

In the last decades Human-Computer Interaction (HCI) has started to focus attention on “persuasive technologies” having the goal of changing users’ behavior and attitudes according to a predefined direction. In this talk we show how some of the techniques employed in such technologies trigger some well known cognitive biases by adopting a strategy relying on logical fallacies (i.e. forms of reasoning which are logically invalid but psychologically persuasive). In particular, we will show how the mechanisms reducible to logical fallacies are (...) used to design web and mobile interfaces in domains ranging from the e-commerce to the jihadist propaganda. The final part of the talk will be devoted to point out the potential ethical dangers related to the misuse of these techniques in the design of persuasive technologies. (shrink)

Safe-by-Design (SBD) frameworks for the development of emerging technologies have become an ever more popular means by which scholars argue that transformative emerging technologies can safely incorporate human values. One such popular SBD methodology is called Value Sensitive Design (VSD). A central tenet of this design methodology is to investigate stakeholder values and design those values into technologies during early stage research and development (R&D). To accomplish this, the VSD framework mandates that designers consult the philosophical (...) and ethical literature to best determine how to weigh moral trade-offs. However, the VSD framework also concedes the universalism of moral values, particularly the values of freedom, autonomy, equality trust and privacy justice. This paper argues that the VSD methodology, particularly applied to nano-bio-info-cogno (NBIC) technologies, has an insufficient grounding for the determination of moral values. As such, an exploration of the value-investigations of VSD are deconstructed to illustrate both its strengths and weaknesses. This paper also provides possible modalities for the strengthening of the VSD methodology, particularly through the application of moral imagination and how moral imagination exceed the boundaries of moral intuitions in the development of novel technologies. (shrink)

We propose that virtue ethics can be used to address ethical issues central to discussions about sex robots. In particular, we argue virtue ethics is well equipped to focus on the implications of sex robots for human moral character. Our evaluation develops in four steps. First, we present virtue ethics as a suitable framework for the evaluation of human–robot relationships. Second, we show the advantages of our virtue ethical account of sex robots by comparing it to current (...) instrumentalist approaches, showing how the former better captures the reciprocal interaction between robots and their users. Third, we examine how a virtue ethical analysis of intimate human–robot relationships could inspire the design of robots that support the cultivation of virtues. We suggest that a sex robot which is equipped with a consent-module could support the cultivation of compassion when used in supervised, therapeutic scenarios. Fourth, we discuss the ethical implications of our analysis for user autonomy and responsibility. (shrink)

Historically the focus of moral decision-making in games has been narrow, mostly confined to challenges of moral judgement (deciding right and wrong). In this paper, we look to moral psychology to get a broader view of the skills involved in ethical behaviour and how they may be employed in games. Following the Four Component Model of Rest and colleagues, we identify four “lenses” – perspectives for considering moral gameplay in terms of focus, sensitivity, judgement and action – and describe the (...) design problems raised by each. To conclude, we analyse two recent games, The Walking Dead and Papers, Please, and show how the lenses give us insight into important design differences between them. (shrink)

The development of cultured meat has gained urgency through the increasing problems associated with meat, but what it might become is still open in many respects. In existing debates, two main moral profiles can be distinguished. Vegetarians and vegans who embrace cultured meat emphasize how it could contribute to the diminishment of animal suffering and exploitation, while in a more mainstream profile cultured meat helps to keep meat eating sustainable and affordable. In this paper we argue that these profiles do (...) not exhaust the options and that feelings as well as imagination are needed to explore possible future options. On the basis of workshops, we present a third moral profile, “the pig in the backyard”. Here cultured meat is imagined as an element of a hybrid community of humans and animals that would allow for both the consumption of animal protein and meaningful relations with domestic animals. Experience in the workshops and elsewhere also illustrates that thinking about cultured meat inspires new thoughts on “normal” meat. In short, the idea of cultured meat opens up new search space in various ways. We suggest that ethics can take an active part in these searches, by fostering a process that integrates feelings, imagination and rational thought and that expands the range of our moral identities. (shrink)

Objective: There are benefits and risks of giving patients more granular control of their personal health information in electronic health record (EHR) systems. When designing EHR systems and policies, informaticists and system developers must balance these benefits and risks. Ethical considerations should be an explicit part of this balancing. Our objective was to develop a structured ethics framework to accomplish this. -/- Methods: We reviewed existing literature on the ethical and policy issues, developed an ethics framework called a (...) “Points to Consider” (P2C) document, and convened a national expert panel to review and critique the P2C. -/- Results: We developed the P2C to aid informaticists designing an advanced query tool for an electronic health record (EHR) system in Indianapolis. The P2C consists of six questions (“Points”) that frame important ethical issues, apply accepted principles of bioethics and Fair Information Practices, comment on how questions might be answered, and address implications for patient care. -/- Discussion: The P2C is intended to clarify whatis at stake when designers try to accommodate potentially competing ethical commitments and logistical realities. The P2C was developed to guide informaticists who were designing a query tool in an existing EHR that would permit patient granular control. While consideration of ethical issues is coming to the forefront of medical informatics design and development practices, more reflection is needed to facilitate optimal collaboration between designers and ethicists. This report contributes to that discussion. (shrink)

The paper investigates the ethics of information transparency (henceforth transparency). It argues that transparency is not an ethical principle in itself but a pro-ethical condition for enabling or impairing other ethical practices or principles. A new definition of transparency is offered in order to take into account the dynamics of information production and the differences between data and information. It is then argued that the proposed definition provides a better understanding of what sort of information should be disclosed and (...) what sort of information should be used in order to implement and make effective the ethical practices and principles to which an organisation is committed. The concepts of “heterogeneous organisation” and “autonomous computational artefact” are further defined in order to clarify the ethical implications of the technology used in implementing information transparency. It is argued that explicit ethical designs, which describe how ethical principles are embedded into the practice of software design, would represent valuable information that could be disclosed by organisations in order to support their ethical standing. (shrink)

Artificial Social Agents (ASAs), which are AI software driven entities programmed with rules and preferences to act autonomously and socially with humans, are increasingly playing roles in society. As their sophistication grows, humans will share greater amounts of personal information, thoughts, and feelings with ASAs, which has significant ethical implications. We conducted a study to investigate what ethical principles are of relative importance when people engage with ASAs and whether there is a relationship between people’s values and the ethical principles (...) they prioritise. The study uses scenarios, embedded with the five AI4People ethical principles (Beneficence, Non-maleficence, Autonomy, Justice, and Explicability), involving ASAs taking on roles traditionally played by humans to understand whether these roles and behaviours (including dialogues) are seen as acceptable or unacceptable. Results from 268 participants reveal the greatest sensitivity to ASA behaviours that relate to Autonomy, Justice, Explicability, and the privacy of their personal data. Models were created using Schwartz’s Refined Values as a possible indicator of how stakeholders discern and prioritise the different AI4People ethical principles when interacting with ASAs. Our findings raise issues around the ethical acceptability of ASAs for nudging and changing behaviour due to participants’ desire for autonomy and their concerns over deceptive ASA behaviours such as pretending to have memories and emotions. (shrink)

Emerging technologies such as cloud computing, augmented and virtual reality, artificial intelligence and robotics, among others, are transforming the field of manufacturing and industry as a whole in unprecedent ways. This fourth industrial revolution is consequentially changing how operators that have been crucial to industry success go about their practices in industrial environments. This short paper briefly introduces the notion of the Operator 4.0 as well as how this novel way of conceptualizing the human operator necessarily implicates human values in (...) the technologies that constitute it. Similarly, the design methodology known as value sensitive design (VSD) is drawn upon to discuss how these Operator 4.0 technologies can be design for human values and, conversely, how a potential value-sensitive Operator 4.0 can be used to strengthen the VSD methodology in developing novel technologies. (shrink)

Research on the ethics of algorithms has grown substantially over the past decade. Alongside the exponential development and application of machine learning algorithms, new ethical problems and solutions relating to their ubiquitous use in society have been proposed. This article builds on a review of the ethics of algorithms published in 2016, 2016). The goals are to contribute to the debate on the identification and analysis of the ethical implications of algorithms, to provide an updated analysis of epistemic (...) and normative concerns, and to offer actionable guidance for the governance of the design, development and deployment of algorithms. (shrink)

Healthcare is becoming increasingly automated with the development and deployment of care robots. There are many benefits to care robots but they also pose many challenging ethical issues. This paper takes care robots for the elderly as the subject of analysis, building on previous literature in the domain of the ethics and design of care robots. Using the value sensitive design approach to technology design, this paper extends its application to care robots by integrating the values (...) of care, values that are specific to AI, and higher-scale values such as the United Nations Sustainable Development Goals. The ethical issues specific to care robots for the elderly are discussed at length alongside examples of specific design requirements that work to ameliorate these ethical concerns. (shrink)

In information societies, operations, decisions and choices previously left to humans are increasingly delegated to algorithms, which may advise, if not decide, about how data should be interpreted and what actions should be taken as a result. More and more often, algorithms mediate social processes, business transactions, governmental decisions, and how we perceive, understand, and interact among ourselves and with the environment. Gaps between the design and operation of algorithms and our understanding of their ethical implications can have severe (...) consequences affecting individuals as well as groups and whole societies. This paper makes three contributions to clarify the ethical importance of algorithmic mediation. It provides a prescriptive map to organise the debate. It reviews the current discussion of ethical aspects of algorithms. And it assesses the available literature in order to identify areas requiring further work to develop the ethics of algorithms. (shrink)

Value Sensitive Design (VSD) is an established method for integrating values into technical design. It has been applied to different technologies and, more recently, to artificial intelligence (AI). We argue that AI poses a number of challenges specific to VSD that require a somewhat modified VSD approach. Machine learning (ML), in particular, poses two challenges. First, humans may not understand how an AI system learns certain things. This requires paying attention to values such as transparency, explicability, and accountability. (...) Second, ML may lead to AI systems adapting in ways that ‘disembody’ the values embedded in them. To address this, we propose a threefold modified VSD approach: 1) integrating a known set of VSD principles (AI4SG) as design norms from which more specific design requirements can be derived; 2) distinguishing between values that are promoted and respected by the design to ensure outcomes that not only do no harm but also contribute to good; and 3) extending the VSD process to encompass the whole life cycle of an AI technology in order to monitor unintended value consequences and redesign as needed. We illustrate our VSD for AI approach with an example use case of a SARS-CoV-2 contact tracing app. (shrink)

I argue that, contrary to intuition, it would be both possible and permissible to design people - whether artificial or organic - who by their nature desire to do tasks we find unpleasant.

Genetic engineering technologies are a subclass of the biotechnology family, and are concerned with the use of laboratory-based technologies to intervene with a given organism at the genetic level, i.e., the level of its DNA. This class of technologies could feasibly be used to treat diseases and disabilities, create disease-resistant crops, or even be used to enhance humans to make them more resistant to certain environmental conditions. However, both therapeutic and enhancement applications of genetic engineering raise serious ethical concerns. This (...) paper examines various objections to genetic engineering (as applied to humans) which have been raised in the literature, and presents a new way to frame these issues, and to look for solutions. Specifically, this paper frames genetic engineering technologies within the ‘design turn in applied ethics’ lens and thus situates these technologies as covarying with societal forces. The value sensitive design (VSD) approach to technology design is then appropriated as the conceptual framework in which genetic engineering technologies can be considered so that they can be designed for important human values. By doing so, this paper brings further nuance to the scholarship on genetic engineering technologies by discussing the sociotechnicity of genetic engineering systems rather than framing them as value-neutral tools that either support or constrain values based on how they are used. (shrink)

We propose four policies of ethical design of human-grade Artificial Intelligence. Two of our policies are precautionary. Given substantial uncertainty both about ethical theory and about the conditions under which AI would have conscious experiences, we should be cautious in our handling of cases where different moral theories or different theories of consciousness would produce very different ethical recommendations. Two of our policies concern respect and freedom. If we design AI that deserves moral consideration equivalent to that of (...) human beings, that AI should be designed with self-respect and with the freedom to explore values other than those we might impose. We are especially concerned about the temptation to create human-grade AI pre-installed with the desire to cheerfully sacrifice itself for its creators’ benefit. (shrink)

Existing ethical guidelines that aim to guide the development of mental health apps tend to overemphasize the role of Western conceptual frameworks. While such frameworks have proved to be a useful first step in introducing ethics to a previously unregulated industry, the rapid global uptake of mental health apps requires thinking more deeply about the diverse populations these apps seek to serve. One way to do this is to introduce more intercultural ethical perspectives into app design and the (...) guidelines that aim to encourage best practices. In addition to this, existing ethical guidelines can also benefit from the ethical scholarship from the feminist and disability traditions, both of which highlight specific ethical considerations for vulnerable users. Rethinking the ethical responsibilities of mental health app designers through the prisms of feminism, disability studies, and intercultural philosophy leads us to a more global and inclusive set of ethical considerations in app design. This white paper explores what existing guidelines for the regulation of mental health apps are missing. It also explores how these guidelines could be improved for users who inhabit an increasingly diverse and globalized world. (shrink)

Surveillance programs supporting the management of One Health issues such as antibiotic resistance are complex systems in themselves. Designing ethical surveillance systems is thus a complex task (retroactive and iterative), yet one that is also complicated to implement and evaluate (e.g., sharing, collaboration, and governance). The governance of health surveillance requires attention to ethical concerns about data and knowledge (e.g., performance, trust, accountability, and transparency) and empowerment ethics, also referred to as a form of responsible self-governance. Ethics in (...) reflexive governance operates as a systematic critical-thinking procedure that aims to define its value: What are the “right” criteria to justify how to govern “good” actions for a “better” future? The objective is to lay the foundations for a methodological framework in empirical bioethics, the rudiments of which have been applied to a case study to building reflexive governance in One Health. This ongoing critical thinking process involves “mapping, framing, and shaping” the dynamics of interests and perspectives that could jeopardize a “better” future. This paper proposes to hybridize methods to combine insights from collective deliberation and expert evaluation through a reflexive governance functioning as a community-based action-ethics methodology. The intention is to empower individuals and associations in a dialogue with society, which operation is carried out using a case study approach on data sharing systems. We based our reasoning on a feasibility study conducted in Québec, Canada (2018–2021), envisioning an antibiotic use surveillance program in animal health for 2023. Using the adaptive cycle and governance techniques and perspectives, we synthesize an alternative governance model rooted in the value of empowerment. The framework, depicted as a new “research and design (R&D)” practice, is linking operation and innovation by bridging the gap between Reflexive, Evaluative, and Deliberative reasonings and by intellectualizing the management of democratizing critical thinking locally (collective ethics) by recognizing its context (social ethics). Drawing on the literature in One Health and sustainable development studies, this article describes how a communitarian and pragmatic approach can broaden the vision of feasibility studies to ease collaboration through public-private-academic partnerships. The result is a process that “reassembles” the One Health paradigm under the perspective of global bioethics to create bridges between the person and the ecosystem through pragmatic ethics. (shrink)

This chapter proposed a novel design methodology called Value-Sensitive Design and its potential application to the field of artificial intelligence research and design. It discusses the imperatives in adopting a design philosophy that embeds values into the design of artificial agents at the early stages of AI development. Because of the high risk stakes in the unmitigated design of artificial agents, this chapter proposes that even though VSD may turn out to be a less-than-optimal (...) design methodology, it currently provides a framework that has the potential to embed stakeholder values and incorporate current design methods. The reader should begin to take away the importance of a proactive design approach to intelligent agents. (shrink)

The idea of artificial intelligence for social good is gaining traction within information societies in general and the AI community in particular. It has the potential to tackle social problems through the development of AI-based solutions. Yet, to date, there is only limited understanding of what makes AI socially good in theory, what counts as AI4SG in practice, and how to reproduce its initial successes in terms of policies. This article addresses this gap by identifying seven ethical factors that are (...) essential for future AI4SG initiatives. The analysis is supported by 27 case examples of AI4SG projects. Some of these factors are almost entirely novel to AI, while the significance of other factors is heightened by the use of AI. From each of these factors, corresponding best practices are formulated which, subject to context and balance, may serve as preliminary guidelines to ensure that well-designed AI is more likely to serve the social good. (shrink)

The international debate on the ethics and legality of autonomous weapon systems (AWS) as well as the call for a ban are primarily focused on the nebulous concept of fully autonomous AWS. More specifically, on AWS that are capable of target selection and engagement without human supervision or control. This thesis argues that such a conception of autonomy is divorced both from military planning and decision-making operations as well as the design requirements that govern AWS engineering and subsequently (...) the tracking and tracing of moral responsibility. To do this, this thesis marries two different levels of meaningful human control (MHC), termed levels of abstraction, to couple military operations with design ethics. In doing so, this thesis argues that the contentious notion of ‘full’ autonomy is not problematic under this two-tiered understanding of MHC. It proceeds to propose the value sensitive design (VSD) approach as a means for designing for MHC. (shrink)

In this paper, I examine the ethics of e - trust and e - trustworthiness in the context of health care, looking at direct computer-patient interfaces (DCPIs), information systems that provide medical information, diagnosis, advice, consenting and/or treatment directly to patients without clinicians as intermediaries. Designers, manufacturers and deployers of such systems have an ethical obligation to provide evidence of their trustworthiness to users. My argument for this claim is based on evidentialism about trust and trustworthiness: the idea that (...) trust should be based on sound evidence of trustworthiness. Evidence of trustworthiness is a broader notion than one might suppose, including not just information about the risks and performance of the system, but also interactional and context-based information. I suggest some sources of evidence in this broader sense that make it plausible that designers, manufacturers and deployers of DCPIs can provide evidence to users that is cognitively simple, easy to communicate, yet rationally connected with actual trustworthiness. (shrink)

A series of recent developments points towards auditing as a promising mechanism to bridge the gap between principles and practice in AI ethics. Building on ongoing discussions concerning ethics-based auditing, we offer three contributions. First, we argue that ethics-based auditing can improve the quality of decision making, increase user satisfaction, unlock growth potential, enable law-making, and relieve human suffering. Second, we highlight current best practices to support the design and implementation of ethics-based auditing: To be (...) feasible and effective, ethics-based auditing should take the form of a continuous and constructive process, approach ethical alignment from a system perspective, and be aligned with public policies and incentives for ethically desirable behaviour. Third, we identify and discuss the constraints associated with ethics-based auditing. Only by understanding and accounting for these constraints can ethics-based auditing facilitate ethical alignment of AI, while enabling society to reap the full economic and social benefits of automation. (shrink)

The debate on whether and how the Internet can protect and foster human rights has become a defining issue of our time. This debate often focuses on Internet governance from a regulatory perspective, underestimating the influence and power of the governance of the Internet’s architecture. The technical decisions made by Internet Standard Developing Organisations that build and maintain the technical infrastructure of the Internet influences how information flows. They rearrange the shape of the technically mediated public sphere, including which rights (...) it protects and which practices it enables. In this article, we contribute to the debate on SDOs’ ethical responsibility to bring their work in line with human rights. We defend three theses. First, SDOs’ work is inherently political. Second, the Internet Engineering Task Force, one of the most influential SDOs, has a moral obligation to ensure its work is coherent with, and fosters, human rights. Third, the IETF should enable the actualisation of human rights through the protocols and standards it designs by implementing a responsibility-by-design approach to engineering. We conclude by presenting some initial recommendations on how to ensure that work carried out by the IETF may enable human rights. (shrink)

A short position paper on how we can preemptively anticipate and design nanotechnology-safe futures.

This report aims to offer insights into cutting-edge research on digital well-being. Many of these insights come from a 2-day academic-impact event, The Future of Digital Well-Being, hosted by a team of researchers working with the Royal Netherlands Academy of Arts and Sciences (KNAW) in February 2024. Today, achieving and maintaining well-being in the face of online technologies is a multifaceted challenge that we believe requires using theoretical resources of different research disciplines. This report explores diverse perspectives on how digital (...) well-being can be actively cultivated, while also emphasising the importance of considering individual differences, societal contexts, and nuanced cultural factors. We aim to offer a holistic view of the future of digital well-being, one that will inspire the next generation of designers of online tools, as well as policymakers who will regulate these tools. We start by asking what digital well-being is – how we can best define a concept that is used by diverse stakeholders and researchers from many disciplines in various ways. To do this, we explore the classic ethical theories of well-being, showing how they can give us insights into how the term digital well-being is currently deployed. We then move to look at the existing strategies that have been proposed to actively cultivate digital well-being, exploring the business models that threaten digital well-being and the relative advantages of the digital and non-digital solutions that are currently proposed. On the one hand, digital tools – such as Apple’s Screen Time and app blockers such as Opal and Forest – integrate seamlessly with the digital lifestyles of users. They also create precise metrics for digital well-being, which facilitates their solutions to reduce screen time. On the other hand, non-digital solutions, including mindfulness practices, digital detoxes, and digital well-being coaching, offer a new set of tools to reconnect individuals to their natural rhythms and help to actively promote offline activities. We then move to discuss diversity and how various groups of users have strikingly different digital well-being needs. Embracing neurodiversity in digital well-being is crucial as it strongly impacts the users’ experience of online technologies. When designing for diversity, organisations and designers alike need to prioritise customization for people with physical disabilities, mitigate harmful content for users with mental well-being conditions, address gender stereotypes and online harassment, and be designed in ways that recognize the very real risks of online technologies. This report closes by examining cultural differences. We believe that non-Western conceptions of well-being offer rich sources for enhancing digital well-being insofar as these traditions can inform and inspire the designers of future online technologies. We focus on East-Asian and South-Asian traditions, although in further work we recognise it would be useful to investigate conceptions of well-being that are influential in the Gulf region, Africa, and South America. Each of these areas have ethical frameworks that discuss well-being in depth as well as a rich cultural heritage. In conclusion, this report’s insights underscore the imperative of recognizing diversity in digital well-being, both in terms of cultural contexts and disciplinary perspectives. It emphasises the need for culturally responsive design methodologies and the integration of non-Western philosophical perspectives into current digital well-being research. Embracing this diversity, we believe, offers the best chance to create digital environments that prioritise well-being for users and the societies they live in across the world. Ultimately, we believe that it is not only about designing better online products; it’s about shaping a digital landscape that promotes well-being and flourishing for everyone. (shrink)

Soda taxes are controversial. While proponents point to their potential health benefits and the public projects that could be funded with their revenue, critics argue that they are paternalistic and regressive. In this paper, we explore the prospects for designing a just soda tax, one that appropriately balances the often-competing ethical considerations of promoting social welfare, respecting people’s autonomy, and ensuring distributive fairness. We argue that policymakers have several paths forward for designing a just soda tax, but that the considerations (...) relevant to ethical policy design are more complicated than is sometimes acknowledged. (shrink)

It has been suggested that to overcome the challenges facing the UK’s National Health Service (NHS) of an ageing population and reduced available funding, the NHS should be transformed into a more informationally mature and heterogeneous organisation, reliant on data-based and algorithmically-driven interactions between human, artificial, and hybrid (semi-artificial) agents. This transformation process would offer significant benefit to patients, clinicians, and the overall system, but it would also rely on a fundamental transformation of the healthcare system in a way that (...) poses significant governance challenges. In this article, we argue that a fruitful way to overcome these challenges is by adopting a pro-ethical approach to design that analyses the system as a whole, keeps society-in-the-loop throughout the process, and distributes responsibility evenly across all nodes in the system. (shrink)

Safe-by-Design (SBD) frameworks for the development of emerging technologies have become an ever more popular means by which scholars argue that transformative emerging technologies can safely incorporate human values. One such popular SBD methodology is called Value Sensitive Design (VSD). A central tenet of this design methodology is to investigate stakeholder values and design those values into technologies during early stage research and development (R&D). To accomplish this, the VSD framework mandates that designers consult the philosophical (...) and ethical literature to best determine how to weigh moral trade-offs. However, the VSD framework also concedes the universalism of moral values, particularly the values of freedom, autonomy, equality trust and privacy justice. This paper argues that the VSD methodology, particularly applied to nano-bio-info-cogno (NBIC) technologies, has an insufficient grounding for the determination of moral values. As such, an exploration of the value-investigations of VSD are deconstructed to illustrate both its strengths and weaknesses. This paper also provides possible modalities for the strengthening of the VSD methodology, particularly through the application of moral imagination and how moral imagination exceed the boundaries of moral intuitions in the development of novel technologies. (shrink)

A series of recent developments points towards auditing as a promising mechanism to bridge the gap between principles and practice in AI ethics. Building on ongoing discussions concerning ethics-based auditing, we offer three contributions. First, we argue that ethics-based auditing can improve the quality of decision making, increase user satisfaction, unlock growth potential, enable law-making, and relieve human suffering. Second, we highlight current best practices to support the design and implementation of ethics-based auditing: To be (...) feasible and effective, ethics-based auditing should take the form of a continuous and constructive process, approach ethical alignment from a system perspective, and be aligned with public policies and incentives for ethically desirable behaviour. Third, we identify and discuss the constraints associated with ethics-based auditing. Only by understanding and accounting for these constraints can ethics-based auditing facilitate ethical alignment of AI, while enabling society to reap the full economic and social benefits of automation. (shrink)