Experimental design is one aspect of a scientific method. A well-designed, properly conducted experiment aims to control variables in order to isolate and manipulate causal effects and thereby maximize internal validity, support causal inferences, and guarantee reliable results. Traditionally employed in the natural sciences, experimental design has become an important part of research in the social and behavioral sciences. Experimental methods are also endorsed as the most reliable guides to policy effectiveness. Through a discussion of some of the (...) central concepts associated with experimental design, including controlled variation and randomization, this chapter will provide a summary of key ethical issues that tend to arise in experimental contexts. In addition, by exploring assumptions about the nature of causation and by analyzing features of causal relationships, systems, and inferences in social contexts, this chapter will summarize the ways in which experimental design can undermine the integrity of not only social and behavioral research but policies implemented on the basis of such research. (shrink)

Design for Values (DfV) philosophies are a series of design approaches that aim to incorporate human values into the early phases of technological design to direct innovation into beneficial outcomes. The difficulty and necessity of directing advantageous futures for transformative technologies through the application and adoption of value-based design approaches are apparent. However, questions of whose values to design are of critical importance. DfV philosophies typically aim to enrol the stakeholders who may be affected by (...) the emergence of such a technology. However, regardless of which design approach is adopted, all enrolled stakeholders are human ones who propose human values. Contemporary scholarship on metahumanisms, particularly those on posthumanism, have decentred the human from its traditionally privileged position among other forms of life. Arguments that the humanist position is not (and has never been) tenable are persuasive. As such, scholarship has begun to provide a more encompassing ontology for the investigation of nonhuman values. Given the potentially transformative nature of future technologies as relates to the earth and its many assemblages, it is clear that the value investigations of these design approaches fail to account for all relevant stakeholders (i.e., nonhuman animals). This paper has two primary objectives: (1) to argue for the cogency of a posthuman ethics in the design of technologies; and (2) to describe how existing DfV approaches can begin to envision principled and methodological ways of incorporating non-human values into design. To do this, the paper provides a rudimentary outline of what constitutes DfV approaches. It then takes up a unique design approach called Value Sensitive Design (VSD) as an illustrative example. Out of all the other DfV frameworks, VSD most clearly illustrates a principled approach to the integration of values in design. (shrink)

The sustainability movement, currently gathering considerable attention from architects, derives much of its moral foundation from the theoretical initiatives of environmental ethics. How is the value of sustainability to mesh with architecture’s time-tested values? The idea that an ethic of sustainability might serve architects’ efforts to reground their practices in something that opposes consumer values of the marketplace has intuitive appeal and makes a certain amount of sense. However, it is far from obvious that the sustainability movement provides a (...) strong enough conceptual framework for an entire designphilosophy. This issue is complicated by two different sustainable design outlooks which parallel two conceptions of environmental ethics: the practical and the radical. Neverthleless, sustainability need not resort to the philosophical excess of its radical branch to help foster a new public-spiritedness. (shrink)

The conjunction of wireless computing, ubiquitous Internet access, and the miniaturisation of sensors have opened the door for technological applications that can monitor health and well-being outside of formal healthcare systems. The health-related Internet of Things (H-IoT) increasingly plays a key role in health management by providing real-time tele-monitoring of patients, testing of treatments, actuation of medical devices, and fitness and well-being monitoring. Given its numerous applications and proposed benefits, adoption by medical and social care institutions and consumers may be (...) rapid. However, a host of ethical concerns are also raised that must be addressed. The inherent sensitivity of health-related data being generated and latent risks of Internet-enabled devices pose serious challenges. Users, already in a vulnerable position as patients, face a seemingly impossible task to retain control over their data due to the scale, scope and complexity of systems that create, aggregate, and analyse personal health data. In response, the H-IoT must be designed to be technologically robust and scientifically reliable, while also remaining ethically responsible, trustworthy, and respectful of user rights and interests. To assist developers of the H-IoT, this paper describes nine principles and nine guidelines for ethical design of H-IoT devices and data protocols. (shrink)

Toleration is one of the fundamental principles that inform the design of a democratic and liberal society. Unfortunately, its adoption seems inconsistent with the adoption of paternalistically benevolent policies, which represent a valuable mechanism to improve individuals’ well-being. In this paper, I refer to this tension as the dilemma of toleration. The dilemma is not new. It arises when an agent A would like to be tolerant and respectful towards another agent B’s choices but, at the same time, A (...) is altruistically concerned that a particular course of action would harm, or at least not improve, B’s well-being, so A would also like to be helpful and seeks to ensure that B does not pursue such course of action, for B’s sake and even against B’s consent. In the article, I clarify the specific nature of the dilemma and show that several forms of paternalism, including those based on ethics by design and structural nudging, may not be suitable to resolve it. I then argue that one form of paternalism, based on pro-ethical design, can be compatible with toleration and hence with the respect for B’s choices, by operating only at the informational and not at the structural level of a choice architecture. This provides a successful resolution of the dilemma, showing that tolerant paternalism is not an oxymoron but a viable approach to the design of a democratic and liberal society. (shrink)

Technologies cannot simply be understood as neutral tools or instruments; they embody the values of their creators and may unconsciously reinforce systematic patterns of inequality, discrimination, and oppression. -/- Technology Ethics shows how responsible innovation can be achieved. Demonstrating how design and philosophy converge, the book delves into the intricate narratives that shape our understanding of technology – from instrumentalist views to social constructivism. Yet, at its core, it champions interactionalism as the most promising and responsible narrative. Through (...) compelling examples and actionable tools, this book unravels the nuances of these philosophical positions tailored to foster responsible innovation and thoughtful design. As our everyday lives further intertwine with technology, understanding and implementing these design principles becomes not just beneficial, but essential. -/- This concise and accessible introduction is essential reading for students and scholars of philosophy of technology, engineering ethics, science and technology studies, human-machine communication, as well as policymakers. (shrink)

Manufacturing and industry practices are undergoing an unprecedented revolution as a consequence of the convergence of emerging technologies such as artificial intelligence, robotics, cloud computing, virtual and augmented reality, among others. This fourth industrial revolution is similarly changing the practices and capabilities of operators in their industrial environments. This paper introduces and explores the notion of the Operator 4.0 as well as how this novel way of conceptualizing the human operator necessarily implicates human values in the technologies that constitute it. (...) The design approach known as value sensitive design (VSD) is used to explore how these Operator 4.0 technologies can be designed for human values. Expert elicitation surveys were used to determine the values of industry stakeholders and examples of how the VSD methodology can be adopted by engineers in order to design for these values is illustrated. The results provide preliminary adoption strategies that industrial teams can take to Operator 4.0 technology for human values. (shrink)

This research project aims to accomplish two primary objectives: (1) propose an argument that a posthuman ethics in the design of technologies is sound and thus warranted and, (2) how can existent SBD approaches begin to envision principled and methodological ways of incorporating nonhuman values into design. In order to do this this MRP will provide a rudimentary outline of what constitutes SBD approaches. A particular design approach - Value Sensitive Design (VSD) - is taken (...) up as an illustrative example given that it, among the other SBD frameworks, most clearly illustrates a principled approach to the integration of values in design. -/- This explication will be followed by the strongest arguments for a posthumanist ethic, primarily drawing from the works of the Italian philosophers Leonardo Caffo and Roberto Marchesini and Francesa Ferrando. In doing so I will show how the human imperative to account for nonhuman values is a duty and as such must be continually ready-to-hand when making value-critical decision. (shrink)

Designing in Ethics provides a compilation of well-curated essays that tackle the ethical issues that surround technological design and argue that ethics must form a constitutive part of the designing process and a foundation in our institutions and practices. The appropriation of a design approach to applied ethics is argued as a means by which ethical issues that implicate technological artifact may be achieved.

One recent priority of the U.S. government is developing autonomous robotic systems. The U.S. Army has funded research to design a metric of evil to support military commanders with ethical decision-making and, in the future, allow robotic military systems to make autonomous ethical judgments. We use this particular project as a case study for efforts that seek to frame morality in quantitative terms. We report preliminary results from this research, describing the assumptions and limitations of a program that assesses (...) the relative evil of two courses of action. We compare this program to other attempts to simulate ethical decision-making, assess possibilities for overcoming the trade-off between input simplification and output reliability, and discuss the responsibilities of users and designers in implementing such programs. We conclude by discussing the implications that this project highlights for the successes and challenges of developing automated mechanisms for ethical decision making. (shrink)

Purpose This paper discusses ethical principles that are implicit in second-order cybernetics, with the aim of arriving at a better understanding of how second-order cybernetics frames living in a world with others. It further investigates implications for second-order cybernetics approaches to architectural design, i.e. the activity of designing frameworks for living. -/- Design/methodology/approach The paper investigates the terminology in the second-order cybernetics literature with specific attention to terms that suggest that there are ethical principles at work. It further (...) relates second-order cybernetics to selected notions in phenomenology, pragmatism and transcendental idealism. The comparison allows for conclusions about the specificity of a second-order inquiry. In line with the thematic focus of this journal issue on the framing of shared worlds, the paper further elaborates on questions relating to the activity of designing “worlds” in which people live with others. -/- Findings The paper highlights that a radical openness toward the future and toward the agency of others is inscribed in the conception of second-order cybernetics. It creates a frame of reference for conceiving social systems of all kinds, including environments that are designed to be inhabited. -/- Originality/value The paper identifies an aesthetics grounded in the process of living-with-others as an ethical principle implicit in second-order cybernetics thought. It is an aesthetics that is radically open for the agency of others. Linking aesthetics and ethics, the paper’s contributions will be of specific value for practitioners and theoreticians of design. Considering second-order cybernetics as a practice generally dealing with designing, it also contributes to the wider second-order cybernetics discourse. (shrink)

With the emergence of quantum technologies such as quantum computing, quantum communications, and quantum sensing, new potential has emerged for smart manufacturing and Industry 4.0. These technologies, however, present ethical concerns that must be addressed in order to ensure they are developed and used responsibly. This article outlines some of the ethical challenges that quantum technologies may raise for Industry 4.0 and presents the value sensitive design methodology as a strategy for ethics-by-design of quantum computing in Industry (...) 4.0. This research further investigates the potential ethical difficulties that may come from the use of quantum technologies in Industry 4.0, such as concerns about privacy, security, accountability, and the influence of these technologies on workers and society as a whole. The article argues, based on current literature, that these issues necessitate a proactive and comprehensive approach to ethics-by-design. (shrink)

This paper explores how participation and sustainability are being addressed by architects within the Building Schools for the Future (BSF) programme in the UK. The intentions promoted by the programme are certainly ambitious, but the ways to fulfil these aims are ill-explored. Simply focu- sing on providing innovative learning technologies, or indeed teaching young people about phy- sical sustainability features in buildings, will not necessarily teach them the skills they will need to respond to the environmental and social challenges of (...) a rapidly changing world. However, anticipating those skills is one of the most problematic issues of the programme. The involve- ment of young people in the design of schools is used to suggest empowerment, place-making and to promote social cohesion but this is set against government design literature which advo- cates for exemplars, standard layouts and best practice, all leading to forms of standardisation. The potentials for tokenistic student involvement and conflict with policy aims are evident. This paper explores two issues: how to foster in young people an ethic towards future generations, and the role of co-design practices in this process. Michael Oakeshott calls teaching the conver- sation of mankind. In this paper, I look at the philosophy of Hannah Arendt, Emmanuel Levinas, Maurice Merleau-Ponty and Luce Irigaray to argue that investigating the ethical dilemmas of the programme through critical dialogue with students offers an approach to meeting government objectives, building sustainable schools, and fostering sustainable citizenship. (shrink)

Emerging technologies such as cloud computing, augmented and virtual reality, artificial intelligence and robotics, among others, are transforming the field of manufacturing and industry as a whole in unprecedent ways. This fourth industrial revolution is consequentially changing how operators that have been crucial to industry success go about their practices in industrial environments. This short paper briefly introduces the notion of the Operator 4.0 as well as how this novel way of conceptualizing the human operator necessarily implicates human values in (...) the technologies that constitute it. Similarly, the design methodology known as value sensitive design (VSD) is drawn upon to discuss how these Operator 4.0 technologies can be design for human values and, conversely, how a potential value-sensitive Operator 4.0 can be used to strengthen the VSD methodology in developing novel technologies. (shrink)

Caregiving robots are often lauded for their potential to assist with geriatric care. While seniors can be wise and mature, possessing valuable life experience, they can also present a variety of ethical challenges, from prevalence of racism and sexism, to troubled relationships, histories of abusive behavior, and aggression, mood swings and impulsive behavior associated with cognitive decline. I draw on Confucian ethics, especially the concept of filial piety, to address these issues. Confucian scholars have developed a rich set of (...) theoretical resources for dealing with beloved but imperfect elders, and navigating the challenges of supporting seniors whose ethical commitments are unreliable. These resources provide a way to reconcile two important but conflicting desiderata: to value and care for seniors, but also to clear-mindedly deal with their moral shortcomings. In particular, they articulate a duty to remonstrate with our elders when they err. Confucian filial piety can helpfully inform robot design and use in geriatric care. They can be used to strengthen and protect emotional connections in important relationships, but should not be used to reinforce patient preferences when doing so damages relationships or their ability to act morally. Rather than conceive of patient wellbeing as in tension with moral behavior, and care as a burden for caregivers, not a source of value and meaning, Confucian accounts of filial piety help identify both new areas of concern and new potential in the development of caregiving technologies, ones which see these goods as complementary. (shrink)

The value sensitive design (VSD) approach to designing transformative technologies for human values is taken as the object of study in this chapter. VSD has traditionally been conceptualized as another type of technology or instrumentally as a tool. The various parts of VSD’s principled approach would then aim to discern the various policy requirements that any given technological artifact under consideration would implicate. Yet, little to no consideration has been given to how laws, regulations, policies and social norms engage (...) within VSD practices. Similarly, how the interactive nature of the VSD approach can, in turn, influence those directives. This is exacerbated when we consider machine ethics policy that have global consequences outside their development spheres. What constructs and models will position AI designers to engage in policy concerns? How can the design of AI policy be integrated with technical design? How might VSD be used to develop AI policy? How might law, regulations, social norms, and other kinds of policy regarding AI systems be engaged within value sensitive design? This chapter takes the VSD as its starting point and aims to determine how laws, regulations and policies come to influence how value trade-offs can be managed within VSD practices. It shows that the iterative and interactional nature of VSD both permits and encourages existing policies to be integrated both early on and throughout the design process. The chapter concludes with some potential future research programs. (shrink)

Value Sensitive Design (VSD) is an established method for integrating values into technical design. It has been applied to different technologies and, more recently, to artificial intelligence (AI). We argue that AI poses a number of challenges specific to VSD that require a somewhat modified VSD approach. Machine learning (ML), in particular, poses two challenges. First, humans may not understand how an AI system learns certain things. This requires paying attention to values such as transparency, explicability, and accountability. (...) Second, ML may lead to AI systems adapting in ways that ‘disembody’ the values embedded in them. To address this, we propose a threefold modified VSD approach: 1) integrating a known set of VSD principles (AI4SG) as design norms from which more specific design requirements can be derived; 2) distinguishing between values that are promoted and respected by the design to ensure outcomes that not only do no harm but also contribute to good; and 3) extending the VSD process to encompass the whole life cycle of an AI technology in order to monitor unintended value consequences and redesign as needed. We illustrate our VSD for AI approach with an example use case of a SARS-CoV-2 contact tracing app. (shrink)

In the last decades Human-Computer Interaction (HCI) has started to focus attention on “persuasive technologies” having the goal of changing users’ behavior and attitudes according to a predefined direction. In this talk we show how some of the techniques employed in such technologies trigger some well known cognitive biases by adopting a strategy relying on logical fallacies (i.e. forms of reasoning which are logically invalid but psychologically persuasive). In particular, we will show how the mechanisms reducible to logical fallacies are (...) used to design web and mobile interfaces in domains ranging from the e-commerce to the jihadist propaganda. The final part of the talk will be devoted to point out the potential ethical dangers related to the misuse of these techniques in the design of persuasive technologies. (shrink)

One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents (IAs). This paper explores how decision matrix algorithms, via the belief-desire-intention model (...) for autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles. (shrink)

The authors developed this textbook in response to an increasing interest in ethics, and a growing number of courses on this topic that are now being offered in educational leadership programs. It is designed to fill a gap in instructional materials for teaching the ethics component of the knowledge base that has been established for the profession. The text has several purposes: First, it demonstrates the application of different ethical paradigms (the ethics of justice, care, critique, and (...) the profession) through discussion and analysis of real-life moral dilemmas that educational leaders face in their schools and communities. Second, it addresses some of the practical, pedagogical, and curricular issues related to the teaching of ethics for educational leaders. Third, it emphasizes the importance of ethics instruction from a variety of theoretical approaches. Finally, it provides a process that instructors might follow to develop their own ethics unit or course. * Part I provides an overview of why ethics is so important, especially for today's educational leaders, and describes a multiparadigm approach essential to practitioners as they grapple with ethical dilemmas. * Part II deals with the dilemmas themselves. Ethical dilemmas written by the authors' graduate students bring readers face-to-face with the kinds of dilemmas faced by practicing administrators in urban, suburban, and rural settings in an era full of complexities and contradictions. * Part III focuses on pedagogy and provides teaching notes for the instructor. The authors discuss the importance of self-reflection on the part of both instructors and students, and model how they thought through their own personal and professional ethical codes as well as reflected upon the critical incidents in their lives that shaped their teaching and frequently determined what they privileged in class. (shrink)

Artificial Social Agents (ASAs), which are AI software driven entities programmed with rules and preferences to act autonomously and socially with humans, are increasingly playing roles in society. As their sophistication grows, humans will share greater amounts of personal information, thoughts, and feelings with ASAs, which has significant ethical implications. We conducted a study to investigate what ethical principles are of relative importance when people engage with ASAs and whether there is a relationship between people’s values and the ethical principles (...) they prioritise. The study uses scenarios, embedded with the five AI4People ethical principles (Beneficence, Non-maleficence, Autonomy, Justice, and Explicability), involving ASAs taking on roles traditionally played by humans to understand whether these roles and behaviours (including dialogues) are seen as acceptable or unacceptable. Results from 268 participants reveal the greatest sensitivity to ASA behaviours that relate to Autonomy, Justice, Explicability, and the privacy of their personal data. Models were created using Schwartz’s Refined Values as a possible indicator of how stakeholders discern and prioritise the different AI4People ethical principles when interacting with ASAs. Our findings raise issues around the ethical acceptability of ASAs for nudging and changing behaviour due to participants’ desire for autonomy and their concerns over deceptive ASA behaviours such as pretending to have memories and emotions. (shrink)

Objective: There are benefits and risks of giving patients more granular control of their personal health information in electronic health record (EHR) systems. When designing EHR systems and policies, informaticists and system developers must balance these benefits and risks. Ethical considerations should be an explicit part of this balancing. Our objective was to develop a structured ethics framework to accomplish this. -/- Methods: We reviewed existing literature on the ethical and policy issues, developed an ethics framework called a (...) “Points to Consider” (P2C) document, and convened a national expert panel to review and critique the P2C. -/- Results: We developed the P2C to aid informaticists designing an advanced query tool for an electronic health record (EHR) system in Indianapolis. The P2C consists of six questions (“Points”) that frame important ethical issues, apply accepted principles of bioethics and Fair Information Practices, comment on how questions might be answered, and address implications for patient care. -/- Discussion: The P2C is intended to clarify whatis at stake when designers try to accommodate potentially competing ethical commitments and logistical realities. The P2C was developed to guide informaticists who were designing a query tool in an existing EHR that would permit patient granular control. While consideration of ethical issues is coming to the forefront of medical informatics design and development practices, more reflection is needed to facilitate optimal collaboration between designers and ethicists. This report contributes to that discussion. (shrink)

This article analyses the ethical aspects of multistakeholder recommendation systems (RSs). Following the most common approach in the literature, we assume a consequentialist framework to introduce the main concepts of multistakeholder recommendation. We then consider three research questions: who are the stakeholders in a RS? How are their interests taken into account when formulating a recommendation? And, what is the scientific paradigm underlying RSs? Our main finding is that multistakeholder RSs (MRSs) are designed and theorised, methodologically, according to neoclassical welfare (...) economics. We consider and reply to some methodological objections to MRSs on this basis, concluding that the multistakeholder approach offers the resources to understand the normative social dimension of RSs. (shrink)

We propose that virtue ethics can be used to address ethical issues central to discussions about sex robots. In particular, we argue virtue ethics is well equipped to focus on the implications of sex robots for human moral character. Our evaluation develops in four steps. First, we present virtue ethics as a suitable framework for the evaluation of human–robot relationships. Second, we show the advantages of our virtue ethical account of sex robots by comparing it to current (...) instrumentalist approaches, showing how the former better captures the reciprocal interaction between robots and their users. Third, we examine how a virtue ethical analysis of intimate human–robot relationships could inspire the design of robots that support the cultivation of virtues. We suggest that a sex robot which is equipped with a consent-module could support the cultivation of compassion when used in supervised, therapeutic scenarios. Fourth, we discuss the ethical implications of our analysis for user autonomy and responsibility. (shrink)

Philosophers have talked to each other about moral issues concerning technology, but few of them have talked about issues of technology and the good life, and even fewer have talked about technology and the good life with the public in the form of recommendation. In effect, recommendations for various technologies are often left to technologists and gurus. Given the potential benefits of informing the public on their impacts on the good life, however, this is a curious state of affairs. In (...) the present paper, I will examine why philosophers are seemingly reluctant to offer recommendations to the public. While there are many reasons for philosophers to refrain from offering recommendations, I shall focus on a specific normative reason. More specifically, it appears that, according to a particular definition, offering recommendations can be viewed as paternalistic, and therefore is prima facie wrong to do so. I will provide an argument to show that the worry about paternalism is unfounded, because a form of paternalism engendered by technology is inevitable. Given the inevitability of paternalism, I note that philosophers should accept the duty to offer recommendations to the public. I will then briefly turn to design ethics, which has reconceptualised the role of philosophers and, in my mind, fitted well with the inevitability of paternalism. Finally, I shall argue that design ethics has to be supplemented by the practice of recommendation if it is to sustain its objective. (shrink)

Safe-by-Design (SBD) frameworks for the development of emerging technologies have become an ever more popular means by which scholars argue that transformative emerging technologies can safely incorporate human values. One such popular SBD methodology is called Value Sensitive Design (VSD). A central tenet of this design methodology is to investigate stakeholder values and design those values into technologies during early stage research and development (R&D). To accomplish this, the VSD framework mandates that designers consult the philosophical (...) and ethical literature to best determine how to weigh moral trade-offs. However, the VSD framework also concedes the universalism of moral values, particularly the values of freedom, autonomy, equality trust and privacy justice. This paper argues that the VSD methodology, particularly applied to nano-bio-info-cogno (NBIC) technologies, has an insufficient grounding for the determination of moral values. As such, an exploration of the value-investigations of VSD are deconstructed to illustrate both its strengths and weaknesses. This paper also provides possible modalities for the strengthening of the VSD methodology, particularly through the application of moral imagination and how moral imagination exceed the boundaries of moral intuitions in the development of novel technologies. (shrink)

I argue that, contrary to intuition, it would be both possible and permissible to design people - whether artificial or organic - who by their nature desire to do tasks we find unpleasant.

Healthcare is becoming increasingly automated with the development and deployment of care robots. There are many benefits to care robots but they also pose many challenging ethical issues. This paper takes care robots for the elderly as the subject of analysis, building on previous literature in the domain of the ethics and design of care robots. Using the value sensitive design approach to technology design, this paper extends its application to care robots by integrating the values (...) of care, values that are specific to AI, and higher-scale values such as the United Nations Sustainable Development Goals. The ethical issues specific to care robots for the elderly are discussed at length alongside examples of specific design requirements that work to ameliorate these ethical concerns. (shrink)

We propose four policies of ethical design of human-grade Artificial Intelligence. Two of our policies are precautionary. Given substantial uncertainty both about ethical theory and about the conditions under which AI would have conscious experiences, we should be cautious in our handling of cases where different moral theories or different theories of consciousness would produce very different ethical recommendations. Two of our policies concern respect and freedom. If we design AI that deserves moral consideration equivalent to that of (...) human beings, that AI should be designed with self-respect and with the freedom to explore values other than those we might impose. We are especially concerned about the temptation to create human-grade AI pre-installed with the desire to cheerfully sacrifice itself for its creators’ benefit. (shrink)

The development of cultured meat has gained urgency through the increasing problems associated with meat, but what it might become is still open in many respects. In existing debates, two main moral profiles can be distinguished. Vegetarians and vegans who embrace cultured meat emphasize how it could contribute to the diminishment of animal suffering and exploitation, while in a more mainstream profile cultured meat helps to keep meat eating sustainable and affordable. In this paper we argue that these profiles do (...) not exhaust the options and that feelings as well as imagination are needed to explore possible future options. On the basis of workshops, we present a third moral profile, “the pig in the backyard”. Here cultured meat is imagined as an element of a hybrid community of humans and animals that would allow for both the consumption of animal protein and meaningful relations with domestic animals. Experience in the workshops and elsewhere also illustrates that thinking about cultured meat inspires new thoughts on “normal” meat. In short, the idea of cultured meat opens up new search space in various ways. We suggest that ethics can take an active part in these searches, by fostering a process that integrates feelings, imagination and rational thought and that expands the range of our moral identities. (shrink)

The ethical issues related to the possible future creation of machines with general intellectual capabilities far outstripping those of humans are quite distinct from any ethical problems arising in current automation and information systems. Such superintelligence would not be just another technological development; it would be the most important invention ever made, and would lead to explosive progress in all scientific and technological fields, as the superintelligence would conduct research with superhuman efficiency. To the extent that ethics is a (...) cognitive pursuit, a superintelligence could also easily surpass humans in the quality of its moral thinking. However, it would be up to the designers of the superintelligence to specify its original motivations. Since the superintelligence may become unstoppably powerful because of its intellectual superiority and the technologies it could develop, it is crucial that it be provided with human-friendly motivations. This paper surveys some of the unique ethical issues in creating superintelligence, and discusses what motivations we ought to give a superintelligence, and introduces some cost-benefit considerations relating to whether the development of superintelligent machines ought to be accelerated or retarded. (shrink)

Genetic engineering technologies are a subclass of the biotechnology family, and are concerned with the use of laboratory-based technologies to intervene with a given organism at the genetic level, i.e., the level of its DNA. This class of technologies could feasibly be used to treat diseases and disabilities, create disease-resistant crops, or even be used to enhance humans to make them more resistant to certain environmental conditions. However, both therapeutic and enhancement applications of genetic engineering raise serious ethical concerns. This (...) paper examines various objections to genetic engineering (as applied to humans) which have been raised in the literature, and presents a new way to frame these issues, and to look for solutions. Specifically, this paper frames genetic engineering technologies within the ‘design turn in applied ethics’ lens and thus situates these technologies as covarying with societal forces. The value sensitive design (VSD) approach to technology design is then appropriated as the conceptual framework in which genetic engineering technologies can be considered so that they can be designed for important human values. By doing so, this paper brings further nuance to the scholarship on genetic engineering technologies by discussing the sociotechnicity of genetic engineering systems rather than framing them as value-neutral tools that either support or constrain values based on how they are used. (shrink)

The paper investigates the ethics of information transparency (henceforth transparency). It argues that transparency is not an ethical principle in itself but a pro-ethical condition for enabling or impairing other ethical practices or principles. A new definition of transparency is offered in order to take into account the dynamics of information production and the differences between data and information. It is then argued that the proposed definition provides a better understanding of what sort of information should be disclosed and (...) what sort of information should be used in order to implement and make effective the ethical practices and principles to which an organisation is committed. The concepts of “heterogeneous organisation” and “autonomous computational artefact” are further defined in order to clarify the ethical implications of the technology used in implementing information transparency. It is argued that explicit ethical designs, which describe how ethical principles are embedded into the practice of software design, would represent valuable information that could be disclosed by organisations in order to support their ethical standing. (shrink)

The idea of artificial intelligence for social good is gaining traction within information societies in general and the AI community in particular. It has the potential to tackle social problems through the development of AI-based solutions. Yet, to date, there is only limited understanding of what makes AI socially good in theory, what counts as AI4SG in practice, and how to reproduce its initial successes in terms of policies. This article addresses this gap by identifying seven ethical factors that are (...) essential for future AI4SG initiatives. The analysis is supported by 27 case examples of AI4SG projects. Some of these factors are almost entirely novel to AI, while the significance of other factors is heightened by the use of AI. From each of these factors, corresponding best practices are formulated which, subject to context and balance, may serve as preliminary guidelines to ensure that well-designed AI is more likely to serve the social good. (shrink)

Soda taxes are controversial. While proponents point to their potential health benefits and the public projects that could be funded with their revenue, critics argue that they are paternalistic and regressive. In this paper, we explore the prospects for designing a just soda tax, one that appropriately balances the often-competing ethical considerations of promoting social welfare, respecting people’s autonomy, and ensuring distributive fairness. We argue that policymakers have several paths forward for designing a just soda tax, but that the considerations (...) relevant to ethical policy design are more complicated than is sometimes acknowledged. (shrink)

Background Genomic research on neurodevelopmental disorders (NDDs), particularly involving minors, combines and amplifies existing research ethics issues for biomedical research. We performed a review of the literature on the ethical issues associated with genomic research involving children affected by NDDs as an aid to researchers to better anticipate and address ethical concerns. Results Qualitative thematic analysis of the included articles revealed themes in three main areas: research design and ethics review, inclusion of research participants, and communication of (...) research results. Ethical issues known to be associated with genomic research in general, such as privacy risks and informed consent/assent, seem especially pressing for NDD participants because of their potentially decreased cognitive abilities, increased vulnerability, and stigma associated with mental health problems. Additionally, there are informational risks: learning genetic information about NDD may have psychological and social impact, not only for the research participant but also for family members. However, there are potential benefits associated with research participation, too: by enrolling in research, the participants may access genetic testing and thus increase their chances of receiving a (genetic) diagnosis for their neurodevelopmental symptoms, prognostic or predictive information about disease progression or the risk of concurrent future disorders. Based on the results of our review, we developed an ethics checklist for genomic research involving children affected by NDDs. Conclusions In setting up and designing genomic research efforts in NDD, researchers should partner with communities of persons with NDDs. Particular attention should be paid to preventing disproportional burdens of research participation of children with NDDs and their siblings, parents and other family members. Researchers should carefully tailor the information and informed consent procedures to avoid therapeutic and diagnostic misconception in NDD research. To better anticipate and address ethical issues in specific NDD studies, we suggest researchers to use the ethics checklist for genomic research involving children affected by NDDs presented in this paper. (shrink)

The debate on whether and how the Internet can protect and foster human rights has become a defining issue of our time. This debate often focuses on Internet governance from a regulatory perspective, underestimating the influence and power of the governance of the Internet’s architecture. The technical decisions made by Internet Standard Developing Organisations that build and maintain the technical infrastructure of the Internet influences how information flows. They rearrange the shape of the technically mediated public sphere, including which rights (...) it protects and which practices it enables. In this article, we contribute to the debate on SDOs’ ethical responsibility to bring their work in line with human rights. We defend three theses. First, SDOs’ work is inherently political. Second, the Internet Engineering Task Force, one of the most influential SDOs, has a moral obligation to ensure its work is coherent with, and fosters, human rights. Third, the IETF should enable the actualisation of human rights through the protocols and standards it designs by implementing a responsibility-by-design approach to engineering. We conclude by presenting some initial recommendations on how to ensure that work carried out by the IETF may enable human rights. (shrink)

A recent systematic review of Machine Learning (ML) approaches to health data, containing over 100 studies, found that the most investigated problem was mental health (Yin et al., 2019). Relatedly, recent estimates suggest that between 165,000 and 325,000 health and wellness apps are now commercially available, with over 10,000 of those designed specifically for mental health (Carlo et al., 2019). In light of these trends, the present chapter has three aims: (1) provide an informative overview of some of the recent (...) work taking place at the intersection of text mining and mental health so that we can (2) highlight and analyze several pressing ethical issues that are arising in this rapidly growing field and (3) suggest productive directions for how these issues might be better addressed within future interdisciplinary work to ensure the responsible development of text mining approaches in psychology generally, and in mental health fields, specifically. In Section 1, we review some of the recent literature on text-mining and mental health in the contexts of traditional experimental settings, social media, and research involving electronic health records. Then, in Section 2, we introduce and discuss ethical concerns that arise before, during, and after research is conducted. Finally, in Section 3, we offer several suggestions about how ethical oversight of text-mining research might be improved to be more responsive to the concerns mapped out in Section 2. (shrink)

In information societies, operations, decisions and choices previously left to humans are increasingly delegated to algorithms, which may advise, if not decide, about how data should be interpreted and what actions should be taken as a result. More and more often, algorithms mediate social processes, business transactions, governmental decisions, and how we perceive, understand, and interact among ourselves and with the environment. Gaps between the design and operation of algorithms and our understanding of their ethical implications can have severe (...) consequences affecting individuals as well as groups and whole societies. This paper makes three contributions to clarify the ethical importance of algorithmic mediation. It provides a prescriptive map to organise the debate. It reviews the current discussion of ethical aspects of algorithms. And it assesses the available literature in order to identify areas requiring further work to develop the ethics of algorithms. (shrink)

Historically the focus of moral decision-making in games has been narrow, mostly confined to challenges of moral judgement (deciding right and wrong). In this paper, we look to moral psychology to get a broader view of the skills involved in ethical behaviour and how they may be employed in games. Following the Four Component Model of Rest and colleagues, we identify four “lenses” – perspectives for considering moral gameplay in terms of focus, sensitivity, judgement and action – and describe the (...) design problems raised by each. To conclude, we analyse two recent games, The Walking Dead and Papers, Please, and show how the lenses give us insight into important design differences between them. (shrink)

Prometheus has grown four years older since its last and highly controversial special issue, published in 2017 on the Shaken Baby Debate. But, as always, Prometheus is committed to open discussion and dissemination of scientific research, regardless of the potential backlash or controversy that may ensue from such a venture, a venture that is at the core of authentic scholarship. Since the beginning of 2020, the world has changed irrevocably, making once-held norms seem obsolete in favour of new ways of (...) being in the world and new technologies emerging to face these new ways of living. Although it has been a long-held insight in the philosophy of technology that technical systems are carriers of values, the SARS-CoV-2 pandemic has made manifest how these values, and their incarnations in sociotechnical systems, can likewise change. Prometheus has, since its inception, danced in tandem with the critical interpretations, theories, and methods for understanding innovation, and how innovations fundamentally impact and are impacted by the world in which they emerge and are situated. For this reason, Steffen Steinert, Tristan de Wildt, and I chose to guest edit this special issue on designing for value change and chose Prometheus as its home. (shrink)

Personal Information Management Systems (PIMS) aim to facilitate the sharing of personal information and protect privacy. Efforts to enhance privacy management, aligned with established privacy policies, have led to guidelines for integrating transparent notices and meaningful choices within these systems. Although discussions have revolved around the design of privacy-friendly systems that comply with legal requirements, there has been relatively limited philosophical discourse on incorporating the value of privacy into these systems. Exploring the connection between privacy and personal autonomy illuminates (...) the instrumental value of privacy and highlights the importance of intentionally embedding the value of privacy into these systems. To translate the value of privacy into concrete design requirements, this study constructs a values hierarchy consisting of values, norms, and design requirements. After analyzing the relationships between privacy and autonomy and identifying norms, the design requirements translated from the norms associated with the components of personal autonomy are specified at the lowest layer. These requirements include a design to prevent unauthorized access and dark patterns and to provide effective and efficient notices and choices. The findings contribute to expanding the requirements for designing the aspect of privacy as a legal requirement to incorporate the value of privacy into systems. (shrink)

This chapter serves as an introduction to the edited collection of the same name, which includes chapters that explore digital well-being from a range of disciplinary perspectives, including philosophy, psychology, economics, health care, and education. The purpose of this introductory chapter is to provide a short primer on the different disciplinary approaches to the study of well-being. To supplement this primer, we also invited key experts from several disciplines—philosophy, psychology, public policy, and health care—to share their thoughts on what they (...) believe are the most important open questions and ethical issues for the multi-disciplinary study of digital well-being. We also introduce and discuss several themes that we believe will be fundamental to the ongoing study of digital well-being: digital gratitude, automated interventions, and sustainable co-well-being. (shrink)

This chapter serves as an introduction to the edited collection of the same name, which includes chapters that explore digital well-being from a range of disciplinary perspectives, including philosophy, psychology, economics, health care, and education. The purpose of this introductory chapter is to provide a short primer on the different disciplinary approaches to the study of well-being. To supplement this primer, we also invited key experts from several disciplines—philosophy, psychology, public policy, and health care—to share their thoughts on what they (...) believe are the most important open questions and ethical issues for the multi-disciplinary study of digital well-being. We also introduce and discuss several themes that we believe will be fundamental to the ongoing study of digital well-being: digital gratitude, automated interventions, and sustainable co-well-being. (shrink)

Autonomous weapons systems, often referred to as ‘killer robots’, have been a hallmark of popular imagination for decades. However, with the inexorable advance of artificial intelligence systems (AI) and robotics, killer robots are quickly becoming a reality. These lethal technologies can learn, adapt, and potentially make life and death decisions on the battlefield with little-to-no human involvement. This naturally leads to not only legal but ethical concerns as to whether we can meaningful control such machines, and if so, then how. (...) Such concerns are made even more poignant by the ever-present fear that something may go wrong, and the machine may carry out some action(s) violating the ethics or laws of war. -/- Researchers, policymakers, and designers are caught in the quagmire of how to approach these highly controversial systems and to figure out what exactly it means to have meaningful human control over them, if at all. -/- In Designed for Death, Dr Steven Umbrello aims to not only produce a realistic but also an optimistic guide for how, with human values in mind, we can begin to design killer robots. Drawing on the value sensitive design (VSD) approach to technology innovation, Umbrello argues that context is king and that a middle path for designing killer robots is possible if we consider both ethics and design as fundamentally linked. Umbrello moves beyond the binary debates of whether or not to prohibit killer robots and instead offers a more nuanced perspective of which types of killer robots may be both legally and ethically acceptable, when they would be acceptable, and how to design for them. (shrink)

Research on the ethics of algorithms has grown substantially over the past decade. Alongside the exponential development and application of machine learning algorithms, new ethical problems and solutions relating to their ubiquitous use in society have been proposed. This article builds on a review of the ethics of algorithms published in 2016, 2016). The goals are to contribute to the debate on the identification and analysis of the ethical implications of algorithms, to provide an updated analysis of epistemic (...) and normative concerns, and to offer actionable guidance for the governance of the design, development and deployment of algorithms. (shrink)

This chapter proposed a novel design methodology called Value-Sensitive Design and its potential application to the field of artificial intelligence research and design. It discusses the imperatives in adopting a design philosophy that embeds values into the design of artificial agents at the early stages of AI development. Because of the high risk stakes in the unmitigated design of artificial agents, this chapter proposes that even though VSD may turn out to be a less-than-optimal (...) design methodology, it currently provides a framework that has the potential to embed stakeholder values and incorporate current design methods. The reader should begin to take away the importance of a proactive design approach to intelligent agents. (shrink)

Artificial Intelligence (AI) is increasingly adopted in society, creating numerous opportunities but at the same time posing ethical challenges. Many of these are familiar, such as issues of fairness, responsibility and privacy, but are presented in a new and challenging guise due to our limited ability to steer and predict the outputs of AI systems. This chapter first introduces these ethical challenges, stressing that overviews of values are a good starting point but frequently fail to suffice due to the context (...) sensitivity of ethical challenges. Frequently, additional (ethical) values emerge for specific applications, as e.g. challenges with fraud detection are very different from those around language technologies. Second, methods to tackle these challenges are discussed. Main ethical theories (virtue ethics, consequentialism, and deontology) are shown to provide a starting point, but often lack the details needed for actionable AI Ethics. Instead, mid-level philosophical theories coupled to design-approaches such as Design for Values, together with interdisciplinary working methods, offer the best way forwards. The chapter aims to show how these approaches can lead to an ethics of AI that is actionable and that can be proactively integrated in the design of AI systems. (shrink)