Engineering Ethics

As Christian List (2021) has recently argued, the increasing arrival of powerful AI systems that operate autonomously in high-stakes contexts creates a need for “future-proofing” our regulatory frameworks, i.e., for reassessing them in the face of these developments. One core part of our regulatory frameworks that dominates our everyday moral interactions is blame. Therefore, “future-proofing” our extant regulatory frameworks in the face of the increasing arrival of powerful AI systems requires, among others things, that we ask whether it makes sense (...) to extend our blaming practices to these systems. In the paper, we argue for the admittedly surprising thesis that this question should be answered in the affirmative: contrary to what one might initially think, it can make a lot of sense to blame AI systems, since, as we furthermore argue, many of the important functions that are fulfilled by blaming humans can also be served by blaming AI systems. The paper concludes that this result gives us a good pro tanto reason to extend our blame practices to AI systems. (shrink)

Autonomy has been central to moral and political philosophy for millenia, and has been positioned as a critical aspect of both justice and wellbeing. Research in psychology supports this position, providing empirical evidence that autonomy is critical to motivation, personal growth and psychological wellness. Responsible AI will require an understanding of, and ability to effectively design for, human autonomy (rather than just machine autonomy) if it is to genuinely benefit humanity. Yet the effects on human autonomy of digital experiences are (...) neither straightforward nor consistent, and are complicated by commercial interests and tensions around compulsive overuse. This multi-layered reality requires an analysis that is itself multidimensional and that takes into account human experience at various levels of resolution. We borrow from HCI and psychological research to apply a model (“METUX”) that identifies six distinct spheres of technology experience. We demonstrate the value of the model for understanding human autonomy in a technology ethics context at multiple levels by applying it to the real-world case study of an AI-enhanced video recommender system. In the process we argue for the following three claims: 1) There are autonomy-related consequences to algorithms representing the interests of third parties, and they are not impartial and rational extensions of the self, as is often perceived; 2) Designing for autonomy is an ethical imperative critical to the future design of responsible AI; and 3) Autonomy-support must be analysed from at least six spheres of experience in order to approriately capture contradictory and downstream effects. (shrink)

It is crucial for engineers to anticipate the socio-ethical impacts of emerging technologies. Such acts of anticipation are thoroughly normative and should be cultivated in engineering ethics education. In this paper we ask: ‘ how do we anticipate the socio-ethical implications of emerging technologies responsibly? ’ And ‘ how can such responsible anticipation be taught? ’ We o ff er a conceptual answer, building upon the framework of Responsible Innovation and its four core practices: anticipation, reflexivity, inclusion, and responsiveness. We (...) forge a more explicit link between the practices of anticipation, reflexivity, and inclusion, while also enriching them with insights from disability studies, STS, design theory, and philosophy. On this basis we present responsible anticipation as an activity of reflective problem framing grounded in epistemic humility. Via the RI-practice of responsiveness we present responsible anticipation as a creative approach to engineering ethics, offering engineering students a critical yet productive perspective on how ethics may inform innovation. (shrink)

Algorithm engineering is sometimes portrayed as a new 21st century return of manipulative social engineering. Yet algorithms are necessary tools for individuals to navigate online platforms. Algorithms are like a sensory apparatus through which we perceive online platforms: this is also why individuals can be subtly but pervasively manipulated by biased algorithms. How can we better understand the nature of algorithm engineering and its proper function? In this chapter I argue that algorithm engineering can be best conceptualized as a type (...) of environmental engineering aimed at making the online environment more hospitable to human use, in particular by safeguarding the conditions that allow for trust. (shrink)

This chapter discusses the fundamental question of the defense industry’s role and legitimacy for societies. It begins with a parable of a psychopath doing something self-serving that has beneficial moral consequences. Analogously, it is argued, the defense industry profiting by selling weapons that can kill people makes it useful in solving moral problems not solvable by people with ordinary moral scruples. Next, the chapter argues that while the defense industry is a business, it is also implicated in the security of (...) its home nations. In addition, its products can be used for good or evil. Thus, it must navigate conflicting values, with the result that the rules often thought to rightly regulate the industry—codes of business ethics, engineering ethics, procurement ethics, plus laws of the land, and dicta of conscience—need supplementing by general moral reflection. This chapter argues for a principle that tells how to decide when to violate the rules, for a theory of rational choice on which choosing by this principle is rational, and for teaching that theory to defense industry employees to ensure their ethical behavior. (shrink)

Climate change is an existential risk reinforced by ordinary actions in afuent societies—often silently present in comfortable and enjoyable habits. This silence is sometimes broken, presenting itself as a nagging reminder of how our habits fuel a catastrophe. As a case in point, global warming has created a state of urgency among wine makers in Spain, as the alcohol level has risen to a point where it jeopardises wine quality and thereby Spanish viticulture. Eforts are currently being made to solve (...) this problem technologically by developing (non-GMO) strains of yeast that produce less alcohol. If successful, this could help save Spanish viticulture. This kind of technological solution is routinely criticised for ofering simplistic “techno-fx” solutions to solve complex societal problems. However, it is not clear what features are criticised by the notion of techno-fx and hence how to avoid this criticism. In our interpretation, the techno-fx notion is not exclusively used as a dismissive term. The notion points to a general virtue of engineering: to create technological solutions that work silently in the background. This asset of technological solutions might sometimes be problematic and sometimes not. Hence, it needs to be analysed case-by-case by paying attention to the moral relevance of the hidden implications of the technology and of the unrefective actions and habits that they facilitate. Such moral analysis will in turn inform strategies for foregrounding this technology to counteract silencing. We discuss what this means in the case of modifying yeast as a viticultural climate resilience strategy. (shrink)

As quantum technologies (QT) advance, their potential impact on and relation with society has been developing into an important issue for exploration. In this paper, we investigate the topic of democratization in the context of QT, particularly quantum computing. The paper contains three main sections. First, we briefly introduce different theories of democracy (participatory, representative, and deliberative) and how the concept of democratization can be formulated with respect to whether democracy is taken as an intrinsic or instrumental value. Second, we (...) give an overview of how the concept of democratization is used in the QT field. Democratization is mainly adopted by companies working on quantum computing and used in a very narrow understanding of the concept. Third, we explore various narratives and counter-narratives concerning democratization in QT. Finally, we explore the general efforts of democratization in QT such as different forms of access, formation of grassroot communities and special interest groups, the emerging culture of manifesto writing, and how these can be located within the different theories of democracy. In conclusion, we argue that although the ongoing efforts in the democratization of QT are necessary steps towards the democratization of this set of emerging technologies, they should not be accepted as sufficient to argue that QT is a democratized field. We argue that more reflexivity and responsiveness regarding the narratives and actions adopted by the actors in the QT field and making the underlying assumptions of ongoing efforts on democratization of QT explicit, can result in a better technology for society. (shrink)

We are likely to have immersive virtual reality and ubiquitous augmented reality in the coming decades. At least some people will use extended reality or “the metaverse” to work, play and shop. In order to achieve the best possible versions of this virtual future, however, we will need to learn from three decades of regulating the Internet. The new virtual world cannot consist of walled corporate fiefdoms ruled only by profitmaximization. The interests of workers, consumers and citizens in virtuality require (...) proactive legislation and oversight. -/- This white paper first addresses the central question the metaverse poses, whether virtual life is inherently more alienating and less authentic than face-to-face life experiences. This question is both a philosophical question about the nature of the good life and an empirical question about the accumulating evidence about the impacts of the digital on subjective well-being. -/- . (shrink)

Non possiamo immaginare un mondo senza le nostre tecnologie e i nostri strumenti. In molti modi, le nostre tecnologie sono ciò che ci definisce come esseri umani, separandoci dal resto del regno animale. Tuttavia, pensare alle nostre tecnologie come semplici strumenti, strumenti che possono essere usati nel bene o nel male, ci rende vulnerabili agli effetti sistemici e duraturi che le tecnologie hanno sulla nostra società, sui comportamenti, e sulle generazioni future. Oggetti Buoni esplora come le tecnologie incarnano i valori (...) dei loro creatori. Prendendo questo approccio unico per guardare alle nostre importanti tecnologie, questa è la prima monografia in Italiano che esplora come le tecnologie siano sensibili al valore, dimostrando come possiamo orientare il nostro futuro attraverso un design intelligente ed etico. Piuttosto che aspettare il futuro, Oggetti Buoni ci mostra come possiamo progettare il nostro futuro per i valori che riteniamo più importanti. (shrink)

Gran parte della letteratura riguardante l’uso dell’intelligenza artificiale (IA) sul posto di lavoro, in particolare nell’ambito dell’assistenza infermieristica e dei servizi di cura, si è concentrata sui problemi etici che insorgono a valle della sua implementazione o per ragioni puramente speculative. Concentrarsi sull’IA come artefatto separato dal suo design e dai suoi progettisti rende l’assistenza infermieristica e la cura, come qualsiasi altro settore, in gran parte impotente nei confronti degli impatti dell’IA. Per questo motivo, la focalizzazione sul design e su (...) come progettare rispettando valori e professionalità dei professionisti e degli operatori sanitari è di massima importanza. Sono state proposti vari approcci per raggiungere questo obiettivo, come la progettazione partecipata, la progettazione universale, la progettazione inclusiva e la progettazione orientata ai valori. Nonostante i vantaggi di questi approcci più consolidati, nessuno di essi si concentra sulle narrazioni e le metafore sottostanti che guidano e influenzano come l’IA viene percepita e quindi impatta il lavoro dei professionisti. Questo lavoro esamina brevemente un approccio complementare, ovvero l’IA centrata sull’essere umano (HCAI), che propone nuove narrazioni di potenziamento e miglioramento per gli utenti, piuttosto che narrazioni di sostituzione. Se i professionisti spingono per l’adozione di tale approccio e nuove narrazioni, possono aumentare, piuttosto che abdicare, la loro responsabilità sul posto di lavoro e aumentare la loro capacità di fornire cure adeguate. (shrink)

In a recent article, Madelaine Ley evaluates the future of work, specifically robotised workplaces, via the lens of care ethics. Like many proponents of care ethics, Ley draws on the approach and its emphasis on relationality to understand ethical action necessary for worker wellbeing. Her paper aims to fill a research gap by shifting away from the traditional contexts in which care ethics is employed, i.e., health and care contexts and instead appropriates the approach to tackle the sociotechnicity of robotics (...) and how caring should be integrated into non-traditional contexts. This paper comments on that of Ley’s, making the case that the author does, in fact, achieve this end while still leaving areas of potential future research open to buttressing the approach she presents. (shrink)

Various approaches have emerged over the last several decades to meet the challenges and complexities of anticipating and responding to the potential impacts of emerging technologies. Although many of the existing approaches share similarities, they each have shortfalls. This paper takes as the object of its study Anticipatory Ethics for Emerging Technologies (ATE) to technology assessment, given that it was formatted to address many of the privations characterising parallel approaches. The ATE approach, also in practice, presents certain areas for retooling, (...) such as how it characterises levels and objects of analysis. This paper results from the work done with the TechEthos Horizon 2020 project in evaluating the ethical, legal, and social impacts of climate engineering, digital extended reality, and neurotechnologies. To meet the challenges these technology families present, this paper aims to enhance the ATE framework to encompass the variety of human processes and material forms, functions, and applications that comprise the socio-technical systems in which these technologies are embedded. (shrink)

The goal of this paper is to review and critically discuss the philosophical aspects of probabilistic seismic hazard analysis (PSHA). Given that estimates of seismic hazard are typically riddled with uncertainty, diferent epistemic values (related to the pursuit of scientifc knowledge) compete in the selection of seismic hazard models, in a context infuenced by non-epistemic values (related to practical goals and aims) as well. We frst distinguish between the diferent types of uncertainty in PSHA. We claim that epistemic and nonepistemic (...) considerations are closely related in the selection of the appropriate estimate of seismic hazard by the experts. Finally, we argue that the division of scientifc responsibility among the experts can lead to responsibility gaps. This raises a problem for the ownership of the results (“no one’s model” problem) similar to the “problem of many hands” in the ethics of technology. We conclude with a plea for a close collaboration between philosophy and engineering. (shrink)

Abstract. The article is devoted to the possibilities of the formation and development of engineering thinking. The paper considers the features of engineering thinking, compares various concepts that characterize engineering activities. The authors compare the concepts of technical, economic, research thinking, identifying the principles of engineering thinking. The need for a humanitarian component in engineering thinking is noted. Consistency and multidimensionality are considered by the authors as the most important concepts for the formation of engineering thinking. In conclusion, the authors (...) point out that engineering thinking universally orients the employee when solving different types of tasks and contributes to greater variability in making standard and non-standard decisions in the production process. -/- . (shrink)

The first part of this article makes the case that human cognition is an intergenerational project enabled by the inheritance and bequeathal of cognitive technology (Sects. 2–4). The final two sections of the article (Sects. 5 and 6) explore the normative significance of this claim. My case for the intergenerational claim draws results from multiple disciplines: philosophy (Sect. 2), cultural evolutionary approaches in cognitive science (Sect. 3), and developmental psychology and neuroscience (Sect. 4). In Sect. 5, I propose that cognitive (...) technology should be given to future generations in accordance with principles of pluralism and transparency. In the final main section of the article, Sect. 6, I apply these principles to topics such as the preservation of information, environmental offloading of cognition, and thinking itself. (shrink)

This article makes the case that our digital devices create illusions of agency. There are times when users feel as if they are in control when in fact they are merely responding to stimuli on the screen in predictable ways. After the introduction, the second section of the article offers examples of illusions of agency that do not involve human–computer interaction in order to show that such illusions are possible and not terribly uncommon. The third and fourth sections of the (...) article cover relevant work from empirical psychology, including the cues that are known to generate the sense of agency. The fifth section of the article shows that our devices are designed to deliver precisely those cues. In the sixth section, the argument is completed with evidence that users frequently use their smartphones without the sort of intentional supervision involved in genuine agency. This sixth section includes the introduction of Digital Environmental Dependency Syndrome (DEDS) as a possible way of characterizing extended use of the smartphone without genuine agency. In the final section of the article, there is a discussion of questions raised by the main claim, including suggestions for reducing occurrences of illusions of agency through software design. (shrink)

[Opinion] This aims to begin deliberation about investing in negative emissions technologies (NETs) by suggesting that the investment could be responsive to two particular values: need and efficiency—and that these values point us towards taking different actions. For negative emissions technologies, I suggest, we face a Need-Efficiency Tradeoff, i.e. a “NET effect”. This tradeoff also highlights several contrasts: responding to need focuses on regional and short-term moral considerations; responding to efficiency focuses on global and long-term moral considerations. [Open access].

Digital ethics, also known as computer ethics or information ethics, is now a lively field that draws a lot of attention, but how did it come about and what were the developments that lead to its existence? What are the traditions, the concerns, the technological and social developments that pushed digital ethics? How did ethical issues change with digitalisation of human life? How did the traditional discipline of philosophy respond? The article provides an overview, proposing historical epochs: ‘pre-modernity’ prior to (...) digital computation over data, via the ‘modernity’ of digital data processing to our present ‘post-modernity’ when not only the data is digital, but our lives themselves are largely digital. In each section, the situation in technology and society is sketched, and then the developments in digital ethics are explained. Finally, a brief outlook is provided. (shrink)

Scientists have the ability to influence policy in important ways through how they present their results. Surprisingly, existing codes of scientific ethics have little to say about such choices. I propose that we can arrive at a set of ethical guidelines to govern scientists’ presentation of information to policymakers by looking to bioethics: roughly, just as a clinician should aim to promote informed decision-making by patients, a scientist should aim to promote informed decision-making by policymakers. Though this may sound like (...) a natural proposal, I show it offers guidance that conflicts with standard scientific practices. I conclude by considering one cost of the proposal: that it would prevent scientists from acting as advocates in a way that is currently common in certain fields. I accept that the proposal would restrict scientists’ political advocacy rights, but argue that the benefits of adopting it — promoting democratic governance — justify the restriction. (shrink)

Achieving energy sovereignty is increasingly gaining prominence as a goal in energy politics. The aim of this paper is to provide a conceptual analysis of this principle from an ethics and social justice perspective. We rely on the literature on food sovereignty to identify through a comparative analysis the elements energy sovereignty will most likely demand and thereafter distinguish the unique constituencies of the energy sector. The idea of energy sovereignty embraces a series of values, among which we identified: (i) (...) accessibility, to allow access to everyone, (ii) empowerment and recognition, to develop and sustain capabilities to collaboratively produce solution-oriented energy system knowledge and effectively participate in governance, (iii) stewardship and sustainability, to be able to design and manage decentralised renewable systems in view of protecting the environment, (iv) self-sufficiency, to reduce the negative shocks of exploitative business practises, (v) resilience, to maintain production capacities while withstanding socioeconomic, political, environmental and climatic shocks, (vi) peace, to establish production systems that do not involve hostile relations, (vii) transparency and self-determination, to establish democratic decision-making mechanisms that give a voice to previously underrepresented groups and limit corporate takeover (viii) gender-justice, by acknowledging the contributions of women and eliminate barriers to their empowerment. With a conceptual framework of energy sovereignty, we present a rationale that draws on the key values to be considered when formulating policy solutions for the energy sector. (shrink)

Augmented reality (AR) technologies function to ‘augment’ normal perception by superimposing virtual objects onto an agent’s visual field. The philosophy of augmented reality is a small but growing subfield within the philosophy of technology. Existing work in this subfield includes research on the phenomenology of augmented experiences, the metaphysics of virtual objects, and different ethical issues associated with AR systems, including (but not limited to) issues of privacy, property rights, ownership, trust, and informed consent. This paper addresses some epistemological issues (...) posed by AR systems. I focus on a near-future version of AR technology called the Real-World Web, which promises to radically transform the nature of our relationship to digital information by mixing the virtual with the physical. I argue that the Real-World Web (RWW) threatens to exacerbate three existing epistemic problems in the digital age: the problem of digital distraction, the problem of digital deception, and the problem of digital divergence. The RWW is poised to present new versions of these problems in the form of what I call the augmented attention economy, augmented skepticism, and the problem of other augmented minds. The paper draws on a range of empirical research on AR and offers a phenomenological analysis of virtual objects as perceptual affordances to help ground and guide the speculative nature of the discussion. It also considers a few policy-based and designed-based proposals to mitigate the epistemic threats posed by AR technology. (shrink)

Genetic engineering technologies are a subclass of the biotechnology family, and are concerned with the use of laboratory-based technologies to intervene with a given organism at the genetic level, i.e., the level of its DNA. This class of technologies could feasibly be used to treat diseases and disabilities, create disease-resistant crops, or even be used to enhance humans to make them more resistant to certain environmental conditions. However, both therapeutic and enhancement applications of genetic engineering raise serious ethical concerns. This (...) paper examines various objections to genetic engineering (as applied to humans) which have been raised in the literature, and presents a new way to frame these issues, and to look for solutions. Specifically, this paper frames genetic engineering technologies within the ‘design turn in applied ethics’ lens and thus situates these technologies as covarying with societal forces. The value sensitive design (VSD) approach to technology design is then appropriated as the conceptual framework in which genetic engineering technologies can be considered so that they can be designed for important human values. By doing so, this paper brings further nuance to the scholarship on genetic engineering technologies by discussing the sociotechnicity of genetic engineering systems rather than framing them as value-neutral tools that either support or constrain values based on how they are used. (shrink)

Although artificial intelligence has been given an unprecedented amount of attention in both the public and academic domains in the last few years, its convergence with other transformative technologies like cloud computing, robotics, and augmented/virtual reality is predicted to exacerbate its impacts on society. The adoption and integration of these technologies within industry and manufacturing spaces is a fundamental part of what is called Industry 4.0, or the Fourth Industrial Revolution. The impacts of this paradigm shift on the human operators (...) who continue to work alongside and symbiotically with these technologies in the industry bring with it novel ethical issues. Therefore, how to design these technologies for human values becomes the critical area of intervention. This paper takes up the case study of robotic AI-based assistance systems to explore the potential value implications that emerge due to current design practices and use. The design methodology known as Value Sensitive Design (VSD) is proposed as a sufficient starting point for designing these technologies for human values to address these issues. (shrink)

In this article, we discuss the continued circulation and use of retracted science as a complex problem: Multiple stakeholders throughout the publishing ecosystem hold competing perceptions of this problem and its possible solutions. We describe how we used a participatory design process model to co-develop recommendations for addressing this problem with stakeholders in the Alfred P. Sloan-funded project, Reducing the Inadvertent Spread of Retracted Science (RISRS). After introducing the four core RISRS recommendations, we discuss how the issue of retraction-related stigma (...) gives rise to recommendation #4, Educate stakeholders about retraction and pre- and post-publication stewardship of the scholarly record. This recommendation is important for training publishing professionals and realizing this recommendation will require further collaborative design work across scholarly communications. We highlight ongoing stakeholder work which is now re-starting the design cycle. We conclude with a discussion of ongoing activities facilitating uptake and refinement of RISRS research and the implementation agenda. (shrink)

It has been argued that ethical frameworks for data science often fail to foster ethical behavior, and they can be difficult to implement due to their vague and ambiguous nature. In order to overcome these limitations of current ethical frameworks, we propose to integrate the analysis of the connections between technical choices and sociocultural factors into the data science process, and show how these connections have consequences for what data subjects can do, accomplish, and be. Using healthcare as an example, (...) attention to sociocultural conversion factors relevant to health can help in navigating technical choices that require broader considerations of the sociotechnical system, such as metric tradeoffs in model validation, resulting in better ethical and technical choices. This approach promotes awareness of the ethical dimension of technical choices by data scientists and others, and that can foster the cultivation of 'ethical skills' as integral to data science. (shrink)

AI-supported methods for identifying and combating disinformation are progressing in their development and application. However, these methods face a litany of epistemic and ethical challenges. These include (1) robustly defining disinformation, (2) reliably classifying data according to this definition, and (3) navigating ethical risks in the deployment of countermeasures, which involve a mixture of harms and benefits. This paper seeks to expose and offer preliminary analysis of these challenges.

[Newspaper opinion] To give carbon storage sites the greatest chance of success, it makes sense to develop them in places where the geology has been thoroughly explored and where there is lots of relevant expertise. This would imply pumping carbon into underground storage sites in northern Europe, the Middle East and the US, where companies have spent centuries looking for and extracting fossil fuels. On the other hand, it might be important to develop storage sites in economies where the current (...) and future demand for carbon capture and storage is greatest. The regions with the best prospects are not often those with the greatest expected need. [Open access]. (shrink)

This paper puts forward two claims about funding carbon capture and storage. The first claim is that there are moral justifications supporting strategic investment into CO2 storage from global and regional perspectives. One argument draws on the empirical evidence which suggests carbon capture and storage would play a significant role in a portfolio of global solutions to climate change; the other draws on Rawls' notion of legitimate expectations and Moellendorf's Anti-Poverty principle. The second claim is that where to pursue this (...) strategic investment poses a morally non-trivial problem, with considerations like near-term global distributive justice and undermining legitimate expectations favouring investing in developing regions, especially in Asia, and considerations like long-term climate impacts and best uses of resources favouring investing in the relatively wealthy regions that have the best prospects for successful storage development. [Open access]. (shrink)

Engineers are traditionally regarded as trustworthy professionals who meet exacting standards. In this chapter I begin by explicating our trust relationship towards engineers, arguing that it is a linear but indirect relationship in which engineers “stand behind” the artifacts and technological systems that we rely on directly. The chapter goes on to explain how this relationship has become more complex as engineers have taken on two additional aims: the aim of social engineering to create and steer trust between people, and (...) the aim of creating automated systems that take over human tasks and are meant to invite the trust of those who rely on and interact with them. (shrink)

In this article, we apply the literature on the ethics of choice-architecture (nudges) to the realm of virtual reality (VR) to point out ethical problems with using VR for empathy-based nudging. Specifically, we argue that VR simulations aiming to enhance empathic understanding of others via perspective-taking will almost always be unethical to develop or deploy. We argue that VR-based empathy enhancement not only faces traditional ethical concerns about nudge (autonomy, welfare, transparency), but also a variant of the semantic variance problem (...) that arises for intersectional perspective-taking. VR empathy simulations deceive and manipulate their users about their experiences. Despite their often laudable goals, such simulations confront significant ethical challenges. In light of these goals and challenges, we conclude by proposing that VR designers shift from designing simulations aimed at producing empathic perspective-taking to designing simulations aimed at generating sympathy. These simulations, we claim, can avoid the most serious ethical issues associated with VR nudges, semantic variance, and intersectionality. (shrink)

The international debate on the ethics and legality of autonomous weapon systems (AWS), along with the call for a ban, primarily focus on the nebulous concept of fully autonomous AWS. These are AWS capable of target selection and engagement absent human supervision or control. This paper argues that such a conception of autonomy is divorced from both military planning and decision-making operations; it also ignores the design requirements that govern AWS engineering and the subsequent tracking and tracing of moral responsibility. (...) To show how military operations can be coupled with design ethics, this paper marries two different kinds of meaningful human control (MHC) termed levels of abstraction. Under this two-tiered understanding of MHC, the contentious notion of ‘full’ autonomy becomes unproblematic. (shrink)

The value sensitive design (VSD) approach to designing transformative technologies for human values is taken as the object of study in this chapter. VSD has traditionally been conceptualized as another type of technology or instrumentally as a tool. The various parts of VSD’s principled approach would then aim to discern the various policy requirements that any given technological artifact under consideration would implicate. Yet, little to no consideration has been given to how laws, regulations, policies and social norms engage within (...) VSD practices. Similarly, how the interactive nature of the VSD approach can, in turn, influence those directives. This is exacerbated when we consider machine ethics policy that have global consequences outside their development spheres. What constructs and models will position AI designers to engage in policy concerns? How can the design of AI policy be integrated with technical design? How might VSD be used to develop AI policy? How might law, regulations, social norms, and other kinds of policy regarding AI systems be engaged within value sensitive design? This chapter takes the VSD as its starting point and aims to determine how laws, regulations and policies come to influence how value trade-offs can be managed within VSD practices. It shows that the iterative and interactional nature of VSD both permits and encourages existing policies to be integrated both early on and throughout the design process. The chapter concludes with some potential future research programs. (shrink)

Value Sensitive Design (VSD) is an established method for integrating values into technical design. It has been applied to different technologies and, more recently, to artificial intelligence (AI). We argue that AI poses a number of challenges specific to VSD that require a somewhat modified VSD approach. Machine learning (ML), in particular, poses two challenges. First, humans may not understand how an AI system learns certain things. This requires paying attention to values such as transparency, explicability, and accountability. Second, ML (...) may lead to AI systems adapting in ways that ‘disembody’ the values embedded in them. To address this, we propose a threefold modified VSD approach: 1) integrating a known set of VSD principles (AI4SG) as design norms from which more specific design requirements can be derived; 2) distinguishing between values that are promoted and respected by the design to ensure outcomes that not only do no harm but also contribute to good; and 3) extending the VSD process to encompass the whole life cycle of an AI technology in order to monitor unintended value consequences and redesign as needed. We illustrate our VSD for AI approach with an example use case of a SARS-CoV-2 contact tracing app. (shrink)

This paper provides a retrospective and prospective overview of TU Delft’s approach to engineering ethics education. For over twenty years, the Ethics and Philosophy of Technology Section at TU Delft has been at the forefront of engineering ethics education, offering education to a wide range of engineering and design students. The approach developed at TU Delft is deeply informed by the research of the Section, which is centered around Responsible Research and Innovation, Design for Values, and Risk Ethics. These theoretical (...) approaches are premised on the notion that technologies are inherently value-laden, and as such contain the possibility of fostering or hindering moral values. Each of these approaches encourages students to take a proactive attitude with respect to their projects and profession, thinking creatively about – and taking responsibility for – how to both prevent harm and do good via the technologies they help develop. To explain how this is put into practice, this paper sketches a brief history of ethics teaching at TU Delft, outlines current activities, and presents future plans for Bachelor and Master’s level engineering ethics education at TU Delft. (shrink)

At the beginning of the COVID-19 pandemic, high hopes were placed on digital contact tracing. Digital contact tracing apps can now be downloaded in many countries, but as further waves of COVID-19 tear through much of the northern hemisphere, these apps are playing a less important role in interrupting chains of infection than anticipated. We argue that one of the reasons for this is that most countries have opted for decentralised apps, which cannot provide a means of rapidly informing users (...) of likely infections while avoiding too many false positive reports. Centralised apps, in contrast, have the potential to do this. But policy making was influenced by public debates about the right app configuration, which have tended to focus heavily on privacy, and are driven by the assumption that decentralised apps are “privacy preserving by design”. We show that both types of apps are in fact vulnerable to privacy breaches, and, drawing on principles from safety engineering and risk analysis, compare the risks of centralised and decentralised systems along two dimensions, namely the probability of possible breaches and their severity. We conclude that a centralised app may in fact minimise overall ethical risk, and contend that we must reassess our approach to digital contact tracing, and should, more generally, be cautious about a myopic focus on privacy when conducting ethical assessments of data technologies. (shrink)

The proposed paper presents an argument in favor of a Rawlsian approach to ethics for Internet technology companies (den Hoven & Rooksby, 2008; Hoffman, 2017). Ethics statements from such companies are analyzed and shown to be utilitarian and teleological in nature, and therefore in opposition to Rawls’ theories of justice and fairness. The statements are also shown to have traits in common with Confucian virtue ethics (Ames, 2011; Nylan, 2008).

If a robot sends a deceptive signal to a human user, is this always and everywhere an unethical act, or might it sometimes be ethically desirable? Building upon previous work in robot ethics, this article tries to clarify and refine our understanding of the ethics of robotic deception. It does so by making three arguments. First, it argues that we need to distinguish between three main forms of robotic deception (external state deception; superficial state deception; and hidden state deception) in (...) order to think clearly about its ethics. Second, it argues that the second type of deception – superficial state deception – is not best thought of as a form of deception, even though it is frequently criticised as such. And third, it argues that the third type of deception is best understood as a form of betrayal because doing so captures the unique ethical harm to which it gives rise, and justifies special ethical protections against its use. (shrink)

In this panel, we explore the future of value sensitive design (VSD). The stakes are high. Many in public and private sectors and in civil society are gradually realizing that taking our values seriously implies that we have to ensure that values effectively inform the design of technology which, in turn, shapes people’s lives. Value sensitive design offers a highly developed set of theory, tools, and methods to systematically do so.

A prominent view in contemporary philosophy of technology suggests that more technology implies more possibilities and, therefore, more responsibilities. Consequently, the question ‘What technology?’ is discussed primarily on the backdrop of assessing, assigning, and avoiding technology-borne culpability. The view is reminiscent of the Olympian gods’ vengeful and harsh reaction to Prometheus’ play with fire. However, the Olympian view leaves unexplained how technologies increase possibilities. Also, if Olympians are right, endorsing their view will at some point demand putting a halt to (...) technological development, which is absurd. Hence, we defend an alternative perspective on the relationship between responsibility and technology: Our Promethean view recognises technology as the result of collective, forward-looking responsibility and not only as a cause thereof. Several examples illustrate that technologies are not always the right means to tackle human vulnerabilities. Together, these arguments prompt a change in focus from the question ‘What technology?’ to ‘Why technology?’. (shrink)

Søren Kierkegaard, in his essay "The Present Age," takes a hostile stance towards the press. This is because he maintains that the press prepares the ground for the emergence of nihilism. Hubert Dreyfus extends this idea to other information technologies, especially the Internet. Since Kierkegaard-Dreyfus’ attitude towards various forms of information technology originates from philosophical anthropology and a particular conception of the meaning of life, assessing the viability of the attitude they hold requires further critical scrutiny. This paper aims to (...) show that, although, Kierkegaard’s and Dreyfus' insights are important in understanding the dangers of information technology their approach concerning the meaning of life and human identity is a one-sided analysis of the problem situation; In particular, their reliance on "Unconditional Commitment" could bring about new undesired consequences. This paper emphasizes that an appropriate stance towards information technology needs, among other things, a richer and more effective philosophical anthropology; one that by utilizing religious-moral wisdom in a sensible manner, provides an effective way to safely benefit from various types of technology without falling into the abyss of nihilism. The paper further argues that we also need to provide an institutional control of technology through piecemeal social engineering in a democratic process. (shrink)

Since the Nuremberg Code and the first Declaration of Helsinki, globally there has been increasing adoption and adherence to procedures for ensuring that human subjects in research are as well informed as possible of the study’s reasons and risks and voluntarily consent to serving as subject. To do otherwise is essentially viewed as violation of the human research subject’s legal and moral rights. However, with the recent philosophical concerns about responsible robotics, the limits and ambiguities of research-subjects ethical codes become (...) apparent on the matter of constructing automata that maximally resemble human beings (as defined hereunder). In this case, the automata themselves, as products of research and development, are in the very process of their construction subjects of research and development. However, such research faces a paradox: The subjects cannot give their informed consent to this research for their own development, although their consent would be needed for the research. According to ethical codes, this research would be unethical. The article then explores whether the background concepts giving rise to this paradox could be reframed in order to allow such research to proceed ethically. (shrink)

As we look beyond our terrestrial boundary to a multi-planetary future for humankind, it becomes paramount to anticipate the challenges of various human factors on the most likely scenario for this future: permanent human settlement of Mars. Even if technical hurdles are circumvented to provide adequate resources for basic physiological and psychological needs, Homo sapiens will not survive on an alien planet if a dysfunctional psyche prohibits the utilization of these resources. No matter how far we soar into the stars, (...) our psychologies for future generations will be forever tethered to the totality of our surroundings. By shaping our environment toward survival and welfare during the voyage to Mars and in a Martian colony, we indirectly shape our psyches and prepare them for a mission of unprecedented alienation and duration. Once on Mars, human factors such as leadership structure, social organization and code of conduct, group size, gender balance, developmental cycle, mobility, length of stay and the ecological settings and type and manner of subsistence, will create a novel Martian culture. The degree that settlers are severed from the Earth will affect how radically foreign this culture will be when compared with cultures on Earth. (shrink)

Engineering and technology aim to lead a better life for people. But the meaning of “better” is highly contested in modern democratic societies where different citizens have different cultures and values. Engineers, as one of the citizens in such societies, are also living in multicultural and multi-value settings, and therefore they need to be responsible for such diversity when they engage in technological developments. Therefore, in engineering education, it is necessary to aim at not only acquiring the specialized technological knowledge (...) but also cultivating citizenship. By citizenship, it refers to a set of abilities to communicate and care for people with respect by taking into account different opinions and expertise of others. Nevertheless, this has not been emphasized much in engineering education in Japan. For example, even in the class of engineering ethics, emphasis is placed more on the acquisition of textbook-based knowledge and virtue of problem cases, and less on abilities to discuss freely and gently. Then, in general education of NIT we have conducted a dialogue-based educational program where learners/students ask questions, listen together and discuss with others. This program is designed based upon so-called Philosophy for/with Children (P4C). Matthew Lipman, one of the founders of P4C, defined the primary aim of P4C as multidimensional- thinking: critical thinking, creative thinking, and caring thinking. In addition, this multidimensional- thinking may, according to many P4C scholars, have a potential of creating active citizenry. The discussion by P4C has three characteristics as follows: 1) People make a circle in the classroom and create a space where students can feel an emotional and intellectual “safety”. 2)Questions being discussed is proposed by students themselves based on their interests, not by teachers 3) Rather than rushing to reach a conclusion, students are asked to concentrate on listening to the differences between each other. This paper begins by explaining what P4C is and why/how P4C is suitable for citizenship education, and then the following sections show our P4C classes in NIT (Tokyo and Ube) and learner's responses. Finally, we claim that the “community of inquiry” created through P4C can prevent the “self- righteousness” of engineers. (shrink)

A new book by Batya Friedman and David G. Hendry, Value Sensitive Design: Shaping Technology with Moral Imagination, is reviewed. Value Sensitive Design is a project into the ethical and design issues that emerge during the engineering programs of new technologies. This book is intended to build on the over two decades of value sensitive design research, however with a greater emphasis on the developments of the theoretical underpinnings of the approach as well as initial steps that designers can employ (...) to put the method into practice. (shrink)

The last decade has witnessed the mass distribution and adoption of smart home systems and devices powered by artificial intelligence systems ranging from household appliances like fridges and toasters to more background systems such as air and water quality controllers. The pervasiveness of these sociotechnical systems makes analyzing their ethical implications necessary during the design phases of these devices to ensure not only sociotechnical resilience, but to design them for human values in mind and thus preserve meaningful human control over (...) them. This paper engages in a conceptual investigations of how meaningful human control over smart home devices can be attained through design. The value sensitive design (VSD) approach is proposed as a way of attaining this level of control. In the proposed framework, values are identified and defined, stakeholder groups are investigated and brought into the design process and the technical constraints of the technologies in question are considered. The paper concludes with some initial examples that illustrate a more adoptable way forward for both ethicists and engineers of smart home devices. (shrink)

The Internet has been identified in human enhancement scholarship as a powerful cognitive enhancement technology. It offers instant access to almost any type of information, along with the ability to share that information with others. The aim of this paper is to critically assess the enhancement potential of the Internet. We argue that unconditional access to information does not lead to cognitive enhancement. The Internet is not a simple, uniform technology, either in its composition, or in its use. We will (...) look into why the Internet as an informational resource currently fails to enhance cognition. We analyze some of the phenomena that emerge from vast, continual fluxes of information–information overload, misinformation and persuasive design—and show how they could negatively impact users’ cognition. Methods for mitigating these negative impacts are then advanced: individual empowerment, better collaborative systems for sorting and categorizing information, and the use of artificial intelligence assistants that could guide users through the informational space of today’s Internet. (shrink)

I discuss three tiers of technological innovation: mild innovation, or the acceleration by technology of a human activity aimed at a good; moderate innovation, or the obviation by technology of an activity aimed at a good; and radical innovation, or the altering by technology of the human condition so as to change what counts as a good. I argue that it is impossible to morally assess proposed innovations within any of these three tiers unless we rehabilitate a natural-law ethical framework. (...) And I offer some moral starting points within such a framework, in connection with innovations of each of the three types. (shrink)

Many authors have proposed constraining the behaviour of intelligent systems with ‘machine ethics’ to ensure positive social outcomes from the development of such systems. This paper critically analyses the prospects for machine ethics, identifying several inherent limitations. While machine ethics may increase the probability of ethical behaviour in some situations, it cannot guarantee it due to the nature of ethics, the computational limitations of computational agents and the complexity of the world. In addition, machine ethics, even if it were to (...) be ‘solved’ at a technical level, would be insufficient to ensure positive social outcomes from intelligent systems. (shrink)

I recommend this book, although it lacks coverage of environmental ethics.

This article brings animal protection theory to bear on Temple Grandin’s work, in her capacity both as a designer of slaughter facilities and as an advocate for omnivorism. Animal protection is a better term for what is often termed animal rights, given that many of the theories grouped under the animal rights label do not extend the concept of rights to animals. I outline the nature of Grandin’s system of humane slaughter as it pertains to cattle. I then outline four (...) arguments Grandin has made defending meat-eating. On a protection-based approach, I argue, Grandin’s system of slaughter is superior to its traditional counterpart. Grandin’s success as a designer of humane slaughterhouses however is not matched by any corresponding success in offering a moral defence of meat-eating. Despite, or perhaps because of, the popularity of her work, Grandin’s arguments for continuing to eat animals are noteworthy only in how disappointing and rudimentary they are. If we can thank Grandin for making a difference in the lives of millions of farm animals, her work can also be criticized for not engaging the moral status of animals with the depth and rigor that it deserves. (shrink)