Engineering Ethics

Autonomy has been central to moral and political philosophy for millenia, and has been positioned as a critical aspect of both justice and wellbeing. Research in psychology supports this position, providing empirical evidence that autonomy is critical to motivation, personal growth and psychological wellness. Responsible AI will require an understanding of, and ability to effectively design for, human autonomy (rather than just machine autonomy) if it is to genuinely benefit humanity. Yet the effects on human autonomy of digital experiences are (...) neither straightforward nor consistent, and are complicated by commercial interests and tensions around compulsive overuse. This multi-layered reality requires an analysis that is itself multidimensional and that takes into account human experience at various levels of resolution. We borrow from HCI and psychological research to apply a model (“METUX”) that identifies six distinct spheres of technology experience. We demonstrate the value of the model for understanding human autonomy in a technology ethics context at multiple levels by applying it to the real-world case study of an AI-enhanced video recommender system. In the process we argue for the following three claims: 1) There are autonomy-related consequences to algorithms representing the interests of third parties, and they are not impartial and rational extensions of the self, as is often perceived; 2) Designing for autonomy is an ethical imperative critical to the future design of responsible AI; and 3) Autonomy-support must be analysed from at least six spheres of experience in order to approriately capture contradictory and downstream effects. (shrink)

Engineers are traditionally regarded as trustworthy professionals who meet exacting standards. In this chapter I begin by explicating our trust relationship towards engineers, arguing that it is a linear but indirect relationship in which engineers “stand behind” the artifacts and technological systems that we rely on directly. The chapter goes on to explain how this relationship has become more complex as engineers have taken on two additional aims: the aim of social engineering to create and steer trust between people, and (...) the aim of creating automated systems that take over human tasks and are meant to invite the trust of those who rely on and interact with them. (shrink)

Scientists have the ability to influence policy in important ways through how they present their results. Surprisingly, existing codes of scientific ethics have little to say about such choices. I propose that we can arrive at a set of ethical guidelines to govern scientists’ presentation of information to policymakers by looking to bioethics: roughly, just as a clinician should aim to promote informed decision-making by patients, a scientist should aim to promote informed decision-making by policymakers. Though this may sound like (...) a natural proposal, I show it offers guidance that conflicts with standard scientific practices. I conclude by considering one cost of the proposal: that it would prevent scientists from acting as advocates in a way that is currently common in certain fields. I accept that the proposal would restrict scientists’ political advocacy rights, but argue that the benefits of adopting it — promoting democratic governance — justify the restriction. (shrink)

The international debate on the ethics and legality of autonomous weapon systems (AWS), along with the call for a ban, primarily focus on the nebulous concept of fully autonomous AWS. These are AWS capable of target selection and engagement absent human supervision or control. This paper argues that such a conception of autonomy is divorced from both military planning and decision-making operations; it also ignores the design requirements that govern AWS engineering and the subsequent tracking and tracing of moral responsibility. (...) To show how military operations can be coupled with design ethics, this paper marries two different kinds of meaningful human control (MHC) termed levels of abstraction. Under this two-tiered understanding of MHC, the contentious notion of ‘full’ autonomy becomes unproblematic. (shrink)

In this article, we apply the literature on the ethics of choice-architecture (nudges) to the realm of virtual reality (VR) to point out ethical problems with using VR for empathy-based nudging. Specifically, we argue that VR simulations aiming to enhance empathic understanding of others via perspective-taking will almost always be unethical to develop or deploy. We argue that VR-based empathy enhancement not only faces traditional ethical concerns about nudge (autonomy, welfare, transparency), but also a variant of the semantic variance problem (...) that arises for intersectional perspective-taking. VR empathy simulations deceive and manipulate their users about their experiences. Despite their often laudable goals, such simulations confront significant ethical challenges. In light of these goals and challenges, we conclude by proposing that VR designers shift from designing simulations aimed at producing empathic perspective-taking to designing simulations aimed at generating sympathy. These simulations, we claim, can avoid the most serious ethical issues associated with VR nudges, semantic variance, and intersectionality. (shrink)

The value sensitive design (VSD) approach to designing transformative technologies for human values is taken as the object of study in this chapter. VSD has traditionally been conceptualized as another type of technology or instrumentally as a tool. The various parts of VSD’s principled approach would then aim to discern the various policy requirements that any given technological artifact under consideration would implicate. Yet, little to no consideration has been given to how laws, regulations, policies and social norms engage within (...) VSD practices. Similarly, how the interactive nature of the VSD approach can, in turn, influence those directives. This is exacerbated when we consider machine ethics policy that have global consequences outside their development spheres. What constructs and models will position AI designers to engage in policy concerns? How can the design of AI policy be integrated with technical design? How might VSD be used to develop AI policy? How might law, regulations, social norms, and other kinds of policy regarding AI systems be engaged within value sensitive design? This chapter takes the VSD as its starting point and aims to determine how laws, regulations and policies come to influence how value trade-offs can be managed within VSD practices. It shows that the iterative and interactional nature of VSD both permits and encourages existing policies to be integrated both early on and throughout the design process. The chapter concludes with some potential future research programs. (shrink)

Value Sensitive Design (VSD) is an established method for integrating values into technical design. It has been applied to different technologies and, more recently, to artificial intelligence (AI). We argue that AI poses a number of challenges specific to VSD that require a somewhat modified VSD approach. Machine learning (ML), in particular, poses two challenges. First, humans may not understand how an AI system learns certain things. This requires paying attention to values such as transparency, explicability, and accountability. Second, ML (...) may lead to AI systems adapting in ways that ‘disembody’ the values embedded in them. To address this, we propose a threefold modified VSD approach: 1) integrating a known set of VSD principles (AI4SG) as design norms from which more specific design requirements can be derived; 2) distinguishing between values that are promoted and respected by the design to ensure outcomes that not only do no harm but also contribute to good; and 3) extending the VSD process to encompass the whole life cycle of an AI technology in order to monitor unintended value consequences and redesign as needed. We illustrate our VSD for AI approach with an example use case of a SARS-CoV-2 contact tracing app. (shrink)

At the beginning of the COVID-19 pandemic, high hopes were placed on digital contact tracing. Digital contact tracing apps can now be downloaded in many countries, but as further waves of COVID-19 tear through much of the northern hemisphere, these apps are playing a less important role in interrupting chains of infection than anticipated. We argue that one of the reasons for this is that most countries have opted for decentralised apps, which cannot provide a means of rapidly informing users (...) of likely infections while avoiding too many false positive reports. Centralised apps, in contrast, have the potential to do this. But policy making was influenced by public debates about the right app configuration, which have tended to focus heavily on privacy, and are driven by the assumption that decentralised apps are “privacy preserving by design”. We show that both types of apps are in fact vulnerable to privacy breaches, and, drawing on principles from safety engineering and risk analysis, compare the risks of centralised and decentralised systems along two dimensions, namely the probability of possible breaches and their severity. We conclude that a centralised app may in fact minimise overall ethical risk, and contend that we must reassess our approach to digital contact tracing, and should, more generally, be cautious about a myopic focus on privacy when conducting ethical assessments of data technologies. (shrink)

The proposed paper presents an argument in favor of a Rawlsian approach to ethics for Internet technology companies (den Hoven & Rooksby, 2008; Hoffman, 2017). Ethics statements from such companies are analyzed and shown to be utilitarian and teleological in nature, and therefore in opposition to Rawls’ theories of justice and fairness. The statements are also shown to have traits in common with Confucian virtue ethics (Ames, 2011; Nylan, 2008).

If a robot sends a deceptive signal to a human user, is this always and everywhere an unethical act, or might it sometimes be ethically desirable? Building upon previous work in robot ethics, this article tries to clarify and refine our understanding of the ethics of robotic deception. It does so by making three arguments. First, it argues that we need to distinguish between three main forms of robotic deception (external state deception; superficial state deception; and hidden state deception) in (...) order to think clearly about its ethics. Second, it argues that the second type of deception – superficial state deception – is not best thought of as a form of deception, even though it is frequently criticised as such. And third, it argues that the third type of deception is best understood as a form of betrayal because doing so captures the unique ethical harm to which it gives rise, and justifies special ethical protections against its use. (shrink)

In this panel, we explore the future of value sensitive design (VSD). The stakes are high. Many in public and private sectors and in civil society are gradually realizing that taking our values seriously implies that we have to ensure that values effectively inform the design of technology which, in turn, shapes people’s lives. Value sensitive design offers a highly developed set of theory, tools, and methods to systematically do so.

A prominent view in contemporary philosophy of technology suggests that more technology implies more possibilities and, therefore, more responsibilities. Consequently, the question ‘What technology?’ is discussed primarily on the backdrop of assessing, assigning, and avoiding technology-borne culpability. The view is reminiscent of the Olympian gods’ vengeful and harsh reaction to Prometheus’ play with fire. However, the Olympian view leaves unexplained how technologies increase possibilities. Also, if Olympians are right, endorsing their view will at some point demand putting a halt to (...) technological development, which is absurd. Hence, we defend an alternative perspective on the relationship between responsibility and technology: Our Promethean view recognises technology as the result of collective, forward-looking responsibility and not only as a cause thereof. Several examples illustrate that technologies are not always the right means to tackle human vulnerabilities. Together, these arguments prompt a change in focus from the question ‘What technology?’ to ‘Why technology?’. (shrink)

Since the Nuremberg Code and the first Declaration of Helsinki, globally there has been increasing adoption and adherence to procedures for ensuring that human subjects in research are as well informed as possible of the study’s reasons and risks and voluntarily consent to serving as subject. To do otherwise is essentially viewed as violation of the human research subject’s legal and moral rights. However, with the recent philosophical concerns about responsible robotics, the limits and ambiguities of research-subjects ethical codes become (...) apparent on the matter of constructing automata that maximally resemble human beings (as defined hereunder). In this case, the automata themselves, as products of research and development, are in the very process of their construction subjects of research and development. However, such research faces a paradox: The subjects cannot give their informed consent to this research for their own development, although their consent would be needed for the research. According to ethical codes, this research would be unethical. The article then explores whether the background concepts giving rise to this paradox could be reframed in order to allow such research to proceed ethically. (shrink)

As we look beyond our terrestrial boundary to a multi-planetary future for humankind, it becomes paramount to anticipate the challenges of various human factors on the most likely scenario for this future: permanent human settlement of Mars. Even if technical hurdles are circumvented to provide adequate resources for basic physiological and psychological needs, Homo sapiens will not survive on an alien planet if a dysfunctional psyche prohibits the utilization of these resources. No matter how far we soar into the stars, (...) our psychologies for future generations will be forever tethered to the totality of our surroundings. By shaping our environment toward survival and welfare during the voyage to Mars and in a Martian colony, we indirectly shape our psyches and prepare them for a mission of unprecedented alienation and duration. Once on Mars, human factors such as leadership structure, social organization and code of conduct, group size, gender balance, developmental cycle, mobility, length of stay and the ecological settings and type and manner of subsistence, will create a novel Martian culture. The degree that settlers are severed from the Earth will affect how radically foreign this culture will be when compared with cultures on Earth. (shrink)

Engineering and technology aim to lead a better life for people. But the meaning of “better” is highly contested in modern democratic societies where different citizens have different cultures and values. Engineers, as one of the citizens in such societies, are also living in multicultural and multi-value settings, and therefore they need to be responsible for such diversity when they engage in technological developments. Therefore, in engineering education, it is necessary to aim at not only acquiring the specialized technological knowledge (...) but also cultivating citizenship. By citizenship, it refers to a set of abilities to communicate and care for people with respect by taking into account different opinions and expertise of others. Nevertheless, this has not been emphasized much in engineering education in Japan. For example, even in the class of engineering ethics, emphasis is placed more on the acquisition of textbook-based knowledge and virtue of problem cases, and less on abilities to discuss freely and gently. Then, in general education of NIT we have conducted a dialogue-based educational program where learners/students ask questions, listen together and discuss with others. This program is designed based upon so-called Philosophy for/with Children (P4C). Matthew Lipman, one of the founders of P4C, defined the primary aim of P4C as multidimensional- thinking: critical thinking, creative thinking, and caring thinking. In addition, this multidimensional- thinking may, according to many P4C scholars, have a potential of creating active citizenry. The discussion by P4C has three characteristics as follows: 1) People make a circle in the classroom and create a space where students can feel an emotional and intellectual “safety”. 2)Questions being discussed is proposed by students themselves based on their interests, not by teachers 3) Rather than rushing to reach a conclusion, students are asked to concentrate on listening to the differences between each other. This paper begins by explaining what P4C is and why/how P4C is suitable for citizenship education, and then the following sections show our P4C classes in NIT (Tokyo and Ube) and learner's responses. Finally, we claim that the “community of inquiry” created through P4C can prevent the “self- righteousness” of engineers. (shrink)

A new book by Batya Friedman and David G. Hendry, Value Sensitive Design: Shaping Technology with Moral Imagination, is reviewed. Value Sensitive Design is a project into the ethical and design issues that emerge during the engineering programs of new technologies. This book is intended to build on the over two decades of value sensitive design research, however with a greater emphasis on the developments of the theoretical underpinnings of the approach as well as initial steps that designers can employ (...) to put the method into practice. (shrink)

The last decade has witnessed the mass distribution and adoption of smart home systems and devices powered by artificial intelligence systems ranging from household appliances like fridges and toasters to more background systems such as air and water quality controllers. The pervasiveness of these sociotechnical systems makes analyzing their ethical implications necessary during the design phases of these devices to ensure not only sociotechnical resilience, but to design them for human values in mind and thus preserve meaningful human control over (...) them. This paper engages in a conceptual investigations of how meaningful human control over smart home devices can be attained through design. The value sensitive design (VSD) approach is proposed as a way of attaining this level of control. In the proposed framework, values are identified and defined, stakeholder groups are investigated and brought into the design process and the technical constraints of the technologies in question are considered. The paper concludes with some initial examples that illustrate a more adoptable way forward for both ethicists and engineers of smart home devices. (shrink)

The Internet has been identified in human enhancement scholarship as a powerful cognitive enhancement technology. It offers instant access to almost any type of information, along with the ability to share that information with others. The aim of this paper is to critically assess the enhancement potential of the Internet. We argue that unconditional access to information does not lead to cognitive enhancement. The Internet is not a simple, uniform technology, either in its composition, or in its use. We will (...) look into why the Internet as an informational resource currently fails to enhance cognition. We analyze some of the phenomena that emerge from vast, continual fluxes of information–information overload, misinformation and persuasive design—and show how they could negatively impact users’ cognition. Methods for mitigating these negative impacts are then advanced: individual empowerment, better collaborative systems for sorting and categorizing information, and the use of artificial intelligence assistants that could guide users through the informational space of today’s Internet. (shrink)

I discuss three tiers of technological innovation: mild innovation, or the acceleration by technology of a human activity aimed at a good; moderate innovation, or the obviation by technology of an activity aimed at a good; and radical innovation, or the altering by technology of the human condition so as to change what counts as a good. I argue that it is impossible to morally assess proposed innovations within any of these three tiers unless we rehabilitate a natural-law ethical framework. (...) And I offer some moral starting points within such a framework, in connection with innovations of each of the three types. (shrink)

Many authors have proposed constraining the behaviour of intelligent systems with ‘machine ethics’ to ensure positive social outcomes from the development of such systems. This paper critically analyses the prospects for machine ethics, identifying several inherent limitations. While machine ethics may increase the probability of ethical behaviour in some situations, it cannot guarantee it due to the nature of ethics, the computational limitations of computational agents and the complexity of the world. In addition, machine ethics, even if it were to (...) be ‘solved’ at a technical level, would be insufficient to ensure positive social outcomes from intelligent systems. (shrink)

This article brings animal protection theory to bear on Temple Grandin’s work, in her capacity both as a designer of slaughter facilities and as an advocate for omnivorism. Animal protection is a better term for what is often termed animal rights, given that many of the theories grouped under the animal rights label do not extend the concept of rights to animals. I outline the nature of Grandin’s system of humane slaughter as it pertains to cattle. I then outline four (...) arguments Grandin has made defending meat-eating. On a protection-based approach, I argue, Grandin’s system of slaughter is superior to its traditional counterpart. Grandin’s success as a designer of humane slaughterhouses however is not matched by any corresponding success in offering a moral defence of meat-eating. Despite, or perhaps because of, the popularity of her work, Grandin’s arguments for continuing to eat animals are noteworthy only in how disappointing and rudimentary they are. If we can thank Grandin for making a difference in the lives of millions of farm animals, her work can also be criticized for not engaging the moral status of animals with the depth and rigor that it deserves. (shrink)

Designing in Ethics provides a compilation of well-curated essays that tackle the ethical issues that surround technological design and argue that ethics must form a constitutive part of the designing process and a foundation in our institutions and practices. The appropriation of a design approach to applied ethics is argued as a means by which ethical issues that implicate technological artifact may be achieved.

There are two primary camps in which nanotechnology today can be categorized normal nanotechnology and speculative nanotechnology. The birth of nanotechnology proper was conceived through discourses of speculative nanotechnology. However, current nanotech-nology research has detracted from its speculative promises in favour of more attainable material products. Nonetheless, normal nanotechnology has leveraged the popular support and consequential funding it needs to conduct research and development (R&D) as a result of popular conceptions of speculative nanotechnology and its promises. Similarly, the scholarly literature (...) has shifted its focus away from speculative nanofutures towards normal nanotech-nology R&D. This paper shows that there is an incongruence between the representation of nanotechnology in the media, scholarly journals and industry. (shrink)

Responsible Research and Innovation (RRI) reflects an innovation paradigm that acknowledges that market innovations do not automatically deliver on socially desirable objectives, and requires a broad governance of knowledge coalitions of governmental bodies as well as industrial and societal actors to address market deficits. Responsible Innovation should be understood as a new paradigm for innovation which requires institutional changes in the research and innovation system and the public governance of the economy. It also requires the institutionalisation of an ethics of (...) co-responsibility as well as the introduction of new standards and certification processes for products. Dr. Dr. phil. von Schomberg will introduce Responsible Innovation against the background of 6 deficits of the (global) research and innovation system. (shrink)

This paper focuses on the question of What kind of engineering ethics (EE) is needed to develop holistic engineers who can practice and promote the principles of sustainable development? -/- It is argued that, given the existence of other models, an approach to EE, as argued for at EESD 2016, centred on “training engineers for handling ethical dilemmas in sustainability contexts” (Lundqvist and Svanstrom 2016) is inadequate to address the sustainability challenge facing engineers.. We contend that while EE is now (...) a diverse and fragmented field sociological tools can be used to understand this diversity. A framework is offered for understanding different approaches. This is used as the basis for arguing for a more extended and broad approach which allows us to focus on the relationship between social structure and human action and the need for “adequate social institutions and structures” (Becker 2012: 28) to enable ethical action. Thus engineers not should only understand the constraints and enablers emanating from the environments in which they work but can also strive for change in these environments. (shrink)

The growth of self-tracking and personal surveillance has given rise to the Quantified Self movement. Members of this movement seek to enhance their personal well-being, productivity, and self-actualization through the tracking and gamification of personal data. The technologies that make this possible can also track and gamify aspects of our interpersonal, romantic relationships. Several authors have begun to challenge the ethical and normative implications of this development. In this article, we build upon this work to provide a detailed ethical analysis (...) of the Quantified Relationship. We identify eight core objections to the QR and subject them to critical scrutiny. We argue that although critics raise legitimate concerns, there are ways in which tracking technologies can be used to support and facilitate good relationships. We thus adopt a stance of cautious openness toward this technology and advocate the development of a research agenda for the positive use of QR technologies. (shrink)

I criticize Robison's proposal to excise normative ethical paradigms from the engineering ethics curriculum.

On the historical origins of technological fixes and their wider social and political implications.

This research project aims to accomplish two primary objectives: (1) propose an argument that a posthuman ethics in the design of technologies is sound and thus warranted and, (2) how can existent SBD approaches begin to envision principled and methodological ways of incorporating nonhuman values into design. In order to do this this MRP will provide a rudimentary outline of what constitutes SBD approaches. A particular design approach - Value Sensitive Design (VSD) - is taken up as an illustrative example (...) given that it, among the other SBD frameworks, most clearly illustrates a principled approach to the integration of values in design. -/- This explication will be followed by the strongest arguments for a posthumanist ethic, primarily drawing from the works of the Italian philosophers Leonardo Caffo and Roberto Marchesini and Francesa Ferrando. In doing so I will show how the human imperative to account for nonhuman values is a duty and as such must be continually ready-to-hand when making value-critical decision. (shrink)

This paper argues that although moral intuitions are insufficient for making judgments on new technological innovations, they maintain great utility for informing responsible innovation. To do this, this paper employs the Value Sensitive Design (VSD) methodology as an illustrative example of how stakeholder values can be better distilled to inform responsible innovation. Further, it is argued that moral intuitions are necessary for determining stakeholder values required for the design of responsible technologies. This argument is supported by the claim that the (...) moral intuitions of stakeholders allow designers to conceptualize stakeholder values and incorporate them into the early phases of design. It is concluded that design-for-values (DFV) frameworks like the VSD methodology can remain potent if developers adopt heuristic tools to diminish the influence of cognitive biases thus strengthening the reliability of moral intuitions. (shrink)

Atomically precise manufacturing (APM) is the assembly of materials with atomic precision. APM does not currently exist, and may not be feasible, but if it is feasible, then the societal impacts could be dramatic. This paper assesses the net societal impacts of APM across the full range of important APM sectors: general material wealth, environmental issues, military affairs, surveillance, artificial intelligence, and space travel. Positive effects were found for material wealth, the environment, military affairs (specifically nuclear disarmament), and space travel. (...) Negative effects were found for military affairs (specifically rogue actor violence and AI. The net effect for surveillance was ambiguous. The effects for the environment, military affairs, and AI appear to be the largest, with the environment perhaps being the largest of these, suggesting that APM would be net beneficial to society. However, these factors are not well quantified and no definitive conclusion can be made. One conclusion that can be reached is that if APM R&D is pursued, it should go hand-in-hand with effective governance strategies to increase the benefits and reduce the harms. (shrink)

There are various philosophical approaches and theories describing the intimate relation people have to artifacts. In this paper, I explore the relation between two such theories, namely distributed cognition and distributed morality theory. I point out a number of similarities and differences in these views regarding the ontological status they attribute to artifacts and the larger systems they are part of. Having evaluated and compared these views, I continue by focussing on the way cognitive artifacts are used in moral practice. (...) I specifically conceptualise how such artifacts (a) scaffold and extend moral reasoning and decision-making processes, (b) have a certain moral status which is contingent on their cognitive status, and (c) whether responsibility can be attributed to distributed systems. This paper is primarily written for those interested in the intersection of cognitive and moral theory as it relates to artifacts, but also for those independently interested in philosophical debates in extended and distributed cognition and ethics of (cognitive) technology. (shrink)

This paper traces the role of American technocrats in popularizing the notion later dubbed the “technological fix”. Channeled by their long-term “chief”, Howard Scott, their claim was that technology always provides the most effective solution to modern social, cultural and political problems. The account focuses on the expression of this technological faith, and how it was proselytized, from the era of high industrialism between the World Wars through, and beyond, the nuclear age. I argue that the packaging and promotion of (...) these ideas relied on allegorical technological tales and readily-absorbed graphic imagery. Combined with what Scott called “symbolization”, this seductive discourse preached beliefs about technology to broad audiences. The style and conviction of the messages were echoed by establishment figures such as National Lab director Alvin Weinberg, who employed the techniques to convert mainstream and elite audiences through the end of the twentieth century. (shrink)

Social Media is part of contemporary technology that is the contentious subject matter within the society. It is paradoxical when social media should provide techniques and objects that serve human being in a positive way, but at the same time, it can dehumanize human being such as alienation. The main problem is because the lack of impact of public policy, which does not involve society in the democratic sphere. The article is about the possibility of democratization social media in the (...) discourse of philosophy of technology. I refer to Andrew Feenberg’s Critical Theory of Technology (CTT) for opening discourse and criticizing social media. Social Media should be changed by the critical view to analyze the internal contradictions in technocracy, which view social media merely as an instrument and value-free. In the other hand, CTT will lead into the discourse of instrumentalization theory, technological rationality, technical code and democratization of social media. I conclude this article by applying CTT to delineate extant approach and consideration of democratization of social media in Indonesian through critical thinking participation and emotional education in the public sphere. (shrink)

To create fair and accountable AI and robotics, we need precise regulation and better methods to certify, explain, and audit inscrutable systems.

The convergence of computing, sensing, and communication technology will soon permit large-scale deployment of self-driving vehicles. This will in turn permit a radical transformation of traffic control technology. This paper makes a case for the importance of addressing questions of social justice in this transformation, and sketches a preliminary framework for doing so. We explain how new forms of traffic control technology have potential implications for several dimensions of social justice, including safety, sustainability, privacy, efficiency, and equal access. Our central (...) focus is on efficiency and equal access as desiderata for traffic control design. We explain the limitations of conventional traffic control in meeting these desiderata, and sketch a preliminary vision for a next-generation traffic control tailored to address better the demands of social justice. One component of this vision is cooperative, hierarchically distributed self-organization among vehicles. Another component of this vision is a priority system enabling selection of priority levels by the user for each vehicle trip in the network, based on the supporting structure of non-monetary credits. (shrink)

If the intelligence of artificial systems were to surpass that of humans significantly, this would constitute a significant risk for humanity. Time has come to consider these issues, and this consideration must include progress in AI as much as insights from the theory of AI. The papers in this volume try to make cautious headway in setting the problem, evaluating predictions on the future of AI, proposing ways to ensure that AI systems will be beneficial to humans – and critically (...) evaluating such proposals. (shrink)

This essay develops a new conceptual framework of science and engineering ethics education based on virtue ethics and positive psychology. Virtue ethicists and positive psychologists have argued that current rule-based moral philosophy, psychology, and education cannot effectively promote students’ moral motivation for actual moral behavior and may even lead to negative outcomes, such as moral schizophrenia. They have suggested that their own theoretical framework of virtue ethics and positive psychology can contribute to the effective promotion of motivation for self-improvement by (...) connecting the notion of morality and eudaimonic happiness. Thus this essay attempts to apply virtue ethics and positive psychology to science and engineering ethics education and to develop a new conceptual framework for more effective education. In addition to the conceptual-level work, this essay suggests two possible educational methods: moral modeling and involvement in actual moral activity in science and engineering ethics classes, based on the conceptual framework. (shrink)

La robotique, comme plus largement le numérique, débouche sur de multiples usages aux déploiements parfois aussi massifs qu’inattendus, tel l’essor actuel des drones civils. Dans ce contexte évolutif, il serait vain d’énoncer de nouvelles normes éthiques qui pourraient vite s’avérer inadéquates. Mieux vaut équiper le monde scienti que pour que la dimension éthique devienne indissociable de l’activité de recherche, dans les communautés et les esprits. Le présent avis émet à cet effet quelques préconisations à l’attention des établissements et un ensemble (...) de préconisations ancrées dans la recherche à l’attention des scientifiques. (shrink)

This study develops a Science–Technology–Society (STS)-based science ethics education program for high school students majoring in or planning to major in science and engineering. Our education program includes the fields of philosophy, history, sociology and ethics of science and technology, and other STS-related theories. We expected our STS-based science ethics education program to promote students’ epistemological beliefs and moral judgment development. These psychological constructs are needed to properly solve complicated moral and social dilemmas in the fields of science and engineering. (...) We applied this program to a group of Korean high school science students gifted in science and engineering. To measure the effects of this program, we used an essay-based qualitative measurement. The results indicate that there was significant development in both epistemological beliefs and moral judgment. In closing, we briefly discuss the need to develop epistemological beliefs and moral judgment using an STS-based science ethics education program. (shrink)

Synthetic biology is a field of research that concentrates on the design, construction, and modification of new biomolecular parts and metabolic pathways using engineering techniques and computational models. By employing knowledge of operational pathways from engineering and mathematics such as circuits, oscillators, and digital logic gates, it uses these to understand, model, rewire, and reprogram biological networks and modules. Standard biological parts with known functions are catalogued in a number of registries (e.g. Massachusetts Institute of Technology Registry of Standard Biological (...) Parts). Biological parts can then be selected from the catalogue and assembled in a variety of combinations to construct a system or pathway in a microbe. Through the innovative re-engineering of biological circuits and the optimization of certain metabolic pathways, biological modules can be designed to reprogram organisms to produce products or behaviors. Synthetic biology is what is known as a “platform technology”. That is, it generates highly transferrable theoretical models, engineering principles, and know-how that can be applied to create potential products in a wide variety of industries. Proponents suggest that applications of synthetic biology may be able to provide scientific and engineered solutions to a multitude of worldwide problems from health to energy. Synthetic biology research has already been successful in constructing microbial products which promise to offer cheaper pharmaceuticals such as the antimalarial synthetic drug artemisinin, engineered microbes capable of cleaning up oil spills, and the engineering of biosensors that can detect the presence of high concentrations of arsenic in drinking water. One of the potential benefits of synthetic biology research is in its application to biofuel production. It is this application which is the focus of this entry. The term “biofuel” has referred generally to all liquid fuels that are sourced from plant or plant byproducts and are used for energy necessary for transportation vehicles (Thompson 2012). Biofuels that are produced using synthetic biological techniques re-engineer microbes into biofuel factories are a subset of these. (shrink)

The primary responsibility of the US Food and Drug Administration is to protect public health by ensuring the safety of the food supply. To that end, it sometimes conducts risk assessments of novel food products, such as genetically modified food. The FDA describes its regulatory review of GM food as a purely scientific activity, untainted by any normative considerations. This paper provides evidence that the regulatory agency is not justified in making that claim. It is argued that the FDA’s policy (...) stance on GM food is shaped by neoliberal considerations. The agency’s review of a genetically engineered animal, the AquAdvantage salmon, is used as a case study to track the influence of neoliberalism on its regulatory review protocol. After that, an epistemic argument justifying public engagement in the risk assessment of new GM food is outlined. It is because risk evaluations involve normative judgments, in a democracy, layperson representatives of informal epistemic communities that could be affected by a new GM food should have the opportunity to decide the ethical, political or other normative questions that arise during the regulatory review of that entity. (shrink)

Lethal Autonomous Weapon Systems are here. Technological development will see them become widespread in the near future. This is in a matter of years rather than decades. When the UN Convention on Certain Conventional Weapons meets on 10-14th November 2014, well-considered guidance for a decision on the general policy direction for LAWS is clearly needed. While there is widespread opposition to LAWS—or ‘killer robots’, as they are popularly called—and a growing campaign advocates banning them outright, we argue the opposite. LAWS (...) may very well reduce suffering and death in war. Rather than banning them, they should be regulated, to ensure both compliance with international humanitarian law, and that this positive outcome occurs. This policy memo sets out the basic structure and content of the regulation required. (shrink)

In France, some institutions seem to call for the engineer’s sense of social responsibility. However, this call is scarcely heard. Still, engineering students have been given the opportunity to gain a general education through courses in literature, law, economics, since the nineteenth century. But, such courses have long been offered only in the top ranked engineering schools. In this paper, we intend to show that the wish to increase engineering students’ social responsibility is an old concern. We also aim at (...) highlighting some macro social factors which shaped the answer to the call for social responsibility in the French engineering “Grandes Ecoles”. In the first part, we provide an overview of the scarce attention given to the engineering curriculum in the scholarly literature in France. In the second part, we analyse one century of discourses about the definition of the “complete engineer” and the consequent role of non technical education. In the third part, we focus on the characteristics of the corpus which has been institutionalized. Our main finding is that despite the many changes which occurred in engineering education during one century, the “other formation” remains grounded on a non academic “way of knowing”, and aims at increasing the reputation of the schools, more than enhancing engineering students’ social awareness. (shrink)

In this paper, we discuss the problems of Tohoku earthquake in terms of engineering ethics. But as“engineers,”we also count seismologists. This is because, simply thinking, the recent disaster is partially attributable to seismologists. Through the discussion, including an overview of the earthquake, we reach the conclusion endorsing the abolition of nuclear power plants.

Atomic energy developed from 1940 as a subject shrouded in secrecy. Identified successively as a crucial element in military strategy, national status and export aspirations, the research and development of atomic piles (nuclear chain-reactors) were nurtured at isolated installations. Like monastic orders, new national laboratories managed their specialist workers in occupational environments that were simultaneously cosseted and constrained, defining regional variants of a new state-managed discipline: reactor technology. This paper discusses the significance of security in defining the new subject in (...) the USA, UK and Canada – wartime allies with similar political traditions but distinct trajectories in this field during the Cold War. The intellectual borders and content of the subject developed differently in each country, shaped under the umbrella of secrecy by disparate clusters of expertise, industrial traditions, and national goals. The nascent cadre was contained until the mid 1950s by classified publications and state-sponsored specialist courses. The early context of high security filtered its members and capped enduringly both their professional aspirations and public engagement. (shrink)

This special issue deals with the emerging debate on robo- ethics, the human ethics ap- plied to robotics. Is a specific ethic applied to robotics truly neces- sary? Or, conversely, are not the gen- eral principles of ethics adequate to answer many of the issues raised by our field’s applications? In our opin- ion, and according to many roboticists and human scientists, many novel issues that emerge and many more that will show up in the immediate future, arising from the (...) upcoming marketed robotics products, demand the development of new cultural and legal tools that can provide the crucial answers to the most sensitive questions. (shrink)

A capability approach has been proposed to risk analysis, where risk is conceptualized as the probability that capabilities are reduced. Capabilities refer to the genuine opportunities of individuals to achieve valuable doings and beings, such as being adequately nourished. Such doings and beings are called functionings. A current debate in risk analysis and other fields where a capability approach has been developed concerns whether capabilities or actual achieved functionings should be used. This paper argues that in risk analysis the consequences (...) of hazardous scenarios should be conceptualized in terms of capabilities, not achieved functionings. Furthermore, the paper proposes a method for assessing capabilities, which considers the levels of achieved functionings of other individuals with similar boundary conditions. The capability of an individual can then be captured statistically based on the variability of the achieved functionings over the considered population. (shrink)