This article described three heuristics that are employed in making judgements under uncertainty: representativeness, which is usually employed when people are asked to judge the probability that an object or event A belongs to class or process B; availability of instances or scenarios, which is often employed when people are asked to assess the frequency of a class or the plausibility of a particular development; and adjustment from an anchor, which is usually employed in numerical prediction when a relevant value (...) is available. These heuristics are highly economical and usually effective, but they lead to systematic and predictable errors. A better understanding of these heuristics and of the biases to which they lead could improve judgements and decisions in situations of uncertainty. (shrink)

Information technology is an integral part of the practices and institutions of post-industrial society. It is also a source of hard moral questions and thus is both a probing and relevant area for moral theory. In this volume, an international team of philosophers sheds light on many of the ethical issues arising from information technology, including informational privacy, digital divide and equal access, e-trust and tele-democracy. Collectively, these essays demonstrate how accounts of equality and justice, property and privacy benefit from (...) taking into account how information technology has shaped our social and epistemic practices and our moral experiences. Information technology changes the way that we look at the world and deal with one another. It calls, therefore, for a re-examination of notions such as friendship, care, commitment and trust. (shrink)

Perhaps this is due to the belief that technology has a value-neutral nature, and that issues of value are better left to philosophers.

This essay situates some recent empirical research on the origin, nature, role, and reliability of moral intuitions against the background of nineteenth-century debates between ethical naturalism and rational intuitionism. The legitimate heir to Millian naturalism is the contemporary method of reflective equilibrium and its defeasible reliance on moral intuitions. Recent doubts about moral intuitions—worries that they reflect the operation of imperfect cognitive heuristics, are resistant to undermining evidence, are subject to framing effects, and are variable—are best addressed by ethical naturalism (...) as part of a broad dialectical equilibrium. (shrink)

Contemporary literature investigating the significant impact of technology on our lives leads many to conclude that ethics must be a part of the discussion at an earlier stage in the design process i.e., before a commercial product is developed and introduced. The problem, however, is the question regarding how ethics can be incorporated into an earlier stage of technological development and it is this question that we argue has not yet been answered adequately. There is no consensus amongst scholars as (...) to the kind of ethics that should be practiced, nor the individual selected to perform this ethical analysis. One school of thought holds that ethics should have pragmatic value in research and design and that it should be implemented by the engineers and/or scientists themselves, while another school of thought holds that ethics need not be so pragmatic. For the latter, the ethical reflection can aim at a variety of goals, and be carried out by an ethicist. None of the approaches resulting from these lines of thinking have been adopted on a wide-scale basis. To that end, the approach presented here is intended to bridge the gap between these schools of thought. It is our contention that ethics ought to be pragmatic and to provide utility for the design process and we maintain that adequate ethical reflection, and all that it entails, ought to be conducted by an ethicist. Thus, we propose a novel role for the ethicist—the ethicist as designer—who subscribes to a pragmatic view of ethics in order to bring ethics into the research and design of artifacts—no matter the stage of development. In this paper we outline the series of steps that a pragmatic value analysis entails: uncovering relevant values, scrutinizing these values and, working towards the translation of values into technical content. In conclusion, we present a list of tasks for the ethicist in his/her role as designer on the interdisciplinary team. (shrink)

There has been considerable recent debate on the ethics of human enhancement. A number of prominent authors have been concerned about or critical of the use of technology to alter or enhance human beings, citing threats to human nature and dignity as one basis for these concerns. Frances Kamm has given a detailed rebuttal of Sandel's arguments, arguing that human enhancement is permissible. Nicholas Agar, in his book Liberal Eugenics, argues that enhancement should be permissible but not obligatory. He argues (...) that what distinguishes liberal eugenics from the objectionable eugenic practices of the Nazis is that it is not based on a single conception of a desirable genome and that it is voluntary and not obligatory. This article takes a more provocative position. It aims to argue that, far from its being merely permissible, we have a moral obligation or moral reason to enhance ourselves and our children. Indeed, we have the same kind of obligation as we have to treat and prevent disease. It begins by considering the current interests in and possibilities of enhancement. It then offers three arguments that we have very strong reasons to seek to enhance. (shrink)

The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of (...) our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence. (shrink)

Research on moral judgment has been dominated by rationalist models, in which moral judgment is thought to be caused by moral reasoning. The author gives 4 reasons for considering the hypothesis that moral reasoning does not cause moral judgment; rather, moral reasoning is usually a post hoc construction, generated after a judgment has been reached. The social intuitionist model is presented as an alternative to rationalist models. The model is a social model in that it deemphasizes the private reasoning done (...) by individuals and emphasizes instead the importance of social and cultural influences. The model is an intuitionist model in that it states that moral judgment is generally the result of quick, automatic evaluations (intuitions). The model is more consistent than rationalist models with recent findings in social, cultural, evolutionary, and biological psychology, as well as in anthropology and primatology. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

��Is moral judgment accomplished by intuition or conscious reasoning? An answer demands a detailed account of the moral principles in question. We investigated three principles that guide moral judgments: (a) Harm caused by action is worse than harm caused by omission, (b) harm intended as the means to a goal is worse than harm foreseen as the side effect of a goal, and (c) harm involving physical contact with the victim is worse than harm involving no physical contact. Asking whether (...) these principles are invoked to explain moral judgments, we found that subjects generally appealed to the first and third principles in their justifications, but not to the second. This finding has significance for methods and theories of moral psychology: The moral principles used in judgment must be directly compared with those articulated in justification, and doing so shows that some moral principles are available to conscious reasoning whereas others are not. (shrink)

The Accreditation Board of Engineering and Technology (ABET) has declared that to achieve accredited status, “engineering programs must demonstrate that their graduates have an understanding of professional and ethical responsibility.” Many engineering professors struggle to integrate this required ethics instruction in technical classes and projects because of the lack of a formalized ethics-in-design approach. However, one methodology developed in human-computer interaction research, the Value-Sensitive Design approach, can serve as an engineering education tool which bridges the gap between design and ethics (...) for many engineering disciplines. The three major components of Value-Sensitive Design, conceptual, technical, and empirical, exemplified through a case study which focuses on the development of a command and control supervisory interface for a military cruise missile. (shrink)

We use the phrase "moral intuition" to describe the appearance in consciousness of moral judgments or assessments without any awareness of having gone through a conscious reasoning process that produces this assessment. This paper investigates the neural substrates of moral intuition. We propose that moral intuitions are part of a larger set of social intuitions that guide us through complex, highly uncertain and rapidly changing social interactions. Such intuitions are shaped by learning. The neural substrates for moral intuition include fronto-insular, (...) cingulate, and orbito-frontal cortices and associated subcortical structure such as the septum, basil ganglia and amygdala. Understanding the role of these structures undercuts many philosophical doctrines concerning the status of moral intuitions, but vindicates the claim that they can sometimes play a legitimate role in moral decision-making. (shrink)

Suppose that we develop a medically safe and affordable means of enhancing human intelligence. For concreteness, we shall assume that the technology is genetic engineering (either somatic or germ line), although the argument we will present does not depend on the technological implementation. For simplicity, we shall speak of enhancing “intelligence” or “cognitive capacity,” but we do not presuppose that intelligence is best conceived of as a unitary attribute. Our considerations could be applied to specific cognitive abilities such as verbal (...) fluency, memory, abstract reasoning, social intelligence, spatial cognition, numerical ability, or musical talent. It will emerge that the form of argument that we use can be applied much more generally to help assess other kinds of enhancement technologies as well as other kinds of reform. However, to give a detailed illustration of how the argument form works, we will focus on the prospect of cognitive enhancement. (shrink)

An empirical study of people's intuitions about freedom of the will. We show that people tend to have compatiblist intuitions when they think about the problem in a more concrete, emotional way but that they tend to have incompatiblist intuitions when they think about the problem in a more abstract, cognitive way.

During the last decades several tools have been developed to anticipate the future impact of new and emerging technologies. Many of these focus on ‘hard,’ quantifiable impacts, investigating how novel technologies may affect health, environment and safety. Much less attention is paid to what might be called ‘soft’ impacts: the way technology influences, for example, the distribution of social roles and responsibilities, moral norms and values, or identities. Several types of technology assessment and of scenario studies can be used to (...) anticipate such soft impacts. We argue, however, that these methods do not recognize the dynamic character of morality and its interaction with technology. As a result, they miss an important opportunity to broaden the scope of social and political deliberation on new and emerging technologies.In this paper we outline a framework for building scenarios that enhance the techno-moral imagination by anticipating how technology, morality and their interaction might evolve. To show what kind of product might result from this framework, a scenario is presented as an exemplar. This scenario focuses on developments in biomedical nanotechnology and the moral regime of experimenting with human beings. Finally, the merits and limitations of our framework and the resulting type of scenarios are discussed. (shrink)

As information systems transform our world, computer scientists design affordances that influence the uses and impacts of these technological objects. This article describes how the practices of design affect the social values materialized in emerging technologies, and explores how design practices can encourage ethical reflection and action. The article presents an ethnography of a laboratory that engineered software for mobile phones to track users’ locations, habits, and behaviors. This technical work raised a number of ethical challenges, particularly around questions of (...) data use and surveillance. The ethnography suggests that particular activities within laboratories can help engineers agree on social values as important to design. It characterizes these activities as values levers: practices that open new conversations about social values and encourage consensus around those values as design criteria. Laboratory leaders and advocates can enable and strengthen these levers to encourage ethical reflection and action as an explicit part of design practice. (shrink)

Information technology is widely used to fulfill societal goals such as safety and security. These application areas put ever changing demands on the functionality of the technology. Designing technological appliances to be reconfigurable, thereby keeping them open to functionalities yet to be determined, will possibly allow the technology to fulfill these changing demands in an efficient way. In this paper we present a first exploration of potential societal and moral issues of reconfigurable sensors developed for application in the safety and (...) security domain, in the context of a large scale R&D-project in the Netherlands. We discuss the subtle distinction between the relevant notions of reconfigurability, function creep, and unrestricted or unforeseen technological affordances. We argue that the feature of reconfigurability makes context of use the central issue in the assessment of the societal and moral impact of the technology. It follows that the design of good policies for new application contexts has to be central in a value sensitive design approach to reconfigurable technology. (shrink)

Abstract In this essay, a new approach for the ethical study of emerging technology ethics will be presented, called anticipatory technology ethics (ATE). The ethics of emerging technology is the study of ethical issues at the R&D and introduction stage of technology development through anticipation of possible future devices, applications, and social consequences. I will argue that a major problem for its development is the problem of uncertainty, which can only be overcome through methodologically sound forecasting and futures studies. I (...) will then consider three contemporary approaches to the ethics of emerging technologies that use forecasting: ethical technology assessment, the techno-ethical scenarios approach and the ETICA approach, and I considered their strengths and weaknesses. Based on this critical study, I then present my own approach: ATE. ATE is a conceptually and methodologically rich approach for the ethical analysis of emerging technologies that incorporates a large variety of ethical principles, issues, objects and levels of analysis, and research aims. It is ready to be applied to contemporary and future emerging technologies. Content Type Journal Article Category Original Paper Pages 1-13 DOI 10.1007/s11569-012-0141-7 Authors Philip A. E. Brey, Department of Philosophy, School of Behavioral Sciences, University of Twente, P.O. Box 217, 7500 AE Enschede, The Netherlands Journal NanoEthics Online ISSN 1871-4765 Print ISSN 1871-4757. (shrink)

When thinking about ethics, technology is often only mentioned as the source of our problems, not as a potential solution to our moral dilemmas. When thinking about technology, ethics is often only mentioned as a constraint on developments, not as a source and spring of innovation. In this paper, we argue that ethics can be the source of technological development rather than just a constraint and technological progress can create moral progress rather than just moral problems. We show this by (...) an analysis of how technology can contribute to the solution of so-called moral overload or moral dilemmas. Such dilemmas typically create a moral residue that is the basis of a second-order principle that tells us to reshape the world so that we can meet all our moral obligations. We can do so, among other things, through guided technological innovation. (shrink)

In recent years, several authors have argued that the desirability of novel technologies should be assessed early, when they are still emerging. Such an ethical assessment of emerging technologies is by definition focused on an elusive object. Usually promises, expectations, and visions of the technology are taken as a starting point. As Nordmann and Rip have pointed out in a recent article, however, ethicists should not take for granted the plausibility of such expectations and visions. In this paper, we explore (...) how the quality of expectations on emerging technologies might be assessed when engaging in a reflection on the desirability of emerging technologies. We propose that an assessment of expectations’ plausibility should focus on statements on technological feasibility, societal usability, and desirability of the expected technology. Whereas the feasibility statement and, to a lesser extent, the usability statements are frequently quite futuristic, the claims on desirability, by contrast, often display a conservative stance towards the future. Assessing the quality of expectations and visions on behalf of emerging technologies requires, then, a careful and well-directed use of both skepticism and imagination. We conclude with a brief overview of the tools and methods ethicists could use to assess claims made on behalf of emerging technologies and improve the ethical reflection on them. (shrink)

Starting from common-sense notions of ‘furniture of the world’ a process ontology is developed in which prospective is an integral part. Technology as configurations that work (precariously) embodies expectations which structure further development. Examples (a cloned puppy, hotel keys, DC airplanes, stem cells, and overpasses on Long Island) are used to develop the notion of material narratives that are “written”, not just by engineers and designers/producers, but also by users: “reading” implies some further “writing”. In contrast to prevailing notions of (...) technological control (through manipulation of building blocks), the “writing” of nanotechnology is modulation of the invisible and impredictable - an extreme example of unruly technology and repair work after the fact, where in practice control is a gesture not so different from magic. Because ontology cannot be other than prospective, it is political throughout. Thus, prospective technology highlights ontological politics. (shrink)

Some writers claim that ethicists involved in assessing future technologies like nanotechnology and human enhancement devote too much time to debating issues that may or may not arise, at the expense of addressing more urgent, current issues. This practice has been claimed to squander the scarce and valuable resource of ethical concern. I assess this view, and consider some alternatives to ‘speculative ethics’ that have been put forward. I argue that attempting to restrict ethical debate so as to avoid considering (...) unacceptably speculative scenarios would not only leave scientific progress devoid of ethical guidance, but would also rule out some of our most important ethical projects. I conclude that the issue of speculation is a red herring: what is most important is not that ethicists concentrate on current issues or those that are most likely to arise; but that ethicists, scientists, and others focus on maximising what is most valuable. (shrink)

Although applications are being developed and have reached the market, nanopharmacy to date is generally still conceived as an emerging technology. Its concept is ill-defined. Nanopharmacy can also be construed as a converging technology, which combines features of multiple technologies, ranging from nanotechnology to medicine and ICT. It is still debated whether its features give rise to new ethical issues or that issues associated with nanopharma are merely an extension of existing issues in the underlying fields. We argue here that, (...) regardless of the alleged newness of the ethical issues involved, developments occasioned by technological advances affect the roles played by stakeholders in the field of nanopharmacy to such an extent that this calls for a different approach to responsible innovation in this field. Specific features associated with nanopharmacy itself and features introduced to the associated converging technologies- bring about a shift in the roles of stakeholders that call for a different approach to responsibility. We suggest that Value Sensitive Design is a suitable framework to involve stakeholders in addressing moral issues responsibly at an early stage of development of new nanopharmaceuticals. (shrink)

The development of ever smaller integrated circuits at the sub-micron and nanoscale—in accordance with Moore’s Law—drives the production of very small tags, smart cards, smart labels and sensors. Nanoelectronics and submicron technology supports surveillance technology which is practically invisible. I argue that one of the most urgent and immediate concerns associated with nanotechnology is privacy. Computing in the twenty-first century will not only be pervasive and ubiquitous, but also inconspicuous. If these features are not counteracted in design, they will facilitate (...) ubiquitous surveillance practices which are widely available, cheap, and intrusive. RFID technology is an instructive example of what nanotechnology has in store for privacy. (shrink)

It should not be a surprise in the near future to encounter either a personal or a professional service robot in our homes and/or our work places: according to the International Federation for Robots, there will be approx 35 million service robots at work by 2018. Given that individuals will interact and even cooperate with these service robots, their design and development demand ethical attention. With this in mind I suggest the use of an approach for incorporating ethics into the (...) design process of robots known as Care Centered Value Sensitive Design. Although this approach was originally and intentionally designed for the healthcare domain, the aim of this paper is to present a preliminary study of how personal and professional service robots might also be evaluated using the CCVSD approach. The normative foundations for CCVSD come from its reliance on the care ethics tradition and in particular the use of care practices for: structuring the analysis and, determining the values of ethical import. To apply CCVSD outside of healthcare one must show that the robot has been integrated into a care practice. Accordingly, the practice into which the robot is to be used must be assessed and shown to meet the conditions of a care practice. By investigating the foundations of the approach I hope to show why it may be applicable for service robots and further to give examples of current robot prototypes that can and cannot be evaluated using CCVSD. (shrink)

Engagement with stakeholders and civil society is increasingly important for new scientific and technological developments. Preparation of such engagements sets the stage for engagement activities and thus contributes to their outcomes. Preparation is a demanding task, particularly if the facilitating agent aims for timely engagement related to emerging technologies. Requirements for such preparation include understanding of the emerging science & technology and its dynamics. Multi-level analysis and socio-technical scenarios are two complementary tools for constructing productive engagement. Examination of the emergence (...) of nanotechnologies in the food packaging sector demonstrates how these tools work. In light of recent policy demands for responsible innovation, but also more generally, the role of organizers of engagement activities is one that deserves reflection insofar as it can extend beyond that of preparation and facilitation. (shrink)