The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of (...) our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence. (shrink)

STS research has devoted relatively little attention to the promotion and reception of science and technology by non-scientific actors and institutions. One consequence is that the relationship of science and technology to political power has tended to remain undertheorized. This article aims to fill that gap by introducing the concept of sociotechnical imaginaries. Through a comparative examination of the development and regulation of nuclear power in the US and South Korea, the article demonstrates the analytic potential of the imaginaries concept. (...) Although nuclear power and nationhood have long been imagined together in both countries, the nature of those imaginations has remained strikingly different. In the US, the state’s central move was to present itself as a responsible regulator of a potentially runaway technology that demands effective containment. In South Korea, the dominant imaginary was of atoms for development which the state not only imported but incorporated into its scientific, technological and political practices. In turn, these disparate imaginaries have underwritten very different responses to a variety of nuclear shocks and challenges, such as Three Mile Island (TMI), Chernobyl, and the spread of the anti-nuclear movement. (shrink)

Some writers claim that ethicists involved in assessing future technologies like nanotechnology and human enhancement devote too much time to debating issues that may or may not arise, at the expense of addressing more urgent, current issues. This practice has been claimed to squander the scarce and valuable resource of ethical concern. I assess this view, and consider some alternatives to ‘speculative ethics’ that have been put forward. I argue that attempting to restrict ethical debate so as to avoid considering (...) unacceptably speculative scenarios would not only leave scientific progress devoid of ethical guidance, but would also rule out some of our most important ethical projects. I conclude that the issue of speculation is a red herring: what is most important is not that ethicists concentrate on current issues or those that are most likely to arise; but that ethicists, scientists, and others focus on maximising what is most valuable. (shrink)

There might not be a specific nano-ethics, but there definitely is an ethics of new & emerging science and technology (NEST), with characteristic tropes and patterns of moral argumentation. Ethical discussion in and around nanoscience and technology reflects such NEST-ethics. We offer an inventory of the arguments, and show patterns in their evolution, in arenas full of proponents and opponents. We also show that there are some nano-specific issues: in how size matters, and when agency is delegated to smart devices. (...) Our overall approach is a pragmatist ethics, and we conclude that struggle (and learning) might be more productive than models emphasizing consensus. (shrink)

Most known technology serves to ingeniously adapt the world to the physical and mental limitations of human beings. Humankind has acquired awesome power with its rather limited means. Nanotechnological capabilities further this power. On some accounts, however, nanotechnological research will contribute to a rather different kind of technological development, namely one that changes human beings so as to remove or reduce their physical and mental limitations. The prospect of this technological development has inspired a fair amount of ethical debate. Here, (...) proponents and opponents of such visions of human enhancement are criticized alike for engaging in speculative ethics. This critique exposes a general pattern that extends to other nano-, bio-, or neuroethical debates. While it does not apply to all discussions of “enhancement technologies” it does apply to all ethical discourse that constructs and validates an incredible future which it only then proceeds to endorse or critique. This discourse violates conditions of intelligibility, squanders the scarce and valuable resource of ethical concern, and misleads by casting remote possibilities or philosophical thought-experiments as foresight about likely technical developments. In effect, it deflects consideration from the transformative technologies of the present. (shrink)

The growing number of ‘smart’ instruments, those equipped with AI, has raised concerns because these instruments make autonomous decisions; that is, they act beyond the guidelines provided them by programmers. Hence, the question the makers and users of smart instrument face is how to ensure that these instruments will not engage in unethical conduct. The article suggests that to proceed we need a new kind of AI program—oversight programs—that will monitor, audit, and hold operational AI programs accountable.

The growing field of machine morality has becoming increasingly concerned with how to develop artificial moral agents. However, there is little consensus on what constitutes an ideal moral agent let alone an artificial one. Leveraging a recent account of heroism in humans, the aim of this paper is to provide a prospective framework for conceptualizing, and in turn designing ideal artificial moral agents, namely those that would be considered heroic robots. First, an overview of what it means to be an (...) artificial moral agent is provided. Then, an overview of a recent account of heroism that seeks to define the construct as the dynamic and interactive integration of character strengths and situational constraints that afford the opportunity for moral behavior . With this as a foundation, a discussion is provided for what it might mean for a robot to be an ideal moral agent by proposing a dynamic and interactive connectionist model of robotic heroism. Given the limited accounts of robots engaging in moral behavior, a case for extending robotic moral capacities beyond just being a moral agent to the level of heroism is supported by drawing from exemplar situations where robots demonstrate heroism in popular film and fiction. (shrink)

Abstract In this essay, a new approach for the ethical study of emerging technology ethics will be presented, called anticipatory technology ethics (ATE). The ethics of emerging technology is the study of ethical issues at the R&D and introduction stage of technology development through anticipation of possible future devices, applications, and social consequences. I will argue that a major problem for its development is the problem of uncertainty, which can only be overcome through methodologically sound forecasting and futures studies. I (...) will then consider three contemporary approaches to the ethics of emerging technologies that use forecasting: ethical technology assessment, the techno-ethical scenarios approach and the ETICA approach, and I considered their strengths and weaknesses. Based on this critical study, I then present my own approach: ATE. ATE is a conceptually and methodologically rich approach for the ethical analysis of emerging technologies that incorporates a large variety of ethical principles, issues, objects and levels of analysis, and research aims. It is ready to be applied to contemporary and future emerging technologies. Content Type Journal Article Category Original Paper Pages 1-13 DOI 10.1007/s11569-012-0141-7 Authors Philip A. E. Brey, Department of Philosophy, School of Behavioral Sciences, University of Twente, P.O. Box 217, 7500 AE Enschede, The Netherlands Journal NanoEthics Online ISSN 1871-4765 Print ISSN 1871-4757. (shrink)

The convergence of biomedical sciences with nanotechnology as well as ICT has created a new wave of biomedical technologies, resulting in visions of a ‘molecular medicine’. Since novel technologies tend to shift concepts of disease and health, this paper investigates how the emerging field of molecular medicine may shift the meaning of ‘disease’ as well as the boundary between health and disease. It gives a brief overview of the development towards and the often very speculative visions of molecular medicine. Subsequently (...) three views of disease often used in the philosophy of medicine are briefly discussed: the ontological or neo-ontological, the physiological and the normative/holistic concepts of disease. Against this background two tendencies in the field of molecular medicine are highlighted: (1) the use of a cascade model of disease and (2) the notion of disease as a deviation from an individual pattern of functioning. It becomes clear that molecular medicine pulls conceptualizations of disease and health in several, partly opposed directions. However, the resulting tensions may also offer opportunities to steer the future of medicine in more desirable directions. (shrink)

Since it is now broadly acknowledged that ethics should receive early consideration in discourse on emerging technologies, ethical debates tend to flourish even while new fields of technology are still in their infancy. Such debates often liberally mix existing applications with technologies in the pipeline and far-reaching visions. This paper analyses the problems associated with this use of ethics as “preparatory” research, taking discourse on human enhancement in general and on pharmaceutical cognitive enhancement in particular as an example. The paper (...) will outline and discuss the gap between the scientific and technological state of the art and the ethical debates, pointing out epistemic problems in this context. Furthermore, it will discuss the future role of genuine ethical reflection in discourse on human enhancement, arguing also that such discourse needs to include a technology assessment—in the broad sense of the term—which encompasses, inter alia, anthropological perspectives and aspects of social theory. (shrink)

The prospective robots in healthcare intended to be included within the conclave of the nurse-patient relationship—what I refer to as care robots—require rigorous ethical reflection to ensure their design and introduction do not impede the promotion of values and the dignity of patients at such a vulnerable and sensitive time in their lives. The ethical evaluation of care robots requires insight into the values at stake in the healthcare tradition. What’s more, given the stage of their development and lack of (...) standards provided by the International Organization for Standardization to guide their development, ethics ought to be included into the design process of such robots. The manner in which this may be accomplished, as presented here, uses the blueprint of the Value-sensitive design approach as a means for creating a framework tailored to care contexts. Using care values as the foundational values to be integrated into a technology and using the elements in care, from the care ethics perspective, as the normative criteria, the resulting approach may be referred to as care centered value-sensitive design. The framework proposed here allows for the ethical evaluation of care robots both retrospectively and prospectively. By evaluating care robots in this way, we may ultimately ask what kind of care we, as a society, want to provide in the future. (shrink)

In the debate on the ethics of the non-medical use of pharmaceuticals for cognitive performance enhancement in healthy individuals there is a clear division between those who view “cognitive enhancement” as ethically unproblematic and those who see such practices as fraught with ethical problems. Yet another, more subtle issue, relates to the relevance and quality of the contribution of scholarly bioethics to this debate. More specifically, how have various forms of speculation, anticipatory ethics, and methods to predict scientific trends and (...) societal responses augmented or diminished this contribution? In this paper, we use the discussion of the ethics of cognitive enhancement to explore the positive and negative contribution of speculation in bioethics scholarship. First, we review and discuss how speculation has relied on different sets of assumptions regarding the non-medical use of stimulants, namely: terminology and framing; scientific aspects such as efficacy and safety; estimates of prevalence and consequent normalization; and the need for normative reflection and regulatory guidelines. Second, three methodological guideposts are proposed to alleviate some of the pitfalls of speculation: acknowledge assumptions more explicitly and identify the value attributed to assumptions; validate assumptions with interdisciplinary literature; and adopt a broad perspective to promote more comprehensive reflection. We conclude that, through the examination of the controversy about cognitive enhancement, we can employ these methodological guideposts to enhance the value of contributions from bioethics and minimize potential epistemic and practical pitfalls in this case and perhaps in other areas of bioethical debate. (shrink)

In 2003, Peter Singer and others sounded a warning in the pages of the journal Nanotechnology that research into the ethical, social, and legal implications of nanotechnology was increasingly lagging behind research into nanotechnology itself. More recently, Alfred Nordmann and Arie Rip have argued that while the pace of ELSI inquiry has now picked up, the inquiry itself is focused far too much on hypothetical and futuristic scenarios. But might there be advantages for ethicists and philosophers of technology interested in (...) the ELSI of emerging technologies to continue to think in a speculative vein? Drawing upon some lessons learned from the development of environmental ethics, and looking primarily at information and computing technologies, I suggest three reasons as to how speculative thinking can add value to ELSI reflection. I argue that it can allow for critical values to emerge that might otherwise go unheeded, open up avenues to reframe issues that might otherwise go unnoticed, and, perhaps most importantly, permit questions to be raised that might otherwise go unvoiced. (shrink)