The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of (...) our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence. (shrink)

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

The growing proportion of elderly people in society, together with recent advances in robotics, makes the use of robots in elder care increasingly likely. We outline developments in the areas of robot applications for assisting the elderly and their carers, for monitoring their health and safety, and for providing them with companionship. Despite the possible benefits, we raise and discuss six main ethical concerns associated with: (1) the potential reduction in the amount of human contact; (2) an increase in the (...) feelings of objectification and loss of control; (3) a loss of privacy; (4) a loss of personal liberty; (5) deception and infantilisation; (6) the circumstances in which elderly people should be allowed to control robots. We conclude by balancing the care benefits against the ethical costs. If introduced with foresight and careful guidelines, robots and robotic technology could improve the lives of the elderly, reducing their dependence, and creating more opportunities for social interaction. (shrink)

The United States Army’s Future Combat Systems Project, which aims to manufacture a “robot army” to be ready for deployment by 2012, is only the latest and most dramatic example of military interest in the use of artificially intelligent systems in modern warfare. This paper considers the ethics of a decision to send artificially intelligent robots into war, by asking who we should hold responsible when an autonomous weapon system is involved in an atrocity of the sort that would normally (...) be described as a war crime. A number of possible loci of responsibility for robot war crimes are canvassed; the persons who designed or programmed the system, the commanding officer who ordered its use, the machine itself. I argue that in fact none of these are ultimately satisfactory. Yet it is a necessary condition for fighting a just war, under the principle of jus in bellum, that someone can be justly held responsible for deaths that occur in the course of the war. As this condition cannot be met in relation to deaths caused by an autonomous weapon system it would therefore be unethical to deploy such systems in warfare. (shrink)

This classic collection of essays, first published in 1968, represents H.L.A. Hart's landmark contribution to the philosophy of criminal responsibility and punishment. Unavailable for ten years, this new edition reproduces the original text, adding a new critical introduction by John Gardner, a leading contemporary criminal law theorist.

Should we grant rights to artificially intelligent robots? Most current and near-future robots do not meet the hard criteria set by deontological and utilitarian theory. Virtue ethics can avoid this problem with its indirect approach. However, both direct and indirect arguments for moral consideration rest on ontological features of entities, an approach which incurs several problems. In response to these difficulties, this paper taps into a different conceptual resource in order to be able to grant some degree of moral consideration (...) to some intelligent social robots: it sketches a novel argument for moral consideration based on social relations. It is shown that to further develop this argument we need to revise our existing ontological and social-political frameworks. It is suggested that we need a social ecology, which may be developed by engaging with Western ecology and Eastern worldviews. Although this relational turn raises many difficult issues and requires more work, this paper provides a rough outline of an alternative approach to moral consideration that can assist us in shaping our relations to intelligent robots and, by extension, to all artificial and biological entities that appear to us as more than instruments for our human purposes. (shrink)

Liberty is an expanded edition of Isaiah Berlin's classic of liberalism, Four Essays on Liberty. Berlin's editor Henry Hardy has incorporated a fifth essay, as Berlin wished, and added further pieces on the same topic, so that Berlin's principal statements on liberty are available together for the first time. He also describes the gestation of the book and throws further biographical light on Berlin's preoccupation with liberty in appendices drawn from his unpublished writings.

A controversial scientific vision predicts a time in which humans and machines will merge and create a new form of non-biological intelligence, explaining how the occurrence will solve such issues as pollution, hunger, and aging.

Because of accelerating technological progress, humankind may be rapidly approaching a critical phase in its career. In addition to well-known threats such as nuclear holocaust, the propects of radically transforming technologies like nanotech systems and machine intelligence present us with unprecedented opportunities and risks. Our future, and whether we will have a future at all, may well be determined by how we deal with these challenges. In the case of radically transforming technologies, a better understanding of the transition dynamics from (...) a human to a "posthuman" society is needed. Of particular importance is to know where the pitfalls are: the ways in which things could go terminally wrong. While we have had long exposure to various personal, local, and endurable global hazards, this paper analyzes a recently emerging category: that of existential risks. These are threats that could case our extinction or destroy the potential of Earth - originating intelligent life. Some of these threats are relatively well known while others, including some of the gravest, have gone almost unrecognized. Existential risks have a cluster of features that make ordinary risk management ineffective. A final section of this paper discusses several ethical and policy implications. A clearer understanding of the threat picture will enable us to formulate better strategies. (shrink)

In what ways should we include future humanoid robots, and other kinds of artificial agents, in our moral universe? We consider the Organic view, which maintains that artificial humanoid agents, based on current computational technologies, could not count as full-blooded moral agents, nor as appropriate targets of intrinsic moral concern. On this view, artificial humanoids lack certain key properties of biological organisms, which preclude them from having full moral status. Computationally controlled systems, however advanced in their cognitive or informational capacities, (...) are, it is proposed, unlikely to possess sentience and hence will fail to be able to exercise the kind of empathic rationality that is a prerequisite for being a moral agent. The organic view also argues that sentience and teleology require biologically based forms of self-organization and autonomous self-maintenance. The organic view may not be correct, but at least it needs to be taken seriously in the future development of the field of Machine Ethics. (shrink)

In this provocative and timely book, David Kennedy explores what can go awry when we put our humanitarian yearnings into action on a global scale--and what we can do in response. Rooted in Kennedy's own experience in numerous humanitarian efforts, the book examines campaigns for human rights, refugee protection, economic development, and for humanitarian limits to the conduct of war. It takes us from the jails of Uruguay to the corridors of the United Nations, from the founding of a non-governmental (...) organization dedicated to the liberation of East Timor to work aboard an aircraft carrier in the Persian Gulf. Kennedy shares the satisfactions of international humanitarian engagement--but also the disappointments of a faith betrayed. With humanitarianism's new power comes knowledge that even the most well-intentioned projects can create as many problems as they solve. Kennedy develops a checklist of the unforeseen consequences, blind spots, and biases of humanitarian work--from focusing too much on rules and too little on results to the ambiguities of waging war in the name of human rights. He explores the mix of altruism, self-doubt, self-congratulation, and simple disorientation that accompany efforts to bring humanitarian commitments to foreign settings. Writing for all those who wish that "globalization" could be more humane, Kennedy urges us to think and work more pragmatically. A work of unusual verve, honesty, and insight, this insider's account urges us to embrace the freedom and the responsibility that come with a deeper awareness of the dark sides of humanitarian governance. (shrink)

This essay warns of eroding accountability in computerized societies. It argues that assumptions about computing and features of situations in which computers are produced create barriers to accountability. Drawing on philosophical analyses of moral blame and responsibility, four barriers are identified: 1) the problem of many hands, 2) the problem of bugs, 3) blaming the computer, and 4) software ownership without liability. The paper concludes with ideas on how to reverse this trend.

Social thinkers in all fields are faced with one unavoidable question: What does it mean to be human in the 21st century? This ambitious and groundbreaking book provides the first synthesis of historical, philosophical and sociological insights needed to address this question in a thoughtful and creative manner.

This book explores how the design, construction, and use of robotics technology may affect today's legal systems and, more particularly, matters of responsibility and agency in criminal law, contractual obligations, and torts. By distinguishing between the behaviour of robots as tools of human interaction, and robots as proper agents in the legal arena, jurists will have to address a new generation of "hard cases." General disagreement may concern immunity in criminal law (e.g., the employment of robot soldiers in battle), personal (...) accountability for certain robots in contracts (e.g., robo-traders), much as clauses of strict liability and negligence-based responsibility in extra-contractual obligations (e.g., service robots in tort law). Since robots are here to stay, the aim of the law should be to wisely govern our mutual relationships. (shrink)

As engineers propose constructing humanlike automata, the question arises as to whether such machines merit human rights. The issue warrants serious and rigorous examination, although it has not yet cohered into a conversation. To put it into a sure direction, this paper proposes phrasing it in terms of whether humans are morally obligated to extend to maximally humanlike automata full human rights, or those set forth in common international rights documents. This paper’s approach is to consider the ontology of humans (...) and of automata and whether ontological difference between them, that pertains to the very bases of human rights, affects the latter’s claims to full human rights. Considering common bases of human rights, can these bases tell us whether a certain ontological distinction of humans from automata—or a de facto distinction about humans tacitly acknowledged by full-rights-recognizing societies—makes a difference in whether humans are morally obligated to assign these entities full rights? Human rights to security also arise. The conclusion is that humans need not be under any moral obligation to confer full human rights on automata. The paper’s ultimate point is not to close the discussion with this ontological cap but to set a solid moral and legal groundwork for opening it up tout court. (shrink)

Could an artificial intelligence become a legal person? As of today, this question is only theoretical. No existing computer program currently possesses the sort of capacities that would justify serious judicial inquiry into the question of legal personhood. The question is nonetheless of some interest. Cognitive science begins with the assumption that the nature of human intelligence is computational, and therefore, that the human mind can, in principle, be modelled as a program that runs on a computer. Artificial intelligence (AI) (...) research attempts to develop such models. But even as cognitive science has displaced behavioralism as the dominant paradigm for investigating the human mind, fundamental questions about the very possibility of artificial intelligence continue to be debated. This Essay explores those questions through a series of thought experiments that transform the theoretical question whether artificial intelligence is possible into legal questions such as, "Could an artificial intelligence serve as a trustee?" What is the relevance of these legal thought experiments for the debate over the possibility of artificial intelligence? A preliminary answer to this question has two parts. First, putting the AI debate in a concrete legal context acts as a pragmatic Occam's razor. By reexamining positions taken in cognitive science or the philosophy of artificial intelligence as legal arguments, we are forced to see them anew in a relentlessly pragmatic context. Philosophical claims that no program running on a digital computer could really be intelligent are put into a context that requires us to take a hard look at just what practical importance the missing reality could have for the way we speak and conduct our affairs. In other words, the legal context provides a way to ask for the "cash value" of the arguments. The hypothesis developed in this Essay is that only some of the claims made in the debate over the possibility of AI do make a pragmatic difference, and it is pragmatic differences that ought to be decisive. Second, and more controversially, we can view the legal system as a repository of knowledge-a formal accumulation of practical judgments. The law embodies core insights about the way the world works and how we evaluate it. Moreover, in common-law systems judges strive to decide particular cases in a way that best fits the legal landscape-the prior cases, the statutory law, and the constitution. Hence, transforming the abstract debate over the possibility of AI into an imagined hard case forces us to check our intuitions and arguments against the assumptions that underlie social decisions made in many other contexts. By using a thought experiment that explicitly focuses on wide coherence, we increase the chance that the positions we eventually adopt will be in reflective equilibrium with our views about related matters. In addition, the law embodies practical knowledge in a form that is subject to public examination and discussion. Legal materials are published and subject to widespread public scrutiny and discussion. Some of the insights gleaned in the law may clarify our approach to the artificial intelligence debate. (shrink)

We imagine posthumans as humans made superhumanly intelligent or resilient by future advances in nanotechnology, biotechnology, information technology and cognitive science. Many argue that these enhanced people might live better lives; others fear that tinkering with our nature will undermine our sense of our own humanity. Whoever is right, it is assumed that our technological successor will be an upgraded or degraded version of us: Human 2.0. Posthuman Life argues that the enhancement debate projects a human face onto an empty (...) screen. We do not know what will happen and, not being posthuman, cannot anticipate how posthumans will assess the world. If a posthuman future will not necessarily be informed by our kind of subjectivity or morality the limits of our current knowledge must inform any ethical or political assessment of that future. Posthuman Life develops a critical metaphysics of posthuman succession and argues that only a truly speculative posthumanism can support an ethics that meets the challenge of the transformative potential of technology. (shrink)

The enduring innovations in artificial intelligence and robotics offer the promised capacity of computer consciousness, sentience and rationality. The development of these advanced technologies have been considered to merit rights, however these can only be ascribed in the context of commensurate responsibilities and duties. This represents the discernable next-step for evolution in this field. Addressing these needs requires attention to the philosophical perspectives of moral responsibility for artificial intelligence and robotics. A contrast to the moral status of animals may be (...) considered. At a practical level, the attainment of responsibilities by artificial intelligence and robots can benefit from the established responsibilities and duties of human society, as their subsistence exists within this domain. These responsibilities can be further interpreted and crystalized through legal principles, many of which have been conserved from ancient Roman law. The ultimate and unified goal of stipulating these responsibilities resides through the advancement of mankind and the enduring preservation of the core tenets of humanity. (shrink)

It is commonly understood that in its focus on rights and obligations law is centrally concerned with organising responsibility. In defining how obligations are created, in contract or property law, say, or imposed, as in tort, public, or criminal law, law and legal institutions are usually seen as society’s key mode of asserting and defining the content and scope of responsibilities. This book takes the converse view: legal institutions are centrally involved in organising irresponsibility. Particularly with respect to the production (...) of large-scale harms – including extensive human rights violations, forms of colonialism, or environmental or nuclear devastation – and in opposition to conventional understandings of responsibility in law, morality and politics, the book provides a detailed analysis of the ways in which legal institutions – their practices, concepts, and categories – themselves operate as much to deflect responsibility for harms suffered as they do to acknowledge them. Drawing on a series of case studies from local, national, and global concerns the book analyses how law facilitates dispersals and disavowals of responsibility, and it shows how it does so in consistent and patterned ways. In assessing how this ‘organised irresponsibility’ operates, and what its consequences are for both legal analysis and society generally, a thoroughgoing re-evaluation of law’s methods, operation, and consequences is required. At stake is nothing less than a fundamental re-assessment of the role of modern law in the production and legitimation of human suffering. This innovative and interdisciplinary book provides a sustained challenge to conventional thinking about law and legal institutions. It will be of major interest to those working in law, political and legal theory, sociology and moral philosophy. (shrink)

This short story, written when Berlin was twelve, is his first surviving essay. It reveals the disposition that found expression in his more mature work. Berlin contrasts the settled life of ‘a cosy little home’ with the crude consequentialism of Commissar Uritsky and its destructive effects. The story is a morality tale: Uritsky meets his just end.

Recent research on the cognitive abilities and emotional capacities of animals has fueled the animal rights movement and renewed debate over the differences between human and non-human animals. This debate has not been central to sociology, although George Herbert Mead drew a very hard line between humans and animals by asserting that the latter were not capable of symbolic interaction. Sociologists are now beginning to question this assumption, and this article falls within this new line of research. We begin by (...) presenting alternative interpretations of symbolic interaction that allow for the possibility of such activity in non-human animals. We review recent research on symbolic interaction between humans and dogs, and we present our own research findings on human-feline interaction. We conclude that there is growing evidence that symbolic interaction is widely distributed throughout the animal kingdom, and that it enables animals to survive more effectively in a wide variety of environments. (shrink)

Epistemic limitations concerning prediction and explanation of the behaviour of robots that learn from experience are selectively examined by reference to machine learning methods and computational theories of supervised inductive learning. Moral responsibility and liability ascription problems concerning damages caused by learning robot actions are discussed in the light of these epistemic limitations. In shaping responsibility ascription policies one has to take into account the fact that robots and softbots - by combining learning with autonomy, pro-activity, reasoning, and planning - (...) can enter cognitive interactions that human beings have not experienced with any other non-human system. (shrink)

The cyborg that Donna Haraway appropriated in ‘Manifesto for Cyborgs’ as a metaphor for political action and theoretical inquiry has ceased to have the potency it did 20 years ago. While Haraway has turned from a central focus on technoculture to companion species, much important cultural work remains to be done, especially in networked and programmable media. Problems with the cyborg as a metaphor include the implication that the liberal humanist subject, however problematized by its hybridization with cybernetic mechanism, continues (...) as a singular entity operating with localized agency. In a word, the cyborg is not networked enough to encompass the emergent possibilities associated with the Internet and the world-wide web and other phenomena of the contemporary digital era. Instead I propose the idea of the cognisphere. As operational concept and suggestive metaphor, the cognisphere recognizes that networked and programmable media are not only more pervasive than ever before in human history but also more cognitively powerful. It is closely associated with what many researchers regard as a major insight: the idea that the physical world is fundamentally computational. While these scientists regard computation as a physical process, the cultural critic is apt to see it as an over-determined metaphor. The binary choice between seeing the computational universe as a literal description of the physical world and reading it as an over-determined metaphor misses a crucial aspect of contemporary cultural dynamics: the interaction between means and metaphor, technology and cultural presupposition. Taking this dynamic into account leads to a more complete understanding summed up in the aphorism, ‘What we make and what (we think) we are co-evolve together.’. (shrink)

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)

In this paper, we move toward offering psychological benchmarks to measure success in building increasingly humanlike robots. By psychological benchmarks we mean categories of interaction that capture conceptually fundamental aspects of human life, specified abstractly enough to resist their identity as a mere psychological instrument, but capable of being translated into testable empirical propositions. Nine possible benchmarks are considered: autonomy, imitation, intrinsic moral value, moral accountability, privacy, reciprocity, conventionality, creativity, and authenticity of relation. Finally, we discuss how getting the right (...) group of benchmarks in human–robot interaction will, in future years, help inform on the foundational question of what constitutes essential features of being human. (shrink)

P. M. Asaro: What should We Want from a Robot Ethic? G. Tamburrini: Robot Ethics: A View from the Philosophy of Science B. Becker: Social Robots - Emotional Agents: Some Remarks on Naturalizing Man-machine Interaction E. Datteri, G. Tamburrini: Ethical Reflections on Health Care Robotics P. Lin, G. Bekey, K. Abney: Robots in War: Issues of Risk and Ethics J. Altmann: Preventive Arms Control for Uninhabited Military Vehicles J. Weber: Robotic warfare, Human Rights & The Rhetorics of Ethical Machines T. (...) Nishida: Towards Robots with Good Will R. Capurro: Ethics and Robotics. (shrink)