The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of (...) our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence. (shrink)

The implementation of moral decision making abilities in artificial intelligence (AI) is a natural and necessary extension to the social mechanisms of autonomous software agents and robots. Engineers exploring design strategies for systems sensitive to moral considerations in their choices and actions will need to determine what role ethical theory should play in defining control architectures for such systems. The architectures for morally intelligent agents fall within two broad approaches: the top-down imposition of ethical theories, and the bottom-up building of (...) systems that aim at goals or standards which may or may not be specified in explicitly theoretical terms. In this paper we wish to provide some direction for continued research by outlining the value and limitations inherent in each of these approaches. (shrink)

At the heart of the argument of the Critique of Practical Reason, one finds Kant’s puzzling and much-criticized claim that the consciousness of the moral law can be called a ‘fact of reason’. In this essay, I clarify the meaning and the importance of this claim. I correct misunderstandings of the term ‘Factum’, situate the relevant passages within their argumentative context, and argue that Kant’s argument can be given a consistent reading on the basis of which the main questions and (...) criticisms can be answered. (shrink)

In this classic text, Kant sets out to articulate and defend the Categorical Imperative - the fundamental principle that underlies moral reasoning - and to lay the foundation for a comprehensive account of justice and human virtues. This new edition and translation of Kant's work is designed especially for students. An extensive and comprehensive introduction explains the central concepts of Groundwork and looks at Kant's main lines of argument. Detailed notes aim to clarify Kant's thoughts and to correct some common (...) misunderstandings of his doctrines. (shrink)

After discussing the distinction between artifacts and natural entities, and the distinction between artifacts and technology, the conditions of the traditional account of moral agency are identified. While computer system behavior meets four of the five conditions, it does not and cannot meet a key condition. Computer systems do not have mental states, and even if they could be construed as having mental states, they do not have intendings to act, which arise from an agent’s freedom. On the other hand, (...) computer systems have intentionality, and because of this, they should not be dismissed from the realm of morality in the same way that natural objects are dismissed. Natural objects behave from necessity; computer systems and other artifacts behave from necessity after they are created and deployed, but, unlike natural objects, they are intentionally created and deployed. Failure to recognize the intentionality of computer systems and their connection to human intentionality and action hides the moral character of computer systems. Computer systems are components in human moral action. When humans act with artifacts, their actions are constituted by the intentionality and efficacy of the artifact which, in turn, has been constituted by the intentionality and efficacy of the artifact designer. All three components – artifact designer, artifact, and artifact user – are at work when there is an action and all three should be the focus of moral evaluation. (shrink)

It is my view that one essential difference between persons and other creatures is to be found in the structure of a person's will. Besides wanting and choosing and being moved to do this or that, men may also want to have certain desires and motives. They are capable of wanting to be different, in their preferences and purposes, from what they are. Many animals appear to have the capacity for what I shall call "first-order desires" or "desires of the (...) first order," which are simply desires to do or not to do one thing or another. No animal other than man, however, appears to have the capacity for reflective self-evaluation that is manifested in the formation of second-order desires. (shrink)

A controversial scientific vision predicts a time in which humans and machines will merge and create a new form of non-biological intelligence, explaining how the occurrence will solve such issues as pollution, hunger, and aging.

This article reviews the reasons scholars hold that driverless cars and many other AI equipped machines must be able to make ethical decisions, and the difficulties this approach faces. It then shows that cars have no moral agency, and that the term ‘autonomous’, commonly applied to these machines, is misleading, and leads to invalid conclusions about the ways these machines can be kept ethical. The article’s most important claim is that a significant part of the challenge posed by AI-equipped machines (...) can be addressed by the kind of ethical choices made by human beings for millennia. Ergo, there is little need to teach machines ethics even if this could be done in the first place. Finally, the article points out that it is a grievous error to draw on extreme outlier scenarios—such as the Trolley narratives—as a basis for conceptualizing the ethical issues at hand. (shrink)

Over the coming decades, Artificial Intelligence will profoundly impact the way we live, work, wage war, play, seek a mate, educate our young, and care for our elderly. It is likely to greatly increase our aggregate wealth, but it will also upend our labor markets, reshuffle our social order, and strain our private and public institutions. Eventually it may alter how we see our place in the universe, as machines pursue goals independent of their creators and outperform us in domains (...) previously believed to be the sole dominion of humans. Whether we regard them as conscious or unwitting, revere them as a new form of life or dismiss them as mere clever appliances, is beside the point. They are likely to play an increasingly critical and intimate role in many aspects of our lives. The emergence of systems capable of independent reasoning and action raises serious questions about just whose interests they are permitted to serve, and what limits our society should place on their creation and use. Deep ethical questions that have bedeviled philosophers for ages will suddenly arrive on the steps of our courthouses. Can a machine be held accountable for its actions? Should intelligent systems enjoy independent rights and responsibilities, or are they simple property? Who should be held responsible when a self-driving car kills a pedestrian? Can your personal robot hold your place in line, or be compelled to testify against you? If it turns out to be possible to upload your mind into a machine, is that still you? The answers may surprise you. (shrink)

There are at least three dimensions to rights. We may have and lack freedom to 1) be, 2) do, and 3) have. These dimensions reformulate Locke’s categories, and are further complicated by placing them within the context of domains such as natural or civil rights. Here the question of the origins of rights is not addressed, but issues concerning how we may contextualize them are discussed. Within the framework developed, this paper makes use of Actor-Network Theory and Enlightenment values to (...) examine the multidimensionality and appropriateness of animal rights and human rights for posthumans. The core position here is that rights may be universal and constant, but they can only be accessed within a matrix of relative cultural dimensions. This will be true for posthumans, and their rights will be relative to human rights and dependent on human and posthuman responsibilities. (shrink)

This book deals with the major philosophical issues in the theoretical framework of Artificial Intelligence (AI) in particular and cognitive science in general.

A classic collection of interlocking tales chronicles the near-future development of the robot and features models that have the ability to read minds, experience human emotions, and take over the world--and, perhaps, render humankind itself obsolete. Reprint. 25,000 first printing.

In the mid of nineteenth century, the hypothesis, “machine can think,” became very popular after Alan Turing’s article on “Computing Machinery and Intelligence.” This hypothesis, “machine can think,” established the foundations of machine intelligence and claimed that machines have a mind. It has the power to compete with human beings. In the first section, I shall explore the importance of Turing thesis, which has been conceptualized in the domain of machine intelligence. Turing presented a completely different view of the machine (...) itself. It addressed philosophers, rather than the mathematicians, and proclaimed that digital computers might be considered as intelligent machines. This approach was wholly new, both philosophically and technically, and started many philosophical debates which continue to this day. He proposed an imitation game, as a test, what is now referred to as a Turing test to evaluate if a machine thinks. That is to say that the main aim of machine intelligence not only constructs challenging programs to solve our day-to-day problems but also reproduce mentality in machines and claimed that all the mental qualities are ascribable to machines. What will be attempted in this paper is a critical evaluation of the arguments against the Turing test put forward by many philosophers. (shrink)

The advent of the intelligent robot has occupied a significant position in society over the past decades and has given rise to new issues in society. As we know, the primary aim of artificial intelligence or robotic research is not only to develop advanced programs to solve our problems but also to reproduce mental qualities in machines. The critical claim of artificial intelligence advocates is that there is no distinction between mind and machines and thus they argue that there are (...) possibilities for machine ethics, just as human ethics. Unlike computer ethics, which has traditionally focused on ethical issues surrounding human use of machines, AI or machine ethics is concerned with the behaviour of machines towards human users and perhaps other machines as well, and the ethicality of these interactions. The ultimate goal of machine ethics, according to the AI scientists, is to create a machine that itself follows an ideal ethical principle or a set of principles; that is to say, it is guided by this principle or these principles in decisions it makes about possible courses of action it could takea. Thus, machine ethics task of ensuring ethical behaviour of an artificial agent. Although, there are many philosophical issues related to artificial intelligence, but our attempt in this paper is to discuss, first, whether ethics is the sort of thing that can be computed. Second, if we are ascribing mind to machines, it gives rise to ethical issues regarding machines. And if we are not drawing the difference between mind and machines, we are not only redefining specifically human mind but also the society as a whole. Having a mind is, among other things, having the capacity to make voluntary decisions and actions. The notion of mind is central to our ethical thinking, and this is because the human mind is self-conscious, and this is a property that machines lack, as yet. (shrink)

This paper is reprinted in the book Machine Ethics, eds. M. Anderson and S. Anderson, Cambridge University Press, 2011.