The implementation of moral decision making abilities in artificial intelligence (AI) is a natural and necessary extension to the social mechanisms of autonomous software agents and robots. Engineers exploring design strategies for systems sensitive to moral considerations in their choices and actions will need to determine what role ethical theory should play in defining control architectures for such systems. The architectures for morally intelligent agents fall within two broad approaches: the top-down imposition of ethical theories, and the bottom-up building of (...) systems that aim at goals or standards which may or may not be specified in explicitly theoretical terms. In this paper we wish to provide some direction for continued research by outlining the value and limitations inherent in each of these approaches. (shrink)

Over the course of its first seven editions, Principles of Biomedical Ethics has proved to be, globally, the most widely used, authored work in biomedical ethics. It is unique in being a book in bioethics used in numerous disciplines for purposes of instruction in bioethics. Its framework of moral principles is authoritative for many professional associations and biomedical institutions-for instruction in both clinical ethics and research ethics. It has been widely used in several disciplines for purposes of teaching in the (...) classroom, during conferences, etc. (shrink)

This first volume contains discussions of the brain, methods for analyzing behavior, thought, consciousness, attention, association, time, and memory.

Conscious experience is one of the most difficult and thorny problems in psychological science. Its study has been neglected for many years, either because it was thought to be too difficult, or because the relevant evidence was thought to be poor. Bernard Baars suggests a way to specify empirical constraints on a theory of consciousness by contrasting well-established conscious phenomena - such as stimulus representations known to be attended, perceptual, and informative - with closely comparable unconscious ones - such as (...) stimulus representations known to be preperceptual, unattended, or habituated. Adducing data to show that consciousness is associated with a kind of global workplace in the nervous system, and that several brain structures are known to behave in accordance with his theory, Baars helps to clarify many difficult problems. (shrink)

This is a book about how we see: the environment around us (its surfaces, their layout, and their colors and textures); where we are in the environment; whether or not we are moving and, if we are, where we are going; what things are good for; how to do things (to thread a needle or drive an automobile); or why things look as they do.The basic assumption is that vision depends on the eye which is connected to the brain. The (...) author suggests that natural vision depends on the eyes in the head on a body supported by the ground, the brain being only the central organ of a complete visual system. When no constraints are put on the visual system, people look around, walk up to something interesting and move around it so as to see it from all sides, and go from one vista to another. That is natural vision—and what this book is about. (shrink)

This paper is about how to give human-like powers to complete agents. For this the most important design choice concerns the overall architecture. Questions regarding detailed mechanisms, forms of representations, inference capabilities, knowledge etc. are best addressed in the context of a global architecture in which different design decisions need to be linked. Such a design would assemble various kinds of functionality into a complete coherent working system, in which there are many concurrent, partly independent, partly mutually supportive, partly potentially (...) incompatible processes, addressing a multitude of issues on different time scales, including asynchronous, concurrent, motive generators. Designing human like agents is part of the more general problem of understanding design space, niche space and their interrelations, for, in the abstract, there is no one optimal design, as biological diversity on earth shows. (shrink)

In this collection of essays we hear from an international array of computer and brain scientists who are actively working from both the machine and human ends...

The Embodied Mind provides a unique, sophisticated treatment of the spontaneous and reflective dimension of human experience.

Prior to the twentieth century, theories of knowledge were inherently perceptual. Since then, developments in logic, statis- tics, and programming languages have inspired amodal theories that rest on principles fundamentally different from those underlying perception. In addition, perceptual approaches have become widely viewed as untenable because they are assumed to implement record- ing systems, not conceptual systems. A perceptual theory of knowledge is developed here in the context of current cognitive science and neuroscience. During perceptual experience, association areas in the (...) brain capture bottom-up patterns of activation in sensory-motor areas. Later, in a top-down manner, association areas partially reactivate sensory-motor areas to implement perceptual symbols. The stor- age and reactivation of perceptual symbols operates at the level of perceptual components – not at the level of holistic perceptual expe- riences. Through the use of selective attention, schematic representations of perceptual components are extracted from experience and stored in memory (e.g., individual memories of green, purr, hot). As memories of the same component become organized around a com- mon frame, they implement a simulator that produces limitless simulations of the component (e.g., simulations of purr). Not only do such simulators develop for aspects of sensory experience, they also develop for aspects of proprioception (e.g., lift, run) and introspec- tion (e.g., compare, memory, happy, hungry). Once established, these simulators implement a basic conceptual system that represents types, supports categorization, and produces categorical inferences. These simulators further support productivity, propositions, and ab- stract concepts, thereby implementing a fully functional conceptual system. Productivity results from integrating simulators combinato- rially and recursively to produce complex simulations. Propositions result from binding simulators to perceived individuals to represent type-token relations. Abstract concepts are grounded in complex simulations of combined physical and introspective events. Thus, a per- ceptual theory of knowledge can implement a fully functional conceptual system while avoiding problems associated with amodal sym- bol systems. Implications for cognition, neuroscience, evolution, development, and artificial intelligence are explored. (shrink)

Can a mass of networked neurons produce moral human agents? I shall argue that it can; a brain can be morally excellent. A connectionist account of how the brain works can explain how a person might be morally excellent in Aristotle's sense of the term. According to connectionism, the brain is a maze of interconnections trained to recognize and respond to patterns of stimulation. According to Aristotle, a morally excellent human is a practically wise person trained in good habits. What (...) an Aristotelian theory of ethics and a connectionist theory of mind have in common is the assumption that the successful mind/brain has the disposition to behave appropriately in appropriate circumstances. According to Aristotle, the good person knows the right end, desires and chooses to pursue it, and recognizes the right means to it. Thus the good person's brain must be able to form certain moral concepts, develop appropriate behavioral dispositions, and learn practical reasoning skills. I shall argue that this collection of the brain's cognitive capacities is best accounted for by a connectionist theory of the mind/brain. The human condition is both material and moral; we are brain-controlled bodies with ethical values. My essay seeks to understand the relationship between our brains and our values, between how the brain works and how we make moral decisions. (shrink)

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

I think, therefore I am. The legendary pronouncement of philosopher René Descartes lingers as accepted wisdom in the Western world nearly four centuries after its author's death. But does thought really come first? Who actually runs the show: we, our thoughts, or the neurons firing within our brains? Walter J. Freeman explores how we control our behavior and make sense of the world around us. Avoiding determinism both in sociobiology, which proposes that persons' genes control their brains' functioning, and in (...) neuroscience, which posits that their brains' disposition is molded by chemistry and environmental forces, Freeman charts a new course--one that gives individuals due credit and responsibility for their actions. Drawing upon his five decades of research in neuroscience, Freeman utilizes the latest advances in his field as well as perspectives from disciplines as diverse as mathematics, psychology, and philosophy to explicate how different human brains act in their chosen diverse ways. He clarifies the implications of brain imaging, by which neural activity can be observed during the course of normal movements, and shows how nonlinear dynamics reveals order within the fecund chaos of brain function. (shrink)

"It's the animal in us," we often hear when we've been bad. But why not when we're good? Primates and Philosophers tackles this question by exploring the biological foundations of one of humanity's most valued traits: morality. In this provocative book, primatologist Frans de Waal argues that modern-day evolutionary biology takes far too dim a view of the natural world, emphasizing our "selfish" genes. Science has thus exacerbated our reciprocal habits of blaming nature when we act badly and labeling the (...) good things we do as "humane." Seeking the origin of human morality not in evolution but in human culture, science insists that we are moral by choice, not by nature. Citing remarkable evidence based on his extensive research of primate behavior, de Waal attacks "Veneer Theory," which posits morality as a thin overlay on an otherwise nasty nature. He explains how we evolved from a long line of animals that care for the weak and build cooperation with reciprocal transactions. Drawing on both Darwin and recent scientific advances, de Waal demonstrates a strong continuity between human and animal behavior. In the process, he also probes issues such as anthropomorphism and human responsibilities toward animals. Based on the Tanner Lectures de Waal delivered at Princeton University's Center for Human Values in 2004, Primates and Philosophers includes responses by the philosophers Peter Singer, Christine M. Korsgaard, and Philip Kitcher and the science writer Robert Wright. They press de Waal to clarify the differences between humans and other animals, yielding a lively debate that will fascinate all those who wonder about the origins and reach of human goodness. (shrink)

Evidence from a variety of domains converges on the view that there are multiple learning/memory systems, but there is no clear understanding of what these systems are, and why they should exist. I review an hypothesis about multiple memory systems postulated by O'Keefe and Nadel (The hippocampus ac a Cognitive map, Oxford: Clarendon Press, 1978), in particular our assertions about the nature of two kinds of systems (the locale and taxon systems), and what differentiates them from each other. I concentrate (...) on our assumption that systems differ in terms of the type of information they process, rather than in terms of the temporal duration over which they function. Our ?content-driven? dichotomy is contrasted with several other current views, none of which appears to explain extant data, or provides clear predictions about when one or the other kind of system would be engaged. Finally, 1 briefly consider why such distinct systems might have evolved. (shrink)

The essays in this volume represent the first steps by philosophers and artificial intelligence researchers toward explaining why it is necessary to add an ...

As arti® cial intelligence moves ever closer to the goal of producing fully autonomous agents, the question of how to design and implement an arti® cial moral agent (AMA) becomes increasingly pressing. Robots possessing autonomous capacities to do things that are useful to humans will also have the capacity to do things that are harmful to humans and other sentient beings. Theoretical challenges to developing arti® cial moral agents result both from controversies among ethicists about moral theory itself, and from (...) computational limits to the implementation of such theories. In this paper the ethical disputes are surveyed, the possibility of a `moral Turing Test ’ is considered and the computational di culties accompanying the diŒerent types of approach are assessed. Human-like performance, which is prone to include immoral actions, may not be acceptable in machines, but moral perfection may be computationally unattainable. The risks posed by autonomous machines ignorantly or deliberately harming people and other sentient beings are great. The development of machines with enough intelligence to assess the eŒects of their actions on sentient beings and act accordingly may ultimately be the most important task faced by the designers of arti® cially intelligent automata. (shrink)

This paper is about how to give human-like powers to complete agents. For this the most important design choice concerns the overall architecture. Questions regarding detailed mechanisms, forms of representations, inference capabilities, knowledge etc. are best addressed in the context of a global architecture in which different design decisions need to be linked. Such a design would assemble various kinds of functionality into a complete coherent working system, in which there are many concurrent, partly independent, partly mutually supportive, partly potentially (...) incompatible processes, addressing a multitude of issues on different time scales, including asynchronous, concurrent, motive generators. Designing human like agents is part of the more general problem of understanding design space, niche space and their interrelations, for, in the abstract, there is no one optimal design, as biological diversity on earth shows. (shrink)

This paper proposes a brain-inspired cognitive architecture that incorporates approximations to the concepts of consciousness, imagination, and emotion. To emulate the empirically established cognitive efficacy of conscious as opposed to non-conscious information processing in the mammalian brain, the architecture adopts a model of information flow from global workspace theory. Cognitive functions such as anticipation and planning are realised through internal simulation of interaction with the environment. Action selection, in both actual and internally simulated interaction with the environment, is mediated by (...) affect. An implementation of the architecture is described which is based on weightless neurons and is used to control a simulated robot. (shrink)

Computing Methodologies -- Artificial Intelligence.

The role of emotion in human action has long been neglected in the philosophy of action. Some prevalent misconceptions of the nature of emotion are responsible for this neglect: emotions are irrational; emotions are passive; and emotions have only an insignificant impact on actions. In this paper we argue that these assumptions about the nature of emotion are problematic and that the neglect of emotion's place in theories of action is untenable. More positively, we argue on the basis of recent (...) research in cognitive neuroscience that emotions may significantly affect action generation as well as action execution and control. Moreover, emotions also play a crucial role in people's explanation of action. We conclude that the concept of emotion deserves a more distinctive and central place in philosophical theories of action. (shrink)

"Sets a standard for rigor, parsimony and theoretical elegance in cognitive modeling....Offers a coherent and predictive system for tackling both specific and general issues." --Science.

This paper discusses some of the requirements for the control architecture of an intelligent human-like agent with multiple independent dynamically changing motives in a dynamically changing only partly predictable world. The architecture proposed includes a combination of reactive, deliberative and meta-management mechanisms along with one or more global ``alarm'' systems. The engineering design requirements are discussed in relation our evolutionary history, evidence of brain function and recent theories of Damasio and others about the relationships between intelligence and emotions. (The paper (...) was completed in haste for a deadline and I forgot to explain why Descartes was in the title. See Damasio 1994.). (shrink)

This paper is reprinted in the book Machine Ethics, eds. M. Anderson and S. Anderson, Cambridge University Press, 2011.

The issue of the biological origin of consciousness is linked to that of its function. One source of evidence in this regard is the contrast between the types of information that are and are not included within its compass. Consciousness presents us with a stable arena for our actions—the world—but excludes awareness of the multiple sensory and sensorimotor transformations through which the image of that world is extracted from the confounding influence of self-produced motion of multiple receptor arrays mounted on (...) multijointed and swivelling body parts. Likewise excluded are the complex orchestrations of thousands of muscle movements routinely involved in the pursuit of our goals. This suggests that consciousness arose as a solution to problems in the logistics of decision making in mobile animals with centralized brains, and has correspondingly ancient roots. (shrink)

Vision, more than any other sense, dominates our mental life. Our visual experience is just so rich, so detailed, that we can hardly distinguish that experience from the world itself. Even when we just think about the world and don't look at it directly, we can't help but 'imagine' what it looks like. We think of 'seeing' as being a conscious activity--we direct our eyes, we choose what we look at, we register what we are seeing. The series of events (...) described in this book radically altered this attitude towards vision. This book describes one of the most extraordinary neurological cases of recent years--one that profoundly changed scientific views on consciousness. It is the story of Dee Fletcher--a woman recently blinded--who became the subject of a series of scientific studies. As events unfolded, Milner and Goodale found that Dee wasn't in fact blind--she just didn't know that she could see. Taking us on a journey into the unconscious brain, the two scientists who made this incredible discovery tell the amazing story of their work, and the surprising conclusion they were forced to reach. Written to be accessible to students and popular science readers, this book is a fascinating illustration of the power of the 'unconscious' mind. (shrink)

In his article on The Liabilities of Mobility, Merker asserts that “Consciousness presents us with a stable arena for our actions—the world …” and argues for this property as providing evolutionary pressure for the evolution of consciousness. In this commentary, I will explore the implications of Merker’s ideas for consciousness in artificial agents as well as animals, and also meet some possible objections to his evolutionary pressure claim.

I address the commentators' calls for clarification of theoretical terms, discussion of similarities to other proposals, and extension of the ideas. In doing so, I keep the focus on the purpose of memory: enabling the organism to make sense of its environment so that it can take action appropriate to constraints resulting from the physical, personal, social, and cultural situations.

A principal goal of the discipline of artificial morality is to design artificial agents to act as if they are moral agents. Intermediate goals of artificial morality are directed at building into AI systems sensitivity to the values, ethics, and legality of activities. The development of an effective foundation for the field of artificial morality involves exploring the technological and philosophical issues involved in making computers into explicit moral reasoners. The goal of this paper is to discuss strategies for implementing (...) artificial morality and the differing criteria for success that are appropriate to different strategies. (shrink)

Conscious events interact with memory systems in learning, rehearsal and retrieval (Ebbinghaus 1885/1964; Tulving 1985). Here we present hypotheses that arise from the IDA computional model (Franklin,Kelemen and McCauley 1998; Franklin 2001b) of global workspace theory (Baars 1988, 2002). Our primary tool for this exploration is a flexible cognitive cycle employed by the IDA computational model and hypothesized to be a basic element of human cognitive processing. Since cognitive cycles are hypothesized to occur five to tentimes a second and include (...) interaction between conscious contents and several of the memory systems, they provide the means for an exceptionally fine-grained analysis of various cognitive tasks. We apply this tool to the small effect size of subliminal learning compared to supraliminal learning, to process dissociation, to implicit learning, to recognition vs. recall, and to the availability heuristic in recall. The IDA model elucidates the role of consciousness in the updating of perceptual memory, transient episodic memory, and procedural memory. In most cases, memory is hypothesized to interact with conscious events for its normal functioning. The methodology of the paper is unusual in that the hypotheses and explanations presented are derived from an empirically based, but broad and qualitative computational model of human cognition. (shrink)

In his article on The Liabilities of Mobility, Merker asserts that “Consciousness presents us with a stable arena for our actions—the world …” and argues for this property as providing evolutionary pressure for the evolution of consciousness. In this commentary, I will explore the implications of Merker’s ideas for consciousness in artificial agents as well as animals, and also meet some possible objections to his evolutionary pressure claim.

This book explores the role of artificial intelligence in the development of a claim that morality is person-made and rational. Professor Danielson builds moral robots that do better than amoral competitors in a tournament of games like the Prisoners Dilemma and Chicken. The book thus engages in current controversies over the adequacy of the received theory of rational choice. It sides with Gauthier and McClennan, who extend the devices of rational choice to include moral constraint. Artificial Morality goes further, by (...) promoting communication, testing and copying of principles and by stressing empirical tests. (shrink)