Building artificial moral agents (AMAs) underscores the fragmentary character of presently available models of human ethical behavior. It is a distinctly different enterprise from either the attempt by moral philosophers to illuminate the “ought” of ethics or the research by cognitive scientists directed at revealing the mechanisms that influence moral psychology, and yet it draws on both. Philosophers and cognitive scientists have tended to stress the importance of particular cognitive mechanisms, e.g., reasoning, moral sentiments, heuristics, intuitions, or a moral grammar, (...) in the making of moral decisions. However, assembling a system from the bottom-up which is capable of accommodating moral considerations draws attention to the importance of a much wider array of mechanisms in honing moral intelligence. Moral machines need not emulate human cognitive faculties in order to function satisfactorily in responding to morally significant situations. But working through methods for building AMAs will have a profound effect in deepening an appreciation for the many mechanisms that contribute to a moral acumen, and the manner in which these mechanisms work together. Building AMAs highlights the need for a comprehensive model of how humans arrive at satisfactory moral judgments. (shrink)

Building artificial moral agents (AMAs) underscores the fragmentary character of presently available models of human ethical behavior. It is a distinctly different enterprise from either the attempt by moral philosophers to illuminate the “ought” of ethics or the research by cognitive scientists directed at revealing the mechanisms that influence moral psychology, and yet it draws on both. Philosophers and cognitive scientists have tended to stress the importance of particular cognitive mechanisms, e.g., reasoning, moral sentiments, heuristics, intuitions, or a moral grammar, (...) in the making of moral decisions. However, assembling a system from the bottom-up which is capable of accommodating moral considerations draws attention to the importance of a much wider array of mechanisms in honing moral intelligence. Moral machines need not emulate human cognitive faculties in order to function satisfactorily in responding to morally significant situations. But working through methods for building AMAs will have a profound effect in deepening an appreciation for the many mechanisms that contribute to a moral acumen, and the manner in which these mechanisms work together. Building AMAs highlights the need for a comprehensive model of how humans arrive at satisfactory moral judgments. (shrink)

I reconstruct Kant's derivation of the Categorical Imperative (CI) as an argument that deduces what the voice of conscience must say from how it must sound - that is, from the authority that is metaphorically attributed to conscience in the form of a resounding voice. The idea of imagining the CI as the voice of conscience comes from Freud; and the present reconstruction is part of a larger project that aims to reconcile Kant's moral psychology with Freud's theory of moral (...) development. As I reconstruct it, Kant's argument yields an imperative commanding us to act for reasons whose validity we can consistently will to be common knowledge among all agents. Universalizing a maxim thus turns out to consist in willing, not that there be some universally quantified rule of conduct, but rather that a principle of practical reasoning be common knowledge - as a principle of reasoning ought to be. (shrink)

This paper considers the ethical implications of applying three major ethical theories to the memory structure of an artificial companion that might have different embodiments such as a physical robot or a graphical character on a hand-held device. We start by proposing an ethical memory model and then make use of an action-centric framework to evaluate its ethical implications. The case that we discuss is that of digital artefacts that autonomously record and store user data, where this data are used (...) as a resource for future interaction with users. (shrink)

That the successful development of fully autonomous artificial moral agents (AMAs) is imminent is becoming the received view within artificial intelligence research and robotics. The discipline of Machines Ethics, whose mandate is to create such ethical robots, is consequently gaining momentum. Although it is often asked whether a given moral framework can be implemented into machines, it is never asked whether it should be. This paper articulates a pressing challenge for Machine Ethics: To identify an ethical framework that is both (...) implementable into machines and whose tenets permit the creation of such AMAs in the first place. Without consistency between ethics and engineering, the resulting AMAs would not be genuine ethical robots, and hence the discipline of Machine Ethics would be a failure in this regard. Here this challenge is articulated through a critical analysis of the development of Kantian AMAs, as one of the leading contenders for being the ethic that can be implemented into machines. In the end, however, the development of Kantian artificial moral machines is found to be anti-Kantian. The upshot of all this is that machine ethicists need to look elsewhere for an ethic to implement into their machines. (shrink)

I report the findings of a comparative analysis of online Christian and Buddhist responses to artificial intelligence. I review the Buddhist response and compare it with the Christian response outlined in an earlier essay (Tamatea 2008). The discussion seeks to answer two questions: Which approach to imago Dei informs the online Buddhist response to artificial intelligence? And to what extent does the preference for a particular approach emerge from a desire to construct the Self? The conclusion is that, like the (...) Christian response, the Buddhist response is grounded not so much in the reality of AI as it is in the discursive constructions of AI made available through Buddhist cosmology, which (paradoxically), like the Christian response, are deployed in defense of the Self, despite claimed adherence to the notion of anatta, or non-Self. (shrink)

Recently, philosophers and psychologists defending the embodied cognition research program have offered arguments against mindreading as a general model of our social understanding. The embodied cognition arguments are of two kinds: those that challenge the developmental picture of mindreading and those that challenge the alleged ubiquity of mindreading. Together, these two kinds of arguments, if successful, would present a serious challenge to the standard account of human social understanding. In this paper, I examine the strongest of these embodied cognition arguments (...) and argue that mindreading approaches can withstand the best of these arguments from embodied cognition. (shrink)

This analysis explores theories of recollective memories and their shortcomings to show how certain recollective memories are to some extent the initial experiencing of past conscious mental states. While dedicated memory theorists over the past century show remembering to be an active and subjective process, they usually make simplistic assumptions regarding the experience that is remembered. Their treatment of experience leaves unexplored the notion that the truth of memory is a dynamic interaction between experience and recollection. The argument's seven sections (...) examine how experience, consciousness, and the self produce memories in odd but actual situations. Examples are presented that are either actual or technologically possible, and they pose a challenge for some theories of memory. Showing that an experience and a memory must be bound by psychological continuity, the sections build upon each other to challenge aprioristic beliefs about the self and consciousness. The later sections examine the lack of available accounts of memory that acknowledge consciousness, dissociation, and "selfhood" to be matters of degree, thus rendering memory theories next to useless when trying to effectively incorporate the notions of experience and reality. (shrink)

This work presents an analysis of the feeling of guilt and in particular of the cognitive defenses against it. It shows how the need to avoid or mitigate the feeling, with the suffering implied, affects the perception and judgment of oneself and others. It is in fact claimed that to copy with their guilt people try to alter the appraisal processes implied by the emotion. Once described the main cognitive components of the feeling of guilt, an analysis is offered of (...) the interventions of the cognitive defenses on such components, to alter the original appraisal processes underlying the feeling. (shrink)

In this article we provide a unifying neural hypothesis on how individuals understand the actions and emotions of others. Our main claim is that the fundamental mechanism at the basis of the experiential understanding of others' actions is the activation of the mirror neuron system. A similar mechanism, but involving the activation of viscero-motor centers, underlies the experiential understanding of the emotions of others.

We can learn about human ethics from machines. We discuss the design of a working machine for making ethical decisions, the N-Reasons platform, applied to the ethics of robots. This N-Reasons platform builds on web based surveys and experiments, to enable participants to make better ethical decisions. Their decisions are better than our existing surveys in three ways. First, they are social decisions supported by reasons. Second, these results are based on weaker premises, as no exogenous expertise (aside from that (...) provided by the participants) is needed to seed the survey. Third, N-Reasons is designed to support experiments so we can learn how to improve the platform. We sketch experimental results that show the platform is a success as well as pointing to ways it can be improved. (shrink)

Should we grant rights to artificially intelligent robots? Most current and near-future robots do not meet the hard criteria set by deontological and utilitarian theory. Virtue ethics can avoid this problem with its indirect approach. However, both direct and indirect arguments for moral consideration rest on ontological features of entities, an approach which incurs several problems. In response to these difficulties, this paper taps into a different conceptual resource in order to be able to grant some degree of moral consideration (...) to some intelligent social robots: it sketches a novel argument for moral consideration based on social relations. It is shown that to further develop this argument we need to revise our existing ontological and social-political frameworks. It is suggested that we need a social ecology, which may be developed by engaging with Western ecology and Eastern worldviews. Although this relational turn raises many difficult issues and requires more work, this paper provides a rough outline of an alternative approach to moral consideration that can assist us in shaping our relations to intelligent robots and, by extension, to all artificial and biological entities that appear to us as more than instruments for our human purposes. (shrink)

Cambridge University Press:1998) P. 35-52. To be reprinted in Alberto Peruzzi (ed) MIND.

Cognitive science is in some sense the science of the mind. But an increasingly influential theme, in recent years, has been the role of the physical body, and of the local environment, in promoting adaptive success. No right-minded cognitive scientist, to be sure, ever claimed that body and world were completely irrelevant to the understanding of mind. But there was, nonetheless, an unmistakeable tendency to marginalize such factors: to dwell on inner complexity whilst simplifying or ignoring the complex inner-outer interplays (...) that characterize the bulk of basic biological problem-solving. This tendency was expressed in, for example, the development of planning algorithms that treated real-world action as merely a way of implementing solutions arrived at by pure cognition. It also surfaced in David Marr's depiction of the task of vision as the construction of a detailed threedimensional image of the visual scene. For possession of such a rich inner model effectively allows the system to ‘throw away’ the world and to focus subsequent computational activity on the inner model alone. (shrink)

The Hypothesis of Extended Cognition (HEC)—that many cognitive processes are carried out by a hybrid coalition of neural, bodily and environmental factors—entails that the intentional states that are reasons for action might best be ascribed to wider entities of which individual persons are only parts. I look at different kinds of extended cognition and agency, exploring their consequences for concerns about the moral agency and personal responsibility of such extended entities. Can extended entities be moral agents and bear responsibility for (...) actions, in addition to or in place of the individuals typically held responsible? What does it mean to be autonomous when one’s cognition is influenced and supported by a milieu of environmental factors? To answer these questions, I explore strong parallels between HEC’s critique of individualism in cognition, and feminist critiques of individualist accounts of self, agency, and autonomy. This relational and social conception of autonomous agency, as scaffolded and supported (or undermined and impaired) by a milieu of social, relational, and normative factors, has important lessons for HEC. Drawing together these two visions of distributed and decentralized aspects of personhood highlights how cognition, action, and responsibility are inextricably linked. It also encourages a reconceptualization of all cognition and all concerns about responsibility for actions, not simply as sometimes extended around individuals, but as fundamentally communal, social, and normative, with individual cognition and individual moral responsibility being derivative special cases, not the paradigm examples. Individuals are merely one of many possible loci of cognition, action, and responsibility. (shrink)

This paper introduces a new, expanded range of relevant cognitive psychological research on collaborative recall and social memory to the philosophical debate on extended and distributed cognition. We start by examining the case for extended cognition based on the complementarity of inner and outer resources, by which neural, bodily, social, and environmental resources with disparate but complementary properties are integrated into hybrid cognitive systems, transforming or augmenting the nature of remembering or decision-making. Adams and Aizawa, noting this distinctive complementarity argument, (...) say that they agree with it completely: but they describe it as “a non-revolutionary approach” which leaves “the cognitive psychology of memory as the study of processes that take place, essentially without exception, within nervous systems.” In response, we carve out, on distinct conceptual and empirical grounds, a rich middle ground between internalist forms of cognitivism and radical anti-cognitivism. Drawing both on extended cognition literature and on Sterelny’s account of the “scaffolded mind” (this issue), we develop a multidimensional framework for understanding varying relations between agents and external resources, both technological and social. On this basis we argue that, independent of any more “revolutionary” metaphysical claims about the partial constitution of cognitive processes by external resources, a thesis of scaffolded or distributed cognition can substantially influence or transform explanatory practice in cognitive science. Critics also cite various empirical results as evidence against the idea that remembering can extend beyond skull and skin. We respond with a more principled, representative survey of the scientific psychology of memory, focussing in particular on robust recent empirical traditions for the study of collaborative recall and transactive social memory. We describe our own empirical research on socially distributed remembering, aimed at identifying conditions for mnemonic emergence in collaborative groups. Philosophical debates about extended, embedded, and distributed cognition can thus make richer, mutually beneficial contact with independently motivated research programs in the cognitive psychology of memory. (shrink)

Prior to the twentieth century, theories of knowledge were inherently perceptual. Since then, developments in logic, statis- tics, and programming languages have inspired amodal theories that rest on principles fundamentally different from those underlying perception. In addition, perceptual approaches have become widely viewed as untenable because they are assumed to implement record- ing systems, not conceptual systems. A perceptual theory of knowledge is developed here in the context of current cognitive science and neuroscience. During perceptual experience, association areas in the (...) brain capture bottom-up patterns of activation in sensory-motor areas. Later, in a top-down manner, association areas partially reactivate sensory-motor areas to implement perceptual symbols. The stor- age and reactivation of perceptual symbols operates at the level of perceptual components – not at the level of holistic perceptual expe- riences. Through the use of selective attention, schematic representations of perceptual components are extracted from experience and stored in memory (e.g., individual memories of green, purr, hot). As memories of the same component become organized around a com- mon frame, they implement a simulator that produces limitless simulations of the component (e.g., simulations of purr). Not only do such simulators develop for aspects of sensory experience, they also develop for aspects of proprioception (e.g., lift, run) and introspec- tion (e.g., compare, memory, happy, hungry). Once established, these simulators implement a basic conceptual system that represents types, supports categorization, and produces categorical inferences. These simulators further support productivity, propositions, and ab- stract concepts, thereby implementing a fully functional conceptual system. Productivity results from integrating simulators combinato- rially and recursively to produce complex simulations. Propositions result from binding simulators to perceived individuals to represent type-token relations. Abstract concepts are grounded in complex simulations of combined physical and introspective events. Thus, a per- ceptual theory of knowledge can implement a fully functional conceptual system while avoiding problems associated with amodal sym- bol systems. Implications for cognition, neuroscience, evolution, development, and artificial intelligence are explored. (shrink)

Conscience is often referred to yet not understood. This text develops a theory of cognition around a model of conscience, the ACTWith model. It represents a synthesis of results from contemporary neuroscience with traditional philosophy, building from Jamesian insights into the emergence of the self to narrative identity, all the while motivated by a single mechanism as represented in the ACTWith model. Emphasis is placed on clarifying historical expressions and demonstrations of conscience - Socrates, Heidegger, Kant, M.L. King - in (...) light of the ACTWith model, while at once turning these resources to developing the basic architecture. In the end, this text aims to enrich moral theory by improving our understanding of moral cognition, while at once providing a useful tool in everyday moral practice and self-development. (shrink)

The Collected Works of John Stuart Mill was directed by an editorial committee appointed from the Faculty of Arts and Science of the University of Toronto and from the University of Toronto Press, and it was published from 1963 to 1991 in thirty-three hardcover volumes. The primary aim of the edition is to present fully collated, accurate texts of those works which exist in a number of versions, both printed and manuscript, and to provide accurate texts of those works previously (...) unpublished or which had become relatively inaccessible. Liberty Fund is pleased to make available in paperback eight volumes of Mill's writings that remain most relevant to liberty and responsibility in the twenty-first century. Mill's Autobiography gives a vivid account of his life, especially his unique education. The Principles of Political Economy, a compendium of economic theory and fact, was the leading economic textbook for decades. Primarily of interest to economists, his Essays on Economics and Society nevertheless contains material of interest to all students of the politics and society of nineteenth-century England. The most indispensable work in understanding his thought is A System of Logic, Ratiocinative and Inductive, which was the first serious attempt to methodize induction in relation to deduction. Essays on Ethics, Religion and Society, one of the most important volumes in the Collected Works, includes the major documents for an assessment of Mill's response to Benthamite utilitarianism and for understanding his development of an independent moral position. Book jacket. (shrink)

Paul Ricoeur has been hailed as one of the most important thinkers of the century. Oneself as Another, the clearest account of his "philosophical ethics," substantiates this position and lays the groundwork for a metaphysics of morals.

This paper discusses essential motivational representations necessary for a comprehensive computational cognitive architecture. It hypothesizes the need for implicit drive representations, as well as explicit goal representations. Drive representations consist of primary drives — both low-level primary drives (concerned mostly with basic physiological needs) and high-level primary drives (concerned more with social needs), as well as derived (secondary) drives. On the basis of drives, explicit goals may be generated on the fly during an agent’s interaction with various situations. These motivational (...) representations help to make cognitive architectural models more comprehensive and provide deeper explanations of psychological processes. This work represents a step forward in making computational cognitive architectures better reflections of the human mind and all its motivational complexity and intricacy. (shrink)

There has been much discussion recently about the scope and limits of purely symbolic models of the mind and about the proper role of connectionism in cognitive modeling. This paper describes the symbol grounding problem : How can the semantic interpretation of a formal symbol system be made intrinsic to the system, rather than just parasitic on the meanings in our heads? How can the meanings of the meaningless symbol tokens, manipulated solely on the basis of their shapes, be grounded (...) in anything but other meaningless symbols? The problem is analogous to trying to learn Chinese from a Chinese/Chinese dictionary alone. A candidate solution is sketched: Symbolic representations must be grounded bottom-up in nonsymbolic representations of two kinds: iconic representations, which are analogs of the proximal sensory projections of distal objects and events, and categorical representations, which are learned and innate feature-detectors that pick out the invariant features of object and event categories from their sensory projections. Elementary symbols are the names of these object and event categories, assigned on the basis of their categorical representations. Higher-order symbolic representations, grounded in these elementary symbols, consist of symbol strings describing category membership relations. Connectionism is one natural candidate for the mechanism that learns the invariant features underlying categorical representations, thereby connecting names to the proximal projections of the distal objects they stand for. In this way connectionism can be seen as a complementary component in a hybrid nonsymbolic/symbolic model of the mind, rather than a rival to purely symbolic modeling. Such a hybrid model would not have an autonomous symbolic module, however; the symbolic functions would emerge as an intrinsically dedicated symbol system as a consequence of the bottom-up grounding of categories ' names in their sensory representations. Symbol manipulation would be governed not just by the arbitrary shapes of the symbol tokens, but by the nonarbitrary shapes of the icons and category invariants in which they are grounded. (shrink)

Many prominent accounts of free will and moral responsibility make use of the idea that agents can be responsive to reasons. Call such theories Reasons accounts. In what follows, I consider the tenability of Reasons accounts in light of situationist social psychology and, to a lesser extent, the automaticity literature. In the first half of this chapter, I argue that Reasons accounts are genuinely threatened by contemporary psychology. In the second half of the paper I consider whether such threats can (...) be met, and at what cost. Ultimately, I argue that Reasons accounts can abandon some familiar assumptions, and that doing so permits us to build a more empirically plausible picture of our agency. (shrink)

We describe a project to capitalize on newly available levels of computational resources in order to understand human cognition. We are building an integrated physical system including vision, sound input and output, and dextrous manipulation, all controlled by a continuously operating large scale parallel MIMD computer. The resulting system will learn to "think" by building on its bodily experiences to accomplish progressively more abstract tasks. Past experience suggests that in attempting to build such an integrated system we will have to (...) fundamentally change the way artificial intelligence, cognitive science, linguistics, and philosophy think about the organization of intelligence. We expect to be able to better reconcile the theories that will be developed with current work in neuroscience. (shrink)

The Sciousness Hypothesis holds that how we know our mental-occurrence instances does not include our having immediate awareness of them. Rather, we take notice of our behaviors or bodily reactions and infer mental-occurrence instances that would explain them. In The Principles, James left it an open question whether the Sciousness Hypothesis is true, and proceeded in accordance with the conviction that one’s stream of consciousness consists only of basic durational components of which one has immediate awareness. Nevertheless, James seems to (...) have been tempted by the Sciousness Hypothesis. And he adopted an account of inner awareness that is popular among present-day psychologists of consciousness, to the effect that awareness of a mental-occurrence instance never takes place from within its phenomenological structure, always from a certain distance, by means of a distinct mental-occurrence instance. This means that the immediacy of inner awareness can only be a temporal and causal immediacy, not the kind we seem to have, whereby we consciously participate in the occurrence of a mental state. The present article, which is published in two separate though continuous parts, clarifies and elaborates the Sciousness Hypothesis, and critically discusses it and the kind of account of inner awareness that seems closest to it. (shrink)

Artificial intelligence is a possibility that should not be ignored in any serious thinking about the future, and it raises many profound issues for ethics and public policy that philosophers ought to start thinking about. This article outlines the case for thinking that human-level machine intelligence might well appear within the next half century. It then explains four immediate consequences of such a development, and argues that machine intelligence would have a revolutionary impact on a wide range of the social, (...) political, economic, commercial, technological, scientific and environmental issues that humanity will face over the coming decades. (shrink)