_Behavioral and Brain Sciences_ , 15, 183-247, 1992. Reprinted in _The Philosopher's Annual_ , Grim, Mar and Williams, eds., vol. XV-1992, 1994, pp. 23-68; Noel Sheehy and Tony Chapman, eds., _Cognitive Science_ , Vol. I, Elgar, 1995, pp.210-274.

The emulation theory of representation is developed and explored as a framework that can revealingly synthesize a wide variety of representational functions of the brain. The framework is based on constructs from control theory (forward models) and signal processing (Kalman filters). The idea is that in addition to simply engaging with the body and environment, the brain constructs neural circuits that act as models of the body and environment. During overt sensorimotor engagement, these models are driven by efference copies in (...) parallel with the body and environment, in order to provide expectations of the sensory feedback, and to enhance and process sensory information. These models can also be run off-line in order to produce imagery, estimate outcomes of different actions, and evaluate and develop motor plans. The framework is initially developed within the context of motor control, where it has been shown that inner models running in parallel with the body can reduce the effects of feedback delay problems. The same mechanisms can account for motor imagery as the off-line driving of the emulator via efference copies. The framework is extended to account for visual imagery as the off-line driving of an emulator of the motor-visual loop. I also show how such systems can provide for amodal spatial imagery. Perception, including visual perception, results from such models being used to form expectations of, and to interpret, sensory input. I close by briefly outlining other cognitive functions that might also be synthesized within this framework, including reasoning, theory of mind phenomena, and language. Key Words: efference copies; emulation theory of representation; forward models; Kalman filters; motor control; motor imagery; perception; visual imagery. (shrink)

There is considerable evidence that the hippocampal system contributes both to (1) the temporary maintenance of memories and to (2) the processing of a particular type of memory representation. The findings on amnesia suggest that these two distinguishing features of hippocampal memory processing are orthogonal. Together with anatomical and physiological data, the neuropsychological findings support a model of cortico-hippocampal interactions in which the temporal and representational properties of hippocampal memory processing are mediated separately. We propose that neocortical association areas maintain (...) shortterm memories for specific items and events prior to hippocampal processing as well as providing the final repositories of long-term memory. The parahippocampal region supports intermediate-term storage of individual items, and the hippocampal formation itself mediates an organization of memories according to relevant relationships among items. Hippocampal-cortical interactions produce (i) strong and persistent memories for events, including their constituent elements and the relationships among them, and (ii) a capacity to express memories flexibly across a wide range of circumstances. (shrink)

In this paper I develop the thesis that dreams are essential to an understanding of waking consciousness. In the first part I argue in opposition to the philosophers Malcolm and Dennett that empirical evidence now shows dreams to be real conscious experiences. In the second part, three questions concerning consciousness research are addressed. (1) How do we isolate the system to be explained (consciousness) from other systems? (2) How do we describe the system thus isolated? (3) How do we reveal (...) the mechanisms on which this system is based? I suggest that empirical dream research combined with other empirical approaches can help us to sketch answers to all of these questions. I argue that the subjective form of dreams reveals the subjective, macro-level form of consciousness in general and that both dreams and the everyday phenomenal world may be thought of as constructed “virtual realities”. A major task for empirical consciousness research is to find out the mechanisms which bind this experienced world into a coherent whole. (shrink)

Thirty years ago, grounded cognition had roots in philosophy, perception, cognitive linguistics, psycholinguistics, cognitive psychology, and cognitive neuropsychology. During the next 20 years, grounded cognition continued developing in these areas, and it also took new forms in robotics, cognitive ecology, cognitive neuroscience, and developmental psychology. In the past 10 years, research on grounded cognition has grown rapidly, especially in cognitive neuroscience, social neuroscience, cognitive psychology, social psychology, and developmental psychology. Currently, grounded cognition appears to be achieving increased acceptance throughout cognitive (...) science, shifting from relatively minor status to increasing importance. Nevertheless, researchers wonder whether grounded mechanisms lie at the heart of the cognitive system or are peripheral to classic symbolic mechanisms. Although grounded cognition is currently dominated by demonstration experiments in the absence of well-developed theories, the area is likely to become increasingly theory driven over the next 30 years. Another likely development is the increased incorporation of grounding mechanisms into cognitive architectures and into accounts of classic cognitive phenomena. As this incorporation occurs, much functionality of these architectures and phenomena is likely to remain, along with many original mechanisms. Future theories of grounded cognition are likely to be heavily influenced by both cognitive neuroscience and social neuroscience, and also by developmental science and robotics. Aspects from the three major perspectives in cognitive science—classic symbolic architectures, statistical/dynamical systems, and grounded cognition—will probably be integrated increasingly in future theories, each capturing indispensable aspects of intelligence. (shrink)

Human agents draw a variety of inferences effortlessly, spontaneously, and with remarkable efficiency – as though these inferences were a reflexive response of their cognitive apparatus. Furthermore, these inferences are drawn with reference to a large body of background knowledge. This remarkable human ability seems paradoxical given the complexity of reasoning reported by researchers in artificial intelligence. It also poses a challenge for cognitive science and computational neuroscience: How can a system of simple and slow neuronlike elements represent a large (...) body of systemic knowledge and perform a range of inferences with such speed? We describe a computational model that takes a step toward addressing the cognitive science challenge and resolving the artificial intelligence paradox. We show how a connectionist network can encode millions of facts and rules involving n-ary predicates and variables and perform a class of inferences in a few hundred milliseconds. Efficient reasoning requires the rapid representation and propagation of dynamic bindings. Our model (which we refer to as SHRUTI) achieves this by representing (1) dynamic bindings as the synchronous firing of appropriate nodes, (2) rules as interconnection patterns that direct the propagation of rhythmic activity, and (3) long-term facts as temporal pattern-matching subnetworks. The model is consistent with recent neurophysiological evidence that synchronous activity occurs in the brain and may play a representational role in neural information processing. The model also makes specific psychologically significant predictions about the nature of reflexive reasoning. It identifies constraints on the form of rules that may participate in such reasoning and relates the capacity of the working memory underlying reflexive reasoning to biological parameters such as the lowest frequency at which nodes can sustain synchronous oscillations and the coarseness of synchronization. (shrink)

Traditionally, philosophers have appealed to the phenomenological similarity between visual experience and visual imagery to support the hypothesis that there is significant overlap between the perceptual and imaginative domains. The current evidence, however, is inconclusive: while evidence from transcranial brain stimulation seems to support this conclusion, neurophysiological evidence from brain lesion studies (e.g., from patients with brain lesions resulting in a loss of mental imagery but not a corresponding loss of perception and vice versa) indicates that there are functional and (...) anatomical dissociations between mental imagery and perception. Assuming that the mental imagery and perception do not overlap, at least, to the extent traditionally assumed, then the question arises as to what exactly mental imagery is and whether it parallels perception by proceeding via several functionally distinct mechanisms. In this review, we argue that even though there may not be a shared mechanism underlying vision for perception and conscious imagery, there is an overlap between the mechanisms underlying vision for action and unconscious visual imagery. On the basis of these findings, we propose a modification of Kosslyn’s model of imagery that accommodates unconscious imagination and explore possible explanations of the quasi-pictorial phenomenology of conscious visual imagery in light of the fact that its underlying neural substrates and mechanisms typically are distinct from those of visual experience. (shrink)

Recent evidence from cognitive neuroscience suggests that certain cognitive processes employ perceptual representations. Inspired by this evidence, a few researchers have proposed that cognition is inherently perceptual. They have developed an innovative theoretical approach that rests on the notion of perceptual simulation and marshaled several general arguments supporting the centrality of perceptual representations to concepts. In this article, I identify a number of weaknesses in these arguments and defend a multiple semantic code approach that posits both perceptual and non-perceptual representations.

Various defenses of amodal symbol systems are addressed, including amodal symbols in sensory-motor areas, the causal theory of concepts, supramodal concepts, latent semantic analysis, and abstracted amodal symbols. Various aspects of perceptual symbol systems are clarified and developed, including perception, features, simulators, category structure, frames, analogy, introspection, situated action, and development. Particular attention is given to abstract concepts, language, and computational mechanisms.

What is the primary function of consciousness in the nervous system? The answer to this question remains enigmatic, not so much because of a lack of relevant data, but because of the lack of a conceptual framework with which to interpret the data. To this end, we have developed Passive Frame Theory, an internally coherent framework that, from an action-based perspective, synthesizes empirically supported hypotheses from diverse fields of investigation. The theory proposes that the primary function of consciousness is well-circumscribed, (...) serving the 'somatic nervous system[. For this system, consciousness serves as a frame that constrains and directs skeletal muscle output, thereby yielding adaptive behavior. The mechanism by which consciousness achieves this is more counterintuitive, passive, and “low level” than the kinds of functions that theorists have previously attributed to consciousness. Passive frame theory begins to illuminate (a) what consciousness contributes to nervous function, (b) how consciousness achieves this function, and (c) the neuroanatomical substrates of conscious processes. Our untraditional, action-based perspective focuses on olfaction instead of on vision and is 'descriptive' (describing the products of nature as they evolved to be) rather than 'normative' (construing processes in terms of how they should function). Passive frame theory begins to isolate the neuroanatomical, cognitive-mechanistic, and representational (e.g., conscious contents) processes associated with consciousness. (shrink)

If sensations were behaviorally conceived, as they should be, as complex functional patterns of interaction between overt behavior and the environment, there would be no point in searching for them as instantaneous psychic elements within the brain or as internal products of the brain.

Mental imagery (varieties of which are sometimes colloquially refered to as “visualizing,” “seeing in the mind's eye,” “hearing in the head,” “imagining the feel of,” etc.) is quasi-perceptual experience; it resembles perceptual experience, but occurs in the absence of the appropriate external stimuli. It is also generally understood to bear intentionality (i.e., mental images are always images of something or other), and thereby to function as a form of mental representation. Traditionally, visual mental imagery, the most discussed variety, was thought (...) to be caused by the presence of picturelike representations (mental images) in the mind, soul, or brain, but this is no longer universally accepted. (shrink)

Drawing on previous models of anxiety, intermediate memory, the positive symptoms of schizophrenia, and goal-directed behaviour, a neuropsychological hypothesis is proposed for the generation of the contents of consciousness. It is suggested that these correspond to the outputs of a comparator that, on a moment-by-moment basis, compares the current state of the organism's perceptual world with a predicted state. An outline is given of the information-processing functions of the comparator system and of the neural systems which mediate them. The hypothesis (...) appears to be able to account for a number of key features of the contents of consciousness. However, it is argued that neitherthis nor any existing comparable hypothesis is yet able to explain why the brain should generate conscious experience of any kind at all. (shrink)

The binding problem is frequently discussed in consciousness research. However, it is by no means clear what the problem is supposed to be and how exactly it relates to consciousness. In the present paper the nature of the binding problem is clarified by distinguishing between different formulations of the problem. Some of them make no mention of consciousness, whereas others are directly related to aspects of phenomenal experience. Certain formulations of the binding problem are closely connected to the classical philosophical (...) problem of the unity of consciousness and the currently fashionable search for the neural correlates of consciousness. Nonetheless, only a part of the current empirical research on binding is directly relevant to the study of consciousness. The main message of the present paper is that the science of consciousness needs to establish a clear theoretical view of the relation between binding and consciousness and to encourage further empirical work that builds on such a theoretical foundation. (shrink)

In this paper we focus on what is referred to as the ‘mineness’ of experience, that is, the intimate familiarity we have with our own thoughts, perceptions, and emotions. Most accounts characterize mineness in terms of an experiential dimension, the first-person givenness of experience, that is subsumed under the notion of minimal self-consciousness or a ‘minimal self’. We argue that this account faces problems and develop an alternative account of mineness in terms of the coherence of experiences with what we (...) label an ‘embodied biography’. Building on a near consensus among consciousness researchers over the function of consciousness as integrating infor- mation, we argue that the phenomenology of mineness consists in the absence of any further thought on top of the experience itself. Finally we argue that this non-phenomenological account of mineness fits well with existing data on pathologies of mineness such as delusions of thought insertion. (shrink)

This article critically examines the contemporary resurgence of empiricism (or “neo-empiricism”) in philosophy, psychology, neuropsychology, and artificial intelligence. This resurgence is an important and positive development. It is the first time that this centuries-old empiricist approach to cognition is precisely formulated in the context of cognitive science and neuroscience. Moreover, neo-empiricists have made several findings that challenge amodal theories of concepts and higher cognition. It is argued, however, that the theoretical foundations of and the empirical evidence for neo-empiricism are not (...) as strong as is usually claimed by its proponents. The empirical evidence for and against neo-empiricism is discussed in detail. (shrink)

Widespread reliance on representationalist understandings commit social scientists to either partially or totally decouple belief from reality, limiting the domain of phenomena that can be treated by belief as an analytic concept. Developing the contrastive notion of practical belief, we introduce the hysteresis effect as a situational phenomenon involving the systematic production of agent-environment mismatches and argue for its placement as a central problem for the theory of action. Revealing the dynamic, embodied conservation of belief in the temporality of practice, (...) hysteresis appears when environmental contexts change in a way that leaves actors without an ontologically complicit relationship to institutions as scaffolds of action. Under these circumstances, a past-inflected reflexiveness replaces a forward-inflecting practical belief in the actor's temporal relation to the world. Drawing from a variety of historical case studies, we locate hysteresis in routine disjunctures between the temporality of practice and the temporality of environments. Our analysis reveals four distinct types of reflexiveness produced the hysteresis effect, each with a unique dispositional impact on actors and extensions to group-level phenomena. We conclude the article by emphasizing the non-eliminativist relationship between belief as disposition and belief as representation. (shrink)

The cognitive mind-brain is haunted by the ghost of consciousness. Cognitive science must face this ghost, since consciousness is perhaps the most important mental phenomenon: it forms a seemingly united, multimodal phenomenological world around the subject who experiences this world from a certain point of view. Many current approaches to consciousness fail to illuminate the nature of this “experienced world”. Some philosophers want to eliminate consciousness from science for good, others build theories in which the concept of consciousness is distorted (...) beyond recognition. I argue that elimination and Daniel Dennett's “multiple drafts” model do not offer genuine explanations for consciousness. However, certain empirically-based approaches to consciousness succeed in exorcising its ghostly reputation and, at the same time, in preserving the experienced world of consciousness as an important explanandum. (shrink)

The currently leading cognitive theory of consciousness, Global Workspace Theory,1,2 postulates that the primary functions of consciousness include a global broadcast serving to recruit internal resources with which to deal with the current situation and to modulate several types of learning. In addition, conscious experiences present current conditions and problems to a "self" system, an executive interpreter that is identifiable with brain structures like the frontal lobes and precuneus.1Be it human, animal or artificial, an autonomous agent3 is said to be (...) functionally conscious if its control structure (mind) implements Global Workspace Theory and the LIDA Cognitive Cycle, which includes unconscious memory and control functions needed to integrate the conscious component of the system. We would therefore consider humans, many animals4 and even some virtual or robotic agents5,6 to be functionally conscious. Such entities may approach phenomenal consciousness, as found in human and other biological brains, as additional brain-like features are added.Here we argue that adding mechanisms to produce a stable, coherent perceptual field7 in a LIDA controlled mobile robot might provide a small but significant step toward phenomenal consciousness in machines.>8 We also propose that implementing several of the various notions of self in such a LIDA controlled robot may well prove another step toward phenomenal consciousness in machines. (shrink)

In this chapter, I outline and defend a version of concept empiricism. The theory has four central tenets: Concepts represent categories by reliable causal relations to category instances; conceptual representations of category vary from occasion to occasion; these representations are perceptually based; and these representations are all learned, not innate. The last two tenets on this list have been central to empiricism historically, and the first two have been developed in more recent years. I look at each in turn, and (...) then I discuss the most obvious objection to empiricism. According to that objection, some concepts cannot be perceptually based because they represent things that are abstract, and hence unperceivable. I discuss two standard examples: democracy and moral badness. I argue that both can be explained using resources available to the empiricist. (shrink)

The term “uncanny valley” goes back to an article of the Japanese roboticist Masahiro Mori. He put forward the hypothesis that humanlike objects like certain kinds of robots elicit emotional responses similar to real humans proportionate to their degree of human likeness. Yet, if a certain degree of similarity is reached emotional responses become all of a sudden very repulsive. The corresponding recess in the supposed function is called the uncanny valley. The present paper wants to propose a philosophical explanation (...) why we feel empathy with inanimate objects in the first place, and why the uncanny valley occurs when these objects become very humanlike. The core of this explanation—which is informed by the recently developing empirical research on the matter—will be a form of empathy involving a kind of imaginative perception. However, as will be shown, imaginative perception fails in cases of very humanlike objects. (shrink)

I advocate a theory of syntactic semantics as a way of understanding how computers can think (and how the Chinese-Room-Argument objection to the Turing Test can be overcome): (1) Semantics, considered as the study of relations between symbols and meanings, can be turned into syntax – a study of relations among symbols (including meanings) – and hence syntax (i.e., symbol manipulation) can suffice for the semantical enterprise (contra Searle). (2) Semantics, considered as the process of understanding one domain (by modeling (...) it) in terms of another, can be viewed recursively: The base case of semantic understanding –understanding a domain in terms of itself – is syntactic understanding. (3) An internal (or narrow ), first-person point of view makes an external (or wide ), third-person point of view otiose for purposes of understanding cognition. (shrink)

According to simulation or shared-substrates models of emotion recognition, our ability to recognize the emotions expressed by other individuals relies, at least in part, on processes that internally simulate the same emotional state in ourselves. The term “emotional expressions” is nearly synonymous, in many people's minds, with facial expressions of emotion. However, vocal prosody and whole-body cues also convey emotional information. What is the relationship between these various channels of emotional communication? We first briefly review simulation models of emotion recognition, (...) and then discuss neuroscientific evidence related to these models, including studies using facial expressions, whole-body cues, and vocal prosody. We conclude by discussing these data in the context of simulation and shared-substrates models of emotion recognition. (shrink)

Fronto-parietal activity has been frequently observed in fMRI and PET studies of attention, working memory, and episodic memory retrieval. Several recent fMRI studies have also reported fronto-parietal activity during conscious visual perception. A major goal of this review was to assess the degree of anatomical overlap among activation patterns associated with these four functions. A second goal was to shed light on the possible cognitive relationship of processes that relate to common brain activity across functions. For all reviewed functions we (...) observed a consistent and overlapping pattern of brain activity. The overlap was most pronounced for the bilateral parietal cortex , and dorsolateral prefrontal cortex . The common fronto-parietal activity will be discussed in terms of processes related to integration of distributed representations in the brain. (shrink)

In the visual system, the represented features of individual objects (shape, colour, movement, and so on) are distributed both in space and time within the brain. Representations of inner and outer event sequences arrive through different sense organs at different times, and are likewise distributed. Objects are nevertheless perceived as integrated wholes - and event sequences are experienced to form a coherent "consciousness stream." In their thoughtful article, Dennett & Kinsbourne ask how this is achieved.

The commentary argues that we cannot be sure that human consciousness has survival value and that in order to understand the origins and, perhaps, the function of consciousness, we should examine the behavioural and neural precursors to consciousness in nonhumans. An example is given of research on the role of context in decisions regarding fleeing from probable predators in the Mongolian gerbil.

This article examined the effects of body–object interaction (BOI) on semantic processing. BOI measures perceptions of the ease with which a human body can physically interact with a word's referent. In Experiment 1, BOI effects were examined in 2 semantic categorization tasks (SCT) in which participants decided if words are easily imageable. Responses were faster and more accurate for high BOI words (e.g., mask) than for low BOI words (e.g., ship). In Experiment 2, BOI effects were examined in a semantic (...) lexical decision task (SLDT), which taps both semantic feedback and semantic processing. The BOI effect was larger in the SLDT than in the SCT, suggesting that BOI facilitates both semantic feedback and semantic processing. The findings are consistent with the embodied cognition perspective (e.g.,, Perceptual Symbols Theory), which proposes that sensorimotor interactions with the environment are incorporated in semantic knowledge. (shrink)

How can we explain the intentional nature of an expert’s actions, performed without immediate and conscious control, relying instead on automatic cognitive processes? How can we account for the differences and similarities with a novice’s performance of the same actions? Can a naturalist explanation of intentional expert action be in line with a philosophical concept of intentional action? Answering these and related questions in a positive sense, this dissertation develops a three-step argument. Part I considers different methods of explanations in (...) cognitive neuroscience (Bennett & Hacker’s philosophical, conceptual analysis; Marr’s three levels of explanation; Neural Correlates of Consciousness research; mechanistic explanation), defending ‘mechanistic explanation’ as a method that provides the necessary tools for integrating interdisciplinary insights into human action. Furthermore, a dynamic, explanatory mechanism allows the assessment of the impact of learning and development on expert action in a valuable way that other methods don’t. Part II continues by scrutinizing several cognitive neuroscientific theories of learning and development (neuroconstructivism; dual-processing theories; simulation theory; extended mind/cognition hypothesis), arguing for the complex interactions between different types of processing and different action representations involved in expert action performances. Moreover, according to our discussion of a particular ‘simulation theory’ these interactions can be influenced in several ways with the use of language, allowing an agent to configure a specific action representation for performance at a later stage. The results of Parts I and II are then applied in Part III to a parallel discussion of philosophical analyses of intentional action (discussing i.a. Frankfurt, Bratman, Pacherie and Ricoeur) and cognitive neuroscientific insights in it. Both approaches are found to converge in emphasizing the importance for an expert to develop stable patterns of actions that comply maximally not only with his intentions, but also with his motor expertise and with situational conditions. Consequently, his actions – automatic, or not – rely on this ‘sculpted space of actions’. (shrink)

Conscious events interact with memory systems in learning, rehearsal and retrieval (Ebbinghaus 1885/1964; Tulving 1985). Here we present hypotheses that arise from the IDA computional model (Franklin,Kelemen and McCauley 1998; Franklin 2001b) of global workspace theory (Baars 1988, 2002). Our primary tool for this exploration is a flexible cognitive cycle employed by the IDA computational model and hypothesized to be a basic element of human cognitive processing. Since cognitive cycles are hypothesized to occur five to tentimes a second and include (...) interaction between conscious contents and several of the memory systems, they provide the means for an exceptionally fine-grained analysis of various cognitive tasks. We apply this tool to the small effect size of subliminal learning compared to supraliminal learning, to process dissociation, to implicit learning, to recognition vs. recall, and to the availability heuristic in recall. The IDA model elucidates the role of consciousness in the updating of perceptual memory, transient episodic memory, and procedural memory. In most cases, memory is hypothesized to interact with conscious events for its normal functioning. The methodology of the paper is unusual in that the hypotheses and explanations presented are derived from an empirically based, but broad and qualitative computational model of human cognition. (shrink)

Turing's analysis of computation is a fundamental part of the background of cognitive science. In this paper it is argued that a re‐interpretation of Turing's work is required to underpin theorizing about cognitive architecture. It is claimed that the symbol systems view of the mind, which is the conventional way of understanding how Turing's work impacts on cognitive science, is deeply flawed. There is an alternative interpretation that is more faithful to Turing's original insights, avoids the criticisms made of the (...) symbol systems approach and is compatible with the growing interest in agent‐environment interaction. It is argued that this interpretation should form the basis for theories of cognitive architecture. (shrink)