The emulation theory of representation is developed and explored as a framework that can revealingly synthesize a wide variety of representational functions of the brain. The framework is based on constructs from control theory (forward models) and signal processing (Kalman filters). The idea is that in addition to simply engaging with the body and environment, the brain constructs neural circuits that act as models of the body and environment. During overt sensorimotor engagement, these models are driven by efference copies in (...) parallel with the body and environment, in order to provide expectations of the sensory feedback, and to enhance and process sensory information. These models can also be run off-line in order to produce imagery, estimate outcomes of different actions, and evaluate and develop motor plans. The framework is initially developed within the context of motor control, where it has been shown that inner models running in parallel with the body can reduce the effects of feedback delay problems. The same mechanisms can account for motor imagery as the off-line driving of the emulator via efference copies. The framework is extended to account for visual imagery as the off-line driving of an emulator of the motor-visual loop. I also show how such systems can provide for amodal spatial imagery. Perception, including visual perception, results from such models being used to form expectations of, and to interpret, sensory input. I close by briefly outlining other cognitive functions that might also be synthesized within this framework, including reasoning, theory of mind phenomena, and language. Key Words: efference copies; emulation theory of representation; forward models; Kalman filters; motor control; motor imagery; perception; visual imagery. (shrink)

In this paper I develop the thesis that dreams are essential to an understanding of waking consciousness. In the first part I argue in opposition to the philosophers Malcolm and Dennett that empirical evidence now shows dreams to be real conscious experiences. In the second part, three questions concerning consciousness research are addressed. (1) How do we isolate the system to be explained (consciousness) from other systems? (2) How do we describe the system thus isolated? (3) How do we reveal (...) the mechanisms on which this system is based? I suggest that empirical dream research combined with other empirical approaches can help us to sketch answers to all of these questions. I argue that the subjective form of dreams reveals the subjective, macro-level form of consciousness in general and that both dreams and the everyday phenomenal world may be thought of as constructed “virtual realities”. A major task for empirical consciousness research is to find out the mechanisms which bind this experienced world into a coherent whole. (shrink)

Thirty years ago, grounded cognition had roots in philosophy, perception, cognitive linguistics, psycholinguistics, cognitive psychology, and cognitive neuropsychology. During the next 20 years, grounded cognition continued developing in these areas, and it also took new forms in robotics, cognitive ecology, cognitive neuroscience, and developmental psychology. In the past 10 years, research on grounded cognition has grown rapidly, especially in cognitive neuroscience, social neuroscience, cognitive psychology, social psychology, and developmental psychology. Currently, grounded cognition appears to be achieving increased acceptance throughout cognitive (...) science, shifting from relatively minor status to increasing importance. Nevertheless, researchers wonder whether grounded mechanisms lie at the heart of the cognitive system or are peripheral to classic symbolic mechanisms. Although grounded cognition is currently dominated by demonstration experiments in the absence of well-developed theories, the area is likely to become increasingly theory driven over the next 30 years. Another likely development is the increased incorporation of grounding mechanisms into cognitive architectures and into accounts of classic cognitive phenomena. As this incorporation occurs, much functionality of these architectures and phenomena is likely to remain, along with many original mechanisms. Future theories of grounded cognition are likely to be heavily influenced by both cognitive neuroscience and social neuroscience, and also by developmental science and robotics. Aspects from the three major perspectives in cognitive science—classic symbolic architectures, statistical/dynamical systems, and grounded cognition—will probably be integrated increasingly in future theories, each capturing indispensable aspects of intelligence. (shrink)

Human agents draw a variety of inferences effortlessly, spontaneously, and with remarkable efficiency – as though these inferences were a reflexive response of their cognitive apparatus. Furthermore, these inferences are drawn with reference to a large body of background knowledge. This remarkable human ability seems paradoxical given the complexity of reasoning reported by researchers in artificial intelligence. It also poses a challenge for cognitive science and computational neuroscience: How can a system of simple and slow neuronlike elements represent a large (...) body of systemic knowledge and perform a range of inferences with such speed? We describe a computational model that takes a step toward addressing the cognitive science challenge and resolving the artificial intelligence paradox. We show how a connectionist network can encode millions of facts and rules involving n-ary predicates and variables and perform a class of inferences in a few hundred milliseconds. Efficient reasoning requires the rapid representation and propagation of dynamic bindings. Our model (which we refer to as SHRUTI) achieves this by representing (1) dynamic bindings as the synchronous firing of appropriate nodes, (2) rules as interconnection patterns that direct the propagation of rhythmic activity, and (3) long-term facts as temporal pattern-matching subnetworks. The model is consistent with recent neurophysiological evidence that synchronous activity occurs in the brain and may play a representational role in neural information processing. The model also makes specific psychologically significant predictions about the nature of reflexive reasoning. It identifies constraints on the form of rules that may participate in such reasoning and relates the capacity of the working memory underlying reflexive reasoning to biological parameters such as the lowest frequency at which nodes can sustain synchronous oscillations and the coarseness of synchronization. (shrink)

Traditionally, philosophers have appealed to the phenomenological similarity between visual experience and visual imagery to support the hypothesis that there is significant overlap between the perceptual and imaginative domains. The current evidence, however, is inconclusive: while evidence from transcranial brain stimulation seems to support this conclusion, neurophysiological evidence from brain lesion studies (e.g., from patients with brain lesions resulting in a loss of mental imagery but not a corresponding loss of perception and vice versa) indicates that there are functional and (...) anatomical dissociations between mental imagery and perception. Assuming that the mental imagery and perception do not overlap, at least, to the extent traditionally assumed, then the question arises as to what exactly mental imagery is and whether it parallels perception by proceeding via several functionally distinct mechanisms. In this review, we argue that even though there may not be a shared mechanism underlying vision for perception and conscious imagery, there is an overlap between the mechanisms underlying vision for action and unconscious visual imagery. On the basis of these findings, we propose a modification of Kosslyn’s model of imagery that accommodates unconscious imagination and explore possible explanations of the quasi-pictorial phenomenology of conscious visual imagery in light of the fact that its underlying neural substrates and mechanisms typically are distinct from those of visual experience. (shrink)

Recent evidence from cognitive neuroscience suggests that certain cognitive processes employ perceptual representations. Inspired by this evidence, a few researchers have proposed that cognition is inherently perceptual. They have developed an innovative theoretical approach that rests on the notion of perceptual simulation and marshaled several general arguments supporting the centrality of perceptual representations to concepts. In this article, I identify a number of weaknesses in these arguments and defend a multiple semantic code approach that posits both perceptual and non-perceptual representations.

Various defenses of amodal symbol systems are addressed, including amodal symbols in sensory-motor areas, the causal theory of concepts, supramodal concepts, latent semantic analysis, and abstracted amodal symbols. Various aspects of perceptual symbol systems are clarified and developed, including perception, features, simulators, category structure, frames, analogy, introspection, situated action, and development. Particular attention is given to abstract concepts, language, and computational mechanisms.

What is the primary function of consciousness in the nervous system? The answer to this question remains enigmatic, not so much because of a lack of relevant data, but because of the lack of a conceptual framework with which to interpret the data. To this end, we have developed Passive Frame Theory, an internally coherent framework that, from an action-based perspective, synthesizes empirically supported hypotheses from diverse fields of investigation. The theory proposes that the primary function of consciousness is well-circumscribed, (...) serving the 'somatic nervous system[. For this system, consciousness serves as a frame that constrains and directs skeletal muscle output, thereby yielding adaptive behavior. The mechanism by which consciousness achieves this is more counterintuitive, passive, and “low level” than the kinds of functions that theorists have previously attributed to consciousness. Passive frame theory begins to illuminate (a) what consciousness contributes to nervous function, (b) how consciousness achieves this function, and (c) the neuroanatomical substrates of conscious processes. Our untraditional, action-based perspective focuses on olfaction instead of on vision and is 'descriptive' (describing the products of nature as they evolved to be) rather than 'normative' (construing processes in terms of how they should function). Passive frame theory begins to isolate the neuroanatomical, cognitive-mechanistic, and representational (e.g., conscious contents) processes associated with consciousness. (shrink)

In this paper we focus on what is referred to as the ‘mineness’ of experience, that is, the intimate familiarity we have with our own thoughts, perceptions, and emotions. Most accounts characterize mineness in terms of an experiential dimension, the first-person givenness of experience, that is subsumed under the notion of minimal self-consciousness or a ‘minimal self’. We argue that this account faces problems and develop an alternative account of mineness in terms of the coherence of experiences with what we (...) label an ‘embodied biography’. Building on a near consensus among consciousness researchers over the function of consciousness as integrating infor- mation, we argue that the phenomenology of mineness consists in the absence of any further thought on top of the experience itself. Finally we argue that this non-phenomenological account of mineness fits well with existing data on pathologies of mineness such as delusions of thought insertion. (shrink)

Widespread reliance on representationalist understandings commit social scientists to either partially or totally decouple belief from reality, limiting the domain of phenomena that can be treated by belief as an analytic concept. Developing the contrastive notion of practical belief, we introduce the hysteresis effect as a situational phenomenon involving the systematic production of agent-environment mismatches and argue for its placement as a central problem for the theory of action. Revealing the dynamic, embodied conservation of belief in the temporality of practice, (...) hysteresis appears when environmental contexts change in a way that leaves actors without an ontologically complicit relationship to institutions as scaffolds of action. Under these circumstances, a past-inflected reflexiveness replaces a forward-inflecting practical belief in the actor's temporal relation to the world. Drawing from a variety of historical case studies, we locate hysteresis in routine disjunctures between the temporality of practice and the temporality of environments. Our analysis reveals four distinct types of reflexiveness produced the hysteresis effect, each with a unique dispositional impact on actors and extensions to group-level phenomena. We conclude the article by emphasizing the non-eliminativist relationship between belief as disposition and belief as representation. (shrink)

This article critically examines the contemporary resurgence of empiricism (or “neo-empiricism”) in philosophy, psychology, neuropsychology, and artificial intelligence. This resurgence is an important and positive development. It is the first time that this centuries-old empiricist approach to cognition is precisely formulated in the context of cognitive science and neuroscience. Moreover, neo-empiricists have made several findings that challenge amodal theories of concepts and higher cognition. It is argued, however, that the theoretical foundations of and the empirical evidence for neo-empiricism are not (...) as strong as is usually claimed by its proponents. The empirical evidence for and against neo-empiricism is discussed in detail. (shrink)

The cognitive mind-brain is haunted by the ghost of consciousness. Cognitive science must face this ghost, since consciousness is perhaps the most important mental phenomenon: it forms a seemingly united, multimodal phenomenological world around the subject who experiences this world from a certain point of view. Many current approaches to consciousness fail to illuminate the nature of this “experienced world”. Some philosophers want to eliminate consciousness from science for good, others build theories in which the concept of consciousness is distorted (...) beyond recognition. I argue that elimination and Daniel Dennett's “multiple drafts” model do not offer genuine explanations for consciousness. However, certain empirically-based approaches to consciousness succeed in exorcising its ghostly reputation and, at the same time, in preserving the experienced world of consciousness as an important explanandum. (shrink)

The currently leading cognitive theory of consciousness, Global Workspace Theory,1,2 postulates that the primary functions of consciousness include a global broadcast serving to recruit internal resources with which to deal with the current situation and to modulate several types of learning. In addition, conscious experiences present current conditions and problems to a "self" system, an executive interpreter that is identifiable with brain structures like the frontal lobes and precuneus.1Be it human, animal or artificial, an autonomous agent3 is said to be (...) functionally conscious if its control structure (mind) implements Global Workspace Theory and the LIDA Cognitive Cycle, which includes unconscious memory and control functions needed to integrate the conscious component of the system. We would therefore consider humans, many animals4 and even some virtual or robotic agents5,6 to be functionally conscious. Such entities may approach phenomenal consciousness, as found in human and other biological brains, as additional brain-like features are added.Here we argue that adding mechanisms to produce a stable, coherent perceptual field7 in a LIDA controlled mobile robot might provide a small but significant step toward phenomenal consciousness in machines.>8 We also propose that implementing several of the various notions of self in such a LIDA controlled robot may well prove another step toward phenomenal consciousness in machines. (shrink)

In this chapter, I outline and defend a version of concept empiricism. The theory has four central tenets: Concepts represent categories by reliable causal relations to category instances; conceptual representations of category vary from occasion to occasion; these representations are perceptually based; and these representations are all learned, not innate. The last two tenets on this list have been central to empiricism historically, and the first two have been developed in more recent years. I look at each in turn, and (...) then I discuss the most obvious objection to empiricism. According to that objection, some concepts cannot be perceptually based because they represent things that are abstract, and hence unperceivable. I discuss two standard examples: democracy and moral badness. I argue that both can be explained using resources available to the empiricist. (shrink)

Concept empiricists are committed to the claim that the vehicles of thought are re-activated perceptual representations. Evidence for empiricism comes from a range of neuroscientific studies showing that perceptual regions of the brain are employed during cognitive tasks such as categorization and inference. I examine the extant neuroscientific evidence and argue that it falls short of establishing this core empiricist claim. During conceptual tasks, the causal structure of the brain produces widespread activity in both perceptual and non-perceptual systems. I lay (...) out several conditions on what is required for a neural state to be a realizer of the functional role played by concepts, and argue that no subset of this activity can be singled out as the unique neural vehicle of conceptual thought. Finally, I suggest that, while the strongest form of empiricism is probably false, the evidence is consistent with several weaker forms of empiricism. (shrink)

The term “uncanny valley” goes back to an article of the Japanese roboticist Masahiro Mori. He put forward the hypothesis that humanlike objects like certain kinds of robots elicit emotional responses similar to real humans proportionate to their degree of human likeness. Yet, if a certain degree of similarity is reached emotional responses become all of a sudden very repulsive. The corresponding recess in the supposed function is called the uncanny valley. The present paper wants to propose a philosophical explanation (...) why we feel empathy with inanimate objects in the first place, and why the uncanny valley occurs when these objects become very humanlike. The core of this explanation—which is informed by the recently developing empirical research on the matter—will be a form of empathy involving a kind of imaginative perception. However, as will be shown, imaginative perception fails in cases of very humanlike objects. (shrink)

I advocate a theory of syntactic semantics as a way of understanding how computers can think (and how the Chinese-Room-Argument objection to the Turing Test can be overcome): (1) Semantics, considered as the study of relations between symbols and meanings, can be turned into syntax – a study of relations among symbols (including meanings) – and hence syntax (i.e., symbol manipulation) can suffice for the semantical enterprise (contra Searle). (2) Semantics, considered as the process of understanding one domain (by modeling (...) it) in terms of another, can be viewed recursively: The base case of semantic understanding –understanding a domain in terms of itself – is syntactic understanding. (3) An internal (or narrow ), first-person point of view makes an external (or wide ), third-person point of view otiose for purposes of understanding cognition. (shrink)

According to simulation or shared-substrates models of emotion recognition, our ability to recognize the emotions expressed by other individuals relies, at least in part, on processes that internally simulate the same emotional state in ourselves. The term “emotional expressions” is nearly synonymous, in many people's minds, with facial expressions of emotion. However, vocal prosody and whole-body cues also convey emotional information. What is the relationship between these various channels of emotional communication? We first briefly review simulation models of emotion recognition, (...) and then discuss neuroscientific evidence related to these models, including studies using facial expressions, whole-body cues, and vocal prosody. We conclude by discussing these data in the context of simulation and shared-substrates models of emotion recognition. (shrink)

Fronto-parietal activity has been frequently observed in fMRI and PET studies of attention, working memory, and episodic memory retrieval. Several recent fMRI studies have also reported fronto-parietal activity during conscious visual perception. A major goal of this review was to assess the degree of anatomical overlap among activation patterns associated with these four functions. A second goal was to shed light on the possible cognitive relationship of processes that relate to common brain activity across functions. For all reviewed functions we (...) observed a consistent and overlapping pattern of brain activity. The overlap was most pronounced for the bilateral parietal cortex , and dorsolateral prefrontal cortex . The common fronto-parietal activity will be discussed in terms of processes related to integration of distributed representations in the brain. (shrink)

This article examined the effects of body–object interaction (BOI) on semantic processing. BOI measures perceptions of the ease with which a human body can physically interact with a word's referent. In Experiment 1, BOI effects were examined in 2 semantic categorization tasks (SCT) in which participants decided if words are easily imageable. Responses were faster and more accurate for high BOI words (e.g., mask) than for low BOI words (e.g., ship). In Experiment 2, BOI effects were examined in a semantic (...) lexical decision task (SLDT), which taps both semantic feedback and semantic processing. The BOI effect was larger in the SLDT than in the SCT, suggesting that BOI facilitates both semantic feedback and semantic processing. The findings are consistent with the embodied cognition perspective (e.g.,, Perceptual Symbols Theory), which proposes that sensorimotor interactions with the environment are incorporated in semantic knowledge. (shrink)

How can we explain the intentional nature of an expert’s actions, performed without immediate and conscious control, relying instead on automatic cognitive processes? How can we account for the differences and similarities with a novice’s performance of the same actions? Can a naturalist explanation of intentional expert action be in line with a philosophical concept of intentional action? Answering these and related questions in a positive sense, this dissertation develops a three-step argument. Part I considers different methods of explanations in (...) cognitive neuroscience (Bennett & Hacker’s philosophical, conceptual analysis; Marr’s three levels of explanation; Neural Correlates of Consciousness research; mechanistic explanation), defending ‘mechanistic explanation’ as a method that provides the necessary tools for integrating interdisciplinary insights into human action. Furthermore, a dynamic, explanatory mechanism allows the assessment of the impact of learning and development on expert action in a valuable way that other methods don’t. Part II continues by scrutinizing several cognitive neuroscientific theories of learning and development (neuroconstructivism; dual-processing theories; simulation theory; extended mind/cognition hypothesis), arguing for the complex interactions between different types of processing and different action representations involved in expert action performances. Moreover, according to our discussion of a particular ‘simulation theory’ these interactions can be influenced in several ways with the use of language, allowing an agent to configure a specific action representation for performance at a later stage. The results of Parts I and II are then applied in Part III to a parallel discussion of philosophical analyses of intentional action (discussing i.a. Frankfurt, Bratman, Pacherie and Ricoeur) and cognitive neuroscientific insights in it. Both approaches are found to converge in emphasizing the importance for an expert to develop stable patterns of actions that comply maximally not only with his intentions, but also with his motor expertise and with situational conditions. Consequently, his actions – automatic, or not – rely on this ‘sculpted space of actions’. (shrink)

Conscious events interact with memory systems in learning, rehearsal and retrieval (Ebbinghaus 1885/1964; Tulving 1985). Here we present hypotheses that arise from the IDA computional model (Franklin,Kelemen and McCauley 1998; Franklin 2001b) of global workspace theory (Baars 1988, 2002). Our primary tool for this exploration is a flexible cognitive cycle employed by the IDA computational model and hypothesized to be a basic element of human cognitive processing. Since cognitive cycles are hypothesized to occur five to tentimes a second and include (...) interaction between conscious contents and several of the memory systems, they provide the means for an exceptionally fine-grained analysis of various cognitive tasks. We apply this tool to the small effect size of subliminal learning compared to supraliminal learning, to process dissociation, to implicit learning, to recognition vs. recall, and to the availability heuristic in recall. The IDA model elucidates the role of consciousness in the updating of perceptual memory, transient episodic memory, and procedural memory. In most cases, memory is hypothesized to interact with conscious events for its normal functioning. The methodology of the paper is unusual in that the hypotheses and explanations presented are derived from an empirically based, but broad and qualitative computational model of human cognition. (shrink)

Turing's analysis of computation is a fundamental part of the background of cognitive science. In this paper it is argued that a re‐interpretation of Turing's work is required to underpin theorizing about cognitive architecture. It is claimed that the symbol systems view of the mind, which is the conventional way of understanding how Turing's work impacts on cognitive science, is deeply flawed. There is an alternative interpretation that is more faithful to Turing's original insights, avoids the criticisms made of the (...) symbol systems approach and is compatible with the growing interest in agent‐environment interaction. It is argued that this interpretation should form the basis for theories of cognitive architecture. (shrink)

In "The Disunity of Consciousness," Gerard O'Brien and Jon Opie argue that human consciousness is not synchronically unified. They suggest that the orthodox conception of the unity of consciousness admits of two readings, neither of which they find persuasive. According to them, "a conscious individual does not have a single consciousness, but several distinct phenomenal consciousnesses, at least one for each of the senses, running in parallel." They call this conception of consciousness the _multi-track account. I make three points in (...) reply: (1) O'Brien and Opie's characterization of the orthodox conception of the unity of consciousness is problematic; (2) their arguments in support of the multitrack account are unpersuasive; and (3) the phenomenon of intersensory integration suggests that O'Brien and Opie are wrong to claim that "the only sense in which it is correct to talk of a 'unified' consciousness (...) is that in which the representational contents of the various components coincide.". (shrink)

The aim of this paper is to give an account of what it is to internalize a rule. I claim that internalization is the process of redistributing the burden of instruction from the teacher to the student. The process is complete when instruction is no longer needed, and the rule has reshaped perceptual classification of the circumstances in which it applies. Teaching a rule is the initiation of this process. We internalize rules by simulating instruction coming from someone else. Running (...) these simulations enables us to toggle between the perspective of the instructor and our own perspective. By doing this we coordinate our perspectives with that of the teacher. The account given here provides a deeper explanation of why internalizing a rule involves the dispositions and reactive attitudes proponents of Rule Consequentialism often say it does, why moral reflection is variably demanding, how intergenerational moral progress is made possible by our cognitive architectures, and why the adoption of a rule should be understood in terms of teaching that rule. (shrink)

We propose category theory, the mathematical theory of structure, as a vehicle for defining ontologies in an unambiguous language with analytical and constructive features. Specifically, we apply categorical logic and model theory, based upon viewing an ontology as a sub-category of a category of theories expressed in a formal logic. In addition to providing mathematical rigor, this approach has several advantages. It allows the incremental analysis of ontologies by basing them in an interconnected hierarchy of theories, with an operation on (...) the hierarchy that expresses the formation of complex theories from simple theories that express first principles. Another operation forms abstractions expressing the shared concepts in an array of theories. The use of categorical model theory makes possible the incremental analysis of possible worlds, or instances, for the theories, and the mapping of instances of a theory to instances of its more abstract parts. We describe the theoretical approach by applying it to the semantics of neural networks. (shrink)

Conceptual knowledge is acquired through recurrent experiences, by extracting statistical regularities at different levels of granularity. At a fine level, patterns of feature co-occurrence are categorized into objects. At a coarser level, patterns of concept co-occurrence are categorized into contexts. We present and test CONCAT, a connectionist model that simultaneously learns to categorize objects and contexts. The model contains two hierarchically organized CALM modules (Murre, Phaf, & Wolters, 1992). The first module, the Object Module, forms object representations based on co-occurrences (...) between features. These representations are used as input for the second module, the Context Module, which categorizes contexts based on object co-occurrences. Feedback connections from the Context Module to the Object Module send activation from the active context to those objects that frequently occur within this context. We demonstrate that context feedback contributes to the successful categorization of objects, especially when bottom-up feature information is degraded or ambiguous. (shrink)

What is it to know the meaning of a word? The traditional view is that it involves the possession of a concept that determines the extension of a word, with the concept corresponding to a single psychological state. Millikan criticizes this view, denying not only that concepts determine extensions but also that sharing a concept means sharing a psychological state. The purpose of this article is to defend a modified version of the traditional view. I argue that Millikan's claims do (...) not translate directly into a thesis about word meaning. Her arguments relate to an extra-linguistic approach to extension, which we can distinguish from a linguistically oriented notion of extension. (shrink)