Prior to the twentieth century, theories of knowledge were inherently perceptual. Since then, developments in logic, statis- tics, and programming languages have inspired amodal theories that rest on principles fundamentally different from those underlying perception. In addition, perceptual approaches have become widely viewed as untenable because they are assumed to implement record- ing systems, not conceptual systems. A perceptual theory of knowledge is developed here in the context of current cognitive science and neuroscience. During perceptual experience, association areas in the (...) brain capture bottom-up patterns of activation in sensory-motor areas. Later, in a top-down manner, association areas partially reactivate sensory-motor areas to implement perceptual symbols. The stor- age and reactivation of perceptual symbols operates at the level of perceptual components – not at the level of holistic perceptual expe- riences. Through the use of selective attention, schematic representations of perceptual components are extracted from experience and stored in memory (e.g., individual memories of green, purr, hot). As memories of the same component become organized around a com- mon frame, they implement a simulator that produces limitless simulations of the component (e.g., simulations of purr). Not only do such simulators develop for aspects of sensory experience, they also develop for aspects of proprioception (e.g., lift, run) and introspec- tion (e.g., compare, memory, happy, hungry). Once established, these simulators implement a basic conceptual system that represents types, supports categorization, and produces categorical inferences. These simulators further support productivity, propositions, and ab- stract concepts, thereby implementing a fully functional conceptual system. Productivity results from integrating simulators combinato- rially and recursively to produce complex simulations. Propositions result from binding simulators to perceived individuals to represent type-token relations. Abstract concepts are grounded in complex simulations of combined physical and introspective events. Thus, a per- ceptual theory of knowledge can implement a fully functional conceptual system while avoiding problems associated with amodal sym- bol systems. Implications for cognition, neuroscience, evolution, development, and artificial intelligence are explored. (shrink)

In artificial intelligence, recent research has demonstrated the remarkable potential of Deep Convolutional Neural Networks (DCNNs), which seem to exceed state-of-the-art performance in new domains weekly, especially on the sorts of very difficult perceptual discrimination tasks that skeptics thought would remain beyond the reach of artificial intelligence. However, it has proven difficult to explain why DCNNs perform so well. In philosophy of mind, empiricists have long suggested that complex cognition is based on information derived from sensory experience, often appealing to (...) a faculty of abstraction. Rationalists have frequently complained, however, that empiricists never adequately explained how this faculty of abstraction actually works. In this paper, I tie these two questions together, to the mutual benefit of both disciplines. I argue that the architectural features that distinguish DCNNs from earlier neural networks allow them to implement a form of hierarchical processing that I call “transformational abstraction”. Transformational abstraction iteratively converts sensory-based representations of category exemplars into new formats that are increasingly tolerant to “nuisance variation” in input. Reflecting upon the way that DCNNs leverage a combination of linear and non-linear processing to efficiently accomplish this feat allows us to understand how the brain is capable of bi-directional travel between exemplars and abstractions, addressing longstanding problems in empiricist philosophy of mind. I end by considering the prospects for future research on DCNNs, arguing that rather than simply implementing 80s connectionism with more brute-force computation, transformational abstraction counts as a qualitatively distinct form of processing ripe with philosophical and psychological significance, because it is significantly better suited to depict the generic mechanism responsible for this important kind of psychological processing in the brain. (shrink)

Concepts are the elementary units of reason and linguistic meaning. They are conventional and relatively stable. As such, they must somehow be the result of neural activity in the brain. The questions are: Where? and How? A common philosophical position is that all concepts—even concepts about action and perception—are symbolic and abstract, and therefore must be implemented outside the brain’s sensory-motor system. We will argue against this position using (1) neuroscientific evidence; (2) results from neural computation; and (3) results about (...) the nature of concepts from cognitive linguistics. We will propose that the sensory-motor system has the right kind of structure to characterise both sensory-motor and more abstract concepts. Central to this picture are the neural theory of language and the theory of cogs, according to which, brain structures in the sensory-motor regions are exploited to characterise the so-called “abstract” concepts that constitute the meanings of grammatical constructions and general inference patterns. (shrink)

A line of research within embodied cognition seeks to show that an organism’s body is a determinant of its conceptual capacities. Comparison of this claim of body determinism to linguistic determinism bears interesting results. Just as Slobin’s (1996) idea of thinking for speaking challenges the main thesis of linguistic determinism, so too the possibility of thinking for acting raises difficulties for the proponent of body determinism. However, recent studies suggest that the body may, after all, have a determining role in (...) cognitive processes of sentence comprehension. (shrink)

Exposing the chimpanzee to language training appears to enhance the animal's ability to perform some kinds of tasks but not others. The abilities that are enhanced involve abstract judgment, as in analogical reasoning, matching proportions of physically unlike exemplars, and completing incomplete representations of action. The abilities that do not improve concern the location of items in space and the inferences one might make in attempting to obtain them. Representing items in space and making inferences about them could be done (...) with an imaginal code, but representing relations and judging the relations between them, as in analogies, requires a more abstract code. Language training cannot instill such an abstract code, but for species that have the code to start with, it may enhance the animal's ability to use it. (shrink)

Embodied agents use bodily actions and environmental interventions to make the world a better place to think in. Where does language fit into this emerging picture of the embodied, ecologically efficient agent? One useful way to approach this question is to consider language itself as a cognition-enhancing animal-built structure. To take this perspective is to view language as a kind of self-constructed cognitive niche: a persisting though never stationary material scaffolding whose critical role in promoting thought and reason remains surprisingly (...) ill-understood. It is the very materiality of this linguistic scaffolding, I suggest, that is responsible for some key benefits. By materializing thought in words, we create structures that are themselves proper objects of perception, manipulation, and thought. (shrink)

Introductory Chapter to the _Cambridge Handbook of Situated Cognition_ (CUP, 2009).

Recent evidence from cognitive neuroscience suggests that certain cognitive processes employ perceptual representations. Inspired by this evidence, a few researchers have proposed that cognition is inherently perceptual. They have developed an innovative theoretical approach that rests on the notion of perceptual simulation and marshaled several general arguments supporting the centrality of perceptual representations to concepts. In this article, I identify a number of weaknesses in these arguments and defend a multiple semantic code approach that posits both perceptual and non-perceptual representations.

Human cognition is striking in its brilliance and its adaptability. How do we get that way? How do we move from the nearly helpless state of infants to the cognitive proficiency that characterizes adults? In this paper I argue, first, that analogical ability is the key factor in our prodigious capacity, and, second, that possession of a symbol system is crucial to the full expression of analogical ability.

A great deal of research has focused on the question of whether or not concepts are embodied as a rule. Supporters of embodiment have pointed to studies that implicate affective and sensorimotor systems in cognitive tasks, while critics of embodiment have offered nonembodied explanations of these results and pointed to studies that implicate amodal systems. Abstract concepts have tended to be viewed as an important test case in this polemical debate. This essay argues that we need to move beyond a (...) pretheoretical notion of abstraction. Against the background of current research and theory, abstract concepts do not pose a single, unified problem for embodied cognition but, instead, three distinct problems: the problem of generalization, the problem of flexibility, and the problem of disembodiment. Identifying these problems provides a conceptual framework for critically evaluating, and perhaps improving upon, recent theoretical proposals. (shrink)

According to grounded cognition, words whose semantics contain sensory-motor features activate sensory-motor simulations, which, in turn, interact with spatial responses to produce grounded congruency effects. Growing evidence shows these congruency effects do not always occur, suggesting instead that the grounded features in a word's meaning do not become active automatically across contexts. Researchers sometimes use this as evidence that concepts are not grounded, further concluding that grounded information is peripheral to the amodal cores of concepts. We first review broad evidence (...) that words do not have conceptual cores, and that even the most salient features in a word's meaning are not activated automatically. Then, in three experiments, we provide further evidence that grounded congruency effects rely dynamically on context, with the central grounded features in a concept becoming active only when the current context makes them salient. Even when grounded features are central to a word's meaning, their activation depends on task conditions. (shrink)

Embodied cognition is sweeping the planet. On a non-embodied approach, the sensory system informs the cognitive system and the motor system does the cognitive system’s bidding. There are causal relations between the systems but the sensory and motor systems are not constitutive of cognition. For embodied views, the relation to the sensori-motor system to cognition is constitutive, not just causal. This paper examines some recent empirical evidence used to support the view that cognition is embodied and raises questions about some (...) of the claims being made by supporters. (shrink)

Many animals can be trained to perform novel tasks. People, too, can be trained, but sometime in early childhood people transition from being trainable to something qualitatively more powerful—being programmable. We argue that such programmability constitutes a leap in the way that organisms learn, interact, and transmit knowledge, and that what facilitates or enables this programmability is the learning and use of language. We then examine how language programs the mind and argue that it does so through the manipulation of (...) embodied, sensorimotor representations. The role language plays in controlling mental representations offers important insights for understanding its origin and evolution. (shrink)

Adult humans show exceptional relational ability relative to other species. In this research, we trace the development of this ability in young children. We used a task widely used in comparative research—the relational match-to-sample task, which requires participants to notice and match the identity relation: for example, AA should match BB instead of CD. Despite the simplicity of this relation, children under 4 years of age failed to pass this test (Experiment 1), and their performance did not improve even with (...) initial feedback (Experiment 2). In Experiments 3 and 4, we found that two kinds of symbolic-linguistic experience can facilitate relational reasoning in young children. Our findings suggest that children learn to become adept analogical thinkers, and that language fosters this learning in at least two distinct ways. (shrink)

The new concept of embodied cognition theories has been enthusiastically studied by the cognitive sciences, by as well as such disparate disciplines as philosophy, anthropology, neuroscience, and robotics. Embodiment theory provides the framework for ongoing discussions on the linkage between “low” cognitive processes as perception and “high” cognition as language processing and comprehension, respectively. This review gives an overview along the lines of argumentation in the ongoing debate on the embodiment of language and employs an ALE meta-analysis to illustrate and (...) weigh previous findings. The collected evidence on the somatotopic activation of motor areas, abstract and concrete word processing, as well as from reported patient and timing studies emphasizes the important role of sensorimotor areas in language processing and supports the hypothesis that the motor system is activated during language comprehension. (shrink)

Recently, there has been a great deal of interest in the idea that natural language enhances and extends our cognitive capabilities. Supporters of embodied cognition have been particularly interested in the way in which language may provide a solution to the problem of abstract concepts. Toward this end, some have emphasized the way in which language may act as form of cognitive scaffolding and others have emphasized the potential importance of language-based distributional information. This essay defends a version of the (...) cognitive enhancement thesis that integrates and builds on both of these proposals. I argue that the embodied representations associated with language processing serve as a supplementary medium for conceptual processing. The acquisition of a natural language provides a means of extending our cognitive reach by giving us access to an internalized combinatorial symbol system that augments and supports the context-sensitive embodied representational systems that exist independently of language. (shrink)

This article critically examines the contemporary resurgence of empiricism (or “neo-empiricism”) in philosophy, psychology, neuropsychology, and artificial intelligence. This resurgence is an important and positive development. It is the first time that this centuries-old empiricist approach to cognition is precisely formulated in the context of cognitive science and neuroscience. Moreover, neo-empiricists have made several findings that challenge amodal theories of concepts and higher cognition. It is argued, however, that the theoretical foundations of and the empirical evidence for neo-empiricism are not (...) as strong as is usually claimed by its proponents. The empirical evidence for and against neo-empiricism is discussed in detail. (shrink)

In The Architecture of the Mind, Carruthers proposes a new and detailed explanation for how human cognition could be both flexible and massively modular. The combinatorial nature of our linguistic faculty and our capacity to engage in inner speech are the cornerstones of this new explanation. Despite the ingenuity of this proposal, I argue that Carruthers has failed to explain how a massively modular mind could display the flexibility that is characteristic of human thought.

In E. Margolis, R. Samuels, and S. Stich (eds.), The Oxford Handbook of Philosophy of Cognitive Science. Oxford University Press, 2008.

We review the relationships between language, inner speech, and cognitive control in children and young adults, focusing on the domain of cognitive flexibility. We address the role that inner speech plays in flexibly shifting between tasks, addressing whether it is used to represent task rules, provide a reminder of task order, or aid in task retrieval. We also consider whether the development of inner speech in childhood serves to drive the development of cognitive flexibility. We conclude that there is a (...) close association between inner speech and cognitive flexibility in both adults and children. Experimental work has begun to specify in detail the role that inner speech might play in adult performance, suggesting that language plays a facilitative but not essential role in representing and activating the relevant task set, processes that occur on both switch and nonswitch trials. While developmental studies suggest an increase in the spontaneous use of verbal strategies with age, implying an increase in top-down control during shifting, experimental work is needed to specify more precisely the nature and precise role that inner speech plays in the development of cognitive control through childhood. (shrink)

We agree with Penn et al. that our human cognitive superiority derives from our exceptional relational ability. We far exceed other species in our ability to grasp analogies and to combine relations into higher-order structures (Gentner 2003). However, we argue here that possession of an elaborated symbol system is necessary to make our relational capacity operational.

In two experiments, Brookshire, Ivry, and Casasanto showed that words with positive and negative emotional valence can activate spatial representations with a high degree of automaticity, but also that this activation is highly context dependent. Lebois, Wilson-Mendenhall, and Barsalou reported that they “aimed to replicate” our study but found only null results in the “Brookshire et al. replication” conditions. Here we express concerns about three aspects of this paper. First, the study was not an attempt to replicate ours; it was (...) a different study that adapted our method. Second, Lebois et al. did not accurately represent our theoretical position. Third, Lebois et al.’s main conclusion, that spatial congruity effects depend on the task context, was not supported by their data. Despite these concerns, we agree with Lebois et al.'s overall message that spatial aspects of words' meanings are activated differently in different contexts. This was a main conclusion of our study as well. (shrink)

According to embodied theories of language (ETLs), word meaning relies on sensorimotor brain areas, generally dedicated to acting and perceiving in the real world. More specifically, words denoting actions are postulated to make use of neural motor areas, while words denoting visual properties draw on the resources of visual brain areas. Therefore, there is a direct correspondence between word meaning and the experience a listener has had with a word's referent on the brain level. Behavioral and neuroimaging studies have provided (...) evidence in favor of ETLs; however, recent studies have also shown that sensorimotor information is recruited in a flexible manner during language comprehension (e.g., Raposo et al. ; Van Dam et al., ), leaving open the question as to what level of language processing sensorimotor activations contribute. In this study, we investigated the time course of modality-specific contributions (i.e., the contribution of action information) as to word processing by manipulating both (a) the linguistic and (b) the action context in which target words were presented. Our results demonstrate that processes reflecting sensorimotor information play a role early in word processing (i.e., within 200 ms of word presentation), but that they are sensitive to the linguistic context in which a word is presented. In other words, when sensorimotor information is activated, it is activated quickly; however, specific words do not reliably activate a consistent sensorimotor pattern. (shrink)

According to embodied theories of language (ETLs), word meaning relies on sensorimotor brain areas, generally dedicated to acting and perceiving in the real world. More specifically, words denoting actions are postulated to make use of neural motor areas, while words denoting visual properties draw on the resources of visual brain areas. Therefore, there is a direct correspondence between word meaning and the experience a listener has had with a word's referent on the brain level. Behavioral and neuroimaging studies have provided (...) evidence in favor of ETLs; however, recent studies have also shown that sensorimotor information is recruited in a flexible manner during language comprehension (e.g., Raposo et al. ; Van Dam et al., ), leaving open the question as to what level of language processing sensorimotor activations contribute. In this study, we investigated the time course of modality‐specific contributions (i.e., the contribution of action information) as to word processing by manipulating both (a) the linguistic and (b) the action context in which target words were presented. Our results demonstrate that processes reflecting sensorimotor information play a role early in word processing (i.e., within 200 ms of word presentation), but that they are sensitive to the linguistic context in which a word is presented. In other words, when sensorimotor information is activated, it is activated quickly; however, specific words do not reliably activate a consistent sensorimotor pattern. (shrink)

Our concerns fall into three areas: (1) Barsalou fails to make clear what simulators are (vs. what they do); (2) activation of perceptual areas of the brain during thought does not distinguish between the activation's being constitutive of concepts or a mere causal consequence (Barsalou needs the former); and (3) Barsalou's attempt to explain how modal symbols handle abstraction fails.

According to a traditionally infl uential idea metaphors have mostly ornamental value. Current research, on the other hand, stresses the cognitive purposes metaphors serve. According to the Conceptual Theory of Metaphor (CTM, for short), e.g., expressions are commonly used metaphorically in order to conceptualize abstract and mental phenomena. More specifically, proponents of CTM claim that abstract terms are understood by means of metaphors and that metaphor comprehension, in turn, is embodied. In this paper, I will argue that CTM fails on (...) both counts. (shrink)