A great deal of research has focused on the question of whether or not concepts are embodied as a rule. Supporters of embodiment have pointed to studies that implicate affective and sensorimotor systems in cognitive tasks, while critics of embodiment have offered nonembodied explanations of these results and pointed to studies that implicate amodal systems. Abstract concepts have tended to be viewed as an important test case in this polemical debate. This essay argues that we need to move beyond a (...) pretheoretical notion of abstraction. Against the background of current research and theory, abstract concepts do not pose a single, unified problem for embodied cognition but, instead, three distinct problems: the problem of generalization, the problem of flexibility, and the problem of disembodiment. Identifying these problems provides a conceptual framework for critically evaluating, and perhaps improving upon, recent theoretical proposals. (shrink)

Do we mentally simulate olfactory information? We investigated mental simulation of odors and sounds in two experiments. Participants retained a word while they smelled an odor or heard a sound, then rated odor/sound intensity and recalled the word. Later odor/sound recognition was also tested, and pleasantness and familiarity judgments were collected. Word recall was slower when the sound and sound-word mismatched. Sound recognition was higher when sounds were paired with a match or near-match word. This indicates sound-words are mentally simulated. (...) However, using the same paradigm no memory effects were observed for odor. Instead it appears odor-words only affect lexical-semantic representations, demonstrated by higher ratings of odor intensity and pleasantness when an odor was paired with a match or near-match word. These results suggest fundamental differences in how odor and sound-words are represented. (shrink)

Traditionally, the language faculty was supposed to be a device that maps linguistic inputs to semantic or conceptual representations. These representations themselves were supposed to be distinct from the representations manipulated by the hearer’s perceptual and motor systems. Recently this view of language has been challenged by advocates of embodied cognition. Drawing on empirical studies of linguistic comprehension, they have proposed that the language faculty reuses the very representations and processes deployed in perceiving and acting. I review some of the (...) evidence and arguments in favor of the embodied view of language comprehension, and argue that none of it is conclusive. Moreover, the embodied view itself blurs two important distinctions: first, the distinction between linguistic comprehension and its typical consequences; and second, the distinction between representational content and vehicles. Given that these distinctions are well-motivated, we have good reason to reject the embodied view of linguistic understanding.Keywords: Language; Comprehension; Perception; Action; Embodied cognition; Representation. (shrink)

Successful athletic performance requires precision in many respects. A batter stands behind home plate awaiting the arrival of a ball that is less than three inches in diameter and moving close to 100 mph. His goal is to hit it with a ba­­t that is also less than three inches in diameter. This impressive feat requires extraordinary temporal and spatial coordination. The sweet spot of the bat must be at the same place, at the same time, as the ball. A (...) basketball player must keep a ball bouncing as she speeds from one end of the court to another, evading defensive players. She may never break pace as she lifts from the ground, throwing the ball fifteen feet toward a hoop that is eighteen inches in diameter. One task facing a psychologist involves explaining how the body does such things within the sometimes very demanding spatial and temporal constraints that a given task imposes. Part of the goal of this chapter is to sketch the commitments of an embodied approach to such an explanation. We shall see that an embodied account of motor skills draws concepts that depart radically from more traditional cognitivist theories of motor activity. Similarly, because an embodied approach to cognition introduces new ways to understand the human capacity for social interaction, it also promises to shed new light on how athletes coordinate their actions with each other. (shrink)

The grounding of symbols in computational models of linguistic abilities is one of the fundamental properties of psychologically plausible cognitive models. In this article, we present an embodied model for the grounding of language in action based on epigenetic robots. Epigenetic robotics is one of the new cognitive modeling approaches to modeling autonomous mental development. The robot model is based on an integrative vision of language in which linguistic abilities are strictly dependent on and grounded in other behaviors and skills. (...) It uses simulated robots that learn through imitation the names of basic actions. Robots also learn higher order action concepts through the process of grounding transfer. The simulation demonstrates how new, higher order behavioral abilities can be autonomously built on previously grounded basic action categories following linguistic interaction with human users. (shrink)

Previous reports have demonstrated that the comprehension of sentences describing motion in a particular direction (toward, away, up, or down) is affected by concurrently viewing a stimulus that depicts motion in the same or opposite direction. We report 3 experiments that extend our understanding of the relation between perception and language processing in 2 ways. First, whereas most previous studies of the relation between perception and language processing have focused on visual perception, our data show that sentence processing can be (...) affected by the concurrent processing of auditory stimuli. Second, it is shown that the relation between the processing of auditory stimuli and the processing of sentences depends on whether the sentences are presented in the auditory or visual modality. (shrink)

When participants are asked to make sensibility judgments on sentences that describe action toward the body (i.e., “Mark dealt the cards to you”) or away from the body (i.e., “You dealt the cards to Mark”), they are faster to respond when the response requires an arm movement in the same direction as the action described by the sentence. This congruence effect is known as the Action–Sentence Compatibility Effect (ACE). This study reports 4 experiments that extend our understanding of the ACE (...) by exploring how the time at which one prepares the motor response required for the sensibility judgment affects the magnitude of the ACE. Results show that the ACE arises only when participants have the opportunity to plan their motor response while they are processing the sentence. (shrink)

Empirical evidence suggests that perceptual‐motor simulations are often constitutively involved in language comprehension. Call this “the simulation view of language comprehension”. This article applies the simulation view to illuminate the much‐discussed phenomenon of copredication, where a noun permits multiple predications which seem to select different senses of the noun simultaneously. On the proposed account, the (in)felicitousness of a copredicational sentence is closely associated with the perceptual simulations that the language user deploys in comprehending the sentence.

Recent research in psycholinguistics suggests that language processing frequently involves mental imagery. This paper focuses on visual imagery and discusses two issues regarding the processing of polysemous words (i.e. words with multiple related meanings or senses) – co-predication and sense-relatedness. It aims to show how mental imagery can illuminate these two issues.

The Action-sentence Compatibility Effect is often taken as supporting the fundamental role of the motor system in understanding sentences that describe actions. This effect would be related to an internal “simulation,” i.e., the reactivation of past perceptual and motor experiences. However, it is not easy to establish whether this simulation predominantly involves spatial imagery or motor anticipation. In the classical ACE experiments, where a real motor response is required, the direction and motor representations are mixed. In order to disentangle spatial (...) and motor aspects involved in the ACE, we performed six experiments in different conditions, where the motor component was always reduced, asking participants to judge the sensibility of sentences by moving a mouse, thus requiring a purely spatial representation, compatible with nonmotor interpretations. In addition, our experiments had the purpose of taking into account the possible confusion of effects of practice and of compatibility. Also, in contrast to the usual paradigm, we included no-transfer filler sentences in the analysis. The ACE was not found in any experiment, a result that failed to support the idea that the ACE could be related to a simulation where spatial aspects rather than motor ones prevail. Strong practice effects were always found and were carved out from results. A surprising effect was that no-transfer sentences were processed much slower than others, perhaps revealing a sort of participants’ awareness of the structure of stimuli, i.e., their finding that some of them involved motion and others did not. The relevance of these outcomes for the embodiment theory is discussed. (shrink)

According to the Perceptual Symbols Theory of cognition (), modality‐specific simulations underlie the representation of concepts. A strong prediction of this view is that perceptual processing affects conceptual processing. In this study, participants performed a perceptual detection task and a conceptual property‐verification task in alternation. Responses on the property‐verification task were slower for those trials that were preceded by a perceptual trial in a different modality than for those that were preceded by a perceptual trial in the same modality. This (...) finding of a modality‐switch effect across perceptual processing and conceptual processing supports the hypothesis that perceptual and conceptual representations are partially based on the same systems. (shrink)

As embodied theories of cognition are increasingly formalized and tested, care must be taken to make informed assumptions regarding the nature of concepts and representations. In this study, we outline three reasons why one cannot, in effect, represent the same concept twice. First, online perception affects offline representation: Current representational content depends on how ongoing demands direct attention to modality-specific systems. Second, language is a fundamental facilitator of offline representation: Bootstrapping and shortcuts within the computationally cheaper linguistic system continuously modify (...) representational content. Third, time itself is a source of representational change: As the content of underlying concepts shifts with the accumulation of direct and vicarious experience, so too does the content of representations that draw upon these concepts. We discuss the ramifications of these principles for research into both human and synthetic cognitive systems. (shrink)

This article provides the first comprehensive conceptual account for the imagistic mental machinery that allows us to travel through time—for the time machine in our mind. It is argued that language reveals this imagistic machine and how we use it. Findings from a range of cognitive fields are theoretically unified and a recent proposal about spatialized mental time travel is elaborated on. The following novel distinctions are offered: external versus internal viewing of time; ‘‘watching” time versus projective ‘‘travel” through time; (...) optional versus obligatory mental time travel; mental time travel into anteriority or posteriority versus mental time travel into the past or future; single mental time travel versus nested dual mental time travel; mental time travel in episodic memory versus mental time travel in semantic memory; and ‘‘seeing” versus ‘‘sensing” mental imagery. Theoretical, empirical, and applied implications are discussed. (shrink)

Whether computational algorithms such as latent semantic analysis (LSA) can both extract meaning from language and advance theories of human cognition has become a topic of debate in cognitive science, whereby accounts of symbolic cognition and embodied cognition are often contrasted. Albeit for different reasons, in both accounts the importance of statistical regularities in linguistic surface structure tends to be underestimated. The current article gives an overview of the symbolic and embodied cognition accounts and shows how meaning induction attributed to (...) a specific statistical process or to activation of embodied representations should be attributed to language itself. Specifically, the performance of LSA can be attributed to the linguistic surface structure, more than special characteristics of the algorithm, and embodiment findings attributed to perceptual simulations can be explained by distributional linguistic information. (shrink)

In this paper I will analyse the relationship between metaphor and imagination. This issue has been recently studied by cognitive linguists who appreciate its importance, while other semantic perspectives neglect it. I will analyse the thesis which affirms that metaphors are based on cognitive components which are not logical-propositional but imaginative: the “image schemata” are recurrent models of corporeal experiences, centres of knowledge organization which structure – in a non-propositional form – an amount of salient information. This information emerges from (...) the sensorimotor activities such as: manipulation of objects, spatial orientation and focusing perceptive attention on different goals. According to this theory, imagination is the drive of the entire cognitive experience and, through metaphorical projection, it activates and coordinates the schemata from which the very linguistic activity originates. Starting with empirical studies about the cognitive and neurobiological plausibility of image schemata, I will assert the function of imagination as the trait d’union between experience and cognitive use of the metaphor, through the use of sensory and synesthetic metaphors as mediators among perceptive, physical and linguistic dimensions. I hope future research will concentrate on the relationship between synesthesia and image schemata because of their strong connection with human perceptive, cognitive and neural structures. (shrink)

This article introduces the theory of cognitive spacetime. This account allows us to go beyond the space–time dichotomy that is commonly employed in psychology and cognitive science. Linguistic analysis and experimental review is provided to support the notion that what is commonly referred to as spatial cognition (or mental space) in the cognitive sciences always contains time, and that what is commonly referred to as temporal cognition (or mental time) always contains space. For “spatial cognition” the term object-spatiotemporal cognition (or (...) object spacetime) and for “temporal cognition” the term event-spatiotemporal cognition (or event spacetime) is introduced. In order to exemplify the virtue of the new spacetime account (with its two subdomains, object spacetime and event spacetime) with a specific example, it is investigated how this new notion can substantially refine our understanding of space–time conceptual metaphor. A new conceptual-metaphor spacetime typology for cognitive processing underlying fictive motion and non-fictive motion is also proposed. Implications of the new spacetime account are discussed for metaphorically mapped mental perspective, metaphorically mapped embodiment, and cognitive science in general. Finally, specific reasons are given why the current proposal of cognitive spacetime cannot be equated with the concept of spacetime in modern physics. (shrink)

Theories of embodied cognition hold that the conceptual system uses perceptual simulations for the purposes of representation. A strong prediction is that perceptual phenomena should emerge in conceptual processing, and, in support, previous research has shown that switching modalities from one trial to the next incurs a processing cost during conceptual tasks. However, to date, such research has been limited by its reliance on the retrieval of familiar concepts. We therefore examined concept creation by asking participants to interpret modality-specific compound (...) phrases (i.e., conceptual combinations). Results show that modality switching costs emerge during the creation of new conceptual entities: People are slower to simulate a novel concept (e.g., auditory jingling onion) when their attention has already been engaged by a different modality in simulating a familiar concept (e.g., visual shiny penny). Furthermore, these costs cannot be accounted for by linguistic factors alone. Rather, our findings support the embodied view that concept creation, as well as retrieval, requires situated perceptual simulation. (shrink)

When describing motion along both the horizontal and vertical axes, languages from different families express the elements encoding verticality before those coding for horizontality (e.g., going up right instead of right up). In light of the motor grounding of language, the present study investigated whether the prevalence of verticality in Path expression also governs the trajectory of arm biological movements. Using a 3D virtual-reality setting, we tracked the kinematics of hand pointing movements in five spatial directions, two of which implied (...) the vertical and horizontal vectors equally (i.e., up right +45° and bottom right −45°). Movement onset could be prompted by visual or auditory verbal cues, the latter being canonical in French (“en haut à droite”/up right) or not (“à droite en haut”/right up). In two experiments, analyses of the index finger kinematics revealed a significant effect of gravity, with earlier acceleration, velocity, and deceleration peaks for upward (+45°) than downward (−45°) movements, irrespective of the instructions. Remarkably, confirming the linguistic observations, we found that vertical kinematic parameters occurred earlier than horizontal ones for upward movements, both for visual and congruent verbal cues. Non-canonical verbal instructions significantly affected this temporal dynamic: for upward movements, the horizontal and vertical components temporally aligned, while they reversed for downward movements where the kinematics of the vertical axis was delayed with respect to that of the horizontal one. This temporal dynamic is so deeply anchored that non-canonical verbal instructions allowed for horizontality to precede verticality only for movements that do not fight against gravity. Altogether, our findings provide new insights into the embodiment of language by revealing that linguistic path may reflect the organization of biological movements, giving priority to the vertical axis. (shrink)

Language is more than a source of information for accessing higher-order conceptual knowledge. Indeed, language may determine how people perceive and interpret visual stimuli. Visual processing in linguistic contexts, for instance, mirrors language processing and happens incrementally, rather than through variously-oriented fixations over a particular scene. The consequences of this atypical visual processing are yet to be determined. Here, we investigated the integration of visual and linguistic input during a reasoning task. Participants listened to sentences containing conjunctions or disjunctions and (...) looked at visual scenes containing two pictures that either matched or mismatched the nouns. Degree of match between nouns and pictures and between their expected and actual spatial positions affected fixations as well as judgments. We conclude that language induces incremental processing of visual scenes, which in turn becomes susceptible to reasoning errors during the language-meaning verification process. (shrink)

This study investigates how speed of motion is processed in language. In three eye-tracking experiments, participants were presented with visual scenes and spoken sentences describing fast or slow events (e.g., The lion ambled/dashed to the balloon). Results showed that looking time to relevant objects in the visual scene was affected by the speed of verb of the sentence, speaking rate, and configuration of a supporting visual scene. The results provide novel evidence for the mental simulation of speed in language and (...) show that internal dynamic simulations can be played out via eye movements toward a static visual scene. (shrink)

In this commentary, I focus on Machery's criticism of Neo-Empiricism. I argue that Neo-Empiricism can survive Machery's critique, and I show that there is an empiricist strategy for forestalling eliminativism.

An eye-tracking while listening study based on the blank screen paradigm was conducted to investigate the processing of literal and metaphorical verbs of motion. The study was based on two assumpti...

People often make use of a spatial “mental time line” to represent events in time. We investigated whether the eyes follow such a mental time line during online language comprehension of sentences that refer to the past, present, and future. Participants' eye movements were measured on a blank screen while they listened to these sentences. Saccade direction revealed that the future is mapped higher up in space than the past. Moreover, fewer saccades were made when two events are simultaneously taking (...) place at the present moment compared to two events that are happening in different points in time. This is the first evidence that oculomotor correlates reflect mental looking along an abstract invisible time line during online language comprehension about time. Our results support the idea that observing eye movements is likely to “detect” invisible spatial scaffoldings which are involved in cognitively processing abstract meaning, even when the abstract meaning lacks an explicit spatial correlate. Theoretical implications of these findings are discussed. (shrink)

In this response to Malt's and Prinz's commentaries, I argue that neo-empiricist hypotheses fail to threaten the argument for the elimination of ‘concept’ because they are unlikely to be true of all concepts, if they are true at all. I also defend the hypothesis that we possess bodies of knowledge retrieved by default from long-term memory, and I argue that prototypes, exemplars, and theories form genuinely distinct concepts.

There is mounting evidence that language comprehension involves the activation of mental imagery of the content of utterances (; ; ; ; ; ; ). This imagery can have motor or perceptual content. Three main questions about the process remain under‐explored, however. First, are lexical associations with perception or motion sufficient to yield mental simulation, or is the integration of lexical semantics into larger structures, like sentences, necessary? Second, what linguistic elements (e.g., verbs, nouns, etc.) trigger mental simulations? Third, how (...) detailed are the visual simulations that are performed? A series of behavioral experiments address these questions, using a visual object categorization task to investigate whether up‐ or down‐related language selectively interferes with visual processing in the same part of the visual field (following ). The results demonstrate that either subject nouns or main verbs can trigger visual imagery, but only when used in literal sentences about real space—metaphorical language does not yield significant effects—which implies that it is the comprehension of the sentence as a whole and not simply lexical associations that yields imagery effects. These studies also show that the evoked imagery contains detail as to the part of the visual field where the described scene would take place. (shrink)

Spatial aspects of words are associated with their canonical locations in the real world. Yet little research has tested whether spatial associations denoted in language comprehension generalize to their corresponding images. We directly tested the spatial aspects of mental imagery in picture and word processing (Experiment 1). We also tested whether spatial representations of motion words produce similar perceptual-interference effects as demonstrated by object words (Experiment 2). Findings revealed that words denoting an upward spatial location produced slower responses to targets (...) appearing at the top of the display, whereas words denoting a downward spatial location produced slower responses to targets appearing at the bottom of the display. Perceptual-interference effects did not obtain for pictures or for words lacking a spatial relation. These findings provide greater empirical support for the perceptual-symbols system theory (Barsalou, 1999, 2008). (shrink)

This paper presents an overview of the activation of background knowledge during text comprehension. We first review the cognitive processes involved in the activation of inferences during text comprehension, stressing the interaction between text and reader in the construction of situation models. Second, we review evidence for embodied theories of cognition and discuss how this new framework can inform our understanding of the nature and role of background knowledge. We then review the neuropsychological data on the activation of background knowledge (...) during text comprehension. Finally, the paper presents existing and future challenges in researching the role of background knowledge both at a conceptual and a methodological level. (shrink)