Whether computational algorithms such as latent semantic analysis (LSA) can both extract meaning from language and advance theories of human cognition has become a topic of debate in cognitive science, whereby accounts of symbolic cognition and embodied cognition are often contrasted. Albeit for different reasons, in both accounts the importance of statistical regularities in linguistic surface structure tends to be underestimated. The current article gives an overview of the symbolic and embodied cognition accounts and shows how meaning induction attributed to (...) a specific statistical process or to activation of embodied representations should be attributed to language itself. Specifically, the performance of LSA can be attributed to the linguistic surface structure, more than special characteristics of the algorithm, and embodiment findings attributed to perceptual simulations can be explained by distributional linguistic information. (shrink)

There is mounting evidence that language comprehension involves the activation of mental imagery of the content of utterances (; ; ; ; ; ; ). This imagery can have motor or perceptual content. Three main questions about the process remain under‐explored, however. First, are lexical associations with perception or motion sufficient to yield mental simulation, or is the integration of lexical semantics into larger structures, like sentences, necessary? Second, what linguistic elements (e.g., verbs, nouns, etc.) trigger mental simulations? Third, how (...) detailed are the visual simulations that are performed? A series of behavioral experiments address these questions, using a visual object categorization task to investigate whether up‐ or down‐related language selectively interferes with visual processing in the same part of the visual field (following ). The results demonstrate that either subject nouns or main verbs can trigger visual imagery, but only when used in literal sentences about real space—metaphorical language does not yield significant effects—which implies that it is the comprehension of the sentence as a whole and not simply lexical associations that yields imagery effects. These studies also show that the evoked imagery contains detail as to the part of the visual field where the described scene would take place. (shrink)

People often answer why-questions with what we call experiential explanations: narratives or stories with temporal structure and concrete details. In contrast, on most theories of the epistemic function of explanation, explanations should be abstractive: structured by general relationships and lacking extraneous details. We suggest that abstractive and experiential explanations differ not only in level of abstraction, but also in structure, and that each form of explanation contributes to the epistemic goals of individual learners and of science. In particular, experiential explanations (...) support mental simulation and survive transitions across background theories; as a result, they support learning and help us translate between competing frameworks. Experiential explanations play an irreducible role in human cognition – and perhaps in science. (shrink)

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 27 Heft: 4 Seiten: 559-572.

Expression of physical motion (e.g.,man runs by) shows systematic variability not only between language types (i.e., inter-typological) but also within a language type (i.e., intra-typological). In this study, we asked whether the patterns of variability extend to metaphorical motion events (e.g.,time runs by). Our analysis of randomly selected 450 physical motion (150/language) and 450 metaphorical motion (150/language) event descriptions from written texts originally produced by German, Polish, and Spanish authors showed strong inter-typological differences in the expression of both event types. (...) German and Polish speakers differed from Spanish speakers in how they packaged manner and path components of a motion event; they also differed in how extensively they expressed each component in their lexicalization of motion. The strong inter-typological differences were accompanied by more modest intra-typological variability: Polish and German writers differed in their packaging and lexicalization of manner and path components of metaphorical—butnotphysical—motion events. Our results provide evidence for robust inter-typological differences evident in the expression of both physical and metaphorical motion, along with less robust intra-typological differences, largely evident in the expression of metaphorical motion. Our study thus highlights event type as an important factor in determining crosslinguistic variation in motion expression. (shrink)

This study investigates how speed of motion is processed in language. In three eye-tracking experiments, participants were presented with visual scenes and spoken sentences describing fast or slow events (e.g., The lion ambled/dashed to the balloon). Results showed that looking time to relevant objects in the visual scene was affected by the speed of verb of the sentence, speaking rate, and configuration of a supporting visual scene. The results provide novel evidence for the mental simulation of speed in language and (...) show that internal dynamic simulations can be played out via eye movements toward a static visual scene. (shrink)

Many metaphor theorists argue that our mental experience of time is grounded in our understanding of space, including motion through space. Results from recent experiments – in which people think about motion, which in turn influences their thinking about time – support this position. Still, many questions remain about the nature of the metaphorical connection between time and space. Can the mere suggestion of motion influence how people reason about time, and if so, when and how? Three experiments investigated how (...) thinking about “abstract” motion through sequences of numbers or letters would influence reasoning about time. Our results extend earlier psychological work on the link between time and space by showing that even motion in non-physical domains can influence temporal reasoning. The results provide further evidence that metaphorical understanding is grounded in our everyday physical and conceptual experience. (shrink)

Conversation is supported by the beliefs that people have in common and the perceptual experience that they share. The visual context of a conversation has two aspects: the information that is available to each conversant, and their beliefs about what is present for each other. In our experiment, we separated these factors for the first time and examined their impact on a spontaneous conversation. We manipulated the fact that a visual scene was shared or not and the belief that a (...) visual scene was shared or not. Participants watched videos of actors talking about a controversial topic, then discussed their own views while looking at either a blank screen or the actors. Each believed (correctly or not) that their partner was either looking at a blank screen or the same images. We recorded conversants’ eye movements, quantified how they were coordinated, and analyzed their speech patterns. Gaze coordination has been shown to be causally related to the knowledge people share before a conversation, and the information they later recall. Here, we found that both the presence of the visual scene, and beliefs about its presence for another, influenced language use and gaze coordination. (shrink)

People often make use of a spatial “mental time line” to represent events in time. We investigated whether the eyes follow such a mental time line during online language comprehension of sentences that refer to the past, present, and future. Participants' eye movements were measured on a blank screen while they listened to these sentences. Saccade direction revealed that the future is mapped higher up in space than the past. Moreover, fewer saccades were made when two events are simultaneously taking (...) place at the present moment compared to two events that are happening in different points in time. This is the first evidence that oculomotor correlates reflect mental looking along an abstract invisible time line during online language comprehension about time. Our results support the idea that observing eye movements is likely to “detect” invisible spatial scaffoldings which are involved in cognitively processing abstract meaning, even when the abstract meaning lacks an explicit spatial correlate. Theoretical implications of these findings are discussed. (shrink)

Experientialist semantics has contributed to a broader notion of linguistic meaning by emphasizing notions such as construal, perspective, metaphor, and embodiment, but has suffered from an individualist concept of meaning and has conflated experiential motivations with conventional semantics. We argue that these problems can be redressed by methods and concepts from phenomenology, on the basis of a case study of sentences of non-actual motion such as “The mountain range goes all the way from Mexico to Canada.” Through a phenomenological reanalysis (...) of proposals of Talmy, Langacker, and Matlock, we show that non-actual motion is both experientially and linguistically non-unitary. At least three different features of human consciousness—enactive perception, visual scanning, and imagination—constitute experiential motivations for non-actual motion sentences, and each of these could be related to phenomenological analyses of human intentionality. The second problem is addressed by proposing that the experiential motivations of non-actual motion sentences can be viewed as sedimented through “passive” processes of acquisition and social transmission and that this implies an interactive loop between experience and language, yielding losses in terms of original experience, but gains in terms of communal signification. Something that is underestimated by phenomenology is that what is sedimented are not only intentional objects such as states of affairs, but aspects of how they are given, i.e., the original, temporal, bodily experiences themselves. Since cognitive semantics has emphasized such aspects of meaning, we suggest that phenomenology can itself benefit from experientialist semantics, especially when it turns its focus from prepredicative to predicative, linguistic intentionality. (shrink)

Enactivist accounts of language use generally treat concrete words in terms of motor intentionality systems and affordances for action. There is less consensus, though, regarding how abstract words are to be understood in enactivist terms. I draw on Merleau-Ponty’s later philosophy to argue, against the representationalist paradigm that has dominated the cognitive scientific and philosophical traditions, that language is fundamentally a mode of participation in our world. In particular, language orients us within our milieus in a manner that extends into (...) the depth of the idea-endowed world. This conceptualization of language allows us to see that abstract words orient us bodily just as surely as concrete words do, albeit in a manner that is more diffuse across the entirety of given situations, as I will show with an example of abstract language use in Don DeLillo’s novel Underworld. These insights are applied to some of the recent enactivist discourse to suggest some ways in which representationalism maintains a latent presence in this discourse. I conclude by pointing to developments in conceptual metaphor theory that can enrich our sense of how abstract language is involved in embodied understanding. (shrink)

This article introduces the theory of cognitive spacetime. This account allows us to go beyond the space–time dichotomy that is commonly employed in psychology and cognitive science. Linguistic analysis and experimental review is provided to support the notion that what is commonly referred to as spatial cognition (or mental space) in the cognitive sciences always contains time, and that what is commonly referred to as temporal cognition (or mental time) always contains space. For “spatial cognition” the term object-spatiotemporal cognition (or (...) object spacetime) and for “temporal cognition” the term event-spatiotemporal cognition (or event spacetime) is introduced. In order to exemplify the virtue of the new spacetime account (with its two subdomains, object spacetime and event spacetime) with a specific example, it is investigated how this new notion can substantially refine our understanding of space–time conceptual metaphor. A new conceptual-metaphor spacetime typology for cognitive processing underlying fictive motion and non-fictive motion is also proposed. Implications of the new spacetime account are discussed for metaphorically mapped mental perspective, metaphorically mapped embodiment, and cognitive science in general. Finally, specific reasons are given why the current proposal of cognitive spacetime cannot be equated with the concept of spacetime in modern physics. (shrink)

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 27 Heft: 2 Seiten: 181-203.

Language is more than a source of information for accessing higher-order conceptual knowledge. Indeed, language may determine how people perceive and interpret visual stimuli. Visual processing in linguistic contexts, for instance, mirrors language processing and happens incrementally, rather than through variously-oriented fixations over a particular scene. The consequences of this atypical visual processing are yet to be determined. Here, we investigated the integration of visual and linguistic input during a reasoning task. Participants listened to sentences containing conjunctions or disjunctions and (...) looked at visual scenes containing two pictures that either matched or mismatched the nouns. Degree of match between nouns and pictures and between their expected and actual spatial positions affected fixations as well as judgments. We conclude that language induces incremental processing of visual scenes, which in turn becomes susceptible to reasoning errors during the language-meaning verification process. (shrink)

Several disciplines within the cognitive sciences have advanced the idea that people comprehend the actions of others, including the linguistic meanings they communicate, through embodied simulations where they imaginatively recreate the actions they observe or hear about. This claim has important consequences for theories of mind and meaning, such as that people’s use and interpretation of language emerges as a kind of bodily activity that is an essential part of ordinary cognition. Daniel Weiskopf presents several arguments against the idea that (...) experiential simulations play a major role in immediate language use and meaning. We offer several rebuttals to Weiskopf, in which we critique his interpretation of simulation theory, present additional psycholinguistic evidence supportive of the simulation perspective, and suggest that a more traditional theory of linguistic meaning and processing has little psychological and empirical validity.Keywords: Language; Comprehension; Embodied cognition; Embodied simulation; Linguistic meaning, Psycholinguistics. (shrink)

An eye-tracking while listening study based on the blank screen paradigm was conducted to investigate the processing of literal and metaphorical verbs of motion. The study was based on two assumpti...

Previous research showed that sensorimotor information affects the perception of properties associated with implied perceptual context during language comprehension. Three experiments addressed a novel question of whether perceptual context may contribute to a simulation of information about such out‐of‐sight objects as cast shadows. In Experiment 1, participants read a sentence that implied a particular shadow cast on a target (blinds vs. an open window) and then verified the picture of the object onto which a shadow was cast. Responses were faster (...) when the shadow of blinds cast on the object matched that implied by the sentence. However, the data did not show the same matching effect for pictures with cast shadows from an open window. In Experiments 2 and 3, we found that verification times for pictures with no cast shadows were faster when preceded by an “open window” sentence, thus suggesting that reading the sentence does not elicit a visual simulation of any specific shadow. Experiment 3 showed that the objects superimposed with a cast shadow of the blinds and blinds themselves were verified faster after reading a “blinds” sentence. However, the results of an order analysis showed the temporal stability of the “blinds shadows” effect, but the disappearance of the “blinds” effect in the second half of the data. We conclude that the results are compatible, to a lesser or greater extent, with multiple accounts, and discuss our findings in the context of a mental imagery view, a mental simulation view, and an amodal representation view. (shrink)

In this article, we address the problem of how people understand predicative metaphors such as “The rumor flew through the office,” and argue that predicative metaphors are understood as indirect (or two-stage) categorizations. In the indirect categorization process, the verb (e.g., fly) of a predicative metaphor evokes an intermediate entity, which in turn evokes a metaphoric category of actions or states (e.g., “to spread rapidly and soon disappear”) to be attributed to the target noun (e.g., rumor), rather than directly evoking (...) a metaphoric category as argued by CitationGlucksberg's (2001) categorization theory. We test our argument using two experiments, namely, offline comprehension and online priming. The offline comprehension experiment showed that interpretation of predicative metaphors had greater overlap with words indirectly associated with the verb than those directly associated with the verb. The online priming experiment demonstrated that indirectly associated words were activated during predicative metaphor comprehension, but directly associated words were not. These results provide convergent evidence for our argument, and thus the psychological validity of two-stage categorization as a process of predicative metaphor comprehension was confirmed. (shrink)

Recent investigations on how people derive meaning from language have focused on task‐dependent shifts between two cognitive systems. The symbolic (amodal) system represents meaning as the statistical relationships between words. The embodied (modal) system represents meaning through neurocognitive simulation of perceptual or sensorimotor systems associated with a word's referent. A primary finding of literature in this field is that the embodied system is only dominant when a task necessitates it, but in certain paradigms, this has only been demonstrated using nouns (...) and adjectives. The purpose of this paper is to study whether similar effects hold with verbs. Experiment 1 evaluated a novel task in which participants rated a selection of verbs on their implied vertical movement. Ratings correlated well with distributional semantic models, establishing convergent validity, though some variance was unexplained by language statistics alone. Experiment 2 replicated previous noun‐based location‐cue congruency experimental paradigms with verbs and showed that the ratings obtained in Experiment 1 predicted reaction times more strongly than language statistics. Experiment 3 modified the location‐cue paradigm by adding movement to create an animated, temporally decoupled, movement‐verb judgment task designed to examine the relative influence of symbolic and embodied processing for verbs. Results were generally consistent with linguistic shortcut hypotheses of symbolic‐embodied integrated language processing; location‐cue congruence elicited processing facilitation in some conditions, and perceptual information accounted for reaction times and accuracy better than language statistics alone. These studies demonstrate novel ways in which embodied and linguistic information can be examined while using verbs as stimuli. (shrink)

Name der Zeitschrift: Cognitive Linguistics Jahrgang: 26 Heft: 4 Seiten: 657-696.

Metaphor plays a unique role in cognitive development by structuring abstract concepts and leading to conceptual change. Existing work suggests early emergence of metaphorical abilities, with five-year-olds understanding and explaining metaphors that involve cross-domain comparisons (e.g., SPACE to TIME). Yet relatively little is known about the factors that explain this developmental change. This study focuses on spatial metaphors for time, and asks whether cognitive and/or verbal factors best explain developmental changes in three- to six-year-old children's comprehension and explanation of metaphors. (...) The results show that children's grasp of the time concept—but not verbal ability—predicts their metaphor comprehension. Verbal ability, on the other hand, is a predictor of metaphor explanation, even after controlling for age. The results thus suggest that cognitive and verbal factors selectively predict children's emerging metaphorical abilities. (shrink)

The linguistic path has been explored through several works. The present paper investigates a path underlain by the fictive motion phenomenon: The plateau goes east along the river. This itinerary, here called the ‘localization path’ discloses the FM of an item along a trajectory to highlight its immobility in space. This linguistic path is here inspected through a corpus-based analysis displaying the verbs come and go. If experiencing language is first vocal, this process also implies kinetic, non-verbal modalities. The languaging (...) experience will hence be explored through the interaction between language, space and the speaker’s body through an enactive approach. A prototypical syntactic configuration mirroring the interpretative grid of FM reality will be defined. Recurrent syntactic patterns revealing the way the speaker projects his own world through simplex models will highlight the way the complexity of visual scenari is converted into linguistic sequences. (shrink)

In this study, we investigate the expression of speed—one of the principal dimensions of manner—in relation to the expression of space in Estonian, a satellite-framed and morphology-rich language. Our multivariate and extensive corpus analysis is informed by asymmetries attested in languages with regard to expressing space (thegoal-over-sourcebias) and speed (thefast-over-slowbias) where we attempt to explicitly link the two. We demonstrate moderate speed effects in the data in that fast motion verbs tend to combine with Goal, and slow motion verbs with (...) Location and Trajectory expressions, making verbs of fast motion similar to goal verbs in their clausal behaviour. We also show that semantic congruency (i.e., expressing semantic information repeatedly in motion clauses) overrides thegoal-over-sourcebias. That is, although verbs also occur in diverse patterns, they often combine with semantic units that mirror their meaning: goal verbs tend to combine with Goal, source verbs with Source, and manner verbs with Manner expressions. Such semantic congruency might serve as a tool for construal and, thus, is an important issue for future research. (shrink)

Starting from the overwhelming view that time is metaphorically conceptualized in terms of space, this study will, on the one hand, take the time interval words into minute analysis to confirm our view of event conceptualization of time at a more basic level along with space–time metaphoric conceptualization of time at a relational level. In alignment with the epistemology of the time–space conflation of the Chinese ancestors, our view is supported by the systematic examination of evidence related to the cultural (...) origins of the conceptualization of time, through a scrutiny of the original meanings and construction of words related to intervals of time in Mandarin Chinese. This study offers a new explanation of how: the conceptualization of time in Chinese is realized through metonymic cognition and words related to specific intervals of time are coined based on the metonymic conceptualization of related events or a corresponding event schema. Five major types of event-based metonymies are identified, and their interactive functions are illustrated. Based on this evidence, we argue that the double nature of both metaphoric and metonymic time conceptualization in Mandarin Chinese lies in the fact that time interval words can be used in its time categorial sense or as a time entity which suggests the etymological origins of Chinese as ideograph. It is concluded therefore that the event-based metonymy conceptualization of time can provide better insights into the characteristics of Chinese modes of thinking and its influences on the perception of and interaction with the world. This study can also serve as good evidence for the shaping effect of language on cognition. (shrink)