Pantomime has long been considered distinct from co-speech gesture. It has therefore been argued that pantomime cannot be part of gesture-speech integration. We examine pantomime as distinct from silent gesture, focusing on non-co-speech gestures that occur in the midst of children’s spoken narratives. We propose that gestures with features of pantomime are an infrequent but meaningful component of a multimodal communicative strategy. We examined spontaneous non-co-speech representational gesture production in the narratives of 30 monolingual English-speaking children between the ages of (...) 8- and 11-years. We compared the use of co-speech and non-co-speech gestures in both autobiographical and fictional narratives and examined viewpoint and the use of non-manual articulators, as well as the length of responses and narrative quality. The use of non-co-speech gestures was associated with longer narratives of equal or higher quality than those using only co-speech gestures. Non-co-speech gestures were most likely to adopt character-viewpoint and use non-manual articulators. The present study supports a deeper understanding of the term pantomime and its multimodal use by children in the integration of speech and gesture. (shrink)

Expression of physical motion (e.g., man runs by) shows systematic variability not only between language types (i.e., inter-typological) but also within a language type (i.e., intra-typological). In this study, we asked whether the patterns of variability extend to metaphorical motion events (e.g., time runs by). Our analysis of randomly selected 450 physical motion (150/language) and 450 metaphorical motion (150/language) event descriptions from written texts originally produced by German, Polish, and Spanish authors showed strong inter-typological differences in the expression of both (...) event types. German and Polish speakers differed from Spanish speakers in how they packaged manner and path components of a motion event; they also differed in how extensively they expressed each component in their lexicalization of motion. The strong inter-typological differences were accompanied by more modest intra-typological variability: Polish and German writers differed in their packaging and lexicalization of manner and path components of metaphorical—but not physical—motion events. Our results provide evidence for robust inter-typological differences evident in the expression of both physical and metaphorical motion, along with less robust intra-typological differences, largely evident in the expression of metaphorical motion. Our study thus highlights event type as an important factor in determining crosslinguistic variation in motion expression. (shrink)

The expression of physical motion (the spider crawls across the net) and metaphorical motion (the fear crawls across her heart) shows strong inter-typological differences between language types (German, an S-language vs. Spanish, a V-language) and more subtle intra-typological differences within a language type (German vs. Polish, both S-languages). However, we know relatively less about the extension of these patterns to translated texts. In this study, we focused on physical and metaphorical motion descriptions in written texts in original language and their (...) translations to a language that belongs to the same or a different typological group, to determine whether motion expression in translated texts shows the same patterns of inter-typological and intra-typological variability as it does in original texts. We investigated this question by extracting 450 physical motion (150/language) and 450 metaphorical motion (150/language) descriptions from novels originally written in German, Polish, or Spanish and their translations to typologically different (i.e. inter-typological; German to Spanish, Spanish to German) or typologically similar (i.e. intra-typological; German to Polish, Polish to German) languages. Our results provided evidence for similar patterns of strong inter-typological and more subtle intra-typological variability in translations akin to those observed in original texts – with translated texts largely following the patterns of the target language in their expression of physical and metaphorical motion. Our results also highlighted specificity of event expression in a language as an important factor in the attainment of target language patterns in translated texts. (shrink)

The human experience is shaped by information from different perceptual channels, but it is still debated whether and how differential experience influences language use. To address this, we compared congenitally blind, blindfolded, and sighted people's descriptions of the same motion events experienced auditorily by all participants (i.e., via sound alone) and conveyed in speech and gesture. Comparison of blind and sighted participants to blindfolded participants helped us disentangle the effects of a lifetime experience of being blind versus the task-specific effects (...) of experiencing a motion event by sound alone. Compared to sighted people, blind people's speech focused more on path and less on manner of motion, and encoded paths in a more segmented fashion using more landmarks and path verbs. Gestures followed the speech, such that blind people pointed to landmarks more and depicted manner less than sighted people. This suggests that visual experience affects how people express spatial events in the multimodal language and that blindness may enhance sensitivity to paths of motion due to changes in event construal. These findings have implications for the claims that language processes are deeply rooted in our sensory experiences. (shrink)