We examine the embodiment of one foundational aspect of human cognition, language, through its bodily association with the gestures that accompany its expression in speech. Gesture is a universal feature of human communication. Gestures are produced by all speakers in every culture. They are tightly timed with speech. Gestures convey important communicative information to the listener, but even blind speakers gesture while talking to blind listeners, so the mutual co-occurrence of speech and gesture reflects a deep association between the two (...) modes that transcends the intentions of the speaker to communicate. Indeed, we believe that this linkage of the vocal expression of language and the arm movements produced with it are a manifestation of the embodiment of thought: that human mental activities arise through bodily interactions with the world and remain linked with them throughout the lifespan. In particular, we propose that speech and gesture have their developmental origins in early hand-mouth linkages, such that as oral activities become gradually used for meaningful speech, these linkages are maintained and strengthened. Both hand and mouth are tightly coupled in the mutual cognitive activity of language. In short, it is the initial sensorimotor linkages of these systems that form the bases for their later cognitive interdependence. (shrink)

Many studies have documented a close timing relationship between speech prosody and co-speech gesture, but some studies have not, and it is unclear whether these differences in speech-gesture alignment are due to different speaking tasks, different target gesture types, different prosodic elements, different definitions of alignment, or even different languages/speakers. This study contributes to the ongoing effort to elucidate the precise nature of the gesture–speech timing relationship by examining an understudied variety of American English, i.e., academic-lecture-style speech, with a focus (...) on an understudied type of gesture: Non-Referential gestures, which make up the majority of this corpus. Results for the 1,334 Stroke-Defined Gestures in this 20-min sample suggest that the stroke phase of a Non-Referential gesture tends to align with a pitch-accented syllable, just as reported in studies of other gesture types (e.g., deictic gestures) and in other speaking styles (such as narration). Preliminary results are presented suggesting that trajectory shapes of these Non-Referential gestures are consistent across a higher-level prosodic grouping, supporting earlier proposals for kinematic constancy across spoken prosodic constituents ( Kendon, 1972, 1980, 2004 ). Analysis also raises the possibility that the category of Non-Referential gestures is not solely made up of ‘beats,’ defined as simple bi-phasic flick-like movements that beat out the rhythm of the speech, but includes gestures with multiple phases and various types of rhythmicity. Taken together, the results of this analysis suggest (1) a wide range of gesture configurations within the undifferentiated category of Non-Referential gestures or ‘beats,’ which requires further investigation, and (2) a close coordination between co-speech gestures and the prosodic structure of spoken utterances across speaking styles and gesture referentiality, which has profound implications for modeling the process of planning an utterance. (shrink)