A review of 'The Hand, an Organ of the Mind: What the Manual Tells the Mental', ed. Zdravko Radman.

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

Cognitive research on metaphoric concepts of time has focused on differences between moving Ego and moving time models, but even more basic is the contrast between Ego‐ and temporal‐reference‐point models. Dynamic models appear to be quasi‐universal cross‐culturally, as does the generalization that in Ego‐reference‐point models, FUTURE IS IN FRONT OF EGO and PAST IS IN BACK OF EGO. The Aymara language instead has a major static model of time wherein FUTURE IS BEHIND EGO and PAST IS IN FRONT OF EGO; (...) linguistic and gestural data give strong confirmation of this unusual culture‐specific cognitive pattern. Gestural data provide crucial information unavailable to purely linguistic analysis, suggesting that when investigating conceptual systems both forms of expression should be analyzed complementarily. Important issues in embodied cognition are raised: how fully shared are bodily grounded motivations for universal cognitive patterns, what makes a rare pattern emerge, and what are the cultural entailments of such patterns? (shrink)

The extended mind thesis (EM) asserts that some cognitive processes are (partially) composed of actions consisting of the manipulation and exploitation of environmental structures. Might some processes at the root of social cognition have a similarly extended structure? In this paper, I argue that social cognition is fundamentally an interactive form of space management—the negotiation and management of ‘‘we-space”—and that some of the expressive actions involved in the negotiation and management of we-space (gesture, touch, facial and whole-body expressions) drive basic (...) processes of interpersonal understanding and thus do genuine social-cognitive work. Social interaction is a kind of extended social cognition, driven and at least partially constituted by environmental (non-neural) scaffolding. Challenging the Theory of Mind paradigm, I draw upon research from gesture studies, developmental psychology, and work on Moebius Syndrome to support this thesis. (shrink)

Autistic spectrum disorders impair the ability to interact socially. Detecting and understanding their onset is not only an empirical enterprise, but also a theoretical one, often linked to studies on intersubjectivity. Different theoretical perspectives have been elaborated in the past to account for the deficit. The main purpose of this paper is to reinforce and offer empirical grounding to a recent approach, termed Social Orienting Model, by presenting the main theoretical approaches to autism and contrasting them to this view, as (...) well as considering its possible effect on empirical research, focusing on current literature analyzing gestures in children with autism. (shrink)

The strong predominance of right-handedness appears to be a uniquely human characteristic, whereas the left-cerebral dominance for vocalization occurs in many species, including frogs, birds, and mammals. Right-handedness may have arisen because of an association between manual gestures and vocalization in the evolution of language. I argue that language evolved from manual gestures, gradually incorporating vocal elements. The transition may be traced through changes in the function of Broca's area. Its homologue in monkeys has nothing to do with vocal control, (...) but contains the so-called “mirror neurons,” the code for both the production of manual reaching movements and the perception of the same movements performed by others. This system is bilateral in monkeys, but predominantly left-hemispheric in humans, and in humans is involved with vocalization as well as manual actions. There is evidence that Broca's area is enlarged on the left side in Homo habilis, suggesting that a link between gesture and vocalization may go back at least two million years, although other evidence suggests that speech may not have become fully autonomous until Homo sapiens appeared some 170,000 years ago, or perhaps even later. The removal of manual gesture as a necessary component of language may explain the rapid advance of technology, allowing late migrations of Homo sapiens from Africa to replace all other hominids in other parts of the world, including the Neanderthals in Europe and Homo erectus in Asia. Nevertheless, the long association of vocalization with manual gesture left us a legacy of right-handedness. Key Words: cerebral dominance; gestures; handedness; hominids; language evolution; primates; speech; vocalization. (shrink)

Our target article proposed that language production and comprehension are interwoven, with speakers making predictions of their own utterances and comprehenders making predictions of other people's utterances at different linguistic levels. Here, we respond to comments about such issues as cognitive architecture and its neural basis, learning and development, monitoring, the nature of forward models, communicative intentions, and dialogue.

Recent studies of naturalistic face‐to‐face communication have demonstrated coordination patterns such as the temporal matching of verbal and non‐verbal behavior, which provides evidence for the proposal that verbal and non‐verbal communicative control derives from one system. In this study, we argue that the observed relationship between verbal and non‐verbal behaviors depends on the level of analysis. In a reanalysis of a corpus of naturalistic multimodal communication (Louwerse, Dale, Bard, & Jeuniaux, ), we focus on measuring the temporal patterns of specific (...) communicative behaviors in terms of their burstiness. We examined burstiness estimates across different roles of the speaker and different communicative modalities. We observed more burstiness for verbal versus non‐verbal channels, and for more versus less informative language subchannels. Using this new method for analyzing temporal patterns in communicative behaviors, we show that there is a complex relationship between verbal and non‐verbal channels. We propose a “temporal heterogeneity” hypothesis to explain how the language system adapts to the demands of dialog. (shrink)

Adult-infant early dyadic interactions have been extensively explored by developmental psychologists. Around the age of 2 months, infants already demonstrate complex, delicate and very sensitive behaviors that seem to express their ability to interact and share emotions with their caregivers. This paper presents 3 pilot studies of parent-infant dyadic interaction in various set-ups. The first two present longitudinal data collected on two infants aged between 1 and 6 months and their mothers. We analyzed the development of coordination between them, at (...) the motor and at the vocal level. The 3rd pilot study aims to explore interpersonal coordination in both vocal behavior and motor activity for one infant and his mother at 2, 4 and 6 months. These pilot studies however leave a number of questions open concerning developmental changes and infants’ progressive mastery of interaction. We identify areas worth examining and try to tease out specific issues that may help develop new methodological pathways for the study of early naturalistic social interaction. We assume that a continuous, rather than discrete, approach would better capture the changes taking place in the various communicative modalities, while also displaying each dyad’s specificity and the narrative dimension of social engagement between infants and caregivers. (shrink)

This article discusses the importance of social interaction for the development of the representations for symbolic communication. We suggest that there is no need to distinguish between different representational systems emerging at different stages of development. Instead, we propose that representations are rich right from the beginning of a child’s life, and that they are driven mainly by acting and interacting in the physical and social world. The more variety in a child’s interactional experience (i.e., synchrony, sequentiality, and prediction), the (...) more enriched and abstracted the representations become. We review literature providing evidence for the ways in which infants’ development toward symbolic communication benefits from repeated social (inter)action and consider some implications for computational approaches. (shrink)

Toolmaking requires motor skills that in turn require handedness, so that there is no competition between the two sides of the brain. Thus, handedness is not necessarily linked to vocalization but to the origin of causal beliefs required for making complex tools. Language may have evolved from these processes.

The goal of this paper is to explore, from a phenomenologically informed perspective, the phenomenon of the operative spatialization of human thinking, viewed in its relationship with the embodied human organism’s spatial experience. Operative spatialization in this context refers to the cognitive role and functioning of spatial schematizations and differentiations in human thinking. My particular focus is the domain of conceptualization. By drawing on Husserl’s discussion of the (linguistic) process of a sedimentation of meaning, I aim to show that spatialization (...) functions in a structurally ambivalent manner. On the one hand, spatialization predisposes and thus narrows the scope of human conceptual thought. On the other hand, spatialization establishes an implicit cognitive scaffold indispensable for the development and practice of human higher-order thinking. The structure and functioning of this scaffold, I argue, is intrinsically related to the spatial structure and dynamics of human embodiment. Synthesizing insights from phenomenological studies concerning the experiential constitution of space, and classic and recent research findings from fields such as cognitive linguistics and psychology concerning the cognitive dimension of image-schemas and gestural behavior, I argue that the living human body functions centrally as the sense-constitutive ‘site of conversion’ (Husserl) between concrete structures of spatial experience and abstract structures of conceptual thought. (shrink)

We review major developmental evidence on the continuity from action to gesture to word and sign in human children, highlighting the important role of caregivers in the development of multimodal communication. In particular, the basic issues considered here and contributing to the current debate on the origins and development of the language-ready brain are: (1) links between early actions, gestures and words and similarities in representational strategies; (2) importance of multimodal communication and the interplay between gestures and spoken words; (3) (...) interconnections between early actions, gestures and signs. The innovation of this report is in connecting these themes together to relevant findings from studies on children between 6 and 36 months of age and highlighting interesting parallels in studies on ape communicative behavior. (shrink)

This article discusses the importance of social interaction for the development of the representations for symbolic communication. We suggest that there is no need to distinguish between different representational systems emerging at different stages of development. Instead, we propose that representations are rich right from the beginning of a child’s life, and that they are driven mainly by acting and interacting in the physical and social world. The more variety in a child’s interactional experience (i.e., synchrony, sequentiality, and prediction), the (...) more enriched and abstracted the representations become. We review literature providing evidence for the ways in which infants’ development toward symbolic communication benefits from repeated social (inter)action and consider some implications for computational approaches. (shrink)

The integration of language production and comprehension processes may be more specific in terms of developmental timing than Pickering & Garrod (P&G) discuss in their target article. Developmental studies do reveal links between production and comprehension, but also demonstrate that the integration of these skills changes over time. Production-comprehension links occur within specific language skills and specific time windows.

Gestures and speech are clearly synchronized in many ways. However, previous studies have shown that the semantic similarity between gestures and speech breaks down as people approach transitions in understanding. Explanations for these gesture–speech mismatches, which focus on gestures and speech expressing different cognitive strategies, have been criticized for disregarding gestures’ and speech's integration and synchronization. In the current study, we applied three different perspectives to investigate gesture–speech synchronization in an easy and a difficult task: temporal alignment, semantic similarity, and (...) complexity matching. Participants engaged in a simple cognitive task and were assigned to either an easy or a difficult condition. We automatically measured pointing gestures, and we coded participant's speech, to determine the temporal alignment and semantic similarity between gestures and speech. Multifractal detrended fluctuation analysis was used to determine the extent of complexity matching between gestures and speech. We found that task difficulty indeed influenced gesture–speech synchronization in all three domains. We thereby extended the phenomenon of gesture–speech mismatches to difficult tasks in general. Furthermore, we investigated how temporal alignment, semantic similarity, and complexity matching were related in each condition, and how they predicted participants’ task performance. Our study illustrates how combining multiple perspectives, originating from different research areas (i.e., coordination dynamics, complexity science, cognitive psychology), provides novel understanding about cognitive concepts in general and about gesture–speech synchronization and task difficulty in particular. (shrink)

The aim of this study is to analyze the relationship between rhythmic movements and deictic gestures at the end of the first year of life, and to focus on their unimodal or multimodal character. We hypothesize that multimodal rhythmic movement performed with an object in the hand can facilitate the transition to the first deictic gestures. Twenty-three children were observed at 9 and 12 months of age in a naturalistic play situation with their mother or father. Results showed that rhythmic (...) movements with objects in the hand are a frequent behavior in children's repertoires. Rhythmic behaviors tend to decrease from 9 to 12 months, specifically when they are unimodal. Multimodal rhythmic behavior production at 9 months is positively related with proximal deictic gestures 3 months later. Multimodal rhythmic movements are not directly related to distal deictic gestures, but are indirectly related via proximal deictic gestures. These results highlight the relevance of multimodal behaviors in the transition to the use of early gestures, and can be considered as a transitional phenomenon between the instrumental action and early communicative gestures. (shrink)

The Aymara of the Andes use absolute (cardinal) frames of reference for describing the relative position of ordinary objects. However, rather than encoding them in available absolute lexemes, they do it in lexemes that are intrinsic to the body: nayra (“front”) and qhipa (“back”), denoting east and west, respectively. Why? We use different but complementary ethnographic methods to investigate the nature of this encoding: (a) linguistic expressions and speech–gesture co-production, (b) linguistic patterns in the distinct regional Spanish-based variety Castellano Andino (...) (CA), (c) metaphorical extensions of CA’s spatial patterns to temporal ones, and (d) layouts of traditional houses. Findings indicate that, following fundamental principles of Aymara cosmology, people, objects, and land—as a whole—are conceived as having an implicit canonical orientation facing east, a primary landmark determined by the sunrise. The above bodily based lexicalizations are thus linguistic manifestations of a broader macro-cultural worldview and its psycho-cognitive reality. (shrink)