The present study aims to explore the status of filled pauses as pragmatic markers by taking into account their accompanying visual and gestural behavior. This aspect has not yet been widely explored, and the current study breaks new ground by demonstrating that the analysis of gaze and gesture can shed substantial light on the pragmatic functions of filled pauses and other pausing phenomena. Filled pauses (FPs) serve several pragmatic functions in speech, mainly planning but also turn-holding and emphasis, and their (...) use is also highly determined by register and setting. This research explores the different pragmatic functions of FPs by analyzing their distribution in two different communication settings (conversation vs presentation setting), combining a quantitative and a qualitative methodology, following Kosmala & Crible’s (2021) study on the same data. Particular attention was paid to the co-occurring gestural activity of uh/ums and gaze behavior. Analyses show that the pragmatic functions of FPs are also embodied in kinetic activities which differ according to the setting: more pragmatic and referential ones were found during FPs in conversation than in the presentation setting, as well as more eye-contact, which reflects their potential communicative role during interactional sequences. (shrink)

Classical cognitivist and connectionist models posit a Cartesian disembodiment of mind assuming that brain events can adequately explain thought and related notions such as intellect. Instead, we argue for the bodily basis of thought and its continuity beyond the sensorimotor stage. Indeed, there are no eternally fixed representations of the external world in the "motor system," rather, it is under the guidance of both internal and external factors with important linkages to frontal, parietal, cerebellar, basal ganglionic, and cingulate gyrus areas (...) that subserve cognitive and motivational activities. Indeed, the motor system, including related structures, is a self-organizing dynamical system contextualized among musculoskeletal, environmental (e.g., gravity), and social forces. We do not simply inhabit our bodies; we literally use them to think with. (shrink)

Journal Name: Cognitive Linguistics Issue: Ahead of print.

Toolmaking requires motor skills that in turn require handedness, so that there is no competition between the two sides of the brain. Thus, handedness is not necessarily linked to vocalization but to the origin of causal beliefs required for making complex tools. Language may have evolved from these processes.

The strong predominance of right-handedness appears to be a uniquely human characteristic, whereas the left-cerebral dominance for vocalization occurs in many species, including frogs, birds, and mammals. Right-handedness may have arisen because of an association between manual gestures and vocalization in the evolution of language. I argue that language evolved from manual gestures, gradually incorporating vocal elements. The transition may be traced through changes in the function of Broca's area. Its homologue in monkeys has nothing to do with vocal control, (...) but contains the so-called “mirror neurons,” the code for both the production of manual reaching movements and the perception of the same movements performed by others. This system is bilateral in monkeys, but predominantly left-hemispheric in humans, and in humans is involved with vocalization as well as manual actions. There is evidence that Broca's area is enlarged on the left side in Homo habilis, suggesting that a link between gesture and vocalization may go back at least two million years, although other evidence suggests that speech may not have become fully autonomous until Homo sapiens appeared some 170,000 years ago, or perhaps even later. The removal of manual gesture as a necessary component of language may explain the rapid advance of technology, allowing late migrations of Homo sapiens from Africa to replace all other hominids in other parts of the world, including the Neanderthals in Europe and Homo erectus in Asia. Nevertheless, the long association of vocalization with manual gesture left us a legacy of right-handedness. Key Words: cerebral dominance; gestures; handedness; hominids; language evolution; primates; speech; vocalization. (shrink)

It is argued that colour name strategy, object name strategy, and chunking strategy in memory are all aspects of the same general phenomena, called stereotyping, and this in turn is an example of a know-how representation. Such representations are argued to have their origin in a principle called the minimum duplication of resources. For most the subsequent discussions existence of colour name strategy suffices. It is pointed out that the BerlinA- KayA universal partial ordering of colours and the frequency of (...) traffic accidents classified by colour are surprisingly similar; a detailed analysis is not carried out as the specific colours recorded are not identical. Some consequences of the existence of a name strategy for the philosophy of language and mathematics are discussed: specifically it is argued that in accounts of truth and meaning it is necessary throughout to use real numbers as opposed to bi-valent quantities; and also that the concomitant label associated with sentences should not be of unconditional truth, but rather several real-valued quantities associated with visual communication. The implication of real-valued truth quantities is that the Continuum Hypothesis of pure mathematics is side-stepped, because real valued quantities occur ab initio. The existence of name strategy shows that thought/sememes and talk/phonemes can be separate, and this vindicates the assumption of thought occurring before talk used in psycho-linguistic speech production models. (shrink)

Contrary to Müller's claims, and in support of modular theories, genetic factors play a substantial and significant role in language. The finding that some children with specific language impairment (SLI) have nonlinguistic impairments may reflect improper diagnosis of SLI or impairments that are secondary to linguistic impairments. Thus, such findings do not argue against the modularity thesis. The lexical/functional distinction appears to be innate and specifically linguistic and could be instantiated in either symbolic or connectionist systems.

Müller's goal of bringing neuroscience to bear on controversies in linguistics is laudable. However, some of his specific proposals about innateness and autonomy are misguided. Recent studies on the neurobiology of regular and irregular inflectional morphology indicate that these two linguistic processes are subserved by anatomically and physiologically distinct neural subsystems, whose functional organization is likely to be under direct genetic control rather than assembled by strictly epigenetic factors.

Two central assumptions of current models of language acquisition were addressed in this study: (1) knowledge of linguistic structure is "mapped onto" earlier forms of non-linguistic knowledge; and (2) acquiring a language involves a continuous learning sequence from early gestural communication to linguistic expression. The acquisition of the first and second person pronouns ME and YOU was investigated in a longitudinal study of two deaf children of deaf parents learning American Sign Language (ASL) as a first language. Personal pronouns in (...) ASL are formed by pointing directly to the addressee (YOU) or self (I or ME), rather than by arbitrary symbols. Thus, personal pronouns in ASL resemble paralinguistic gestures that commonly accompany speech and are used prelinguistically by both hearing and deaf children beginning around 9 months. This provides a means for investigating the transition from prelinguistic gestural to linguistic expression when both gesture and language reside in the same modality.\nThe results indicate that deaf children acquired knowledge of personal pronouns over a period of time, displaying errors similar to those of hearing children despite the transparency of the pointing gestures. The children initially (ages 10 and 12 months) pointed to persons, objects, and locations. Both children then exhibited a long avoidance period, during which one function of the pointing gesture (pointing to self and others) dropped out completely. During this period their language and cognitive development were otherwise entirely normal, and they continued to use other types of pointing (e.g., to objects). When pointing to self and others returned, it was marked with errors typical of hearing children; one child exhibited consistent pronoun reversal errors, thinking the YOU point referred to herself, while the other child exhibited reversal errors inconsistently. Evidence from experimental tasks conducted with the first child revealed that pronoun errors occurred in comprehension as well. Full control of the ME and YOU pronouns was not achieved until 25-27 months, around the same time when hearing children master these forms. Thus, the study provides evidence for a discontinuity in the child's transition from prelinguistic to linguistic communication. It is argued that aspects of linguistic structure and its acquisition appear to involve distinct, language-specific knowledge. (shrink)

A common method of improving how well understood a theory is, is by comparing it to another theory which has been better developed. Radical interpretation is a theory which attempts to explain how communication has meaning. Radical interpretation is treated as another time dependent theory and compared to the time dependent theory of biological evolution. Several similarities and differences are uncovered. Biological evolution can be gradual or punctuated. Whether radical interpretation is gradual or punctuated depends on how the question is (...) framed: on the coarse-grained time scale it proceeds gradually, but on the fine-grained time scale it proceeds by punctuated equilibria. Biological evolution proceeds by natural selection, the counterpart to this is the increase in both correspondence and coherence. Exaption, mutations, and spandrels have counterparts metaphor, speech errors, and puns respectively. Homologous and analogs have direct counterparts in specific words. The most important differences originate from the existence of a unit of inheritance occurring in biological evolution - there is no such unit in language. (shrink)

A common method of making a theory more understandable is to compare it to another theory that has been better developed. Radical interpretation is a theory that attempts to explain how communication has meaning. Radical interpretation is treated as another time-dependent theory and compared to the time-dependent theory of biological evolution. The main reason for doing this is to find the nature of the time dependence; producing analogs between the two theories is a necessary prerequisite to this and brings up (...) many problems. When the nature of the time dependence is better known it might allow the underlying mechanism to be uncovered. Several similarities and differences are uncovered, and there appear to be more differences than similarities. (shrink)

This article presents an interview method which enables us to bring a person, who may not even have been trained, to become aware of his or her subjective experience, and describe it with great precision. It is focused on the difficulties of becoming aware of one’s subjective experience and describing it, and on the processes used by this interview technique to overcome each of these difficulties. The article ends with a discussion of the criteria governing the validity of the descriptions (...) obtained, and then with a brief review of the functions of these descriptions. (shrink)

In this article, we propose that gestures play an important role in the connection between sensorimotor experience and language. Gestures may be the link between bodily experience and verbal expression that advocates of embodied cognition have postulated. In a developmental sequence of communicative action, gestures, which are initially similar to action sequences, substantially shorten and represent actions in metonymic form. In another process, action sequences are based on kinesthetic schemata that themselves find their metaphoric expression in language. Again, gestures enact (...) kinesthetic schemata that are correlated with verbal expressions. Examples from a large database are used to illustrate the various processes by means of which language arises when students conduct school science investigations. (shrink)

People frequently gesture when a word is on the tip of their tongue (TOT), yet research is mixed as to whether and why gesture aids lexical retrieval. We tested three accounts: the lexical retrieval hypothesis, which predicts that semantically related gestures facilitate successful lexical retrieval; the cognitive load account, which predicts that matching gestures facilitate lexical retrieval only when retrieval is hard, as in the case of a TOT; and the motor movement account, which predicts that any motor movements should (...) support lexical retrieval. In Experiment 1 (a between‐subjects study; N = 90), gesture inhibition, but not neck inhibition, affected TOT resolution but not overall lexical retrieval; participants in the gesture‐inhibited condition resolved fewer TOTs than participants who were allowed to gesture. When participants could gesture, they produced more representational gestures during resolved than unresolved TOTs, a pattern not observed for meaningless motor movements (e.g., beats). However, the effect of gesture inhibition on TOT resolution was not uniform; some participants resolved many TOTs, while others struggled. In Experiment 2 (a within‐subjects study; N = 34), the effect of gesture inhibition was traced to individual differences in verbal, not spatial short‐term memory (STM) span; those with weaker verbal STM resolved fewer TOTs when unable to gesture. This relationship between verbal STM and TOT resolution was not observed when participants were allowed to gesture. Taken together, these results fit the cognitive load account; when lexical retrieval is hard, gesture effectively reduces the cognitive load of TOT resolution for those who find the task especially taxing. (shrink)

Using a cross‐modal semantic priming paradigm, both experiments of the present study investigated the link between the mental representations of iconic gestures and words. Two groups of the participants performed a primed lexical decision task where they had to discriminate between visually presented words and nonwords (e.g., flirp). Word targets (e.g., bird) were preceded by video clips depicting either semantically related (e.g., pair of hands flapping) or semantically unrelated (e.g., drawing a square with both hands) gestures. The duration of gestures (...) was on average 3,500 ms in Experiment 1 but only 1,000 ms in Experiment 2. Significant priming effects were observed in both experiments, with faster response latencies for related gesture–word pairs than unrelated pairs. These results are consistent with the idea of interactions between the gestural and lexical representational systems, such that mere exposure to iconic gestures facilitates the recognition of semantically related words. (shrink)

This bold and brilliant book asks the ultimate question of the life sciences: How did the human mind acquire its incomparable power? In seeking the answer, Merlin Donald traces the evolution of human culture and cognition from primitive apes to the era of artificial intelligence, and presents an original theory of how the human mind evolved from its presymbolic form. In the emergence of modern human culture, Donald proposes, there were three radical transitions. During the first, our bipedal but still (...) apelike ancestors acquired "mimetic" skill—the ability to represent knowledge through voluntary motor acts—which made Homo erectus successful for over a million years. The second transition—to "mythic" culture —coincided with the development of spoken language. Speech allowed the large-brained Homo sapiens to evolve a complex preliterate culture that survives in many parts of the world today. In the third transition, when humans constructed elaborate symbolic systems ranging from cuneiforms, hieroglyphics, and ideograms to alphabetic languages and mathematics, human biological memory became an inadequate vehicle for storing and processing our collective knowledge. The modern mind is thus a hybrid structure built from vestiges of earlier biological stages as well as new external symbolic memory devices that have radically altered its organization. According to Donald, we are symbol-using creatures, more complex than any that went before us, and we may have not yet witnessed the final modular arrangement of the human mind. (shrink)

Healey et al. introduce the special issue with a brief overview of work on communication in the Cognitive Sciences and some of the historical and conceptual influences that have marginalized the study of miscommunication. Drawing on more recent work in Cognitive Science and Conversation Analysis they argue that miscommunication is in fact a highly structured, ubiquitous phenomenon that is fundamental to human interaction.

A persistent controversy in language evolution research has been whether language emerged in the gestural-visual or in the vocal-auditory modality. A “dialectic” solution to this age-old debate has now been gaining ground: language was fully multimodal from the start and remains so to this day. In this paper, we show this solution to be too simplistic and outline a more specific theoretical proposal, which we designate as pantomime-first. To decide between the multimodal-first and pantomime-first alternatives, we review several lines of (...) interdisciplinary evidence and complement it with a cognitive-semiotic experiment. In the study, the participants saw – and then matched to hand-drawn images – recordings of short transitive events enacted by 4 actors in two conditions: visual and multimodal. Significantly, the matching accuracy was greater in the visual than the multimodal condition, though a follow-up experiment revealed that the emotional profiles of the events enacted in the multimodal condition could be reliably detected from the sound alone. We see these results as supporting the proposed pantomime-first scenario. (shrink)

We agree with Müller's epigenetic view of evolution and ontogeny and applaud his multilevel perspective. With him, we stress the importance in ontogeny of progressive specialisation rather than prewired structures. However, we argue that he slips from “speech” to “language” and that, in seeking homologies, these two levels need to be kept separate in the analysis of evolution and ontogeny.

Evidence is presented from a polyglot savant to suggest that double dissociations between linguistic and nonverbal abilities are more important than Müller's target article implies. It is also argued that the special nature of syntax makes its assimilation to other aspects of language or to nonhuman communication systems radically implausible.

The synthetic position adopted by Müller is weakened by a large number of overinterpretations and misrepresentations, together with a caricatured view of innateness and modularity.

Because Müiller fails to distinguish between two senses of the term “autonomy,” there is a danger that his results will be misinterpreted by both linguists and neuroscientists. Although he may very well have been successful in refuting one sense of autonomy, he may actually have helped to provide an explanation for the correctness of autonomy in its other sense.

I enlarge on the theme that the brain mechanisms required for languageand other aspects of the human mind evolved through selective changes in the regulatory genes governing growth. Extension of the period of postnatal growth increases the role of the environment in structuring the brain, and spatiotemporal programming (heterochrony) ofgrowth might explain hierarchical representation, hemispheric specialization, and perhaps sex differences.

Research on interaction in speaking assessment suggests that both verbal and nonverbal interaction are integral parts of the construct of interactional competence (Galaczi & Taylor, 2018; Plough et al., 2018; Young, 2011). However, little has been done to investigate which features significantly contribute to interactional competence scores. This study, therefore, examined which interaction features that raters noticed in individual scripted interview and paired discussion tasks to gain an insight into the interactional competence construct, providing validity evidence for an inclusion of (...) interactional competence in speaking assessment. Sixty-eight student performances were rated based on interaction rating scales. Exploratory factor analysis revealed four factors: nonverbal communication, topic management, interactional management, and interactive listening. Logistic regressions showed that while raters attended to more topic management features in the individual scripted interview task, they noticed more interactional management features in the paired discussion task. Simple regressions showed that nonverbal communication and topic management features predicted interactional competence scores in the individual scripted interview task, whereas nonverbal communication, topic management, interactional management, and interactive listening features were predictors of scores in the paired discussion task. The findings suggest that both nonverbal and verbal interaction features are important in the interactional competence construct with the paired task providing test-takers with more opportunities to demonstrate their interactional ability. (shrink)

Investigations of iconicity in language, whereby interactants coordinate meaningful bodily actions to create resemblances, are prevalent across the human communication sciences. However, when it comes to analysing and comparing iconicity across different interactions and modes of communication, it is not always clear we are looking at the same thing. For example, tokens of spoken ideophones and manual depicting actions may both be analysed as iconic forms. Yet spoken ideophones may signal depictive and descriptive qualities via speech, while manual actions may (...) signal depictive, descriptive, and indexical qualities via the shape, movement, and placement of the hands in space. Furthermore, each may co-occur with other semiotics articulated with the face, hands, and body within composite utterances. The paradigm of iconicity as a single property is too broad and coarse for comparative semiotics, as important details necessary for understanding the range of human communicative potentialities may be masked. Here, we draw on semiotic approaches to language and communication, including the model of language as signalled via describing, indicating and/or depicting and the notion of non-referential indexicality, to illustrate the multidimensionality of iconicity in co-present interactions. This builds on our earlier proposal for analysing how different methods of semiotic signalling are combined in multimodal language use. We discuss some implications for the language and communication sciences and explain how this approach may inform a theory of biosemiotics. (shrink)

This study investigates whether there is a relation between the semantics of linguistic expressions that indicate temporal distance and the spatial properties of their co-speech gestures. To this date, research on time gestures has focused on features such as gesture axis, direction, and shape. Here we focus on a gesture property that has been overlooked so far: the distance of the gesture in relation to the body. To achieve this, we investigate two types of temporal linguistic expressions are addressed: proximal (...) (e.g., near future, near past) and distal (e.g., distant past, distant future). Data was obtained through the NewsScape library, a multimodal corpus of television news. A total of 121 co-speech gestures were collected and divided into the two categories. The gestures were later annotated in terms of gesture space and classified in three categories: (i) center, (ii) periphery, and (iii) extreme periphery. Our results suggest that gesture and language are coherent in the expression of temporal distance: when speakers locate an event far from them, they tend to gesture further from their body; similarly, when locating an event close to them, they gesture closer to their body. These results thus reveal how co-speech gestures also reflect a space-time mapping in the dimension of distance. (shrink)

Müller's review of the neuroscientific evidence undermines nativist claims for autonomous syntax and the argument from the poverty of the stimulus. Generativists will appeal to data from language acquisition, but here too there is growing evidence against the nativist position. Epigenetic naturalism, the developmental alternative to nativism, can be extended to epigenetic socionaturalism, acknowledging the importance of sociocultural processes in language and cognitive development.

Müller attempts to downplay cases of dissociation between language and cognition as evidence against the modularity of language. We review cases of associations between verbal and nonverbal abilities as further evidence against the notion of language as an autonomous subsystem. We also point out a discrepancy between his proposal of homologies between nonhuman primates' communication and human language and recent proposals on the evolution of language.

Speakers frequently produce elaborate hand movements during talk that have been shown to serve a communicative function. Nevertheless, two-thirds of the semantic content of these hand movements is encoded linguistically elsewhere in the discourse . The present experiment demonstrated that while 62.9% of semantic information in gesture was elsewhere, most gestures retained at least one semantic feature that was never represented linguistically. Semantic features were more explicit when they occurred in gesture than when represented linguistically. Even in cases where the (...) imagistic gesture appeared somewhat redundant, gesture at the narrative level preserves a discernable communicative function. (shrink)

This article addresses the issue of non-verbal communication in the light of the Gricean conceptualisation of intentionally conveyed meanings. The first goal is to testify that non-verbal cues can be interpreted as nonnatural meanings and speaker meanings, which partake in intentional communication. Secondly, it is argued that non-verbal signals, exemplified by gestures, are similar to utterances which generate the communicator's what is said and/or conversational implicatures, together with their different subtypes and manifestations. Both of these objectives necessitate a critical overview (...) of Grice's work on the focal aspects of meaning and communication, also on the strength of neo-Gricean research. (shrink)

Using a cross-modal semantic priming paradigm, both experiments of the present study investigated the link between the mental representations of iconic gestures and words. Two groups of the participants performed a primed lexical decision task where they had to discriminate between visually presented words and nonwords (e.g., flirp). Word targets (e.g., bird) were preceded by video clips depicting either semantically related (e.g., pair of hands flapping) or semantically unrelated (e.g., drawing a square with both hands) gestures. The duration of gestures (...) was on average 3,500 ms in Experiment 1 but only 1,000 ms in Experiment 2. Significant priming effects were observed in both experiments, with faster response latencies for related gesture–word pairs than unrelated pairs. These results are consistent with the idea of interactions between the gestural and lexical representational systems, such that mere exposure to iconic gestures facilitates the recognition of semantically related words. (shrink)

One can disagree with Müller that it is neurobiologically questionable to suppose that human language is innate, specialized, and species-specific, yet agree that the precise brain mechanisms controlling language in any individual will be influenced by epigenesis and genetic variability, and that the interplay between inherited and acquired aspects of linguistic capacity deserves to be investigated.

Researchers in the fields of sign language and gesture studies frequently present their participants with video stimuli showing actors performing linguistic signs or co-speech gestures. Up to now, such video stimuli have been mostly controlled only for some of the technical aspects of the video material, leaving open the possibility that systematic differences in video stimulus materials may be concealed in the actual motion properties of the actor’s movements. Computer vision methods such as OpenPose enable the fitting of body-pose models (...) to the consecutive frames of a video clip and thereby make it possible to recover the movements performed by the actor in a particular video clip without the use of a point-based or markerless motion-tracking system during recording. The OpenPoseR package provides a straightforward and reproducible way of working with these body-pose model data extracted from video clips using OpenPose, allowing researchers in the fields of sign language and gesture studies to quantify the amount of motion pertaining only to the movements performed by the actor in a video clip. These quantitative measures can be used for controlling differences in the movements of an actor in stimulus video clips or, for example, between different conditions of an experiment. In addition, the package also provides a set of functions for generating plots for data visualization, as well as an easy-to-use way of automatically extracting metadata from large sets of video files. (shrink)