Past research has suggested that those spontaneous movements of the human hand made during talk convey significant semantic information over and above the speech, at least when the unit of speech analyzed is the individual clause. However, no previous research has tested whether this information is represented linguistically elsewhere in the narrative . The first study, reported here, uses an experimental procedure to identify which specific imagistic gestures add semantic information to the speech. The second study analyzes whether the specific (...) gestures still do this when respondents hear the whole narrative. It was found that two thirds of the semantic information, thought to be carried by the gestures, is, in fact, represented in the linguistic discourse, or is inferable from it. However, one third of the additional semantic information contained in the gestures is not represented linguistically in the narrative nor is it inferable from it. In other words, a proportion of the imagistic gestures that accompany speech are absolutely critical to semantic communication. (shrink)

Name der Zeitschrift: Semiotica Jahrgang: 2017 Heft: 218 Seiten: 21-64.

This study investigated gesture–speech integration among adolescents who are deaf or hard of hearing and those with typical hearing. Thirty-eight adolescents performed a Stroop-like task in which they watched 120 short video clips of gestures and actions twice at random. Participants were asked to press one button if the visual content of the speaker’s movements was related to a written word and to press another button if it was unrelated to a written word while accuracy rates and response times were (...) recorded. We found stronger GSI effects among DHH participants than hearing participants. The semantic congruency effect was significantly larger in DHH participants than in hearing participants, and results of our experiments indicated a significantly larger gender congruency effect in DHH participants as compared to hearing participants. Results of this study shed light on GSI among DHH individuals and suggest future avenues for research examining the impact of gesture on language processing and communication in this population. (shrink)

Climate change is an anthropogenic existential threat that provokes extreme concern among climate scientists, but not, it seems, among all member of the public. Here, there is considerably more variability in level of concern and, it appears, in everyday sustainable behavior. But how does personality affect this variability in behavior? And how are underlying personality states like dispositional optimism linked to more sustainable everyday practices? Research in clinical psychology has suggested that dispositional optimism is a very positive personality characteristic associated (...) with higher levels of hope and resilience, but applied research from other domains has reported that optimists can, on occasion, bury their heads in the sand and avoid attending to external threats, like climate change, in order to maintain mood state. So are optimists more immune to climate change messaging than non-optimists? And do they make fewer sustainable choices? A series of experimental studies, manipulating signifiers of carbon footprint (Study 1) and eco labels on products (Study 2) found that optimists made more sustainable choices than non-optimists and that both groups were influenced equally by climate change film clips in terms of sustainable choices (Study 1). Optimists also displayed a false consensus effect, overestimating the proportion of people who would behave more sustainably like themselves (Study 3). Given that global problems like climate change need concerted, cooperative effort, these optimistic beliefs about how others behave could be adaptive in the long-run. Designing climate change messages to appeal to optimists might be a critical consideration for the future. (shrink)

Dans une communication interpersonnelle, l’échange se fait avec des mots mais aussi avec le corps. Les comportements corporels sont souvent considérés comme un langage dont le code est directement interprétable. Dans la plupart des cas, les comportements corporels sont codés de manière continue, probable et iconique. Il faut alors prendre en compte le processus d’inférence à la base d’une représentation de l’état de la personne qui interagit. L’article présente les outils théoriques et méthodologiques de la psychologie qui permettent d’analyser et (...) interpréter les comportements non verbaux. Il propose une perspective d’interprétation qui tient compte des fonctions des comportements corporels dans la communication et du contexte dans lequel ils sont produits. (shrink)

We examined whether children's ability to integrate speech and gesture follows the pattern of a broader developmental shift between 3- and 5-year-old children regarding the ability to process two pieces of information simultaneously. In Experiment 1, 3-year-olds, 5-year-olds, and adults were presented with either an iconic gesture or a spoken sentence or a combination of the two on a computer screen, and they were instructed to select a photograph that best matched the message. The 3-year-olds did not integrate information in (...) speech and gesture, but 5-year-olds and adults did. In Experiment 2, 3-year-old children were presented with the same speech and gesture as in Experiment 1 that were produced live by an experimenter. When presented live, 3-year-olds could integrate speech and gesture. We concluded that development of the integration ability is a part of the broader developmental shift; however, live-presentation facilitates the nascent integration ability in 3-year-olds. (shrink)

This article presents a multimodal video corpus with the principal aim to model and predict the effects of aging in Mild Cognitive Impairment situation on pragmatic and communicative skills. We take as observable variables the verbal pragmatic markers and non-verbal pragmatic markers. This approach, at the interface of the psycholinguistics, cognitive sciences and rehabilitation medicine (speech-language pathology and therapy) is part of a longitudinal research process in an ecological situation (interviews conducted by close intimate of the elderly).In the first part (...) of the article we present the linguistic, cognitive and social characteristics of aging in its continuum up to mild cognitive impairment and pathological disorders such as Alzheimer’s disease. In the second part, we develop a multimodal approach, in particular to inform and enrich speech and language therapy knowledge. Finally, we present our experimental design and preliminary results on two female participants over 75 years of age with mild cognitive impairment.Our general findings indicate that with aging, verbal pragmatic markers acquire an interactive function that allows people with Mild Cognitive Impairment to maintain intersubjective relationships with their interlocutor. In addition, at the non-verbal level, gestural manifestations are increasingly mobilized over time with a preference for non-verbal pragmatic markers with a referential function and an interactive function. One such non-verbal manifestation compensates for naming deficits, planning difficulties, discursive hitches; while another optimizes and maintains the interaction with the interlocutor.Clinicians have a duty to develop their professional practice through an evidence-based clinical approach whose main objective is to reconcile clinical practice with the best evidence from research (Dollaghan 2007). In the case of speech-language pathology, clinicians consider themselves very limited in this approach (Lof 2011; McCurtin 2011), especially for patients with Mild Cognitive Impairment (Mungas et al. 2010; Hopper 2013; Morello 2017) and more specifically when it comes to assessing or supporting language functions (Cummings 2014).The studies focusing on Mild Cognitive Impairment require longitudinal corpora i) to understand the naturally occurring evolutions in subjects, ii) the implication of the cognitive reserve in each individual, and iii) to take advantage of these parameters as evidence for research and earlier rehabilitation. We aim to show the benefits of linguistic and interactional scientific investigation methods through fragile aging, for health professionals and everyday caregivers. (shrink)