This study investigates moments in which one participant in an interaction embodies that he is “doing thinking,” a display that is commonly referred to as “thinking face. ” From an interactional perspective, it is assumed that embodied displays of “doing thinking” are a recurring social practice and serve interactive functions. While previous studies have examined thinking faces primarily in word searches and storytelling, the present study focuses on argumentative activities, in which children engage in processes of joint decision-making. The paper (...) has two interrelated aims. The first aim is to describe how multiple modalities—beyond the face—are temporally coordinated to create multimodal gestalts of “doing thinking.” It is shown that thinking displays not only involve dynamic imaginative gaze but also stylized bodily postures. The second aim is to generate knowledge about the functions of thinking displays in children's argumentative activities. The analysis describes how both speakers and recipients use thinking displays in different turn positions and align them with verbal talk or silence. The data for this study comprise video recordings of decision-making processes in groups of older children. Drawing on a multimodal approach to situated interaction, it will be proposed that embodied displays of “doing thinking” provide a resource to shape participation frameworks, mark epistemic stances and create epistemic ecologies for collaborative reasoning. By investigating thinking displays in a particular conversational activity, the study sheds light on the diversity and context-sensitive functionality of thinking displays. It also contributes to recent research on children's collaborative reasoning as an embodied discursive practice. (shrink)

Are there individual tendencies in convergence, such that some speakers consistently converge more than others? Similarly, are there natural “leaders,” speakers with whom others converge more? Are such tendencies consistent across different linguistic characteristics? We use the Switchboard Corpus to perform a large‐scale convergence study of speakers in multiple conversations with different interlocutors, across six linguistic characteristics. Because each speaker participated in several conversations, it is possible to look for individual differences in speakers' likelihood of converging and interlocutors' likelihood of (...) eliciting convergence. We only find evidence for individual differences by interlocutor, not by speaker: There are natural leaders of convergence, who elicit more convergence than others across characteristics and across conversations. The lack of similar evidence for speakers who converge more than others suggests that social factors have a stronger effect in mediating convergence than putative individual tendencies in producing convergence, or that such tendencies are characteristic‐specific. (shrink)

Albert and De Ruiter provide an introduction to the Conversation Analytic approach to ‘repair’: the ways in which people detect and deal with troubles in speaking, hearing and understanding in conversation. They explain the basic turn‐taking structures involved, provide examples, explain recent developments in the field and highlight some important points of contact and contrast with work in the Cognitive Sciences.

Paulina Sliwa (2015) argues that knowing why p is necessary and sufficient for understanding why p. She tries to rebut recent attacks against the necessity and sufficiency claims, and explains the gradability of understanding why in terms of knowledge. I argue that her attempts do not succeed, but I indicate more promising ways to defend reductionism about understanding why throughout the discussion.

Dialog is a joint action at different levels. At the highest level, the goal of interlocutors is to align their mental representations. This emerges from joint activity at lower levels, both concerned with linguistic decisions (e.g., choice of words) and nonlinguistic processes (e.g., alignment of posture or speech rate). Because of the high‐level goal, the interlocutors are particularly concerned with close coupling at these lower levels. As we illustrate with examples, this means that imitation and entrainment are particularly pronounced during (...) interactive communication. We then argue that the mechanisms underlying such processes involve covert imitation of interlocutors’ communicative behavior, leading to emulation of their expected behavior. In other words, communication provides a very good example of predictive emulation, in a way that leads to successful joint activity. (shrink)

Cognitive Science, Volume 46, Issue 2, February 2022.

Speakers’ perception of a visual scene influences the language they use to describe it—which objects they choose to mention and how they characterize the relationships between them. We show that visual complexity can either delay or facilitate description generation, depending on how much disambiguating information is required and how useful the scene's complexity can be in providing, for example, helpful landmarks. To do so, we measure speech onset times, eye gaze, and utterance content in a reference production experiment in which (...) the target object is either unique or non-unique in a visual scene of varying size and complexity. Speakers delay speech onset if the target object is non-unique and requires disambiguation, and we argue that this reflects the cost of deciding on a high-level strategy for describing it. The eye-tracking data demonstrate that these delays increase when speakers are able to conduct an extensive early visual search, implying that when speakers scan too little of the scene early on, they may decide to begin speaking before becoming aware that their description is underspecified. Speakers’ content choices reflect the visual makeup of the scene—the number of distractors present and the availability of useful landmarks. Our results highlight the complex role of visual perception in reference production, showing that speakers can make good use of complexity in ways that reflect their visual processing of the scene. (shrink)

How good are we at understanding what others communicate? It often seems to us, at least, that we understand quite well what others convey when speaking in a familiar language. However, a growing body of evidence from the psychology of language suggests that in various communicative settings comprehenders routinely form linguistic representations that are underdetermined, “sketchy”, “shallow” or imprecise, often without noticing it. The paper discusses some important consequences of this evidence. Following recent discussions in this strand of research, I (...) outline how the evidence is currently best interpreted as supporting a view on which operating at a certain level of imprecision and underdetermination is a functional feature of the system responsible for comprehension of linguistic utterances in humans. That this kind of imprecision and underdetermination is part and parcel of linguistic interactions, makes the exact success rate of comprehension particularly hard to estimate. This poses a unique and interesting challenge for assessing the quality of linguistic comprehension. Understanding what a speaker intended to convey with a linguistic utterance may be less transparent than it appears to us. I will discuss the extent to which this evidence may lead to pessimism about how good we are at comprehending what others communicate. However, as I will argue in the last part of the paper, in various cases language users can be sensitive to some types of imprecision and underdetermination in comprehension and make up for it by means of various forms of post hoc deliberation. I will describe some such clarificatory contexts and end by charting a map of important issues that require further investigation. (shrink)

There is plenty of evidence that speech and gesture form a tightly integrated system, as reflected in parallelisms in language production, comprehension, and development ( McNeill, 1992 ; Kendon, 2004 ). Yet, it is a common assumption that speakers use gestures to compensate for their expressive difficulties, a notion found in developmental studies of both first and second language acquisition, and in theoretical proposals concerning the gesture-speech relationship. If gestures are compensatory, they should mainly occur in disfluent stretches of speech. (...) However, the evidence is sparse and conflicting. This study extends previous studies and tests the putative compensatory role of gestures by comparing the gestural behavior in fluent vs. disfluent stretches of narratives by competent speakers in two languages (Dutch and Italian), and by language learners (children and adult L2 learners). The results reveal that (1) in all groups speakers overwhelmingly produce gestures during fluent speech and only rarely during disfluencies. However, L2 learners are significantly more likely to gesture in disfluency than the other groups; (2) in all groups gestures during disfluencies tend to be holds; (3) in all groups the rare gestures completed in disfluencies have both referential and pragmatic functions. Overall, the data strongly suggest that when speech stops, so does gesture. The findings constitute an important challenge to both gesture and language acquisition theories assuming a mainly (lexical) compensatory role for (referential) gestures. Instead, the results provide strong support for the notion that speech and gestures form an integrated system. (shrink)

Dialog is a joint action at different levels. At the highest level, the goal of interlocutors is to align their mental representations. This emerges from joint activity at lower levels, both concerned with linguistic decisions (e.g., choice of words) and nonlinguistic processes (e.g., alignment of posture or speech rate). Because of the high‐level goal, the interlocutors are particularly concerned with close coupling at these lower levels. As we illustrate with examples, this means that imitation and entrainment are particularly pronounced during (...) interactive communication. We then argue that the mechanisms underlying such processes involve covert imitation of interlocutors’ communicative behavior, leading to emulation of their expected behavior. In other words, communication provides a very good example of predictive emulation, in a way that leads to successful joint activity. (shrink)

The present study aims to explore the status of filled pauses as pragmatic markers by taking into account their accompanying visual and gestural behavior. This aspect has not yet been widely explored, and the current study breaks new ground by demonstrating that the analysis of gaze and gesture can shed substantial light on the pragmatic functions of filled pauses and other pausing phenomena. Filled pauses (FPs) serve several pragmatic functions in speech, mainly planning but also turn-holding and emphasis, and their (...) use is also highly determined by register and setting. This research explores the different pragmatic functions of FPs by analyzing their distribution in two different communication settings (conversation vs presentation setting), combining a quantitative and a qualitative methodology, following Kosmala & Crible’s (2021) study on the same data. Particular attention was paid to the co-occurring gestural activity of uh/ums and gaze behavior. Analyses show that the pragmatic functions of FPs are also embodied in kinetic activities which differ according to the setting: more pragmatic and referential ones were found during FPs in conversation than in the presentation setting, as well as more eye-contact, which reflects their potential communicative role during interactional sequences. (shrink)

This experimental study sets out to determine whether people detect click sounds in American English. Recent research has documented the use of non-phonemic clicks in a variety of languages to fulfill a range of functions such as sequence management or signaling searches and different types of attitudinal stance. While these clicks are acoustically salient and have been reported to occur with a frequency of up to 14 per minute in British English, they have not been widely investigated until relatively recently. (...) For this experiment, we designed video stimuli consisting of A and B pairs of approximately 10 seconds of speech, one with a click and the other with the click edited out. We gave 118 participants a questionnaire and asked if they could detect a difference between the pairs of videos. The results indicate that the majority of participants, between 79% and 86%, do not detect click sounds. (shrink)

Speech disfluencies can signal that a speaker is about to refer to something difficult to name. In two experiments, we found evidence that 4-year-olds, like adults, flexibly interpret a particular partner’s disfluency based on their estimate of that partner’s knowledge, derived from the preceding conversation. In entrainment trials, children established partner-specific shared knowledge of names for tangram pictures with one or two adult interlocutors. In each test trial, an adult named one of two visible tangrams either fluently or disfluently while (...) children’s eye-movements were monitored. We manipulated speaker knowledge in the test trials. In Experiment 1, the test-trial speaker was the same speaker from entrainment or a naïve experimenter; in Experiment 2, the test-trial speaker had been one of the child’s partners in entrainment and had seen half of the tangrams. When hearing disfluent expressions, children looked more at a tangram that was unfamiliar from the speaker’s perspective; this systematic disfluency effect disappeared in Experiment 1 when the speaker was entirely naïve, and depended on each speaker’s entrainment experience in Experiment 2. These findings show that 4-year-olds can keep track of two different partners’ knowledge states, and use this information to determine what should be difficult for a particular partner to name, doing so efficiently enough to guide online interpretation of disfluent speech. (shrink)

People frequently gesture when a word is on the tip of their tongue (TOT), yet research is mixed as to whether and why gesture aids lexical retrieval. We tested three accounts: the lexical retrieval hypothesis, which predicts that semantically related gestures facilitate successful lexical retrieval; the cognitive load account, which predicts that matching gestures facilitate lexical retrieval only when retrieval is hard, as in the case of a TOT; and the motor movement account, which predicts that any motor movements should (...) support lexical retrieval. In Experiment 1 (a between‐subjects study; N = 90), gesture inhibition, but not neck inhibition, affected TOT resolution but not overall lexical retrieval; participants in the gesture‐inhibited condition resolved fewer TOTs than participants who were allowed to gesture. When participants could gesture, they produced more representational gestures during resolved than unresolved TOTs, a pattern not observed for meaningless motor movements (e.g., beats). However, the effect of gesture inhibition on TOT resolution was not uniform; some participants resolved many TOTs, while others struggled. In Experiment 2 (a within‐subjects study; N = 34), the effect of gesture inhibition was traced to individual differences in verbal, not spatial short‐term memory (STM) span; those with weaker verbal STM resolved fewer TOTs when unable to gesture. This relationship between verbal STM and TOT resolution was not observed when participants were allowed to gesture. Taken together, these results fit the cognitive load account; when lexical retrieval is hard, gesture effectively reduces the cognitive load of TOT resolution for those who find the task especially taxing. (shrink)

Might Interjections Encode Concepts? More Questions than Answers This paper reflects on the conceptual nature of interjections. Although there are convincing reasons to claim that interjections do not encode concepts, arguments can be adduced to question such claim. In fact, some pragmatists have contended that they may be conceptual elements. After reviewing both the non-conceptualist and conceptualist approaches to interjections, this paper discusses some reasons that can be given to reconsider the conceptuality of interjections. Nevertheless, it adopts an intermediate standpoint (...) by arguing that the heterogeneity of interjections, with items incorporated from other lexical categories, and the openness of the word class they constitute, which results in the coinage of certain interjections or the innovative usage of some elements, could indicate the existence of a continuum of more and less conceptual items. In any case, this paper suggests that those items with conceptual content would not encode full concepts, but some schematic material requiring subsequent pragmatic adjustments. (shrink)

Even though hesitations (e.g., um/uh) were historically perceived as involuntary non-linguistic items (e.g., Maclay & Osgood 1959), more recently, a number of scholars have suggested that hesitations can behave like (a) lexical items (e.g., Clark & Fox Tree 2002), and (b) at least in some contexts and with some functions as grammatical items like suffixes/clitics (Kirjavainen, Crible & Beeching 2022; Tottie 2017). The current study contributes to this body of work and presents two spoken language corpus analyses (frequency analysis; network (...) analysis) investigating the nature of the Finnish planning particle tota. Our results suggest that tota is more similar to grammatical items than lexical items. (shrink)

In this study, we investigate the three-dot sign as a discourse marker (DM) with textual, subjective and intersubjective discourse functions. As a graphical marker that is used across languages, the three-dot sign is especially suitable for comparative studies and dynamics in language contact. Our corpus study targeting instant messages of different languages (English, German, Greek, Russian, Turkish) and speaker groups (monolinguals and bilingual heritage speakers) suggests that graphical DMs are prone to cross-linguistic influence. This depends on the specific contact situation (...) and does not seem to be a general effect of bilingualism. The societal status of a language might further influence the use of such markers in digital informal writing. Language-specific developments that relate to emerging functions indicate that functional versatility promotes frequent use of (graphical) DMs. (shrink)

This article aims to make a philosophical contribution to the understanding of the communicative dimensions and functions of faces and facial expressions. First, I will refer to the expressivist and socio-communicative theories of FEs, and to a proposal to unify them under a pragmatic approach based on the theory of speech acts. Subsequently, I will examine the characterization of faces and FEs as social and behavioral affordances, and I will identify their characteristics and communicative functions, especially in “conversational displays”, to (...) justify why they are functionally special. I will then insert facial signals into the framework of a pragmatic perspective on human communication, both verbal and non-verbal, which is broader than speech act theory: a Pragmatics-First Approach to Human Communication. I will argue that it provides an adequate understanding of the pragmatic-interactive foundations of human communication, where Facereading is a central component. Finally, I will refer to the relationship between Facereading and the Second-person Perspective of social cognition. (shrink)

When interlocutors repeatedly describe referents to each other, they rapidly converge on referring expressions which become increasingly systematized and abstract as the interaction progresses. Previous experimental research suggests that interactive repair mechanisms in dialogue underpin convergence. However, this research has so far only focused on the role of other-initiated repair and has not examined whether self-initiated repair might also play a role. To investigate this question, we report the results from a computer-mediated maze task experiment. In this task, participants communicate (...) with each other via an experimental chat tool, which selectively transforms participants’ private turn-revisions into public self-repairs that are made visible to the other participant. For example, if a participant, A, types “On the top square,” and then before sending, A revises the turn to “On the top row,” the server automatically detects the revision and transforms the private turn-revisions into a public self-repair, for example, “On the top square umm I meant row.” Participants who received these transformed turns used more abstract and systematized referring expressions, but performed worse at the task. We argue that this is due to the artificial self-repairs causing participants to put more effort into diagnosing and resolving the referential coordination problems they face in the task, yielding better grounded spatial semantics and consequently increased use of abstract referring expressions. (shrink)

Clark highlights a neglected issue in research on language use: the process by which speakers and addressees anchor utterances with respect to individual entities in their common ground. In his review, he identifies the challenges linked to investigations of anchoring, but also displays the pitfalls of evading it.

Communicating with multiple addressees poses a problem for speakers: Each addressee necessarily comes to the conversation with a different perspective—different knowledge, different beliefs, and a distinct physical context. Despite the ubiquity of multiparty conversation in everyday life, little is known about the processes by which speakers design language in multiparty conversation. While prior evidence demonstrates that speakers design utterances to accommodate addressee knowledge in multiparty conversation, it is unknown if and how speakers encode and combine different types of perspective information. (...) Here we test whether speakers encode the perspective of multiple addressees, and then simultaneously consider their knowledge and physical context during referential design in a three‐party conversation. Analyses of referential form—expression length, disfluency, and elaboration rate—in an interactive multiparty conversation demonstrate that speakers do take into consideration both addressee knowledge and physical context when designing utterances, consistent with a knowledge‐scene integration view. These findings point to an audience design process that takes as input multiple types of representations about the perspectives of multiple addressees, and that bases the informational content of the to‐be‐designed utterance on a combination of the perspectives of the intended addressees. (shrink)

How do speakers design what they say in order to communicate effectively with groups of addressees who vary in their background knowledge of the topic at hand? Prior findings indicate that when a speaker addresses a pair of listeners with discrepant knowledge, that speakers Aim Low, designing their utterances for the least knowledgeable of the two addressees. Here, we test the hypothesis that speakers will depart from an Aim Low approach in order to efficiently communicate with larger groups of interacting (...) partners. Further, we ask whether the cognitive demands of tracking multiple conversational partners' perspectives places limitations on successful audience design. We find that speakers can successfully track information about what up to four of their partners do and do not know in conversation. When addressing groups of 3–4 addressees at once, speakers design language based on the combined knowledge of the group. These findings point to an audience design process that simultaneously represents the perspectives of multiple other individuals and combines these representations in order to design utterances that strike a balance between the different needs of the individuals within the group. (shrink)

Disfluencies include editing terms such as uh and um as well as repeats and revisions. Little is known about how disfluencies are processed, and there has been next to no research focused on the way that disfluencies affect structure-building operations during comprehension. We review major findings from both computational linguistics and psycholinguistics, and then we summarize the results of our own work which centers on how the parser behaves when it encounters a disfluency. We describe some new research showing that (...) information associated with misarticulated verbs lingers, and which adds to the large body of data on the critical influence of verb argument structures on sentence comprehension. The paper also presents a model of disfluency processing. The parser uses a Tree Adjoining Grammar to build phrase structure. In this approach, filled and unfilled pauses affect the timing of Substitution operations. Repairs and corrections are handled by a mechanism we term “Overlay,” which allows the parser to overwrite an undesired tree with the appropriate, correct tree. This model of disfluency processing highlights the need for the parser to sometimes coordinate the mechanisms that perform garden-path reanalysis with those that do disfluency repair. The research program as a whole demonstrates that it is possible to study disfluencies systematically and to learn how the parser handles filler material and mistakes. It also showcases the power of Tree Adjoining Grammars, a formalism developed by Aravind Joshi which has yielded results in many different areas of linguistics and cognitive science. (shrink)

A speaker's manner of delivery of an utterance can affect a listener's pragmatic interpretation of the message. Disfluencies influence a listener's off-line assessment of whether the speaker is truthful or deceptive. Do listeners also form this assessment during the moment-by-moment processing of the linguistic message? Here we present two experiments that examined listeners’ judgments of whether a speaker was indicating the true location of the prize in a game during fluent and disfluent utterances. Participants’ eye and mouse movements were biased (...) toward the location named by the speaker during fluent utterances, whereas the opposite bias was observed during disfluent utterances. This difference emerged rapidly after the onset of the critical noun. Participants were similarly sensitive to disfluencies at the start of the utterance and in the middle. Our findings support recent research showing that listeners integrate pragmatic information alongside semantic content during the earliest moments of language processing. Unlike prior work which has focused on pragmatic effects in the interpretation of the literal message, here we highlight disfluency's role in guiding a listener to an alternative non-literal message. (shrink)