For people to contribute to discourse, they must do more than utter the right sentence at the right time. The basic requirement is that they add to their common ground in an orderly way. To do this, we argue, they try to establish for each utterance the mutual belief that the addressees have understood what the speaker meant well enough for current purposes. This is accomplished by the collective actions of the current contributor and his or her partners, and these (...) result in units of conversation called contributions. We present a model of contributions and show how it accounts for a variety of features of everyday conversations. (shrink)

Behavioral scientists routinely publish broad claims about human psychology and behavior in the world's top journals based on samples drawn entirely from Western, Educated, Industrialized, Rich, and Democratic (WEIRD) societies. Researchers – often implicitly – assume that either there is little variation across human populations, or that these “standard subjects” are as representative of the species as any other population. Are these assumptions justified? Here, our review of the comparative database from across the behavioral sciences suggests both that there is (...) substantial variability in experimental results across populations and that WEIRD subjects are particularly unusual compared with the rest of the species – frequent outliers. The domains reviewed include visual perception, fairness, cooperation, spatial reasoning, categorization and inferential induction, moral reasoning, reasoning styles, self-concepts and related motivations, and the heritability of IQ. The findings suggest that members of WEIRD societies, including young children, are among the least representative populations one could find for generalizing about humans. Many of these findings involve domains that are associated with fundamental aspects of psychology, motivation, and behavior – hence, there are no obviousa priorigrounds for claiming that a particular behavioral phenomenon is universal based on sampling from a single subpopulation. Overall, these empirical patterns suggests that we need to be less cavalier in addressing questions ofhumannature on the basis of data drawn from this particularly thin, and rather unusual, slice of humanity. We close by proposing ways to structurally re-organize the behavioral sciences to best tackle these challenges. (shrink)

We describe a “centipede’s dilemma” that faces the sciences of human interaction. Research on human interaction has been involved in extensive theoretical debate, although the vast majority of research tends to focus on a small set of human behaviors, cognitive processes, and interactive contexts. The problem is that naturalistic human interaction must integrate all of these factors simultaneously, and grander theoretical mitigation cannot come only from focused experimental or computational agendas. We look to dynamical systems theory as a framework for (...) thinking about how these multiple behaviors, processes, and contexts can be integrated into a broader account of human interaction. By introducing and utilizing basic concepts of self-organization and synergy, we review empirical work that shows how human interaction is flexible and adaptive and structures itself incrementally during unfolding interactive tasks, such as conversation, or more focused goal-based contexts. We end on acknowledging that dynamical systems accounts are very short on concrete models, and we briefly describe ways that theoretical frameworks could be integrated, rather than endlessly disputed, to achieve some success on the centipede’s dilemma of human interaction. (shrink)

Traditional mechanistic accounts of language processing derive almost entirely from the study of monologue. Yet, the most natural and basic form of language use is dialogue. As a result, these accounts may only offer limited theories of the mechanisms that underlie language processing in general. We propose a mechanistic account of dialogue, the interactive alignment account, and use it to derive a number of predictions about basic language processes. The account assumes that, in dialogue, the linguistic representations employed by the (...) interlocutors become aligned at many levels, as a result of a largely automatic process. This process greatly simplifies production and comprehension in dialogue. After considering the evidence for the interactive alignment model, we concentrate on three aspects of processing that follow from it. It makes use of a simple interactive inference mechanism, enables the development of local dialogue routines that greatly simplify language processing, and explains the origins of self-monitoring in production. We consider the need for a grammatical framework that is designed to deal with language in dialogue rather than monologue, and discuss a range of implications of the account. Key Words: common ground; dialogue; dialogue routines; language comprehension; language production; monitoring; perception-behavior link. (shrink)

In conversation, individuals work together to achieve communicative goals, complementing and aligning language and body with each other. An important emerging question is whether interlocutors entrain with one another equally across linguistic levels (e.g., lexical, syntactic, and semantic) and modalities (i.e., speech and gesture), or whether there are complementary patterns of behaviors, with some levels or modalities diverging and others converging in coordinated fashions. This study assesses how kinematic and linguistic entrainment interact with one another across levels of measurement, and (...) according to communicative context. We analyzed data from two matched corpora of dyadic interaction between—respectively—Danish and Norwegian native speakers engaged in affiliative conversations and task‐oriented conversations. We assessed linguistic entrainment at the lexical, syntactic, and semantic level, and kinetic alignment of the head and hands using video‐based motion tracking and dynamic time warping. We tested whether—across the two languages—linguistic alignment correlates with kinetic alignment, and whether these kinetic‐linguistic associations are modulated either by the type of conversation or by the language spoken. We found that kinetic entrainment was positively associated with low‐level linguistic (i.e., lexical) entrainment, while negatively associated with high‐level linguistic (i.e., semantic) entrainment, in a cross‐linguistically robust way. Our findings suggest that conversation makes use of a dynamic coordination of similarity and complementarity both between individuals as well as between different communicative modalities, and provides evidence for a multimodal, interpersonal synergy account of interaction. (shrink)

This study investigates interpersonal processes underlying dialog by comparing two approaches, interactive alignment and interpersonal synergy, and assesses how they predict collective performance in a joint task. While the interactive alignment approach highlights imitative patterns between interlocutors, the synergy approach points to structural organization at the level of the interaction—such as complementary patterns straddling speech turns and interlocutors. We develop a general, quantitative method to assess lexical, prosodic, and speech/pause patterns related to the two approaches and their impact on collective (...) performance in a corpus of task-oriented conversations. The results show statistical presence of patterns relevant for both approaches. However, synergetic aspects of dialog provide the best statistical predictors of collective performance and adding aspects of the alignment approach does not improve the model. This suggests that structural organization at the level of the interaction plays a crucial role in task-oriented conversations, possibly constraining and integrating processes related to alignment. (shrink)

A variety of theoretical frameworks predict the resemblance of behaviors between two people engaged in communication, in the form of coordination, mimicry, or alignment. However, little is known about the time course of the behavior matching, even though there is evidence that dyads synchronize oscillatory motions (e.g., postural sway). This study examined the temporal structure of nonoscillatory actions—language, facial, and gestural behaviors—produced during a route communication task. The focus was the temporal relationship between matching behaviors in the interlocutors (e.g., facial (...) behavior in one interlocutor vs. the same facial behavior in the other interlocutor). Cross-recurrence analysis revealed that within each category tested (language, facial, gestural), interlocutors synchronized matching behaviors, at temporal lags short enough to provide imitation of one interlocutor by the other, from one conversational turn to the next. Both social and cognitive variables predicted the degree of temporal organization. These findings suggest that the temporal structure of matching behaviors provides low-level and low-cost resources for human interaction. (shrink)

We used a new method called “Ghost-in-the-Machine” (GiM) to investigate social interactions with a robotic bartender taking orders for drinks and serving them. Using the GiM paradigm allowed us to identify how human participants recognize the intentions of customers on the basis of the output of the robotic recognizers. Specifically, we measured which recognizer modalities (e.g., speech, the distance to the bar) were relevant at different stages of the interaction. This provided insights into human social behavior necessary for the development (...) of socially competent robots. When initiating the drink-order interaction, the most important recognizers were those based on computer vision. When drink orders were being placed, however, the most important information source was the speech recognition. Interestingly, the participants used only a subset of the available information, focussing only on a few relevant recognizers while ignoring others. This reduced the risk of acting on erroneous sensor data and enabled them to complete service interactions more swiftly than a robot using all available sensor data. We also investigated socially appropriate response strategies. In their responses,the participants preferred to use the same modality as the customer’s requests, e.g., they tended to respond verbally to verbal requests. Also, they added redundancy to their responses, for instance by using echo questions. We argue that incorporating the social strategies discovered with the GiM paradigm in multimodal grammars of human–robot interactions improves the robustness and the ease-of-use of these interactions, and therefore provides a smoother user experience. (shrink)

Collaborative interaction pervades everyday practices: work meetings, innovation and product design, education and arts. Previous studies have pointed to the central role of acknowledgement and acceptance for the success of joint action, by creating affiliation and signaling understanding. We argue that various forms of explicit miscommunication are just as critical to challenge, negotiate and integrate individual contributions in collaborative creative activities. Through qualitative microanalysis of spontaneous coordination in collective creative LEGO constructions, we individuate three interactional styles: inclusive, characterized by acknowledgment (...) and praise; instructional, characterized by self-repair; and integrative, characterized by widespread self- and other-repair. We investigate how different interaction styles leave distinct traces in the resulting LEGO models. The inclusive interaction style results in concatenations of individual contributions with little coherence and core narrative. The instructional style produces coherent, but individually driven models. Finally, the integrative style generates more innovative models, synthesizing individual contributions in shared narratives or schemas. (shrink)

In spite of the remarkable progress made in the burgeoning field of social neuroscience, the neural mechanisms that underlie social encounters are only beginning to be studied and could —paradoxically— be seen as representing the ‘dark matter’ of social neuroscience. Recent conceptual and empirical developments consistently indicate the need for investigations, which allow the study of real-time social encounters in a truly interactive manner. This suggestion is based on the premise that social cognition is fundamentally different when we are in (...) interaction with others rather than merely observing them. In this article, we outline the theoretical conception of a second-person approach to other minds and review evidence from neuroimaging, psychophysiological studies and related fields to argue for the development of a second-person neuroscience, which will help neuroscience to really go social; this may also be relevant for our understanding of psychiatric disorders construed as disorders of social cognition. (shrink)

Dialogue has its origins in joint activities, which it serves to coordinate. Joint activities, in turn, usually emerge in hierarchically nested projects and subprojects. We propose that participants use dialogue to coordinate two kinds of transitions in these joint projects: vertical transitions, or entering and exiting joint projects; and horizontal transitions, or continuing within joint projects. The participants help signal these transitions with project markers, words such as uh-huh, m-hm, yeah, okay, or all right. These words have been studied mainly (...) as signals of listener feedback (back-channel signals) or turn-taking devices (acknowledgment tokens). We present evidence from several types of well-defined tasks that they are also part of a system of contrasts specialized for navigating joint projects. Uh-huh, m-hm and yeah are used for horizontal transitions, and okay and all right for vertical transitions. (shrink)

Human social coordination is often mediated by language. Through verbal dialogue, people direct each other’s attention to properties of their shared environment, they discuss how to jointly solve problems, share their introspections, and distribute roles and assignments. In this article, we propose a dynamical framework for the study of the coordinative role of language. Based on a review of a number of recent experimental studies, we argue that shared symbolic patterns emerge and stabilize through a process of local reciprocal linguistic (...) alignment. Such patterns in turn come to facilitate and refine social coordination by enabling the alignment, joint construction and navigation of conceptual models and actions. Implications of the framework are illustrated and discussed in relation to a case study where dyads of interlocutors interact verbally to reach joint decisions in a perceptual discrimination task. Keywords: social coordination; language; communication; linguistic alignment; symbolic patterns; affordances; emergence; evolution; adaptivity; interaction. (shrink)

Human social coordination is often mediated by language. Through verbal dialogue, people direct each other’s attention to properties of their shared environment, they discuss how to jointly solve problems, share their introspections, and distribute roles and assignments. In this article, we propose a dynamical framework for the study of the coordinative role of language. Based on a review of a number of recent experimental studies, we argue that shared symbolic patterns emerge and stabilize through a process of local reciprocal linguistic (...) alignment. Such patterns in turn come to facilitate and refine social coordination by enabling the alignment, joint construction and navigation of conceptual models and actions. Implications of the framework are illustrated and discussed in relation to a case study where dyads of interlocutors interact verbally to reach joint decisions in a perceptual discrimination task. (shrink)

Capacities for abstract thinking and problem‐solving are central to human cognition. Processes of abstraction allow the transfer of experiences and knowledge between contexts helping us make informed decisions in new or changing contexts. While we are often inclined to relate such reasoning capacities to individual minds and brains, they may in fact be contingent on human‐specific modes of collaboration, dialogue, and shared attention. In an experimental study, we test the hypothesis that social interaction enhances cognitive processes of rule‐induction, which in (...) turn improves problem‐solving performance. Through three sessions of increasing complexity, individuals and groups were presented with a problem‐solving task requiring them to categorize a set of visual stimuli. To assess the character of participants’ problem representations, after each training session, they were presented with a transfer task involving stimuli that differed in appearance, but shared relations among features with the training set. Besides, we compared participants’ categorization behaviors to simulated agents relying on exemplar learning. We found that groups performed superior to individuals and agents in the training sessions and were more likely to correctly generalize their observations in the transfer phase, especially in the high complexity session, suggesting that groups more effectively induced underlying categorization rules from the stimuli than individuals and agents. Crucially, variation in performance among groups was predicted by semantic diversity in members’ dialogical contributions, suggesting a link between social interaction, cognitive diversity, and abstraction. (shrink)

Healey et al. use experiments with chat dialogues to test the hypothesis that language co‐ordination is driven by ‘running repairs’. They replace signals of understanding such as “okay” with weaker, ‘spoof’ signals like “ummm”, and replace specific requests for clarification like “on the left?” with signals that suggest a higher degree of misunderstanding like “what?”. The latter manipulation causes participants to switch rapidly to more abstract forms of referring expression.

Feedback such as backchannels and clarification requests often occurs subsententially, demonstrating the incremental nature of grounding in dialogue. However, although such feedback can occur at any point within an utterance, it typically does not do so, tending to occur at Feedback Relevance Spaces. We present a corpus study of acknowledgements and clarification requests in British English, and describe how our low-level, semantic processing model in Dynamic Syntax accounts for this feedback. The model trivially accounts for the 85% of cases where (...) feedback occurs at FRSs, but we also describe how it can be integrated or interpreted at non-FRSs using the predictive, incremental and interactive nature of the formalism. This model shows how feedback serves to continually realign processing contexts and thus manage the characteristic divergence and convergence that is key to moving dialogue forward. (shrink)

Collaborative interaction pervades many everyday practices: work meetings, innovation and product design, education and arts. Previous studies have pointed to the central role of acknowledgement and acceptance for the success of joint action, by creating affiliation and signaling understanding. We argue that various forms of explicit miscommunication are just as critical to challenge, negotiate and integrate individual contributions in collaborative creative activities. Through qualitative microanalysis of spontaneous coordination in collective creative LEGO constructions, we individuate three interactional styles: inclusive, characterized by (...) acknowledgment and praise; instructional, characterized by self-repair; and integrative, characterized by widespread self- and other-repair. We then investigate how different interaction styles leave distinct material traces in the resulting LEGO models. The inclusive interaction style generally results in concatenations of individual contributions with little coherence and core narrative. The instructional style produces coherent, but largely individually driven models. Finally, the integrative style generates more innovative models, synthesizing individual contributions in shared narratives or schemas. (shrink)

How is linguistic communication possible? How do we come to share the same meanings of words and utterances? One classical position holds that human beings share a transcendental “platonic” ideality independent of individual cognition and language use (Frege 1948). Another stresses immanent linguistic relations (Saussure 1959), and yet another basic embodied structures as the ground for invariant aspects of meaning (Lakoff and Johnson 1999). Here we propose an alternative account in which the possibility for sharing meaning is motivated by four (...) sources of structural stability: 1) the physical constraints and affordances of our surrounding material environment, 2) biological constraints of our human bodies, 3) social normative constraints of culture and society, and 4) the local history of social interactions. These structures and constraints interact in dynamical ways in actual language usage situations: local dialogical and social dynamics motivate and stabilize the profiling of a conceptual space already highly structured by our shared biology, culture, and environment. We will substantiate this perspective with reference to recent studies in experimental pragmatics and semiotics in which participants interact linguistically to solve cooperative tasks. Three main cases will be considered: The dynamic grounding of linguistic categories, the construction of conceptual models to relate entities in a scene, and the construction of shared conceptual scales for assessing and appraising subjective experiences. (shrink)

When people are engaged in social interaction, they can repeat aspects of each other’s communicative behavior, such as words or gestures. This kind of behavioral alignment has been studied across a wide range of disciplines and has been accounted for by diverging theories. In this paper, we review various operationalizations of lexical and gestural alignment. We reveal that scholars have fundamentally different takes on when and how behavior is considered to be aligned, which makes it difficult to compare findings and (...) draw uniform conclusions. Furthermore, we show that scholars tend to focus on one particular dimension of alignment (traditionally, whether two instances of behavior overlap in form), while other dimensions remain understudied. This hampers theory testing and building, which requires a well‐defined account of the factors that are central to or might enhance alignment. To capture the complex nature of alignment, we identify five key dimensions to formalize the relationship between any pair of behavior: time, sequence, meaning, form, and modality. We show how assumptions regarding the underlying mechanism of alignment (placed along the continuum of priming vs. grounding) pattern together with operationalizations in terms of the five dimensions. This integrative framework can help researchers in the field of alignment and related phenomena (including behavior matching, mimicry, entrainment, and accommodation) to formulate their hypotheses and operationalizations in a more transparent and systematic manner. The framework also enables us to discover unexplored research avenues and derive new hypotheses regarding alignment. (shrink)