Recent studies of naturalistic face‐to‐face communication have demonstrated coordination patterns such as the temporal matching of verbal and non‐verbal behavior, which provides evidence for the proposal that verbal and non‐verbal communicative control derives from one system. In this study, we argue that the observed relationship between verbal and non‐verbal behaviors depends on the level of analysis. In a reanalysis of a corpus of naturalistic multimodal communication (Louwerse, Dale, Bard, & Jeuniaux, ), we focus on measuring the temporal patterns of specific (...) communicative behaviors in terms of their burstiness. We examined burstiness estimates across different roles of the speaker and different communicative modalities. We observed more burstiness for verbal versus non‐verbal channels, and for more versus less informative language subchannels. Using this new method for analyzing temporal patterns in communicative behaviors, we show that there is a complex relationship between verbal and non‐verbal channels. We propose a “temporal heterogeneity” hypothesis to explain how the language system adapts to the demands of dialog. (shrink)

We provide a computational model of semantic alignment among communicating agents constrained by social and cognitive pressures. We use our model to analyze the effects of social stratification and a local transmission bottleneck on the coordination of meaning in isolated dyads. The analysis suggests that the traditional approach to learning—understood as inferring prescribed meaning from observations—can be viewed as a special case of semantic alignment, manifesting itself in the behaviour of socially imbalanced dyads put under mild pressure of a local (...) transmission bottleneck. Other parametrizations of the model yield different long-term effects, including lack of convergence or convergence on simple meanings only. (shrink)

Musical improvisation is a natural case of human pattern formation, and Walton and colleagues investigate the way that different contextual constraints affect patterns of improvisation and their aesthetic quality. The authors find that coordination patterns are more diversified between two musicians when the musical space in which to improvise is relatively more constrained. They also find that listeners experience more diversified, complementary patterns between musicians as more enjoyable and harmonious.

In the exploratory study reported here, we tested the efficacy of an intervention designed to train teenagers with Möbius syndrome (MS) to increase the use of alternative communication strategies (e.g., gestures) to compensate for their lack of facial expressivity. Specifically, we expected the intervention to increase the level of rapport experienced in social interactions by our participants. In addition, we aimed to identify the mechanisms responsible for any such increase in rapport. In the study, five teenagers with MS interacted with (...) three naïve participants without MS before the intervention, and with three different naïve participants without MS after the intervention. Rapport was assessed by self-report and by behavioral coders who rated videos of the interactions. Individual non-verbal behavior was assessed via behavioral coders, whereas verbal behavior was automatically extracted from the sound files. Alignment was assessed using cross recurrence quantification analysis and mixed-effects models. The results showed that observer-coded rapport was greater after the intervention, whereas self-reported rapport did not change significantly. Observer-coded gesture and expressivity increased in participants with and without MS, whereas overall linguistic alignment decreased. Fidgeting and repetitiveness of verbal behavior also decreased in both groups. In sum, the intervention may impact non-verbal and verbal behavior in participants with and without MS, increasing rapport as well as overall gesturing, while decreasing alignment. (shrink)

This article presents a case study of a facilitator-lead “shared reading” group with participants suffering from mental health problems. We argue that the text is the most important agent in creating a reading experience which is both subjective and shared. And we point to relatedness as a function of text agency, and to the role of facilitation in creating text-reader relations. The article also presents a new methodological framework combining physiological data of heart rate variability and linguistic, observational and subjective (...) data. By integrating these distinct data points in our analysis we demonstrate the ways in which the text functions as an agent driving processes of individuation and synchronization respectively. On the basis of linguistic analysis of readers’ responses and interactions we point to the cognitive process of mentalization underlying both individual readings and collective meaning making. At the end we discuss the relation of mentalization to diagnosis and argue that “shared reading” may function as an intervention form with a potential for modifying way of thinking; knowing when to read into and when not, and mode of thought; shifting from explanation to experience. (shrink)

When people communicate, they coordinate a wide range of linguistic and non-linguistic behaviors. This process of coordination is called alignment, and it is assumed to be fundamental to successful communication. In this paper, we question this assumption and investigate whether disalignment is a more successful strategy in some cases. More specifically, we hypothesize that alignment correlates with task success only when communication is interactive. We present results from a spot-the-difference task in which dyads of interlocutors have to decide whether they (...) are viewing the same scene or not. Interactivity was manipulated in three conditions by increasing the amount of information shared between interlocutors. We use recurrence quantification analysis to measure the alignment between the scan-patterns of the interlocutors. We found that interlocutors who could not exchange feedback aligned their gaze more, and that increased gaze alignment correlated with decreased task success in this case. When feedback was possible, in contrast, interlocutors utilized it to better organize their joint search strategy by diversifying visual attention. This is evidenced by reduced overall alignment in the minimal feedback and full dialogue conditions. However, only the dyads engaged in a full dialogue increased their gaze alignment over time to achieve successful performances. These results suggest that alignment per se does not imply communicative success, as most models of dialogue assume. Rather, the effect of alignment depends on the type of alignment, on the goals of the task, and on the presence of feedback. (shrink)

We discuss two problems for a general scientific understanding of language, sequences and synergies: how language is an intricately sequenced behavior and how language is manifested as a multidimensionally structured behavior. Though both are central in our understanding, we observe that the former tends to be studied more than the latter. We consider very general conditions that hold in human brain evolution and its computational implications, and identify multimodal and multiscale organization as two key characteristics of emerging cognitive function in (...) our species. This suggests that human brains, and cognitive function specifically, became more adept at integrating diverse information sources and operating at multiple levels for linguistic performance. We argue that framing language evolution, learning, and use in terms of synergies suggests new research questions, and it may be a fruitful direction for new developments in theory and modeling of language as an integrated system. (shrink)

Underlying the recent focus on embodied and interactive aspects of social understanding are several intuitions about what roles the body, interaction processes, and interpersonal experience play. In this paper, we introduce a systematic, hands-on method for investigating the experience of interacting and its role in intersubjectivity. Special about this method is that it starts from the idea that researchers of social understanding are themselves one of the best tools for their own investigations. The method provides ways for researchers to calibrate (...) and to trust themselves as sophisticated instruments to help generate novel insights into human interactive experience. We present the basics of the method, and two empirical studies. The first is a video-study on autism, which shows greater refinement in the way people with autism embody their social interactions than previously thought. The second is a study of thinking in live interactions, which provides insight into the common feeling that too much thinking can hamper interaction, and into how this kind of interactional awkwardness might be unblocked. (shrink)

This study investigates interpersonal processes underlying dialog by comparing two approaches, interactive alignment and interpersonal synergy, and assesses how they predict collective performance in a joint task. While the interactive alignment approach highlights imitative patterns between interlocutors, the synergy approach points to structural organization at the level of the interaction—such as complementary patterns straddling speech turns and interlocutors. We develop a general, quantitative method to assess lexical, prosodic, and speech/pause patterns related to the two approaches and their impact on collective (...) performance in a corpus of task-oriented conversations. The results show statistical presence of patterns relevant for both approaches. However, synergetic aspects of dialog provide the best statistical predictors of collective performance and adding aspects of the alignment approach does not improve the model. This suggests that structural organization at the level of the interaction plays a crucial role in task-oriented conversations, possibly constraining and integrating processes related to alignment. (shrink)

The literature on coordination within and between individuals is reviewed, with an emphasis on the inherent transience of coordination patterns in behavioral activity. This transience is integral to understanding cognitive activity as flexible patterns of coordination in brain, body, and environment. Kello reviews the articles in this special issue as contributions to understanding the role of context in shaping or interpreting coordination patterns in human behavior.

Multiple theories of problem-solving hypothesize that there are distinct qualitative phases exhibited during effective problem-solving. However, limited research has attempted to identify when transitions between phases occur. We integrate theory on collaborative problem-solving with dynamical systems theory suggesting that when a system is undergoing a phase transition it should exhibit a peak in entropy and that entropy levels should also relate to team performance. Communications from 40 teams that collaborated on a complex problem were coded for occurrence of problem-solving processes. (...) We applied a sliding window entropy technique to each team's communications and specified criteria for identifying data points that qualify as peaks and determining which peaks were robust. We used multilevel modeling, and provide a qualitative example, to evaluate whether phases exhibit distinct distributions of communication processes. We also tested whether there was a relationship between entropy values at transition points and CPS performance. We found that a proportion of entropy peaks was robust and that the relative occurrence of communication codes varied significantly across phases. Peaks in entropy thus corresponded to qualitative shifts in teams’ CPS communications, providing empirical evidence that teams exhibit phase transitions during CPS. Also, lower average levels of entropy at the phase transition points predicted better CPS performance. We specify future directions to improve understanding of phase transitions during CPS, and collaborative cognition, more broadly. (shrink)

Cocreating meaning in collaboration is challenging. Success is often determined by people's abilities to coordinate their language to converge upon shared mental representations. Here we explore one set of low‐level linguistic behaviors, linguistic alignment, that both emerges from, and facilitates, outcomes of high‐level convergence. Linguistic alignment captures the ways people reuse, that is, “align to,” the lexical, syntactic, and semantic forms of others' utterances. Our focus is on the temporal change of multi‐level linguistic alignment, as well as how alignment is (...) related to communicative outcomes within a unique collaborative problem‐solving paradigm. The primary task, situated within a virtual educational video game, requires creative thinking between three people where the paths for possible solutions are highly variable. We find that over time interactions are marked by decreasing lexical and syntactic alignment, with a trade‐off of increasing semantic alignment. However, greater semantic alignment does not translate into better team performance. Overall, these findings provide greater clarity on the role of linguistic coordination within complex and dynamic collaborative problem‐solving tasks. (shrink)

A key emergent property of group social dynamic is synchrony–the coordination of actions, emotions, or physiological processes between group members. Despite this fact and the inherent nested structure of groups, little research has assessed physiological synchronization between group members from a multi-level perspective, thus limiting a full understanding of the dynamics between members. To address this gap of knowledge we re-analyzed a large dataset comprising physiological and psychological data that were collected in two laboratory studies that involved two different social (...) group tasks. In both studies, following the group task, members reported their experience of group cohesion via questionnaires. We utilized a non-linear analysis method-multidimensional recurrence quantification analysis that allowed us to represent physiological synchronization in cardiological interbeat intervals between group members at the individual-level and at the group-level. We found that across studies and their conditions, the change in physiological synchrony from baseline to group interaction predicted a psychological sense of group cohesion. This result was evident both at the individual and the group levels and was not modified by the context of the interaction. The individual- and group-level effects were highly correlated. These results indicate that the relationship between synchrony and cohesion is a multilayered construct. We re-affirm the role of physiological synchrony for cohesion in groups. Future studies are needed to crystallize our understanding of the differences and similarities between synchrony at the individual-level and synchrony at the group level to illuminate under which conditions one of these levels has primacy, or how they interact. (shrink)

Communicative interactions across different species have so far received relatively little attention from cognitive or behavioral scientists. Most research in this area views the process of communication as the adaptive interaction of manipulative signalers and information-assessing receivers. This paper discusses some shortcomings of the information/influence model of communication, particularly in the empirical study of interspecific communicative interactions. It then presents an alternative theoretical model, based on recent contributions in psycholinguistics and semiotics. The semiotic alignment model views communication as a dynamic (...) process of joint semiosis resulting in the alignment of the interactants’ own-worlds (Umwelten). It is argued that this model can improve our understanding of communicative interactions between heterospecifics and provide the basis for future work in the empirical study of interspecific communication. (shrink)

Complex systems are to be seen as typically having multiple levels of organization. For instance, in the behavioural and cognitive sciences, there has been a long lasting trend, promoted by the seminal work of David Marr, putting focus on three distinct levels of analysis: the computational level, accounting for the What and Why issues, the algorithmic and the implementational levels specifying the How problem. However, the tremendous developments in neuroscience knowledge about processes at different scales of organization together with the (...) complexity of today cognitive theories suggest that there will hardly be only three levels of explanation. Instead, there will be many different degrees of commitments corresponding to the different granularities—from high-level (behavioural) models to low-level (neural and molecular) models of the cognitive research program. For instance, Bayesian approaches, that are usually advocated for formalizing Marr’s computational level and rational behaviour, have even been adopted to model synaptic plasticity and axon guidance by molecular gradients. As a result, we can consider the behavioural scientist as dealing with models at a multiplicity of levels. The purpose of this Research Topic in Frontiers in Theoretical and Philosophical Psychology is to promote an approach to the role of the levels and explanation and models which is of interest for cognitive scientists, neuroscientists, psychologists, behavioural scientists, and philosophers of science. (shrink)

This article argues for a view on languaging as inherently affective. Informed by recent ecological tendencies within cognitive science and distributed language studies a distinction between first order languaging (language as whole-body sense making) and second order language (language as system like constraints) is put forward. Contrary to common assumptions within linguistics and communication studies separating language-as-a-system from language use (resulting in separations between language vs. body-language and verbal vs. non-verbal communication etc.) the first/second order distinction sees language as emanating (...) from behavior making it possible to view emotion and affect as integral parts languaging behavior. Likewise, emotion and affect are studied, not as inner mental states, but as processes of organism-environment interactions. Based on video recordings of interaction between (1) children with special needs, and (2) couple in therapy and the therapist patterns of reciprocal influences between interactants are examined. Through analyzes of affective stance and patterns of inter-affectivity it is exemplified how language and emotion should not be seen as separate phenomena combined in language use, but rather as completely intertwined phenomena in languaging behavior constrained by second order patterns. (shrink)

The aim of this paper is to demonstrate that the postulation of irreducible, distributed cognitive systems is necessary for the successful explanatory practice of cognitive science and sociology. Towards this end, and with an eye specifically on the phenomenon of distributed cognition, the debate over reductionism versus emergence is examined from the perspective of Dynamical Systems Theory. The motivation for this novel approach is threefold. Firstly, DST is particularly popular amongst cognitive scientists who work on modelling collective behaviors. Secondly, DST (...) can deliver two distinct arguments in support of the claim that the presence of mutual interactions between group members necessitates the postulation of the corresponding group entity. Thirdly, DST can also provide a succinct understanding of the way group entities exert downward causation on their individual members. The outcome is a naturalist account of the emergent, and thereby irreducible, nature of distributed cognitive systems that avoids the reductionists’ threat of epiphenomenalism, while being well in line with materialism. (shrink)

Capacities for abstract thinking and problem‐solving are central to human cognition. Processes of abstraction allow the transfer of experiences and knowledge between contexts helping us make informed decisions in new or changing contexts. While we are often inclined to relate such reasoning capacities to individual minds and brains, they may in fact be contingent on human‐specific modes of collaboration, dialogue, and shared attention. In an experimental study, we test the hypothesis that social interaction enhances cognitive processes of rule‐induction, which in (...) turn improves problem‐solving performance. Through three sessions of increasing complexity, individuals and groups were presented with a problem‐solving task requiring them to categorize a set of visual stimuli. To assess the character of participants’ problem representations, after each training session, they were presented with a transfer task involving stimuli that differed in appearance, but shared relations among features with the training set. Besides, we compared participants’ categorization behaviors to simulated agents relying on exemplar learning. We found that groups performed superior to individuals and agents in the training sessions and were more likely to correctly generalize their observations in the transfer phase, especially in the high complexity session, suggesting that groups more effectively induced underlying categorization rules from the stimuli than individuals and agents. Crucially, variation in performance among groups was predicted by semantic diversity in members’ dialogical contributions, suggesting a link between social interaction, cognitive diversity, and abstraction. (shrink)

Theoretical and empirical contributions to the understanding of communicative interactions between heterospecifics are scarce and tend to apply a monological model of communication that focuses on the transfer of information from signallers to receivers. This study relies on an alternative model of communication, semiotic alignment, which sees communicative interaction as a dialogical process of joint semiosis resulting in the alignment of the interactants’ own-worlds. We conducted an experiment where dyads composed of an elephant instruction-giver and a human instruction-receiver needed to (...) engage in dynamic and interactive communication in order to solve a cooperative object-choice task. Our results showed that dyads were able to solve the task well above chance levels. Moreover, cross-recurrence analysis revealed that interactants were synchronizing referential indexical gestures throughout the experiment. However, we were not able to confirm a direct correlation between joint deixis and experimental outcomes, presumably because these outcomes are dependent on other forms of joint semiosis not analysed in this study. (shrink)

In a matter of mere milliseconds, conversational partners can transform their expectations about the world in a way that accords with another person's perspective. At the same time, in similar situations, the exact opposite also appears to be true. Rather than being at odds, these findings suggest that there are multiple contextual and processing constraints that may guide when and how people consider perspective. These constraints are shaped by a host of factors, including the availability of social and environmental cues, (...) and intrinsic biases and cognitive abilities. To explain how these might be integrated in a new way forward, we turn to an adaptive account of interpersonal interaction. This account draws from basic principles of dynamical systems, principles that we argue are already expressed, both implicitly and explicitly, within a broad landscape of existing research. We then showcase an initial attempt to develop a computational framework to instantiate some of these principles. This framework, consisting of what we argue to be important mechanistic insights rendered by neural network models, is based on a promising and long-standing approach that has yet to take hold in the current domain. We argue that by bridging this gap, new insights into other theoretical accounts, such as the connections between memory and common ground information, might be revealed. (shrink)

Communicative interactions across different species have so far received relatively little attention from cognitive or behavioral scientists. Most research in this area views the process of communication as the adaptive interaction of manipulative signalers and information-assessing receivers. This paper discusses some shortcomings of the information/influence model of communication, particularly in the empirical study of interspecific communicative interactions. It then presents an alternative theoretical model, based on recent contributions in psycholinguistics and semiotics. The semiotic alignment model views communication as a dynamic (...) process of joint semiosis resulting in the alignment of the interactants’ own-worlds (Umwelten). It is argued that this model can improve our understanding of communicative interactions between heterospecifics and provide the basis for future work in the empirical study of interspecific communication. (shrink)

The aim of the paper is to discuss and evaluate the role of positive emotions for cooperation in dialogical inquiry. I analyse dialogical interactions as vehicles for inquiry, and the role of positive emotions in knowledge gain is illustrated in terms of a case study taken from Socratic Dialogue, a contemporary method used in education for fostering group knowledge. I proceed as follows. After having illustrated the case study, I analyse it through the conceptual tools of distributed cognition and character-based (...) virtue epistemology, focusing on the two functions that emotions seem to play in the process of knowledge-building. These functions are motives for joint inquiry, and building blocks of the affective environment where the inquiry takes place. Positive emotions such as love and gratitude foster knowledge generation by providing an environment for posing questions and exploring aspects of a specific topic that a subject would not investigate outside of a group. This analysis helps me defend the thesis for which positive emotions are beneficial for cooperation. Because cooperation is the process that leads a group to cognitive transformation, emotions that support cooperation are beneficial for group knowledge creation as well. I assume that the beneficial function that positive emotions play within dialogical inquiry is the one of enhancement of cooperation. A beneficial factor not only comprises positive emotions that facilitate and strengthen cooperation among the agents in their epistemic practices, but also consists of such emotions that nurture the epistemic agents, enhancing their responsibility to generate epistemic goods, as propositional knowledge or explanatory understanding, for example. Thus, the responsibility toward the epistemic practice disclose the ethical dimension of group inquiry. (shrink)