ABSTRACTPeer action coordination has been often studied in terms of its underlying cognitive mechanisms, and little is known about its emotional processes. The aim of the present study was to inves...

In the absence of pre‐established communicative conventions, people create novel communication systems to successfully coordinate their actions toward a joint goal. In this study, we address two types of such novel communication systems: sensorimotor communication, where the kinematics of instrumental actions are systematically modulated, versus symbolic communication. We ask which of the two systems co‐actors preferentially create when aiming to communicate about hidden object properties such as weight. The results of three experiments consistently show that actors who knew the weight (...) of an object transmitted this weight information to their uninformed co‐actors by systematically modulating their instrumental actions, grasping objects of particular weights at particular heights. This preference for sensorimotor communication was reduced in a fourth experiment where co‐actors could communicate with weight‐related symbols. Our findings demonstrate that the use of sensorimotor communication extends beyond the communication of spatial locations to non‐spatial, hidden object properties. (shrink)

Joint actions typically involve a sense of togetherness that has a distinctive phenomenological component. While it has been hypothesized that group size, hierarchical structure, division of labour, and expertise impact agents’ phenomenology during joint actions, the studies conducted so far have mostly involved dyads performing simple actions. We explore in this study the complex case of collectively improvised musical performances, focusing particularly on the way group size and interactional patterns modulate the phenomenology of joint action. We recorded two expert improvisation (...) ensembles of contrasting sizes and collected data about their musical behaviour, as well as reports about five aspects of their phenomenology and about their musical intentions. Our overall data enabled us to assess how those five phenomenological dimensions related to one another during jointly improvised performances. They also show how such phenomenology varied with the way improvisers dynamically related to one another throughout the performance. Finally, we observe that group size strongly altered the phenomenology of improvisers who otherwise shared many characteristics. Our study thus sheds light on the interactional and structural parameters that shape and modulate our felt experience when acting together, and thereby highlights the importance of pluralism for studying the phenomenology of joint action. (shrink)

Musical ensemble performances provide an ideal environment to gain knowledge about complex human interactions. Network structures of synchronization can reflect specific roles of individual performers on the one hand and a higher level of organization of all performers as a superordinate system on the other. This study builds on research on joint singing, using hyperscanning of respiration and heart rate variability from eight professional singers. Singers performed polyphonic music, distributing their breathing within the same voice and singing without and with (...) physical contact: that is touching each other's shoulder or waist. The idea of singing with touch was motivated by historical depictions of ensemble performances that showed singers touching each other. It raises the question of the potential benefit of touch for group performances. From a psycho-physiological point of view, physical contact should increase the synchronization of singing coordination. The results confirm previous findings on synchronization of respiration and HRV during choir singing and extend those findings to a non-homophonic musical repertoire while also revealing an increase in synchronization in respiration during physical contact. These effects were significant across different frequency ranges. The effect of physical contact was stronger when all singers were singing in comparison to the partial ensemble. Importantly, the synchronization could not be fully explained by the singing action or by the standing position or touch. This finding suggests a higher level of organization of all singers, forming a superordinate system. (shrink)

When people are performing a task, it is hard to know whether they are about to make a mistake. Klaproth, Halbrügge, Krol, Vernaleken, Zander, and Russwinkel address this by recording EEG signals while people are performing a flight control task, and show that by examining the EEG signal they can determine when people failed to notice particular stimuli, which could lead to better assistive tools.

Human expression is open-ended, versatile, and diverse, ranging from ordinary language use to painting, from exaggerated displays of affection to micro-movements that aid coordination. Here we present and defend the claim that this expressive diversity is united by an interrelated suite of cognitive capacities, the evolved functions of which are the expression and recognition of informative intentions. We describe how evolutionary dynamics normally leash communication to narrow domains of statistical mutual benefit, and how expression is unleashed in humans. The relevant (...) cognitive capacities are cognitive adaptations to living in a partner choice social ecology; and they are, correspondingly, part of the ordinarily developing human cognitive phenotype, emerging early and reliably in ontogeny. In other words, we identify distinctive features of our species' social ecology to explain how and why humans, and only humans, evolved the cognitive capacities that, in turn, lead to massive diversity and open-endedness in means and modes of expression. Language use is but one of these modes of expression, albeit one of manifestly high importance. We make cross-species comparisons, describe how the relevant cognitive capacities can evolve in a gradual manner, and survey how unleashed expression facilitates not only language use, but also novel behaviour in many other domains too, focusing on the examples of joint action, teaching, punishment, and art, all of which are ubiquitous in human societies but relatively rare in other species. Much of this diversity derives from graded aspects of human expression, which can be used to satisfy informative intentions in creative and new ways. We aim to help reorient cognitive pragmatics, as a phenomenon that is not a supplement to linguistic communication and on the periphery of language science, but rather the foundation of the many of the most distinctive features of human behaviour, society, and culture. (shrink)

Human interactions are often improvised rather than scripted, which suggests that efficient coordination can emerge even when collective plans are largely underspecified. One possibility is that such forms of coordination primarily rely on mutual influences between interactive partners, and on perception–action couplings such as entrainment or mimicry. Yet some forms of improvised joint actions appear difficult to explain solely by appealing to these emergent mechanisms. Here, we focus on collective free improvisation, a form of highly unplanned creative practice where both (...) agents' subjective reports and the complexity of their interactions suggest that shared intentions may sometimes emerge to support coordination during the course of the improvisation, even in the absence of verbal communication. In four experiments, we show that shared intentions spontaneously emerge during collective musical improvisations, and that they foster coordination on multiple levels, over and beyond the mere influence of shared information. We also show that musicians deploy communicative strategies to manifest and propagate their intentions within the group, and that this predicts better coordination. Overall, our results suggest that improvised and scripted joint actions are more continuous with one another than it first seems, and that they differ merely in the extent to which they rely on emergent or planned coordination mechanisms. (shrink)

We studied collaborative skill acquisition in a dynamic setting with the game Co-op Space Fortress. While gaining expertise, the majority of subjects became increasingly consistent in the role they adopted without being able to communicate. Moreover, they acted in anticipation of the future task state. We constructed a collaborative skill acquisition model in the cognitive architecture ACT-R that reproduced subject skill acquisition trajectory. It modeled role adoption through reinforcement learning and predictive processes through motion extrapolation and learned relevant control parameters (...) using both a reinforcement learning procedure and a new to ACT-R supervised learning procedure. This is the first integrated cognitive model of collaborative skill acquisition and, as such, gives us valuable insights into the multiple cognitive processes that are involved in learning to collaborate. (shrink)

The sense of agency – the subjective feeling of being in control of our own actions – is one central aspect of the phenomenology of action. Computational models provided important contributions toward unveiling the mechanisms underlying the sense of agency in individual action. In particular, the sense of agency is believed to be related to the match between the actual and predicted consequences of our own actions. In the study of joint action, models are even more necessary to understand the (...) mechanisms underlying the development of coordination strategies and how the subjective experiences of control emerge during the interaction. In a joint action, we not only need to predict the consequences of our own actions; we also need to predict the actions and intentions of our partner, and to integrate these predictions to infer their joint consequences. Understanding our partner and developing mutually satisfactory coordination strategies are key components of joint action and in the development of the sense of joint agency. Here we discuss a computational architecture which addresses the sense of agency during intentional, real-time joint action. We first reformulate previous accounts of the sense of agency in probabilistic terms, as the combination of prior beliefs about the action goals and constraints, and the likelihood of the predicted movement outcomes. To look at the sense of joint agency, we extend classical computational motor control concepts - optimal estimation and optimal control. Regarding estimation, we argue that in joint action the players not only need to predict the consequences of their own actions, but also need to predict partner’s actions and intentions and to integrate these predictions to infer their joint consequences. As regards action selection, we use differential game theory – in which actions develop in continuous space and time - to formulate the problem of establishing a stable form of coordination and as a natural extension of optimal control to joint action. The resulting model posits two concurrent observer-controller loops, accounting for ‘joint’ and ‘self’ action control. The two observers quantify the likelihoods of being in control alone or jointly. Combined with prior beliefs, they provide weighing signals which are used to modulate the ‘joint’ and ‘self’ motor commands. We argue that these signals can be interpreted as the subjective sense of joint and self agency. We demonstrate the model predictions by simulating a sensorimotor interactive task where two players are mechanically coupled and are instructed to perform planar movements to reach a shared final target by crossing two differently located intermediate targets. In particular, we explore the relation between self and joint agency and the information available to each player about their partner. The proposed model provides a coherent picture of the inter-relation of prediction, control, and the sense of agency in a broader range of joint actions. (shrink)