Imitation and mirroring processes are necessary but not sufficient conditions for children to develop human sociality. Human sociality entails more than the equivalence and connectedness of perceptual experiences. It corresponds to the sense of a shared world made of shared values. It originates from complex ‘open’ systems of reciprocation and negotiation, not just imitation and mirroring processes that are by definition ‘closed’ systems. From this premise, we argue that if imitation and mirror processes are important foundations for sociality, human inter-subjectivity (...) develops primarily in reciprocation, not just imitation. Imitation provides a basic sense of social connectedness and mutual acknowledgment of existing with others that are ‘like me.’ However, it does not allow for the co-construction of meanings with others. For human sociality to develop, imitation and mirroring processes need to be supplemented by an open system of reciprocation. Developmental research shows that from the second month, mirroring, imitative, and other contagious emotional responses are by-passed. Imitation gives way to first signs of reciprocation (primary intersubjectivity), joint attention to objects (secondary intersubjectivity), the emergence of values that are jointly represented and negotiated with others (tertiary intersubjectivity), and eventually the development of an ethical stance accompanying theories of mind by 4 years of age. We review this development and propose that if mirroring processes enable individuals to bridge their subjective experiences, human inter-subjectivity proper develops from reciprocal social exchanges that lead to value negotiation and mutual recognition, both cardinal trademarks of human sociality. (shrink)

Theory of mind, the attribution of mental states to others is one form of social cognition. The aim of this paper is to highlight the importance of another, much simpler, form of social cognition, which I call vicarious representation. Vicarious representation is the attribution of other-centered properties to objects. This mental capacity is different from, and much simpler than, theory of mind as it does not imply the understanding (or representation) of the mental (or even perceptual) states of another agents. (...) I argue that the most convincing experiments that are supposed to show that non-human primates have theory of mind in fact demonstrate that they are capable of vicarious representation. The same is true for the experiments about the theory of mind of infants under 12 months. (shrink)

Cooperation admits of degrees. When factory workers stage a slowdown, they do not cease to cooperate with management in the production of goods altogether, but they are not fully cooperative either. Full cooperation implies that participants in a joint action are committed to rendering appropriate contributions as needed toward their joint end so as to bring it about, consistently with the type of action and the generally agreed upon constraints within which they work, as efficiently as they can, where their (...) contributions are sensitive to information (where available) about how others are contributing in the sense that they adjust as needed their contributions in light of information about how others are contributing to ensure effective pursuit of their joint end, where this includes rendering aid to other participants if needed, insofar as they are able. Full cooperation entails those cooperating are engaged in a joint intentional action. Some prominent studies of joint intentional action focus exclusively on cases of full cooperation (notably that of Michael Bratman (2014)). But not all joint intentional action is fully cooperative. One example is the work slowdown. Another example is provided by competitive games like chess and football, or sports like boxing and wrestling, where participants are clearly not intending to contribute to the pursuit of all of the goals of the others engaged in the activity, even when those goals are internal to the type of activity in question, but instead intend actively to frustrate some of them. In this paper, I provide a taxonomy of forms of non-cooperative behavior within the context of behavior that is still to some degree cooperative, and I argue that the minimal conditions of joint intentional action define minimal cooperative behavior, that is, that minimally joint intentional action is per se minimally cooperative behavior. I define in precise terms what that comes to, and how it is possible in cases in which it seems that one or more participants are in one or more ways acting so as to frustrate the contributions of other participants to their joint action. (shrink)

Joint actions often require agents to track others’ actions while planning and executing physically incongruent actions of their own. Previous research has indicated that this can lead to visuomotor interference effects when it occurs outside of joint action. How is this avoided or overcome in joint actions? We hypothesized that when joint action partners represent their actions as interrelated components of a plan to bring about a joint action goal, each partner’s movements need not be represented in relation to distinct, (...) incongruent proximal goals. Instead they can be represented in relation to a single proximal goal – especially if the movements are, or appear to be, mechanically linked to a more distal joint action goal. To test this, we implemented a paradigm in which participants produced finger movements that were either congruent or incongruent with those of a virtual partner, and either with or without a joint action goal (the joint flipping of a switch, which turned on two light bulbs). Our findings provide partial support for the hypothesis that visuomotor interference effects can be reduced when two physically incongruent actions are represented as mechanically interdependent contributions to a joint action goal. (shrink)

Drawing on recent findings in the cognitive and neurosciences, this article discusses how people manage to predict each other’s actions, which is fundamental for joint action. We explore how a common coding of perceived and performed actions may allow actors to predict the what, when, and where of others’ actions. The “what” aspect refers to predictions about the kind of action the other will perform and to the intention that drives the action. The “when” aspect is critical for all joint (...) actions requiring close temporal coordination. The “where” aspect is important for the online coordination of actions because actors need to effectively distribute a common space. We argue that although common coding of perceived and performed actions alone is not sufficient to enable one to engage in joint action, it provides a representational platform for integrating the actions of self and other. The final part of the paper considers links between lower‐level processes like action simulation and higher‐level processes like verbal communication and mental state attribution that have previously been at the focus of joint action research. (shrink)

The discovery of so-called ‘mirror neurons’ - found to respond both to own actions and the observation of similar actions performed by others - has been enormously influential in the cognitive sciences and beyond. Given the self-other symmetry these neurons have been hypothesized as underlying a ‘mirror mechanism’ that lets us share representations and thereby ground core social cognitive functions from intention understanding to linguistic abilities and empathy. I argue that mirror neurons are important for very different reasons. Rather than (...) a symmetric ubiquitous or context- independent mechanism, I propose that these neurons are part of broader sensorimotor circuits, which help us navigate and predict the social affordance space that we meet others in. To develop both the critical and positive project I analyze the interpretive choices and the debate surrounding the mirror neuron research and show how the field is marred by highly questionable assumptions about respectively motor and social cognition. The discovery of mirror neurons - and the sensorimotor circuits of which these neurons are a part – actually empirically challenge many of these tacit assumptions. Findings of sensorimotor goal representations at levels of abstraction well beyond actual sensory information and kinetic movements challenge the idea of motor cognition as primarily output production. Additionally, the focus on 3rd person mindreading of hidden mental states is misguiding the field of social cognition. Much ‘mind-reading’ seems rooted in sensorimotor representations and a developmentally primary 2nd person understanding of actions and the mental lives of others, which precisely breaks the assumed dichotomy between mind and behavior. I propose a Social Affordance model where parallel fronto-parietal sensorimotor circuits support representations not just of other people’s actions but of the overall social affordance space. It is a process that monitors concrete goals and teleological possibilities that the environment affords respectively oneself and other present agents. With this model I hypothesize that the complex spectrum of sensorimotor integrations are indeed essential not only to normal action choice calibration but also to social cognitive abilities, as the sensorimotor teleological representations let us relate to others and understand their action choices in a shared pragmatic and intentional context. (shrink)

Research on linguistic interaction suggests that two or more individuals can sometimes form adaptive and cohesive systems. We describe an “alignment system” as a loosely interconnected set of cognitive processes that facilitate social interactions. As a dynamic, multi-component system, it is responsive to higher-level cognitive states such as shared beliefs and intentions (those involving collective intentionality) but can also give rise to such shared cognitive states via bottom-up processes. As an example of putative group cognition we turn to transactive memory (...) and suggest how further research on alignment in these cases might reveal how such systems can be genuinely described as cognitive. Finally, we address a prominent critique of collective cognitive systems, arguing that there is much empirical and explanatory benefit to be gained from considering the possibility of group cognitive systems, especially in the context of small-group human interaction. (shrink)

An important shift is taking place in social cognition research, away from a focus on the individual mind and toward embodied and participatory aspects of social understanding. Empirical results already imply that social cognition is not reducible to the workings of individual cognitive mechanisms. To galvanize this interactive turn, we provide an operational definition of social interaction and distinguish the different explanatory roles – contextual, enabling and constitutive – it can play in social cognition. We show that interactive processes are (...) more than a context for social cognition: they can complement and even replace individual mechanisms. This new explanatory power of social interaction can push the field forward by expanding the possibilities of scientific explanation beyond the individual. (shrink)

Research on collective emotion spans social sciences, psychology and philosophy. There are detailed case studies and diverse theories of collective emotion. However, experimental evidence regarding the universal characteristics, antecedents and consequences of collective emotion remains sparse. Moreover, current research mainly relies on emotion self-reports, accounting for the subjective experience of collective emotion and ignoring their cognitive and physiological bases. In response to these challenges, we argue for experimental research on collective emotion. We start with an overview of theoretical frameworks to (...) identify a set of three characteristics of collective emotion. Based on research in cognitive and affective sciences, we then examine the corresponding candidate mechanisms. Finally, we highlight outstanding questions, review experimental evidence, and suggest ideas for future experimental research. (shrink)

In this article, we suggest that the study of social interactions and the development of a “sense of agency” in joint action can help determine the content of relevant explanations to be implemented in artificial systems to make them “explainable.” The introduction of automated systems, and more broadly of Artificial Intelligence, into many domains has profoundly changed the nature of human activity, as well as the subjective experience that agents have of their own actions and their consequences – an experience (...) that is commonly referred to as sense of agency. We propose to examine the empirical evidence supporting this impact of automation on individuals’ sense of agency, and hence on measures as diverse as operator performance, system explicability and acceptability. Because of some of its key characteristics, AI occupies a special status in the artificial systems landscape. We suggest that this status prompts us to reconsider human–AI interactions in the light of human–human relations. We approach the study of joint actions in human social interactions to deduce what key features are necessary for the development of a reliable sense of agency in a social context and suggest that such framework can help define what constitutes a good explanation. Finally, we propose possible directions to improve human–AI interactions and, in particular, to restore the sense of agency of human operators, improve their confidence in the decisions made by artificial agents, and increase the acceptability of such agents. (shrink)

From playing basketball to ordering at a food counter, we frequently and effortlessly coordinate our attention with others towards a common focus: we look at the ball, or point at a piece of cake. This non-verbal coordination of attention plays a fundamental role in our social lives: it ensures that we refer to the same object, develop a shared language, understand each other’s mental states, and coordinate our actions. Models of joint attention generally attribute this accomplishment to gaze coordination. But (...) are visual attentional mechanisms sufficient to achieve joint attention, in all cases? Besides cases where visual information is missing, we show how combining it with other senses can be helpful, and even necessary to certain uses of joint attention. We explain the two ways in which non-visual cues contribute to joint attention: either as enhancers, when they complement gaze and pointing gestures in order to coordinate joint attention on visible objects, or as modality pointers, when joint attention needs to be shifted away from the whole object to one of its properties, say weight or texture. This multisensory approach to joint attention has important implications for social robotics, clinical diagnostics, pedagogy and theoretical debates on the construction of a shared world. (shrink)

Previous research has shown that the perception that one’s partner is investing effort in a joint action can generate a sense of commitment, leading participants to persist longer despite increasing boredom. The current research extends this finding to human-robot interaction. We implemented a 2-player version of the classic snake game which became increasingly boring over the course of each round, and operationalized commitment in terms of how long participants persisted before pressing a ‘finish’ button to conclude each round. Participants were (...) informed that they would be linked via internet with their partner, a humanoid robot. Our results reveal that participants persisted longer when they perceived what they believed to be cues of their robot partner’s effortful contribution to the joint action. This provides evidence that the perception of a robot partner’s effort can elicit a sense of commitment to human-robot interaction. (shrink)

What enables individuals to act together? Recent discoveries suggest that a variety of mechanisms are involved. But something fundamental is yet to be investigated. In joint action, agents represent a collective goal, or so it is often assumed. But how, if at all, are collective goals represented in joint action and how do such representations impact performance? To investigate this question we adapted a bimanual paradigm, the circle-line drawing paradigm, to contrast two agents acting in parallel with two agents performing (...) a joint action. Participants were required to draw lines or circles while observing circles or lines being drawn. The findings indicate that interpersonal motor coupling may occur in joint but not parallel action. This suggests that participants in joint actions can represent collective goals motorically. (shrink)

In recent years, a number of philosophers and cognitive scientists have advocated for an ‘interactive turn’ in the methodology of social-cognition research: to become more ecologically valid, we must design experiments that are interactive, rather than merely observational. While the practical aim of improving ecological validity in the study of social cognition is laudable, we think that the notion of ‘interaction’ is not suitable for this task: as it is currently deployed in the social cognition literature, this notion leads to (...) serious conceptual and methodological confusion. In this paper, we tackle this confusion on three fronts: 1) we revise the ‘interactionist’ definition of interaction; 2) we demonstrate a number of potential methodological confounds that arise in interactive experimental designs; and 3) we show that ersatz interactivity works just as well as the real thing. We conclude that the notion of ‘interaction’, as it is currently being deployed in this literature, obscures an accurate understanding of human social cognition. (shrink)

A co-actor’s intentionality has been suggested to be a key modulating factor for joint action effects like the joint Simon effect (JSE). However, in previous studies intentionality has often been confounded with agency defined as perceiving the initiator of an action as being the causal source of the action. The aim of the present study was to disentangle the role of agency and intentionality as modulating factors of the JSE. In Experiment 1, participants performed a joint go/nogo Simon task next (...) to a co-actor who either intentionally controlled a response button with own finger movements (agency+/intentionality+) or who passively placed the hand on a response button that moved up and down on its own as triggered by computer signals (agency-/intentionality-). In Experiment 2, we included a condition in which participants believed that the co-actor intentionally controlled the response button with a Brain-Computer Interface while placing the response finger clearly besides the response button, so that the causal relationship between agent and action effect was perceptually disrupted (agency-/intentionality+). As a control condition, the response button was computer controlled while the co-actor placed the response finger besides the response button (agency-/intentionality-). We observed a JSE when the co-actor responded intentionally and the causal relationship between co-actor and action effect could be perceived, but not when the co-actor did not respond intentionally and the causal relationship was disrupted (Experiment 1). When the intentionality of the co-actor was maintained but the perception of the causal relationship between co-actor and action effect destroyed, the JSE was absent (Experiment 2). Our findings clearly indicate a vital role of a co-actor’s agency for the JSE and suggest that the ascription of agency is strongly perceptually grounded. (shrink)

Until recently, it was assumed that co-representation of others’ actions, an essential part in joint action, is biologically tuned. However, research demonstrated that we also simulate actions of non-biological interaction partners under certain conditions. In the present study, we investigated whether perceived intentionality or perspective taking is the underlying mechanisms of this phenomenon. Participants saw a short video fragment of a non-biological agent as main character. The movements of this agent were either described as intentional or as unintentional. Furthermore, participants (...) were instructed to either take the perspective of this non-biological agent or not. Results show that perspective taking and perceived intentionality both lead to action co-representation of non-biological actions. Possible explanations for these findings are discussed. (shrink)

Cognition in work teams has been predominantly understood and explained in terms of shared cognition with a focus on the similarity of static knowledge structures across individual team members. Inspired by the current zeitgeist in cognitive science, as well as by empirical data and pragmatic concerns, we offer an alternative theory of team cognition. Interactive Team Cognition (ITC) theory posits that (1) team cognition is an activity, not a property or a product; (2) team cognition should be measured and studied (...) at the team level; and (3) team cognition is inextricably tied to context. There are implications of ITC for theory building, modeling, measurement, and applications that make teams more effective performers. (shrink)

The ability to understand and communicate about the actions of others is a fundamental aspect of our daily activity. How can we talk about what others are doing? What qualities do different actions have such that they cause us to see them as being different or similar? What is the connection between what we see and the development of concepts and words or expressions for the things that we see? To what extent can two different people see and talk about (...) the same things? Is there a common basis for our perception, and is there then a common basis for the concepts we form and the way in which the concepts become lexicalized in language? The broad purpose of this thesis is to relate aspects of perception, categorization and language to action recognition and conceptualization. This is achieved by empirically demonstrating a prototype structure for action categories and by revealing the effect this structure has on language via the semantic organization of verbs for natural actions. The results also show that implicit access to categorical information can affect the perceptual processing of basic actions. These findings indicate that our understanding of human actions is guided by the activation of high level information in the form of dynamic action templates or prototypes. More specifically, the first two empirical studies investigate the relation between perception and the hierarchical structure of action categories, i.e., subordinate, basic, and superordinate level action categories. Subjects generated lists of verbs based on perceptual criteria. Analyses based on multidimensional scaling showed a significant correlation for the semantic organization of a subset of the verbs for English and Swedish speaking subjects. Two additional experiments were performed in order to further determine the extent to which action categories exhibit graded structure, which would indicate the existence of prototypes for action categories. The results from typicality ratings and category verification showed that typicality judgments reliably predict category verification times for instances of different actions. Finally, the results from a repetition priming paradigm suggest that high level information about the categorical differences between actions can be implicitly activated and facilitates the later visual processing of displays of biological motion. This facilitation occurs for upright displays, but appears to be lacking for displays that are shown upside down. These results show that the implicit activation of information about action categories can play a critical role in the perception of human actions. (shrink)

Until recently, it was assumed that co-representation of others’ actions, an essential part in joint action, is biologically tuned. However, research demonstrated that we also simulate actions of non-biological interaction partners under certain conditions. In the present study, we investigated whether perceived intentionality or perspective taking is the underlying mechanisms of this phenomenon. Participants saw a short video fragment of a non-biological agent as main character. The movements of this agent were either described as intentional or as unintentional. Furthermore, participants (...) were instructed to either take the perspective of this non-biological agent or not. Results show that perspective taking and perceived intentionality both lead to action co-representation of non-biological actions. Possible explanations for these findings are discussed. (shrink)

The sense of agency has received much attention in the context of individual action but not in the context of joint action. We investigated how the sense of agency developed during individual and dyadic performance while people learned a haptic coordination task. The sense of agency increased with better performance in all groups. Individuals and dyads showed a differential sense of agency after initial task learning, with dyads showing a minimal increase. The sense of agency depended on the context in (...) which the task was first learnt, as transfer from joint to individual performance resulted in an illusory boost in the sense of agency. Whereas the quality of performance related to the sense of agency, the generated forces to achieve the task did not. Our findings are consistent with a predictive model account at the perceptual level, such that the sense of agency relies most strongly on sharable perceptual information. (shrink)

Recent research into how musicians coordinate their expressive timing, phrasing, articulation, dynamics, and other stylistic characteristics during performances has highlighted the role of predictive processes, as musicians must anticipate how their partners will play in order to be together. Several studies have used information flow techniques such as Granger causality to show that upcoming movements of a musician can be predicted from immediate past movements of fellow musicians. Although musicians must move to play their instruments, a major goal of music (...) making is to create a joint interpretation through the sounds they produce. Yet, information flow techniques have not been applied previously to examine the role that fellow musicians' sound output plays in these predictive processes and whether this changes as they learn to play together. In the present experiment, we asked professional violinists to play along with recordings of two folk pieces, each eight times in succession, and compared the amplitude envelopes of their performances with those of the recordings using Granger causality to measure information flow and cross-correlation to measure similarity and synchronization. In line with our hypotheses, our measure of information flow was higher from the recordings to the performances than vice versa, and decreased as the violinists became more familiar with the recordings over trials. This decline in information flow is consistent with a gradual shift from relying on auditory cues to predict the recording to relying on an internally-based (learned) model built through repetition. There was also evidence that violinists became more synchronized with the recordings over trials. These results shed light on the planning and learning processes involved in the aligning of expressive intentions in group music performance and lay the groundwork for the application of Granger causality to investigate information flow through sound in more complex musical interactions. (shrink)

Recent studies suggest that covering the face inhibits the recognition of identity and emotional expressions. However, it might also make the eyes more salient, since they are a reliable index to orient our social and spatial attention. This study investigates whether the pervasive interaction with people with face masks fostered by the COVID-19 pandemic modulates the processing of spatial information essential to shift attention according to other’s eye-gaze direction, and whether this potential modulation interacts with motor responses. Participants were presented (...) with face cues orienting their gaze to a congruent or incongruent target letter location while wearing a surgical mask, a patch, or nothing. The task required to discriminate the identity of the lateralized target letters by pressing one of two lateralized response keys, in a corresponding or a non-corresponding position with respect to the target. Results showed that GCE was not modulated by the presence of the Mask, but it occurred in the No-Mask condition, confirming previous studies. Crucially, the GCE interacted with Simon effect in the Mask and Control conditions, though in different ways. While in the Mask condition the GCE emerged only when target and response positions corresponded, in the Control condition it emerged only when they did not correspond. These results indicate that people with face masks induce us to jointly orient our visual attention in the direction of the seen gaze in those conditions resembling a general approaching behavior. This is likely promoted by the fact that we tend to perceive wearing the mask as a personal safety measure and, thus, someone wearing the face mask is perceived as a trustworthy person. In contrast, people with a patch on their face can be perceived as more threatening, therefore inducing a GCE in those conditions associated with a general avoidance behavior. (shrink)

Until recently, it was assumed that co-representation of others’ actions, an essential part in joint action, is biologically tuned. However, research demonstrated that we also simulate actions of non-biological interaction partners under certain conditions. In the present study, we investigated whether perceived intentionality or perspective taking is the underlying mechanisms of this phenomenon. Participants saw a short video fragment of a non-biological agent as main character. The movements of this agent were either described as intentional or as unintentional. Furthermore, participants (...) were instructed to either take the perspective of this non-biological agent or not. Results show that perspective taking and perceived intentionality both lead to action co-representation of non-biological actions. Possible explanations for these findings are discussed. (shrink)

Previous research has shown that stimulus–response (SR) binding and retrieval processes also occur when responses are only observed in another person ( Giesen et al., 2014 ). Importantly, this effect depends on the two individuals interacting interdependently during the task (e.g., competition or cooperation). Interdependence, however, must not necessarily result from task-related demands, but can also reflect an intrinsic feature of a given relationship. The present study examines whether observing responses of one’s romantic partner also produces stimulus-based retrieval of observed (...) responses even if the task itself does not involve interdependence. Participants performed a task pairwise, either with their romantic partner or with a stranger. In a sequential prime-probe design, both participants of a pair gave color responses themselves (actors) or merely observed these (observers) in alternating fashion. As expected, stimulus-based retrieval of observationally acquired SR-bindings occurred only in romantically involved pairs; participants interacting with a stranger showed no retrieval effects. We conclude that mental representations of self and other are more closely intertwined in romantic couples, which produces automatic retrieval of observationally acquired SR binding effects even independently of the task itself. (shrink)

Humans are experts in cooperating with each other when trying to accomplish tasks they cannot achieve alone. Recent studies of joint action have shown that when performing tasks together people strongly rely on the neurocognitive mechanisms that they also use when performing actions individually, that is, they predict the consequences of their co‐actor’s behavior through internal action simulation. Context‐sensitive action monitoring and action selection processes, however, are relatively underrated but crucial ingredients of joint action. In the present paper, we try (...) to correct the somewhat simplified view on joint action by reviewing recent studies of joint action simulation, monitoring, and selection while emphasizing the intricate interrelationships between these processes. We complement our review by defining the contours of a neurologically plausible computational framework of joint action. (shrink)

Numerous philosophical theories of joint agency and its intentional structure have been developed in the past few decades. These theories have offered accounts of joint agency that appeal to higher-level states that are?shared? in some way. These accounts have enhanced our understanding of joint agency, yet there are a number of lower-level cognitive phenomena involved in joint action that philosophers rarely acknowledge. In particular, empirical research in cognitive science has revealed that when individuals engage in a joint activity such as (...) conversation or joint problem solving, they become aligned at multiple levels. We argue that this phenomenon of alignment is crucial to understanding joint actions and should be integrated with philosophical approaches. In this paper, we sketch a possible integration, and draw out its implications for understanding of joint agency and collective intentionality. The result is a process-based, dynamic account of joint action that integrates both low-level and high-level states, and seeks to capture the separate processes of how a joint action is initiated and sustained. (shrink)

Prior research suggests that the action system is responsible for creating an immediate sense of self by determining whether certain sensations and perceptions are the result of one's own actions. In addition, it is assumed that declarative, episodic, or autobiographical memories create a temporally extended sense of self or some form of identity. In the present article, we review recent evidence suggesting that action (procedural) knowledge also forms part of a person's identity, an action identity, so to speak. Experiments that (...) addressed self-recognition of past actions, prediction, and coordination provide ample evidence for this assumption. The phenomena observed in these experiments can be explained by the assumption that observing an action results in the activation of action representations, the more so, when the action observed corresponds to the way in which the observer would produce it. (shrink)