The pull to coordinate with other individuals is fundamental, serving as the basis for our social connectedness to others. Discussed is a dynamical and ecological perspective to joint action, an approach that embeds the individual’s mind in a body and the body in a niche, a physical and social environment. Research on uninstructed coordination of simple incidental rhythmic movement, along with research on goal‐directed, embodied cooperation, is reviewed. Finally, recent research is discussed that extends the coordination and cooperation studies, examining (...) how synchronizing with another, and how emergent social units of perceiving and acting are reflected in people’s feelings of connection to others. (shrink)

When two agents engage in a joint action, such as rowing together, they exercise joint know-how. But what is the relationship between the joint know-how of the two agents and the know-how each agent possesses individually? I construct an “active mutual enablement” account of this relationship, according to which joint know-how arises when each agent knows how to predict, monitor, and make failure-averting adjustments in response to the behaviour of the other agent, while actively enabling the other to make such (...) adjustments. I defend the AME account from three objections, and I then use this account as the platform for an examination of the reducibility of joint know-how to joint propositional knowledge. A summative account of joint propositional knowledge is incompatible with the reduction of joint know-how to joint propositional knowledge, whereas a distributive account is not. I close by highlighting some open questions the AME account brings into view concerning the evolutionary origin and scaling up of joint know-how. (shrink)

This chapter aims at investigating the phenomenology of joint action and at gaining a better understanding of (1) how the sense of agency one experiences when engaged in a joint action differs from the sense of agency one has for individual actions and (2) how the sense of agency one experiences when engaged in a joint action differs according to the type of joint action and to the role one plays in it.

Many philosophers have offered accounts of shared actions aimed at capturing what makes joint actions intentionally joint. I first discuss two leading accounts of shared intentions, proposed by Michael Bratman and Margaret Gilbert. I argue that Gilbert’s account imposes more normativity on shared intentions than is strictly needed and that Bratman’s account requires too much cognitive sophistication on the part of agents. I then turn to the team-agency theory developed by economists that I see as offering an alternative route to (...) shared intention. I concentrate on Michael Bacharach’s version of team-agency theory, according to which shared agency is a matter of team-reasoning, team-reasoning depends on group identification and group identification is the result of processes of self-framing. I argue that it can yield an account of shared intention that is less normatively loaded and less cognitively demanding. (shrink)

No one denies that people adapt what they say and how they interpret what is said to them, depending on their interactive partners. What is controversial is when and how they do so. Several psycholinguistics research programs have found what appear to be failures to adapt to partners in the early moments of processing and have used this evidence to argue for modularity in the language processing architecture, claiming that the system cannot take into account a partner’s distinct needs or (...) knowledge early in processing. We review the evidence for both early and delayed partner‐specific adaptations, and we identify some challenges and difficulties with interpreting this evidence. We then discuss new analyses from a previously published referential communication experiment (Metzing & Brennan, 2003) demonstrating that partner‐specific effects need not occur late in processing. In contrast to Pickering and Garrod (2004) and Keysar, Barr, and Horton (1998b), we conclude that there is no good evidence that early processing has to be be “egocentric,”“dumb,” or encapsulated from social knowledge or common ground, but that under some circumstances, such as when one partner has made an attribution about another’s knowledge or needs, processing can be nimble enough to adapt quite early to a perspective different from one’s own. (shrink)

Robots are increasingly envisaged as our future cohabitants. However, while considerable progress has been made in recent years in terms of their technological realization, the ability of robots to inter-act with humans in an intuitive and social way is still quite limited. An important challenge for social robotics is to determine how to design robots that can perceive the user’s needs, feelings, and intentions, and adapt to users over a broad range of cognitive abilities. It is conceivable that if robots (...) were able to adequately demonstrate this, humans would eventually accept them as social companions. We argue that the best way to achieve this is using a systematic experimental approach based on behavioral and physiological neuroscience methods such as motion/eye tracking, electroencephalography (EEG), or functional near-infrared spectroscopy (fNIRS) embedded in interactive human-robot paradigms. This approach requires understanding how humans interact with each other, how they perform tasks together and how they develop feelings of social connection over time, and using these insights to formulate design principles that make social robots attuned to the workings of the human brain. In this review, we put forward the argument that the likelihood of artificial agents being perceived as social companions can be increased by designing them in a way that they are perceived as intentional agents that activate areas in the human brain involved in social-cognitive processing. We first review literature related to social-cognitive mechanisms involved in human-human interactions, and high-light the importance of perceiving others as intentional agents to activate these brain areas. We then discuss how attribution of intentionality can positively affect human-robot interaction by (a) fostering feelings of social connection, empathy and prosociality, and by (b) enhancing performance on joint human-robot tasks. Lastly, we describe circumstances under which attribution of intentionality to robot agents might be disadvantageous, and discuss challenges associated with designing social robots that are inspired by neuroscientific principles. (shrink)

Cognition in work teams has been predominantly understood and explained in terms of shared cognition with a focus on the similarity of static knowledge structures across individual team members. Inspired by the current zeitgeist in cognitive science, as well as by empirical data and pragmatic concerns, we offer an alternative theory of team cognition. Interactive Team Cognition (ITC) theory posits that (1) team cognition is an activity, not a property or a product; (2) team cognition should be measured and studied (...) at the team level; and (3) team cognition is inextricably tied to context. There are implications of ITC for theory building, modeling, measurement, and applications that make teams more effective performers. (shrink)

Joint action, critical to human social interaction and communication, has garnered increasing scholarly attention in many areas of inquiry, yet its development remains little explored. This paper reviews research on the growth of joint action over the first 2 years of life to show how children become progressively more able to engage deliberately, autonomously, and flexibly in joint action with adults and peers. It is suggested that a key mechanism underlying the dramatic changes in joint action over the second year (...) of life is the ability to reflect consciously on oneself and one’s behavior and volition and correspondingly, on the behavior, goals, and intentions of others. (shrink)

Joint action is a growing field of research, spanning across the cognitive, behavioral, and brain sciences as well as receiving considerable attention amongst philosophers. I argue that there has been a significant oversight within this field concerning the possibility that many joint actions are driven, at least in part, by agents' social motivations rather than merely by their shared intentions. Social motivations are not directly related to the (joint) target goal of the action. Instead, when agents are mutually socially motivated (...) in joint action this is because they find acting with others rewarding in its own right. Moreover the involvement of social motivation in joint action typically enables individuals to achieve the long-term benefits associated with being part of a social bond. I argue that taking social motivations into account better prepares us for explaining a broader range of joint actions, including those that are of an antagonistic, competitive, or explorative character. Finally, I show that recognizing the importance of social motivations entails that joint actions (in general) should be understood as having the two primary functions of (1) achieving the intended target outcome of an action, and (2) attaining the benefits related to being part of a social bond. (shrink)

What is the role of language in social interaction? What does language bring to social encounters? We argue that language can be conceived of as a tool for interacting minds, enabling especially effective and flexible forms of social coordination, perspective-taking and joint action. In a review of evidence from a broad range of disciplines, we pursue elaborations of the language-as-a-tool metaphor, exploring four ways in which language is employed in facilitation of social interaction. We argue that language dramatically extends the (...) possibility-space for interaction, facilitates the profiling and navigation of joint attentional scenes, enables the sharing of situation models and action plans, and mediates the cultural shaping of interacting minds. (shrink)

When sharing a task with another person that requires turn taking, as in doubles games of table tennis, performance on the shared task is similar to performing the whole task alone. This has been taken to indicate that humans co-represent their partner’s task share, as if it were their own. Task co-representation allows prediction of the other’s responses when it is the other’s turn, and leads to response conflict in joint interference tasks. However, data from our lab cast doubt on (...) the view that task co-representation and resulting response conflict are the only or even primary source of effects observed in task sharing. Recent findings furthermore suggest another potential source of interference in joint task performance that has been neglected so far: Self-other discrimination and conflict related to agent identification (i.e., determining whether it is “my” or the other’s turn). Based on these findings we propose that participants might not always co-represent what their partner is supposed to do, but instead co-represent that another agent is responsible for part of the task, and when it is his turn. We call this account the actor co-representation account. (shrink)

Our target article proposed that language production and comprehension are interwoven, with speakers making predictions of their own utterances and comprehenders making predictions of other people's utterances at different linguistic levels. Here, we respond to comments about such issues as cognitive architecture and its neural basis, learning and development, monitoring, the nature of forward models, communicative intentions, and dialogue.

The purpose of this article is to explore the role commitments may play in shaping our sense of joint agency. First, we propose that commitments may contribute to the generation of the sense of joint agency by stabilizing expectations and improving predictability. Second, we argue that commitments have a normative element that may bolster an agent's sense of control over the joint action and help counterbalance the potentially disruptive effects of asymmetries among agents. Finally, we discuss how commitments may contribute (...) to make acting jointly emotionally rewarding, both by improving coordination and by inducing or reinforcing the circumstances under which shared emotions emerge among co-agents. (shrink)

We studied collaborative skill acquisition in a dynamic setting with the game Co-op Space Fortress. While gaining expertise, the majority of subjects became increasingly consistent in the role they adopted without being able to communicate. Moreover, they acted in anticipation of the future task state. We constructed a collaborative skill acquisition model in the cognitive architecture ACT-R that reproduced subject skill acquisition trajectory. It modeled role adoption through reinforcement learning and predictive processes through motion extrapolation and learned relevant control parameters (...) using both a reinforcement learning procedure and a new to ACT-R supervised learning procedure. This is the first integrated cognitive model of collaborative skill acquisition and, as such, gives us valuable insights into the multiple cognitive processes that are involved in learning to collaborate. (shrink)

Why games? How could anyone consider action games an experimental paradigm for Cognitive Science? In 1973, as one of three strategies he proposed for advancing Cognitive Science, Allen Newell exhorted us to “accept a single complex task and do all of it.” More specifically, he told us that rather than taking an “experimental psychology as usual approach,” we should “focus on a series of experimental and theoretical studies around a single complex task” so as to demonstrate that our theories of (...) human cognition were powerful enough to explain “a genuine slab of human behavior” with the studies fitting into a detailed theoretical picture. Action games represent the type of experimental paradigm that Newell was advocating and the current state of programming expertise and laboratory equipment, along with the emergence of Big Data and naturally occurring datasets, provide the technologies and data needed to realize his vision. Action games enable us to escape from our field's regrettable focus on novice performance to develop theories that account for the full range of expertise through a twin focus on expertise sampling and longitudinal studies of simple and complex tasks. (shrink)

In everyday interactions, humans naturally exhibit behavioral cues, such as gaze and head movements, that signal their intentions while interpreting the behavioral cues of others to predict their intentions. Such intention prediction enables each partner to adapt their behaviors to the intent of others, serving a critical role in joint action where parties work together to achieve a common goal. Among behavioral cues, eye gaze is particularly important in understanding a person's attention and intention. In this work, we seek to (...) quantify how gaze patterns may indicate a person's intention. Our investigation was contextualized in a dyadic sandwich-making scenario in which a “worker” prepared a sandwich by adding ingredients requested by a “customer.” In this context, we investigated the extent to which the customers' gaze cues serve as predictors of which ingredients they intend to request. Predictive features were derived to represent characteristics of the customers' gaze patterns. We developed a support vector machine-based (SVM-based) model that achieved 76% accuracy in predicting the customers' intended requests based solely on gaze features. Moreover, the predictor made correct predictions approximately 1.8 s before the spoken request from the customer. We further analyzed several episodes of interactions from our data to develop a deeper understanding of the scenarios where our predictor succeeded and failed in making correct predictions. These analyses revealed additional gaze patterns that may be leveraged to improve intention prediction. This work highlights gaze cues as a significant resource for understanding human intentions and informs the design of real-time recognizers of user intention for intelligent systems, such as assistive robots and ubiquitous devices, that may enable more complex capabilities and improved user experience. (shrink)

This paper develops a theory of joint attention as based on, and explicable in terms of, the exercise of a minimal kind of perceptual joint know-how. On the action-based view I shall be developing, joint forms of perception are object-involving processes constituted by perceivers’ skillfully co-ordinated motor movements in social space. Joint experience can then be understood as presenting the process to the involved perceivers and joint attention as perceivers’ focus on the object of this process. This theory reconciles at (...) least some primitivist and reductionist intuitions about joint attention. (shrink)

The contributions collected in this special issue explore the phenomenology of joint action from a broad range of different disciplinary and methodological angles, including philosophical investigation (both in the analytic and the phenomenological tradition), computational modeling, experimental study, game theory, and developmental psychology. They also vastly expand the range of discussed cases beyond the standard examples of house-painting and sauce-cooking, addressing, for example, collective musical improvisations, dancing, work at the Diversity and Equity office of a university, and historical examples of (...) collective violence such as the revolutionary Terror in France and the Nazis. In our introduction to this special issue, we group the contributions into three thematic areas – 1) the phenomenological fine-structure of joint action, 2) underlying mechanisms for joint action and 3) phenomenal preconditions for joint action. The first theme is discussed under a number of issues – a) components of the phenomenology of joint action, b) the I and the we in joint action, c) the effect of group size, structure and nature on the phenomenology of joint action and d) how do phenomenal relate to normative aspects of joint action? (shrink)

The core of human cooperation is people's ability to perform joint actions. Frequently, this requires effectively decomposing a joint task into individual subtasks, for example, when jointly shopping at the market to buy food. Surprisingly, little is known about how collaborators balance the costs of establishing a joint strategy for such decompositions and its expected benefits for a joint goal. We created a new online task that required pairs of randomly matched participants to jointly collect colored items. We then systematically (...) varied the cognitive costs and benefits of applying a color‐splitting strategy. The results showed that pairs adopted a color‐splitting strategy more often when necessary to lower cognitive costs. However, once the strategy was jointly adopted, it continued to be used even when the cost–benefits changed. Our results provide first insights on how people decompose joint tasks into individual components and how decomposition strategies may evolve into conventions. (shrink)

Altering physical actions when responding to changing environmental demands is important but not always effectively performed. This ineffectiveness, which is an error of social behavior generated by mutual interactions, is not well understood. This study investigated mechanisms of a hesitant behavior that occurs in people walking toward each other, causing people to move in the same direction when attempting to avoid a collision. Using a motion capture device affixed to 17 pairs, we first confirmed the hesitant behavior by a difference (...) between the experimental task, which involved an indeterminate situation to assess the actions of another individual, and the control task, which involved a predetermined avoiding direction, in a real-time situation involving two people. We next investigated the effect of three external factors: long distance until an event, synchronized walking cycle, and different foot relations in dyads on the hesitant behavior. A dramatic increase in freezing and near-collision behavior occurred in dyads for which the avoiding direction was not predetermined. The behavior related with the combination of long distance until an event, synchronized walking cycle, and different foot relations in dyads. We found that the hesitant behavior is influenced by an interpersonal relationship under enough distance to predict other movement. The hesitant behavior has possibly emerged as an undesired by-product of joint action. These results contribute to our understanding of the mechanisms of adaptive control of perception-action coupling in mutual interaction. (shrink)

Recent research into how musicians coordinate their expressive timing, phrasing, articulation, dynamics, and other stylistic characteristics during performances has highlighted the role of predictive processes, as musicians must anticipate how their partners will play in order to be together. Several studies have used information flow techniques such as Granger causality to show that upcoming movements of a musician can be predicted from immediate past movements of fellow musicians. Although musicians must move to play their instruments, a major goal of music (...) making is to create a joint interpretation through the sounds they produce. Yet, information flow techniques have not been applied previously to examine the role that fellow musicians' sound output plays in these predictive processes and whether this changes as they learn to play together. In the present experiment, we asked professional violinists to play along with recordings of two folk pieces, each eight times in succession, and compared the amplitude envelopes of their performances with those of the recordings using Granger causality to measure information flow and cross-correlation to measure similarity and synchronization. In line with our hypotheses, our measure of information flow was higher from the recordings to the performances than vice versa, and decreased as the violinists became more familiar with the recordings over trials. This decline in information flow is consistent with a gradual shift from relying on auditory cues to predict the recording to relying on an internally-based (learned) model built through repetition. There was also evidence that violinists became more synchronized with the recordings over trials. These results shed light on the planning and learning processes involved in the aligning of expressive intentions in group music performance and lay the groundwork for the application of Granger causality to investigate information flow through sound in more complex musical interactions. (shrink)