In everyday interactions, humans naturally exhibit behavioral cues, such as gaze and head movements, that signal their intentions while interpreting the behavioral cues of others to predict their intentions. Such intention prediction enables each partner to adapt their behaviors to the intent of others, serving a critical role in joint action where parties work together to achieve a common goal. Among behavioral cues, eye gaze is particularly important in understanding a person's attention and intention. In this work, we seek to (...) quantify how gaze patterns may indicate a person's intention. Our investigation was contextualized in a dyadic sandwich-making scenario in which a “worker” prepared a sandwich by adding ingredients requested by a “customer.” In this context, we investigated the extent to which the customers' gaze cues serve as predictors of which ingredients they intend to request. Predictive features were derived to represent characteristics of the customers' gaze patterns. We developed a support vector machine-based (SVM-based) model that achieved 76% accuracy in predicting the customers' intended requests based solely on gaze features. Moreover, the predictor made correct predictions approximately 1.8 s before the spoken request from the customer. We further analyzed several episodes of interactions from our data to develop a deeper understanding of the scenarios where our predictor succeeded and failed in making correct predictions. These analyses revealed additional gaze patterns that may be leveraged to improve intention prediction. This work highlights gaze cues as a significant resource for understanding human intentions and informs the design of real-time recognizers of user intention for intelligent systems, such as assistive robots and ubiquitous devices, that may enable more complex capabilities and improved user experience. (shrink)

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

This chapter aims at investigating the phenomenology of joint action and at gaining a better understanding of (1) how the sense of agency one experiences when engaged in a joint action differs from the sense of agency one has for individual actions and (2) how the sense of agency one experiences when engaged in a joint action differs according to the type of joint action and to the role one plays in it.

Many philosophers have offered accounts of shared actions aimed at capturing what makes joint actions intentionally joint. I first discuss two leading accounts of shared intentions, proposed by Michael Bratman and Margaret Gilbert. I argue that Gilbert’s account imposes more normativity on shared intentions than is strictly needed and that Bratman’s account requires too much cognitive sophistication on the part of agents. I then turn to the team-agency theory developed by economists that I see as offering an alternative route to (...) shared intention. I concentrate on Michael Bacharach’s version of team-agency theory, according to which shared agency is a matter of team-reasoning, team-reasoning depends on group identification and group identification is the result of processes of self-framing. I argue that it can yield an account of shared intention that is less normatively loaded and less cognitively demanding. (shrink)

When two agents engage in a joint action, such as rowing together, they exercise joint know-how. But what is the relationship between the joint know-how of the two agents and the know-how each agent possesses individually? I construct an “active mutual enablement” account of this relationship, according to which joint know-how arises when each agent knows how to predict, monitor, and make failure-averting adjustments in response to the behaviour of the other agent, while actively enabling the other to make such (...) adjustments. I defend the AME account from three objections, and I then use this account as the platform for an examination of the reducibility of joint know-how to joint propositional knowledge. A summative account of joint propositional knowledge is incompatible with the reduction of joint know-how to joint propositional knowledge, whereas a distributive account is not. I close by highlighting some open questions the AME account brings into view concerning the evolutionary origin and scaling up of joint know-how. (shrink)

Altering physical actions when responding to changing environmental demands is important but not always effectively performed. This ineffectiveness, which is an error of social behavior generated by mutual interactions, is not well understood. This study investigated mechanisms of a hesitant behavior that occurs in people walking toward each other, causing people to move in the same direction when attempting to avoid a collision. Using a motion capture device affixed to 17 pairs, we first confirmed the hesitant behavior by a difference (...) between the experimental task, which involved an indeterminate situation to assess the actions of another individual, and the control task, which involved a predetermined avoiding direction, in a real-time situation involving two people. We next investigated the effect of three external factors: long distance until an event, synchronized walking cycle, and different foot relations in dyads on the hesitant behavior. A dramatic increase in freezing and near-collision behavior occurred in dyads for which the avoiding direction was not predetermined. The behavior related with the combination of long distance until an event, synchronized walking cycle, and different foot relations in dyads. We found that the hesitant behavior is influenced by an interpersonal relationship under enough distance to predict other movement. The hesitant behavior has possibly emerged as an undesired by-product of joint action. These results contribute to our understanding of the mechanisms of adaptive control of perception-action coupling in mutual interaction. (shrink)

Joint action, critical to human social interaction and communication, has garnered increasing scholarly attention in many areas of inquiry, yet its development remains little explored. This paper reviews research on the growth of joint action over the first 2 years of life to show how children become progressively more able to engage deliberately, autonomously, and flexibly in joint action with adults and peers. It is suggested that a key mechanism underlying the dramatic changes in joint action over the second year (...) of life is the ability to reflect consciously on oneself and one’s behavior and volition and correspondingly, on the behavior, goals, and intentions of others. (shrink)

The pull to coordinate with other individuals is fundamental, serving as the basis for our social connectedness to others. Discussed is a dynamical and ecological perspective to joint action, an approach that embeds the individual’s mind in a body and the body in a niche, a physical and social environment. Research on uninstructed coordination of simple incidental rhythmic movement, along with research on goal‐directed, embodied cooperation, is reviewed. Finally, recent research is discussed that extends the coordination and cooperation studies, examining (...) how synchronizing with another, and how emergent social units of perceiving and acting are reflected in people’s feelings of connection to others. (shrink)

Our target article proposed that language production and comprehension are interwoven, with speakers making predictions of their own utterances and comprehenders making predictions of other people's utterances at different linguistic levels. Here, we respond to comments about such issues as cognitive architecture and its neural basis, learning and development, monitoring, the nature of forward models, communicative intentions, and dialogue.

When sharing a task with another person that requires turn taking, as in doubles games of table tennis, performance on the shared task is similar to performing the whole task alone. This has been taken to indicate that humans co-represent their partner’s task share, as if it were their own. Task co-representation allows prediction of the other’s responses when it is the other’s turn, and leads to response conflict in joint interference tasks. However, data from our lab cast doubt on (...) the view that task co-representation and resulting response conflict are the only or even primary source of effects observed in task sharing. Recent findings furthermore suggest another potential source of interference in joint task performance that has been neglected so far: Self-other discrimination and conflict related to agent identification (i.e., determining whether it is “my” or the other’s turn). Based on these findings we propose that participants might not always co-represent what their partner is supposed to do, but instead co-represent that another agent is responsible for part of the task, and when it is his turn. We call this account the actor co-representation account. (shrink)

No one denies that people adapt what they say and how they interpret what is said to them, depending on their interactive partners. What is controversial is when and how they do so. Several psycholinguistics research programs have found what appear to be failures to adapt to partners in the early moments of processing and have used this evidence to argue for modularity in the language processing architecture, claiming that the system cannot take into account a partner’s distinct needs or (...) knowledge early in processing. We review the evidence for both early and delayed partner‐specific adaptations, and we identify some challenges and difficulties with interpreting this evidence. We then discuss new analyses from a previously published referential communication experiment (Metzing & Brennan, 2003) demonstrating that partner‐specific effects need not occur late in processing. In contrast to Pickering and Garrod (2004) and Keysar, Barr, and Horton (1998b), we conclude that there is no good evidence that early processing has to be be “egocentric,”“dumb,” or encapsulated from social knowledge or common ground, but that under some circumstances, such as when one partner has made an attribution about another’s knowledge or needs, processing can be nimble enough to adapt quite early to a perspective different from one’s own. (shrink)