When conversing and collaborating in everyday situations, people naturally and interactively align their behaviors with each other across various communication channels, including speech, gesture, posture, and gaze. Having access to a partner's referential gaze behavior has been shown to be particularly important in achieving collaborative outcomes, but the process in which people's gaze behaviors unfold over the course of an interaction and become tightly coordinated is not well understood. In this paper, we present work to develop a deeper and more (...) nuanced understanding of coordinated referential gaze in collaborating dyads. We recruited 13 dyads to participate in a collaborative sandwich-making task and used dual mobile eye tracking to synchronously record each participant's gaze behavior. We used a relatively new analysis technique—epistemic network analysis—to jointly model the gaze behaviors of both conversational participants. In this analysis, network nodes represent gaze targets for each participant, and edge strengths convey the likelihood of simultaneous gaze to the connected target nodes during a given time-slice. We divided collaborative task sequences into discrete phases to examine how the networks of shared gaze evolved over longer time windows. We conducted three separate analyses of the data to reveal (1) properties and patterns of how gaze coordination unfolds throughout an interaction sequence, (2) optimal time lags of gaze alignment within a dyad at different phases of the interaction, and (3) differences in gaze coordination patterns for interaction sequences that lead to breakdowns and repairs. In addition to contributing to the growing body of knowledge on the coordination of gaze behaviors in joint activities, this work has implications for the design of future technologies that engage in situated interactions with human users. (shrink)

Joint attention has been extensively studied in the developmental literature because of overwhelming evidence that the ability to socially coordinate visual attention to an object is essential to healthy developmental outcomes, including language learning. The goal of this study was to understand the complex system of sensory-motor behaviors that may underlie the establishment of joint attention between parents and toddlers. In an experimental task, parents and toddlers played together with multiple toys. We objectively measured joint attention—and the sensory-motor behaviors that (...) underlie it—using a dual head-mounted eye-tracking system and frame-by-frame coding of manual actions. By tracking the momentary visual fixations and hand actions of each participant, we precisely determined just how often they fixated on the same object at the same time, the visual behaviors that preceded joint attention and manual behaviors that preceded and co-occurred with joint attention. We found that multiple sequential sensory-motor patterns lead to joint attention. In addition, there are developmental changes in this multi-pathway system evidenced as variations in strength among multiple routes. We propose that coordinated visual attention between parents and toddlers is primarily a sensory-motor behavior. Skill in achieving coordinated visual attention in social settings—like skills in other sensory-motor domains—emerges from multiple pathways to the same functional end. (shrink)

Communicative interactions across different species have so far received relatively little attention from cognitive or behavioral scientists. Most research in this area views the process of communication as the adaptive interaction of manipulative signalers and information-assessing receivers. This paper discusses some shortcomings of the information/influence model of communication, particularly in the empirical study of interspecific communicative interactions. It then presents an alternative theoretical model, based on recent contributions in psycholinguistics and semiotics. The semiotic alignment model views communication as a dynamic (...) process of joint semiosis resulting in the alignment of the interactants’ own-worlds (Umwelten). It is argued that this model can improve our understanding of communicative interactions between heterospecifics and provide the basis for future work in the empirical study of interspecific communication. (shrink)

Communicative interactions across different species have so far received relatively little attention from cognitive or behavioral scientists. Most research in this area views the process of communication as the adaptive interaction of manipulative signalers and information-assessing receivers. This paper discusses some shortcomings of the information/influence model of communication, particularly in the empirical study of interspecific communicative interactions. It then presents an alternative theoretical model, based on recent contributions in psycholinguistics and semiotics. The semiotic alignment model views communication as a dynamic (...) process of joint semiosis resulting in the alignment of the interactants’ own-worlds (Umwelten). It is argued that this model can improve our understanding of communicative interactions between heterospecifics and provide the basis for future work in the empirical study of interspecific communication. (shrink)

Inspired by early proposals in philosophy, dominant accounts of language posit a central role for mutual knowledge, either encoded directly in common ground, or approximated through other cognitive mechanisms. Using existing empirical evidence from language and memory, we challenge this tradition, arguing that mutual knowledge captures only a subset of the mental states needed to support communication. In a novel theoretical proposal, we argue for a cognitive architecture that includes separate, distinct representations of the self and other, and a cognitive (...) process that compares these representations continuously during conversation, outputting both similarities and differences in perspective. Our theory accounts for existing data, interfaces with findings from other cognitive domains, and makes novel predictions about the role of perspective in language use. We term this new account the Multiple Perspectives Theory of mental states in communication. (shrink)

The paper spells out the rationale for developing means of manipulating and of measuring people’s sense of commitment to robot interaction partners. A sense of commitment may lead people to be patient when a robot is not working smoothly, to remain vigilant when a robot is working so smoothly that a task becomes boring, and to increase their willingness to invest effort in teaching a robot. We identify a range of contexts in which a sense of commitment to robot interaction (...) partners may be particularly important. (shrink)