Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

Our target article proposed that language production and comprehension are interwoven, with speakers making predictions of their own utterances and comprehenders making predictions of other people's utterances at different linguistic levels. Here, we respond to comments about such issues as cognitive architecture and its neural basis, learning and development, monitoring, the nature of forward models, communicative intentions, and dialogue.

Traditional mechanistic accounts of language processing derive almost entirely from the study of monologue. Yet, the most natural and basic form of language use is dialogue. As a result, these accounts may only offer limited theories of the mechanisms that underlie language processing in general. We propose a mechanistic account of dialogue, the interactive alignment account, and use it to derive a number of predictions about basic language processes. The account assumes that, in dialogue, the linguistic representations employed by the (...) interlocutors become aligned at many levels, as a result of a largely automatic process. This process greatly simplifies production and comprehension in dialogue. After considering the evidence for the interactive alignment model, we concentrate on three aspects of processing that follow from it. It makes use of a simple interactive inference mechanism, enables the development of local dialogue routines that greatly simplify language processing, and explains the origins of self-monitoring in production. We consider the need for a grammatical framework that is designed to deal with language in dialogue rather than monologue, and discuss a range of implications of the account. Key Words: common ground; dialogue; dialogue routines; language comprehension; language production; monitoring; perception-behavior link. (shrink)

How can be interchangeable with mirroring, which is an automatic response that, from a first-person perspective, enters awareness only after the act? The correspondence between perception of another's action and execution of one's similar action may be an example of a general perception-motor interface that maps perception onto behaviour or disposition towards action, without the need for simulation.

In recent years, a number of philosophers and cognitive scientists have advocated for an ‘interactive turn’ in the methodology of social-cognition research: to become more ecologically valid, we must design experiments that are interactive, rather than merely observational. While the practical aim of improving ecological validity in the study of social cognition is laudable, we think that the notion of ‘interaction’ is not suitable for this task: as it is currently deployed in the social cognition literature, this notion leads to (...) serious conceptual and methodological confusion. In this paper, we tackle this confusion on three fronts: 1) we revise the ‘interactionist’ definition of interaction; 2) we demonstrate a number of potential methodological confounds that arise in interactive experimental designs; and 3) we show that ersatz interactivity works just as well as the real thing. We conclude that the notion of ‘interaction’, as it is currently being deployed in this literature, obscures an accurate understanding of human social cognition. (shrink)

Research on linguistic interaction suggests that two or more individuals can sometimes form adaptive and cohesive systems. We describe an “alignment system” as a loosely interconnected set of cognitive processes that facilitate social interactions. As a dynamic, multi-component system, it is responsive to higher-level cognitive states such as shared beliefs and intentions (those involving collective intentionality) but can also give rise to such shared cognitive states via bottom-up processes. As an example of putative group cognition we turn to transactive memory (...) and suggest how further research on alignment in these cases might reveal how such systems can be genuinely described as cognitive. Finally, we address a prominent critique of collective cognitive systems, arguing that there is much empirical and explanatory benefit to be gained from considering the possibility of group cognitive systems, especially in the context of small-group human interaction. (shrink)

(2013). Distributed intentionality: A model of intentional behavior in humans. Philosophical Psychology: Vol. 26, No. 2, pp. 267-290. doi: 10.1080/09515089.2011.641743.

Imitation, deliberation, and mindreading are characteristically human sociocognitive skills. Research on imitation and its role in social cognition is flourishing across various disciplines; it is here surveyed under headings of behavior, subpersonal mechanisms, and functions of imitation. A model is then advanced within which many of the developments surveyed can be located and explained. The shared circuits model explains how imitation, deliberation, and mindreading can be enabled by subpersonal mechanisms of control, mirroring and simulation. It is cast at a middle, (...) functional level of description, between the level of neural implementation and the level of conscious perceptions and intentional actions. The shared circuits model connects shared informational dynamics for perception and action with shared informational dynamics for self and other, while also showing how the action/perception, self/other and actual/possible distinctions can be overlaid on these shared informational dynamics. It avoids the common conception of perception and action as separate and peripheral to central cognition. Rather, it contributes to the situated cognition movement by showing how mechanisms for perceiving action can be built on those for active perception. (shrink)

While individuals interact, they coordinate their feelings and emotions. They also coordinate several kinds of expression while interacting, like facial expressions and gestures. Inspired by Karl Bühler’s Organon model and Henri Bergson’s description of remembering experiences, we explore interpersonal coordination during a collaborative remembering task between two people. We present a case study of one dyad employing videography to identify and distinguish two types of spontaneous interpersonal coordination. In a later stage, separate interviews of both participants are analyzed to establish (...) whether content, freely remembered, is related to the previously observed coordination. The data describes that expressive-affective coordination during interaction is directly linked to the subjective organization of experience in individual remembering. We discuss these results, emphasizing the intersubjective aspects of lived experience and their relationship to expressive and representational aspects of coordination and remembering. (shrink)

In the absence of pre‐established communicative conventions, people create novel communication systems to successfully coordinate their actions toward a joint goal. In this study, we address two types of such novel communication systems: sensorimotor communication, where the kinematics of instrumental actions are systematically modulated, versus symbolic communication. We ask which of the two systems co‐actors preferentially create when aiming to communicate about hidden object properties such as weight. The results of three experiments consistently show that actors who knew the weight (...) of an object transmitted this weight information to their uninformed co‐actors by systematically modulating their instrumental actions, grasping objects of particular weights at particular heights. This preference for sensorimotor communication was reduced in a fourth experiment where co‐actors could communicate with weight‐related symbols. Our findings demonstrate that the use of sensorimotor communication extends beyond the communication of spatial locations to non‐spatial, hidden object properties. (shrink)

This study investigates interpersonal processes underlying dialog by comparing two approaches, interactive alignment and interpersonal synergy, and assesses how they predict collective performance in a joint task. While the interactive alignment approach highlights imitative patterns between interlocutors, the synergy approach points to structural organization at the level of the interaction—such as complementary patterns straddling speech turns and interlocutors. We develop a general, quantitative method to assess lexical, prosodic, and speech/pause patterns related to the two approaches and their impact on collective (...) performance in a corpus of task-oriented conversations. The results show statistical presence of patterns relevant for both approaches. However, synergetic aspects of dialog provide the best statistical predictors of collective performance and adding aspects of the alignment approach does not improve the model. This suggests that structural organization at the level of the interaction plays a crucial role in task-oriented conversations, possibly constraining and integrating processes related to alignment. (shrink)

People coordinate body postures and gaze patterns during conversation. We review literature showing that (1) action embodies cognition, (2) postural coordination emerges spontaneously when two people converse, (3) gaze patterns influence postural coordination, (4) gaze coordination is a function of common ground knowledge and visual information that conversants believe they share, and (5) gaze coordination is causally related to mutual understanding. We then consider how coordination, generally, can be understood as temporarily coupled neuromuscular components that function as a collective unit (...) known as a coordinative structure in the motor control literature. We speculate that the coordination of gaze and body sway found in conversation may be understood as a cross‐person coordinative structure that embodies the goals of the joint action system. (shrink)

An ideography is a general-purpose code made of pictures that do not encode language, which can be used autonomously – not just as a mnemonic prop – to encode information on a broad range of topics. Why are viable ideographies so hard to find? I contend that self-sufficient graphic codes need to be narrowly specialized. Writing systems are only an apparent exception: At their core, they are notations of a spoken language. Even if they also encode nonlinguistic information, they are (...) useless to someone who lacks linguistic competence in the encoded language or a related one. The versatility of writing is thus vicarious: Writing borrows it from spoken language. Why is it so difficult to build a fully generalist graphic code? The most widespread answer points to a learnability problem. We possess specialized cognitive resources for learning spoken language, but lack them for graphic codes. I argue in favor of a different account: What is difficult about graphic codes is not so much learning or teaching them as getting every user to learn and teach the same code. This standardization problem does not affect spoken or signed languages as much. Those are based on cheap and transient signals, allowing for easy online repairing of miscommunication, and require face-to-face interactions where the advantages of common ground are maximized. Graphic codes lack these advantages, which makes them smaller in size and more specialized. (shrink)

Collaborative interaction pervades many everyday practices: work meetings, innovation and product design, education and arts. Previous studies have pointed to the central role of acknowledgement and acceptance for the success of joint action, by creating affiliation and signaling understanding. We argue that various forms of explicit miscommunication are just as critical to challenge, negotiate and integrate individual contributions in collaborative creative activities. Through qualitative microanalysis of spontaneous coordination in collective creative LEGO constructions, we individuate three interactional styles: inclusive, characterized by (...) acknowledgment and praise; instructional, characterized by self-repair; and integrative, characterized by widespread self- and other-repair. We then investigate how different interaction styles leave distinct material traces in the resulting LEGO models. The inclusive interaction style generally results in concatenations of individual contributions with little coherence and core narrative. The instructional style produces coherent, but largely individually driven models. Finally, the integrative style generates more innovative models, synthesizing individual contributions in shared narratives or schemas. (shrink)

Artificial moral agents raise complex ethical questions both in terms of the potential decisions they may make as well as the inputs that create their cognitive architecture. There are multiple differences between human and artificial cognition which create potential barriers for artificial moral agency, at least as understood anthropocentrically and it is unclear that artificial moral agents should emulate human cognition and decision-making. It is conceptually possible for artificial moral agency to emerge that reflects alternative ethical methodologies without creating ontological (...) challenges or existential crises for human moral agents. (shrink)

Turn-taking – the coordinated and efficient transition between the roles of sender and receiver in communication – is a fundamental property of conversational interaction. The turn-taking mechanism depends on a variety of linguistic factors related to syntax, semantics and prosody, which have recently been subject to vigorous research. This contrasts with the relative lack of studies on nonverbal visual signals and cues that can be involved in taking turns at talking. In this paper, we consider the relation between turn-transitions and (...) adaptors: a class of nonverbal behaviors prototypically involving touching one’s own body or manipulating external objects. We recorded 10 semi-scripted conversations between a total of 12 subjects and annotated the material for discrete adaptors and turn borders. We found that participants produced discrete adaptors significantly more frequently close to floor transfers. Our result goes against the long-standing tradition of interpreting adaptors as unrelated to speech and, more generally, communicative interaction. (shrink)

When conversing and collaborating in everyday situations, people naturally and interactively align their behaviors with each other across various communication channels, including speech, gesture, posture, and gaze. Having access to a partner's referential gaze behavior has been shown to be particularly important in achieving collaborative outcomes, but the process in which people's gaze behaviors unfold over the course of an interaction and become tightly coordinated is not well understood. In this paper, we present work to develop a deeper and more (...) nuanced understanding of coordinated referential gaze in collaborating dyads. We recruited 13 dyads to participate in a collaborative sandwich-making task and used dual mobile eye tracking to synchronously record each participant's gaze behavior. We used a relatively new analysis technique—epistemic network analysis—to jointly model the gaze behaviors of both conversational participants. In this analysis, network nodes represent gaze targets for each participant, and edge strengths convey the likelihood of simultaneous gaze to the connected target nodes during a given time-slice. We divided collaborative task sequences into discrete phases to examine how the networks of shared gaze evolved over longer time windows. We conducted three separate analyses of the data to reveal (1) properties and patterns of how gaze coordination unfolds throughout an interaction sequence, (2) optimal time lags of gaze alignment within a dyad at different phases of the interaction, and (3) differences in gaze coordination patterns for interaction sequences that lead to breakdowns and repairs. In addition to contributing to the growing body of knowledge on the coordination of gaze behaviors in joint activities, this work has implications for the design of future technologies that engage in situated interactions with human users. (shrink)

This paper presents a theorisation of collaborative activity that was developed in the research field known as “collaborative learning”, in order to understand the processes of co-elaboration of meaning and knowledge. Collaboration, as distinguished from cooperation, coordination and collective activity, is defined as a continued and conjoined effort towards elaborating a “joint problem space” of shared representations of the problem to be solved. An approach to analysing the processes of co-construction of a joint problem space is outlined, in terms of (...) inter-discursive operations, together with approaches to defining different forms of cooperative activity. In conclusion, the specificity of this approach to defining collaboration is discussed in relation to other fields of research. (shrink)

Establishing and maintaining mutual understanding in everyday conversations is crucial. To do so, people employ a variety of conversational devices, such as backchannels, repair, and linguistic entrainment. Here, we explore whether the use of conversational devices might be influenced by cross‐linguistic differences in the speakers’ native language, comparing two matched languages—Danish and Norwegian—differing primarily in their sound structure, with Danish being more opaque, that is, less acoustically distinguished. Across systematically manipulated conversational contexts, we find that processes supporting mutual understanding in (...) conversations vary with external constraints: across different contexts and, crucially, across languages. In accord with our predictions, linguistic entrainment was overall higher in Danish than in Norwegian, while backchannels and repairs presented a more nuanced pattern. These findings are compatible with the hypothesis that native speakers of Danish may compensate for its opaque sound structure by adopting a top‐down strategy of building more conversational redundancy through entrainment, which also might reduce the need for repairs. These results suggest that linguistic differences might be met by systematic changes in language processing and use. This paves the way for further cross‐linguistic investigations and critical assessment of the interplay between cultural and linguistic factors on the one hand and conversational dynamics on the other. (shrink)

Linguistic repetitions in children are conceptualized as negative in children with autism – echolalia, without communicative purpose – and positive in typically developing (TD) children – linguistic alignment involved in shared engagement, common ground and language acquisition. To investigate this apparent contradiction we analyzed spontaneous speech in 67 parent–child dyads from a longitudinal corpus (30 minutes of play activities at 6 visits over 2 years). We included 32 children with autism and 35 linguistically matched TD children (mean age at recruitment (...) 32.76 and 20.27 months). We found a small number of exact repetitions in both groups (roughly 1% of utterances across visits), which increased over time in children with autism and decreased in the TD group. Partial repetitions were much more frequent: children reused caregivers' words at high rates regardless of diagnostic group (24% of utterances at first visit), and this increased in frequency (but not level) over time, faster for TD children (at final visit: 33% for autism, 40% for TD). The same happened for partial repetition of syntax and semantic alignment. However, chance alignment (as measured by surrogate pairs) also increased and findings for developmental changes were reliable only for syntactic and semantic alignment. Children with richer linguistic abilities also displayed a higher tendency to partially re–use their caregivers' language (alignment rates and semantic alignment). This highlights that all children commonly re–used the words, syntax, and topics of their caregivers, albeit with some quantitative differences, and that most repetition was at least potentially productive, with repeated language being re–contextualized and integrated with non–repeated language. The salience of echolalia in ASD might be partially explained by slight differences in frequency, amplified by lower semantic alignment, persistence over time, and expectations of echolalia. More in–depth qualitative and quantitative analyses of how repetitions are used and received in context are needed. (shrink)

In spite of the remarkable progress made in the burgeoning field of social neuroscience, the neural mechanisms that underlie social encounters are only beginning to be studied and could —paradoxically— be seen as representing the ‘dark matter’ of social neuroscience. Recent conceptual and empirical developments consistently indicate the need for investigations, which allow the study of real-time social encounters in a truly interactive manner. This suggestion is based on the premise that social cognition is fundamentally different when we are in (...) interaction with others rather than merely observing them. In this article, we outline the theoretical conception of a second-person approach to other minds and review evidence from neuroimaging, psychophysiological studies and related fields to argue for the development of a second-person neuroscience, which will help neuroscience to really go social; this may also be relevant for our understanding of psychiatric disorders construed as disorders of social cognition. (shrink)

What is the role of language in social interaction? What does language bring to social encounters? We argue that language can be conceived of as a tool for interacting minds, enabling especially effective and flexible forms of social coordination, perspective-taking and joint action. In a review of evidence from a broad range of disciplines, we pursue elaborations of the language-as-a-tool metaphor, exploring four ways in which language is employed in facilitation of social interaction. We argue that language dramatically extends the (...) possibility-space for interaction, facilitates the profiling and navigation of joint attentional scenes, enables the sharing of situation models and action plans, and mediates the cultural shaping of interacting minds. (shrink)

Formal pragmatics plays an important, though secondary, role in modern analytical philosophy of language: its aim is to explain how context can affect the meaning of certain special kinds of utterances. During recent years, the adequacy of formal tools has come under attack, often leading to one or another form of relativism or antirealism.1 Our aim will be to extend the critique to formal pragmatics while showing that sceptical conclusions can be avoided by developing a different approach to the issues. (...) In particular, we will show that formal pragmatics cannot provide a complete account of how context affects the meaning of utterances, both on its own terms and when faced with evidence of important aspects of natural languages. The focal issue is the relevant kind of context in which pragmatics should examine utterances. Our contention will be that the relevant context of an utterance is determined by the function of that utterance, this function being dependent upon the primary function of language – to convey information. We will argue that the functions of utterances and of language are too broad to be caught by the tools of formal pragmatics of the sort advocated by Montague (1968, 1974), which are an extension the methods of traditional model-theoretic semantics.2 The particular formal approach we will use as the main example is David Kaplan’s position (1979, 1989),3 an extension of Montague’s program. (shrink)

Paulina Sliwa (2015) argues that knowing why p is necessary and sufficient for understanding why p. She tries to rebut recent attacks against the necessity and sufficiency claims, and explains the gradability of understanding why in terms of knowledge. I argue that her attempts do not succeed, but I indicate more promising ways to defend reductionism about understanding why throughout the discussion.

This paper presents a theorisation of collaborative activity that was developed in the research field known as “collaborative learning”, in order to understand the processes of co-elaboration of meaning and knowledge. Collaboration, as distinguished from cooperation, coordination and collective activity, is defined as a continued and conjoined effort towards elaborating a “joint problem space” of shared representations of the problem to be solved. An approach to analysing the processes of co-construction of a joint problem space is outlined, in terms of (...) inter-discursive operations, together with approaches to defining different forms of cooperative activity. In conclusion, the specificity of this approach to defining collaboration is discussed in relation to other fields of research. (shrink)

Dialog is a joint action at different levels. At the highest level, the goal of interlocutors is to align their mental representations. This emerges from joint activity at lower levels, both concerned with linguistic decisions (e.g., choice of words) and nonlinguistic processes (e.g., alignment of posture or speech rate). Because of the high‐level goal, the interlocutors are particularly concerned with close coupling at these lower levels. As we illustrate with examples, this means that imitation and entrainment are particularly pronounced during (...) interactive communication. We then argue that the mechanisms underlying such processes involve covert imitation of interlocutors’ communicative behavior, leading to emulation of their expected behavior. In other words, communication provides a very good example of predictive emulation, in a way that leads to successful joint activity. (shrink)

In recent years, a number of approaches to social cognition research have emerged that highlight the importance of embodied interaction for social cognition (Reddy, How infants know minds, 2008; Gallagher, J Conscious Stud 8:83–108, 2001; Fuchs and Jaegher, Phenom Cogn Sci 8:465–486, 2009; Hutto, in Seemans (ed.) Joint attention: new developments in psychology, philosophy of mind and social neuroscience, 2012). Proponents of such ‘interactionist’ approaches emphasize the importance of embodied responses that are engaged in online social interaction, and which, according (...) to interactionists, present an alternative to mindreading as a source of social understanding. We agree that it is important to take embodied interaction seriously, but do not agree that this presents a fundamental challenge to mainstream mindreading approaches. Drawing upon an analogy between embodied interaction and the exercise of expert skills, we advocate a hierarchical view which claims that embodied social responses generally operate in close conjunction with higher-level cognitive processes that play a coordinative role, and which are often sensitive to mental states. Thus, investigation of embodied responses should inform rather than conflict with research on mindreading. (shrink)

Individuals shift their language to converge with interlocutors. Recent work has suggested that convergence can target not only observed but also expected linguistic behavior, cued by social information. However, it remains uncertain how expectations and observed behavior interact, particularly when they contradict each other. We investigated this using a cooperative map task experiment, in which pairs of participants communicated online by typing messages to each other in a miniature “alien” language that exhibited variation between alien species. The overall task comprised (...) three phases, in each of which participants were told that they would be paired with a different partner. One member of the pair was given explicit linguistic expectations in each phase, while the software controlled whether or not observed behavior from their partner would be consistent or inconsistent with these expectations. The other participant was given no such expectations, allowing us to control for the role of expectation. Participants converged to both observed and expected linguistic behavior, and convergence was boosted when observation and expectation were aligned. When expected and observed behavior were misaligned, participants updated their expectations, though convergence levels did not drop. Furthermore, participants generalized what they learned about one partner to apparent novel partners of the same alien species. We also discuss individual variation in convergence patterns and the lack of a relationship between linguistic convergence and success at the map task. Findings are consistent with observations outside the laboratory that language users converge toward expected linguistic behavior. They also have broader implications for understanding linguistic accommodation and the influence of social information on linguistic processing and production. (shrink)

The emergence of human communication systems is typically investigated via 2 approaches with complementary strengths and weaknesses: naturalistic studies and computer simulations. This study was conducted with a method that combines these approaches. Pairs of participants played video games requiring communication. Members of a pair were physically separated but exchanged graphic signals through a medium that prevented the use of standard symbols (e.g., letters). Communication systems emerged and developed rapidly during the games, integrating the use of explicit signs with information (...) implicitly available to players and silent behavior‐coordinating procedures. The systems that emerged suggest 3 conclusions: (a) signs originate from different mappings; (b) sign systems develop parsimoniously; (c) sign forms are perceptually distinct, easy to produce, and tolerant to variations. (shrink)

Psycholinguistic studies often look at the production of referring expressions in interactive settings, but so far few referring expression generation algorithms have been developed that are sensitive to earlier references in an interaction. Rather, such algorithms tend to rely on domain-dependent preferences for both content selection and linguistic realization. We present three experiments showing that humans may opt for dispreferred attributes and dispreferred modifier orderings when these were primed in a preceding interaction (without speakers being consciously aware of this). In (...) addition, we show that speakers are more likely to produce overspecified references, including dispreferred attributes (although minimal descriptions with preferred attributes would suffice), when these were similarly primed. (shrink)

The target article says surprisingly little about the possible role of shared circuits in language and communication. This commentary considers how they might contribute to linguistic communication, particularly during dialogue. We argue that shared circuits are used to promote alignment between linguistic representations at many levels and to support production-based emulation of linguistic input during comprehension.

Following a synthesis of naturalistic and experimental studies of language creation, we propose a theoretical model that describes the process through which human communication systems might arise and evolve. Three key processes are proposed that give rise to effective, efficient and shared human communication systems: motivated signs that directly resemble their meaning facilitate cognitive alignment, improving communication success; behavioral alignment onto an inventory of shared sign-to-meaning mappings bolsters cognitive alignment between interacting partners; sign refinement, through interactive feedback, enhances the efficiency (...) of the evolving communication system. By integrating the findings across a range of diverse studies, we propose a theoretical model of the process through which the earliest human communication systems might have arisen and evolved. Importantly, because our model is not bound to a single modality it can describe the creation of shared sign systems across a range of contexts, informing theories of language creation and evolution. (shrink)

This paper compares two explanations of the process by which human communication systems evolve: iterated learning and social collaboration. It then reports an experiment testing the social collaboration account. Participants engaged in a graphical communication task either as a member of a community, where they interacted with seven different partners drawn from the same pool, or as a member of an isolated pair, where they interacted with the same partner across the same number of games. Participants’ horizontal, pair‐wise interactions led (...) “bottom up” to the creation of an effective and efficient shared sign system in the community condition. Furthermore, the community‐evolved sign systems were as effective and efficient as the local sign systems developed by isolated pairs. Finally, and as predicted by a social collaboration account, and not by an iterated learning account, interaction was critical to the creation of shared sign systems, with different isolated pairs establishing different local sign systems and different communities establishing different global sign systems. (shrink)