Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

The notion of common ground is important for the production of referring expressions: In order for a referring expression to be felicitous, it has to be based on shared information. But determining what information is shared and what information is privileged may require gathering information from multiple sources, and constantly coordinating and updating them, which might be computationally too intensive to affect the earliest moments of production. Previous work has found that speakers produce overinformative referring expressions, which include privileged names, (...) violating Grice’s Maxims, and concluded that this is because they do not mark the distinction between shared and privileged information. We demonstrate that speakers are in fact quite effective in marking this distinction in the form of their utterances. Nonetheless, under certain circumstances, speakers choose to overspecify privileged names. (shrink)

Future professionals should be prepared for scientific reasoning, i.e., to construct and apply scientific knowledge, in order to analyze and solve problems in their professional practice. Yet, future practitioners’ scientific reasoning skills often seem to be deficient when solving practical problems. This dissertation explores to what extent collaboration may foster the engagement of future practitioners in scientific reasoning: i.e., in epistemic processes and in referring to scientific content knowledge. Therefore, two studies were conducted to compare collaborative and individual problem solving (...) of pre-service teachers regarding their scientific reasoning. Study 1 investigates the effect of group heterogeneity with respect to problem solving scripts on scientific reasoning. Study 2 explores to what extent Epistemic Network Analysis can serve as a methodological approach for measuring scientific reasoning. As part of Study 1, pre-service teachers solved an educational problem either as individuals or as pairs. Collaboration showed a mixed effect on scientific reasoning processes: pairs engaged more in explaining and reasoning about the problem and drew more conclusions, while individuals engaged more in generating solutions. Additional analyses showed that the more heterogeneous pairs were regarding their members’ problem solving scripts the more they engaged in hypothesizing and evaluating evidence and the less they engaged in generating solutions. Finally, pairs less often referred to scientific content than individuals did during problem solving. Study 2 further analyzed the data by applying Epistemic Network Analysis. This method has the advantage of analyzing patterns of connections between epistemic processes, i.e., epistemic networks of scientific reasoning. The central epistemic process for pairs was evidence evaluation, which they frequently used in combination with hypothesizing and communicating and scrutinizing. On the other hand, the most characteristic process in individuals’ scientific reasoning was solution generation, which very often co-occurred with hypothesizing and evidence evaluation. The overall results indicate that if the aim is to develop a more reflective understanding of the problem, future practitioners should collaborate with each other, especially in heterogeneous settings. However, they should be supported to share knowledge regarding scientific theories and evidence as well as to reach a mutual understanding on the problem after a certain time so as to be able to have the capacity of generating solutions. Moreover, the different effects of collaboration on the process and content aspects of scientific reasoning imply that scientific reasoning might not be a unidimensional construct, and its process and content levels should be differentiated in future research. A further important methodological implication is that the process aspect of scientific reasoning can be analyzed as a network of interconnected skills and such analysis might bring more explanatory value than the mere reliance on frequencies of occurrences of isolated activities. (shrink)

In this paper we consider the potential role of metarepresentation—the representation of another representation, or as commonly considered within cognitive science, the mental representation of another individual's knowledge and beliefs—in mediating definite reference and common ground in conversation. Using dialogues from a referential communication study in which speakers conversed in succession with two different addressees, we highlight ways in which interlocutors work together to successfully refer to objects, and achieve shared conceptualizations. We briefly review accounts of how such shared conceptualizations (...) could be represented in memory, from simple associations between label and referent, to “triple co-presence” representations that track interlocutors in an episode of referring, to more elaborate metarepresentations that invoke theory of mind, mutual knowledge, or a model of a conversational partner. We consider how some forms of metarepresentation, once created and activated, could account for definite reference in conversation by appealing to ordinary processes in memory. We conclude that any representations that capture information about others' perspectives are likely to be relatively simple and subject to the same kinds of constraints on attention and memory that influence other kinds of cognitive representations. (shrink)

Numerous philosophical theories of joint agency and its intentional structure have been developed in the past few decades. These theories have offered accounts of joint agency that appeal to higher-level states that are?shared? in some way. These accounts have enhanced our understanding of joint agency, yet there are a number of lower-level cognitive phenomena involved in joint action that philosophers rarely acknowledge. In particular, empirical research in cognitive science has revealed that when individuals engage in a joint activity such as (...) conversation or joint problem solving, they become aligned at multiple levels. We argue that this phenomenon of alignment is crucial to understanding joint actions and should be integrated with philosophical approaches. In this paper, we sketch a possible integration, and draw out its implications for understanding of joint agency and collective intentionality. The result is a process-based, dynamic account of joint action that integrates both low-level and high-level states, and seeks to capture the separate processes of how a joint action is initiated and sustained. (shrink)

We present a theoretical framework bearing on the evolution of written communication. We analyze writing as a special kind of graphic code. Like languages, graphic codes consist of stable, conventional mappings between symbols and meanings, but (unlike spoken or signed languages) their symbols consist of enduring images. This gives them the unique capacity to transmit information in one go across time and space. Yet this capacity usually remains quite unexploited, because most graphic codes are insufficiently informative. They may only be (...) used for mnemonic purposes or as props for oral communication in real-time encounters. Writing systems, unlike other graphic codes, work by encoding a natural language. This allows them to support asynchronous communication in a more powerful and versatile way than any other graphic code. Yet, writing systems will not automatically unlock the capacity to communicate asynchronously. We argue that this capacity is a rarity in non-literate societies, and not so frequent even in literate ones. Asynchronous communication is intrinsically inefficient because asynchrony constrains the amount of information that the interlocutors share and limits possibilities for repair. This would explain why synchronous, face-to-face communication always fosters the development of sophisticated codes (natural languages), but similar codes for asynchronous communication evolve with more difficulties. It also implies that writing cannot have evolved, at first, for supporting asynchronous communication. (shrink)

Our target article proposed that language production and comprehension are interwoven, with speakers making predictions of their own utterances and comprehenders making predictions of other people's utterances at different linguistic levels. Here, we respond to comments about such issues as cognitive architecture and its neural basis, learning and development, monitoring, the nature of forward models, communicative intentions, and dialogue.

Cocreating meaning in collaboration is challenging. Success is often determined by people's abilities to coordinate their language to converge upon shared mental representations. Here we explore one set of low‐level linguistic behaviors, linguistic alignment, that both emerges from, and facilitates, outcomes of high‐level convergence. Linguistic alignment captures the ways people reuse, that is, “align to,” the lexical, syntactic, and semantic forms of others' utterances. Our focus is on the temporal change of multi‐level linguistic alignment, as well as how alignment is (...) related to communicative outcomes within a unique collaborative problem‐solving paradigm. The primary task, situated within a virtual educational video game, requires creative thinking between three people where the paths for possible solutions are highly variable. We find that over time interactions are marked by decreasing lexical and syntactic alignment, with a trade‐off of increasing semantic alignment. However, greater semantic alignment does not translate into better team performance. Overall, these findings provide greater clarity on the role of linguistic coordination within complex and dynamic collaborative problem‐solving tasks. (shrink)

To reduce ambiguity across a conversation, interlocutors reach temporary conventions or referential precedents on how to refer to an entity. Despite their central role in communication, the cognitive underpinnings of the interpretation of precedents remain unclear, specifically the role and mechanisms by which information related to the speaker is integrated. We contrast predictions of one-stage, original two-stage, and extended two-stage models for the processing of speaker information and provide evidence favoring the latter: we show that both stages are sensitive to (...) speaker-specific information. Using an experimental paradigm based on visual-world eye tracking in the context of a referential communication task, we look at the moment-by-moment interpretation of precedents and focus on the temporal profile of the influence of the speaker and linguistic information when facing ambiguity. We find two clearly identifiable moments where speaker-specific information has its effects on reference resolution. We conclude that these two stages reflect two distinct cognitive mechanisms, with different timings, and rely on different representational formats for encoding and accessing information about the speaker: a cue-driven memory retrieval process that mediates language processing and an inferential mechanism based on perspective-taking abilities. (shrink)

Communicating with multiple addressees poses a problem for speakers: Each addressee necessarily comes to the conversation with a different perspective—different knowledge, different beliefs, and a distinct physical context. Despite the ubiquity of multiparty conversation in everyday life, little is known about the processes by which speakers design language in multiparty conversation. While prior evidence demonstrates that speakers design utterances to accommodate addressee knowledge in multiparty conversation, it is unknown if and how speakers encode and combine different types of perspective information. (...) Here we test whether speakers encode the perspective of multiple addressees, and then simultaneously consider their knowledge and physical context during referential design in a three‐party conversation. Analyses of referential form—expression length, disfluency, and elaboration rate—in an interactive multiparty conversation demonstrate that speakers do take into consideration both addressee knowledge and physical context when designing utterances, consistent with a knowledge‐scene integration view. These findings point to an audience design process that takes as input multiple types of representations about the perspectives of multiple addressees, and that bases the informational content of the to‐be‐designed utterance on a combination of the perspectives of the intended addressees. (shrink)

Adults design utterances to match listeners' informational needs by making both “generic” adjustments (e.g., mentioning atypical more often than typical information) and “particular” adjustments tailored to their specific interlocutor (e.g., including things that their addressee cannot see). For children, however, relevant evidence is mixed. Three experiments investigated how generic and particular factors affect children's production. In Experiment 1, 4‐ to 5‐year‐old children and adults described typical and atypical instrument events to a silent listener who could either see or not see (...) the events. In later extensions, participants described the same events to either a silent (Experiment 2) or an interactive (Experiment 3) addressee with a specific goal. Both adults and 4‐ to 5‐year‐olds performed generic adjustments but, unlike adults, children made listener‐particular adjustments inconsistently. These and prior findings can be explained by assuming that particular adjustments can be costlier for children to implement compared to generic adjustments. (shrink)

This special issue is a refreshing contrast to the intuitively influential notion of language as an internal system. This internal approach to language is going strong in some segments of the cognitive sciences. As an assumption, internalism drives much empirical work on language, and it is the basis of prominent theories of language – its nature (e.g. an internalised computational system), its evolution (e.g. a single still-unknown mutation), and its function (e.g. thinking, not communication). -/- Radical fundamentalist versions of these (...) theories are no longer in the main stream, however, despite the attention they may garner by forceful exposition (e.g. Chomsky 2011a). A fuller canvassing of the cognitive sciences – obviously outside the scope of the current presentation – would probably reveal that most researchers, even those who study aspects of language isolated in individual participants, would allow for an intrinsic social characteristic to language. I would go so far as to guess that they would place this social character on explanatory par with other structural or information-processing features that are studied in the lab. And despite what is averred by Chomsky (2011a), this social character in human cognition has been proposed in many domains, from vision (Balcetis & Lassiter 2010) to memory (Barnier et al. 2008). Humans are intrinsically social in a way that distinguishes them from any other primate species, and this sociality seems to be weaved into many cognitive processes (Castiello et al. 2010; Tomasello 2009). -/- But “social” is not the same thing as “distributed,” by the content of this issue. The latter may subsume the former. The distributed approach discussed in this special issue is not “simply” social – it does not just propose an added static feature of any synchronic language context (as noted in Jennings & Thompson this issue). The approach instead regards this social characteristic as just one part of a broader dynamic distributed process that constitutes language, through different kinds of inter-individual coordination at many levels of spatial and temporal scale (Cowley this issue; Fusaroli & Tylén this issue). (shrink)

We investigate partner effects on spatial perspective taking behavior in listeners, comparing behavior with a human versus a computer partner (Experiments 1 and 2), and with computer partners of different perceived capabilities (Experiment 3). Participants responded to spoken instructions from their partner which could be interpreted egocentrically (from their own perspective) or othercentrically (from their partner's perspective). In contrast to earlier work, we found that participants were more egocentric with a computer than a human partner. Participants were also more egocentric (...) with a computer partner that appeared more modern and capable, compared to one that appeared outdated and limited in ability. Our results show that perspective taking behavior is sensitive to information about one's partner; in particular, listeners consider their partner's potential ability to collaborate, adjusting their egocentric tendencies accordingly. Moreover, we highlight what appears to be a shift in listeners' expectations regarding computers' collaborative capabilities, leading to greater willingness to push the burden of perspective taking onto a computer partner. (shrink)

Speech disfluencies can signal that a speaker is about to refer to something difficult to name. In two experiments, we found evidence that 4-year-olds, like adults, flexibly interpret a particular partner’s disfluency based on their estimate of that partner’s knowledge, derived from the preceding conversation. In entrainment trials, children established partner-specific shared knowledge of names for tangram pictures with one or two adult interlocutors. In each test trial, an adult named one of two visible tangrams either fluently or disfluently while (...) children’s eye-movements were monitored. We manipulated speaker knowledge in the test trials. In Experiment 1, the test-trial speaker was the same speaker from entrainment or a naïve experimenter; in Experiment 2, the test-trial speaker had been one of the child’s partners in entrainment and had seen half of the tangrams. When hearing disfluent expressions, children looked more at a tangram that was unfamiliar from the speaker’s perspective; this systematic disfluency effect disappeared in Experiment 1 when the speaker was entirely naïve, and depended on each speaker’s entrainment experience in Experiment 2. These findings show that 4-year-olds can keep track of two different partners’ knowledge states, and use this information to determine what should be difficult for a particular partner to name, doing so efficiently enough to guide online interpretation of disfluent speech. (shrink)

Through theoretical discussion, literature review, and a computational model, this paper poses a challenge to the notion that perspective-taking involves a fixed architecture in which particular processes have priority. For example, some research suggests that egocentric perspectives can arise more quickly, with other perspectives (such as of task partners) emerging only secondarily. This theoretical dichotomy–between fast egocentric and slow other-centric processes–is challenged here. We propose a general view of perspective-taking as an emergent phenomenon governed by the interplay among cognitive mechanisms (...) that accumulate information at different timescales. We first describe the pervasive relevance of perspective-taking to cognitive science. A dynamical systems model is then introduced that explicitly formulates the timescale interaction proposed. This model illustrates that, rather than having a rigid time course, perspective-taking can be fast or slow depending on factors such as task context. Implications are discussed, with ideas for future empirical research. (shrink)

During dialog, references are presented, accepted, and potentially reused. Two experiments were conducted to examine reuse in a naturalistic setting. In Experiment 1, where the participants interacted face to face, self-presented references and references accepted through verbatim repetition were reused more. Such biases persisted after the end of the interaction. In Experiment 2, where the participants interacted over the phone, reference reuse mainly depended on whether the participant could see the landmarks being referred to, although this bias seemed to be (...) only transient. Consistent with the memory-based approach to dialog, these results shed light on how differences in accessibility in memory affect the unfolding of the interaction. (shrink)

Evidence suggests that speakers can take account of the addressee's needs when referring. However, what representations drive the speaker's audience design has been less clear. This study aims to go beyond previous studies by investigating the interplay between the visual and linguistic context during audience design. Speakers repeated subordinate descriptions given in the prior linguistic context less and used basic-level descriptions more when the addressee did not hear the linguistic context than when s/he did. But crucially, this effect happened only (...) when the referent lacked the visual attributes associated with the expressions, so there was no other contextual cue available for the identification of the referent. This suggests that speakers flexibly use different contextual cues to help their addressee map the referring expression onto the intended referent. In addition, speakers used fewer pronouns when the addressee did not hear the linguistic antecedent than when s/he did. This suggests that although speakers may be egocentric during anaphoric reference, they can cooperatively avoid pronouns when the linguistic antecedents were not shared with their addressee during initial reference. (shrink)

We report two experiments that investigated the widely held assumption that speakers use the addressee’s discourse model when choosing referring expressions (e.g., Ariel, 1990; Chafe, 1994; Givón, 1983; Prince, 1985), by manipulating whether the addressee could hear the immediately preceding linguistic context. Experiment 1 showed that speakers increased pronoun use (and decreased noun phrase use) when the referent was mentioned in the immediately preceding sentence compared to when it was not, even though the addressee did not hear the preceding sentence, (...) indicating that speakers used their own, privileged discourse model when choosing referring expressions. The same pattern of results was found in Experiment 2. Speakers produced more pronouns when the immediately preceding sentence mentioned the referent than when it mentioned a referential competitor, regardless of whether the sentence was shared with their addressee. Thus, we conclude that choice of referring expression is determined by the referent’s accessibility in the speaker’s own discourse model rather than the addressee’s. (shrink)

How do speakers design what they say in order to communicate effectively with groups of addressees who vary in their background knowledge of the topic at hand? Prior findings indicate that when a speaker addresses a pair of listeners with discrepant knowledge, that speakers Aim Low, designing their utterances for the least knowledgeable of the two addressees. Here, we test the hypothesis that speakers will depart from an Aim Low approach in order to efficiently communicate with larger groups of interacting (...) partners. Further, we ask whether the cognitive demands of tracking multiple conversational partners' perspectives places limitations on successful audience design. We find that speakers can successfully track information about what up to four of their partners do and do not know in conversation. When addressing groups of 3–4 addressees at once, speakers design language based on the combined knowledge of the group. These findings point to an audience design process that simultaneously represents the perspectives of multiple other individuals and combines these representations in order to design utterances that strike a balance between the different needs of the individuals within the group. (shrink)

Language use can be viewed as a form of joint activity that requires the coordination of meaning between individuals. Because the linguistic signal is notoriously ambiguous, interlocutors need to draw upon additional sources of information to resolve ambiguity and achieve shared understanding. One way individuals can achieve coordination is by using inferences about the interlocutor’s intentions and mental states to adapt their behavior. However, such an inferential process can be demanding in terms of both time and cognitive resources. Here, we (...) suggest that interaction provides interlocutors with many cues that can support coordination of meaning, even when they are neither produced intentionally for that purpose nor interpreted as signaling speakers’ intention. In many circumstances, interlocutors can take advantage of these cues to adapt their behavior in ways that promote coordination, bypassing the need to resort to deliberative inferential processes. (shrink)

We report on two experiments investigating the effect of an increased cognitive load for speakers on the choice of referring expressions. Speakers produced story continuations to addressees, in which they referred to characters that were either salient or non-salient in the discourse. In Experiment 1, referents that were salient for the speaker were non-salient for the addressee, and vice versa. In Experiment 2, all discourse information was shared between speaker and addressee. Cognitive load was manipulated by the presence or absence (...) of a secondary task for the speaker. The results show that speakers under load are more likely to produce pronouns, at least when referring to less salient referents. We take this finding as evidence that speakers under load have more difficulties taking discourse salience into account, resulting in the use of expressions that are more economical for themselves. (shrink)

Pickering & Garrod's (P&G's) integrated model of production and comprehension includes no explicit role for nonlinguistic cognitive processes. Yet, how domain-general cognitive functions contribute to language processing has become clearer with well-specified theories and supporting data. We therefore believe that their account can benefit by incorporating functions like working memory and cognitive control into a unified model of language processing.

Horton and Gerrig outlined a memory-based processing model of conversational common ground that provided a description of how speakers could both strategically and automatically gain access to information about others through domain-general memory processes acting over ordinary memory traces. In this article, we revisit this account, reviewing empirical findings that address aspects of this memory-based model. In doing so, we also take the opportunity to clarify what we believe this approach implies about the cognitive psychology of common ground, and just (...) as important, what it does not imply. We also highlight related areas of research demonstrating how general cognitive processes can constrain access to relevant knowledge in ways that shape both language production and comprehension. (shrink)

No one denies that people adapt what they say and how they interpret what is said to them, depending on their interactive partners. What is controversial is when and how they do so. Several psycholinguistics research programs have found what appear to be failures to adapt to partners in the early moments of processing and have used this evidence to argue for modularity in the language processing architecture, claiming that the system cannot take into account a partner’s distinct needs or (...) knowledge early in processing. We review the evidence for both early and delayed partner‐specific adaptations, and we identify some challenges and difficulties with interpreting this evidence. We then discuss new analyses from a previously published referential communication experiment (Metzing & Brennan, 2003) demonstrating that partner‐specific effects need not occur late in processing. In contrast to Pickering and Garrod (2004) and Keysar, Barr, and Horton (1998b), we conclude that there is no good evidence that early processing has to be be “egocentric,”“dumb,” or encapsulated from social knowledge or common ground, but that under some circumstances, such as when one partner has made an attribution about another’s knowledge or needs, processing can be nimble enough to adapt quite early to a perspective different from one’s own. (shrink)

Written memoranda of conversations, or memcons, provide a near‐contemporaneous record of what was said in conversation, and offer important insights into the activities of high‐profile individuals. We assess the impact of writing a memcon on memory for conversation. Pairs of participants engaged in conversation and were asked to recall the contents of that conversation 1 week later. One participant in each pair memorialized the content of the interaction in a memcon shortly after the conversation. Participants who generated memcons recalled more (...) details of the conversations than participants who did not, but the content of recall was equally and largely accurate for both participants. Remarkably, only 4.7% of the details of the conversation were recalled by both of the partners after a week delay. Contemporaneous note‐taking appears to enhance memory for conversation by increasing the amount of information remembered but not the accuracy of that information. These findings have implications for evaluating the testimony of participants on conversations with major political or legal ramifications. (shrink)

During communication, we form assumptions about what our communication partners know and believe. Information that is mutually known between the discourse partners—their common ground—serves as a backdrop for successful communication. Here we present an introduction to the focus of this topic, which is the role of memory in common ground and language use. Two types of questions emerge as central to understanding the relationship between memory and common ground, specifically questions having to do with the representation of common ground in (...) memory, and the use of common ground during language processing. (shrink)

Cognitive Science, Volume 46, Issue 1, January 2022.

In a matter of mere milliseconds, conversational partners can transform their expectations about the world in a way that accords with another person's perspective. At the same time, in similar situations, the exact opposite also appears to be true. Rather than being at odds, these findings suggest that there are multiple contextual and processing constraints that may guide when and how people consider perspective. These constraints are shaped by a host of factors, including the availability of social and environmental cues, (...) and intrinsic biases and cognitive abilities. To explain how these might be integrated in a new way forward, we turn to an adaptive account of interpersonal interaction. This account draws from basic principles of dynamical systems, principles that we argue are already expressed, both implicitly and explicitly, within a broad landscape of existing research. We then showcase an initial attempt to develop a computational framework to instantiate some of these principles. This framework, consisting of what we argue to be important mechanistic insights rendered by neural network models, is based on a promising and long-standing approach that has yet to take hold in the current domain. We argue that by bridging this gap, new insights into other theoretical accounts, such as the connections between memory and common ground information, might be revealed. (shrink)

It is well established that language production and comprehension are influenced by information status, for example, whether information is given, new, topical, or predictable, and many scholars suggest that an important component of information status is keeping track of what information is in common ground, and what is not. Information status affects both speakers' choices and how listeners interpret the speaker's meaning. Although there is a wealth of scholarly work on information status, there is no consensus on the mechanisms by (...) which it is used, and in fact relatively little discussion of the underlying representations and psycholinguistic mechanisms. Moreover, a major challenge to understanding information status is that its effects are notoriously variable. This study considers existing proposals about information status, focusing on two questions: how is it represented; and by what mechanisms is it used? I propose that it is important to consider whether representations and mechanisms can be classified as either explicit or emergent. Based on a review of existing evidence, I argue that information status representations are most likely emergent, but the mechanisms by which they are used are both explicit and emergent. This review provides one of the first considerations of information status processing across multiple domains. (shrink)