Traditional mechanistic accounts of language processing derive almost entirely from the study of monologue. Yet, the most natural and basic form of language use is dialogue. As a result, these accounts may only offer limited theories of the mechanisms that underlie language processing in general. We propose a mechanistic account of dialogue, the interactive alignment account, and use it to derive a number of predictions about basic language processes. The account assumes that, in dialogue, the linguistic representations employed by the (...) interlocutors become aligned at many levels, as a result of a largely automatic process. This process greatly simplifies production and comprehension in dialogue. After considering the evidence for the interactive alignment model, we concentrate on three aspects of processing that follow from it. It makes use of a simple interactive inference mechanism, enables the development of local dialogue routines that greatly simplify language processing, and explains the origins of self-monitoring in production. We consider the need for a grammatical framework that is designed to deal with language in dialogue rather than monologue, and discuss a range of implications of the account. Key Words: common ground; dialogue; dialogue routines; language comprehension; language production; monitoring; perception-behavior link. (shrink)

I argue, in this thesis, that proper name reference is a wholly pragmatic phenomenon. The reference of a proper name is neither constitutive of, nor determined by, the semantic content of that name, but is determined, on an occasion of use, by pragmatic factors. The majority of views in the literature on proper name reference claim that reference is in some way determined by the semantics of the name, either because their reference simply constitutes their semantics (which generally requires a (...) very fine-grained individuation of names), or because names have an indexical-like semantics that returns a referent given certain specific contextual parameters. I discuss and criticize these views in detail, arguing, essentially, in both cases, that there can be no determinate criteria for reference determination—a claim required by both types of semantic view. I also consider a less common view on proper name reference: that it is determined wholly by speakers’ intentions. I argue that the most plausible version of this view—a strong neo-Gricean position whereby all utterance content is determined by the communicative intentions of the speaker—is implausible in light of psychological data. In the positive part of my thesis, I develop a pragmatic view of proper name reference that is influenced primarily by the work of Charles Travis. I argue that the reference of proper names can only be satisfactorily accounted for by claiming that reference occurs not at the level of word meaning, but at the pragmatic level, on an occasion of utterance. I claim that the contextual mechanisms that determine the reference of a name on an occasion are the same kinds of thing that determine the truth-values of utterances according to Travis. Thus, names are, effectively, occasion sensitive in the way that Travis claims predicates and sentences (amongst other expressions) are. Finally, I discuss how further research might address how my pragmatic view of reference affects traditional issues in the literature on names, and the consequences of the view for the semantics of names. (shrink)

During communication, we form assumptions about what our communication partners know and believe. Information that is mutually known between the discourse partners—their common ground—serves as a backdrop for successful communication. Here we present an introduction to the focus of this topic, which is the role of memory in common ground and language use. Two types of questions emerge as central to understanding the relationship between memory and common ground, specifically questions having to do with the representation of common ground in (...) memory, and the use of common ground during language processing. (shrink)

In everyday life it is often important to have a mental model of the knowledge, beliefs, desires, and intentions of other people. Sometimes it is even useful to to have a correct model of their model of our own mental states: a second-order Theory of Mind. In order to investigate to what extent adults use and acquire complex skills and strategies in the domains of Theory of Mind and the related skill of natural language use, we conducted an experiment. It (...) was based on a strategic game of imperfect information, in which it was beneficial for participants to have a good mental model of their opponent, and more specifically, to use second-order Theory of Mind. It was also beneficial for them to be aware of pragmatic inferences and of the possibility to choose between logical and pragmatic language use. We found that most participants did not seem to acquire these complex skills during the experiment when being exposed to the game for a number of different trials. Nevertheless, some participants did make use of advanced cognitive skills such as second-order Theory of Mind and appropriate choices between logical and pragmatic language use from the beginning. Thus, the results differ markedly from previous research. (shrink)

We examined how social cues and representational ones jointly shape people's spatial memory representations and their subsequent descriptions. In 24 pairs, Directors studied an array with a symmetrical structure while either knowing their Matcher's subsequent viewpoint or not. During the subsequent description of the array, the array's intrinsic structure was aligned with the Director, the Matcher, or neither partner. According to memory tests preceding descriptions, Directors who had studied the array while aligned with its structure were more likely to use (...) its orientation as an organizing direction. Directors who had studied the array while misaligned with its structure used its orientation more frequently as an organizing orientation when knowing that the Matcher would be aligned with it, but used their own viewpoint more frequently as an organizing direction when not knowing the Matcher's viewpoint. Directors also adapted their descriptions strategically, using more egocentric expressions when aligned with the intrinsic structure and more partner-centered expressions when their Matchers were the ones aligned with the structure, even when this information wasn't available in advance. These findings suggest that speakers are guided by converging social and representational cues to adapt flexibly the organization of their memories and the perspectives of their descriptions. (shrink)

Psycholinguistic studies often look at the production of referring expressions in interactive settings, but so far few referring expression generation algorithms have been developed that are sensitive to earlier references in an interaction. Rather, such algorithms tend to rely on domain-dependent preferences for both content selection and linguistic realization. We present three experiments showing that humans may opt for dispreferred attributes and dispreferred modifier orderings when these were primed in a preceding interaction (without speakers being consciously aware of this). In (...) addition, we show that speakers are more likely to produce overspecified references, including dispreferred attributes (although minimal descriptions with preferred attributes would suffice), when these were similarly primed. (shrink)

Why is interaction so simple? This article presents a theory of interaction based on the use of shared representations as “coordination tools” (e.g., roundabouts that facilitate coordination of drivers). By aligning their representations (intentionally or unintentionally), interacting agents help one another to solve interaction problems in that they remain predictable, and offer cues for action selection and goal monitoring. We illustrate how this strategy works in a joint task (building together a tower of bricks) and discuss its requirements from a (...) computational viewpoint. (shrink)

In this paper we consider the potential role of metarepresentation—the representation of another representation, or as commonly considered within cognitive science, the mental representation of another individual's knowledge and beliefs—in mediating definite reference and common ground in conversation. Using dialogues from a referential communication study in which speakers conversed in succession with two different addressees, we highlight ways in which interlocutors work together to successfully refer to objects, and achieve shared conceptualizations. We briefly review accounts of how such shared conceptualizations (...) could be represented in memory, from simple associations between label and referent, to “triple co-presence” representations that track interlocutors in an episode of referring, to more elaborate metarepresentations that invoke theory of mind, mutual knowledge, or a model of a conversational partner. We consider how some forms of metarepresentation, once created and activated, could account for definite reference in conversation by appealing to ordinary processes in memory. We conclude that any representations that capture information about others' perspectives are likely to be relatively simple and subject to the same kinds of constraints on attention and memory that influence other kinds of cognitive representations. (shrink)

While speakers have been shown to adapt to the knowledge state of their addressee in choosing referring expressions, they often also show some egocentric tendencies. The current paper aims to provide an explanation for this “mixed” behavior by presenting a model that derives such patterns from the probabilistic combination of both the speaker's and the addressee's perspectives. To test our model, we conducted a language production experiment, in which participants had to refer to objects in a context that also included (...) a visually misleading object whose function was either known to both partners, or known just to the speaker but not the addressee. Modeling results indicate that the experimental findings cannot be explained by assuming that speakers tailor a referring expression solely to their own perspective or to the perspective of their addressee. Instead, accounting for the behavioral pattern requires an approach where both perspectives influence the choice of referring expressions. Nevertheless, in our situation, speakers consider their partner's perspective more than their own. (shrink)

Communicating with multiple addressees poses a problem for speakers: Each addressee necessarily comes to the conversation with a different perspective—different knowledge, different beliefs, and a distinct physical context. Despite the ubiquity of multiparty conversation in everyday life, little is known about the processes by which speakers design language in multiparty conversation. While prior evidence demonstrates that speakers design utterances to accommodate addressee knowledge in multiparty conversation, it is unknown if and how speakers encode and combine different types of perspective information. (...) Here we test whether speakers encode the perspective of multiple addressees, and then simultaneously consider their knowledge and physical context during referential design in a three‐party conversation. Analyses of referential form—expression length, disfluency, and elaboration rate—in an interactive multiparty conversation demonstrate that speakers do take into consideration both addressee knowledge and physical context when designing utterances, consistent with a knowledge‐scene integration view. These findings point to an audience design process that takes as input multiple types of representations about the perspectives of multiple addressees, and that bases the informational content of the to‐be‐designed utterance on a combination of the perspectives of the intended addressees. (shrink)

Adults design utterances to match listeners' informational needs by making both “generic” adjustments (e.g., mentioning atypical more often than typical information) and “particular” adjustments tailored to their specific interlocutor (e.g., including things that their addressee cannot see). For children, however, relevant evidence is mixed. Three experiments investigated how generic and particular factors affect children's production. In Experiment 1, 4‐ to 5‐year‐old children and adults described typical and atypical instrument events to a silent listener who could either see or not see (...) the events. In later extensions, participants described the same events to either a silent (Experiment 2) or an interactive (Experiment 3) addressee with a specific goal. Both adults and 4‐ to 5‐year‐olds performed generic adjustments but, unlike adults, children made listener‐particular adjustments inconsistently. These and prior findings can be explained by assuming that particular adjustments can be costlier for children to implement compared to generic adjustments. (shrink)

A long‐standing debate in the study of human communication centers on the degree to which communicators tune their communicative signals (e.g., speech, gestures) for specific addressees, as opposed to taking a neutral or egocentric perspective. This tuning, called recipient design, is known to occur under special conditions (e.g., when errors in communication need to be corrected), but several researchers have argued that it is not an intrinsic feature of human communication, because that would be computationally too demanding. In this study, (...) we contribute to this debate by studying a simple communicative behavior, communicative pointing, under conditions of successful (error‐free) communication. Using an information‐theoretic measure, called legibility, we present evidence of recipient design in communicative pointing. The legibility effect is present early in the movement, suggesting that it is an intrinsic part of the communicative plan. Moreover, it is reliable only from the viewpoint of the addressee, suggesting that the motor plan is tuned to the addressee. These findings suggest that recipient design is an intrinsic feature of human communication. (shrink)

How do communities establish shared communication systems? The Common Knowledge view assumes that symbolic conventions develop through the accumulation of common knowledge regarding communication practices among the members of a community. In contrast with this view, it is proposed that coordinated communication emerges a by‐product of local interactions among dyads. A set of multi‐agent computer simulations show that a population of “egocentric” agents can establish and maintain symbolic conventions without common knowledge. In the simulations, convergence to a single conventional system (...) was most likely and most efficient when agents updated their behavior on the basis of local rather than global, system‐level information. The massive feedback and parallelism present in the simulations gave rise to phenomena that are often assumed to result from complex strategic processing on the part of individual agents. The implications of these findings for the development of theories of language use are discussed. (shrink)

We investigate partner effects on spatial perspective taking behavior in listeners, comparing behavior with a human versus a computer partner (Experiments 1 and 2), and with computer partners of different perceived capabilities (Experiment 3). Participants responded to spoken instructions from their partner which could be interpreted egocentrically (from their own perspective) or othercentrically (from their partner's perspective). In contrast to earlier work, we found that participants were more egocentric with a computer than a human partner. Participants were also more egocentric (...) with a computer partner that appeared more modern and capable, compared to one that appeared outdated and limited in ability. Our results show that perspective taking behavior is sensitive to information about one's partner; in particular, listeners consider their partner's potential ability to collaborate, adjusting their egocentric tendencies accordingly. Moreover, we highlight what appears to be a shift in listeners' expectations regarding computers' collaborative capabilities, leading to greater willingness to push the burden of perspective taking onto a computer partner. (shrink)

Through theoretical discussion, literature review, and a computational model, this paper poses a challenge to the notion that perspective-taking involves a fixed architecture in which particular processes have priority. For example, some research suggests that egocentric perspectives can arise more quickly, with other perspectives (such as of task partners) emerging only secondarily. This theoretical dichotomy–between fast egocentric and slow other-centric processes–is challenged here. We propose a general view of perspective-taking as an emergent phenomenon governed by the interplay among cognitive mechanisms (...) that accumulate information at different timescales. We first describe the pervasive relevance of perspective-taking to cognitive science. A dynamical systems model is then introduced that explicitly formulates the timescale interaction proposed. This model illustrates that, rather than having a rigid time course, perspective-taking can be fast or slow depending on factors such as task context. Implications are discussed, with ideas for future empirical research. (shrink)

Paulina Sliwa (2015) argues that knowing why p is necessary and sufficient for understanding why p. She tries to rebut recent attacks against the necessity and sufficiency claims, and explains the gradability of understanding why in terms of knowledge. I argue that her attempts do not succeed, but I indicate more promising ways to defend reductionism about understanding why throughout the discussion.

Evidence suggests that speakers can take account of the addressee's needs when referring. However, what representations drive the speaker's audience design has been less clear. This study aims to go beyond previous studies by investigating the interplay between the visual and linguistic context during audience design. Speakers repeated subordinate descriptions given in the prior linguistic context less and used basic-level descriptions more when the addressee did not hear the linguistic context than when s/he did. But crucially, this effect happened only (...) when the referent lacked the visual attributes associated with the expressions, so there was no other contextual cue available for the identification of the referent. This suggests that speakers flexibly use different contextual cues to help their addressee map the referring expression onto the intended referent. In addition, speakers used fewer pronouns when the addressee did not hear the linguistic antecedent than when s/he did. This suggests that although speakers may be egocentric during anaphoric reference, they can cooperatively avoid pronouns when the linguistic antecedents were not shared with their addressee during initial reference. (shrink)

We report two experiments that investigated the widely held assumption that speakers use the addressee’s discourse model when choosing referring expressions (e.g., Ariel, 1990; Chafe, 1994; Givón, 1983; Prince, 1985), by manipulating whether the addressee could hear the immediately preceding linguistic context. Experiment 1 showed that speakers increased pronoun use (and decreased noun phrase use) when the referent was mentioned in the immediately preceding sentence compared to when it was not, even though the addressee did not hear the preceding sentence, (...) indicating that speakers used their own, privileged discourse model when choosing referring expressions. The same pattern of results was found in Experiment 2. Speakers produced more pronouns when the immediately preceding sentence mentioned the referent than when it mentioned a referential competitor, regardless of whether the sentence was shared with their addressee. Thus, we conclude that choice of referring expression is determined by the referent’s accessibility in the speaker’s own discourse model rather than the addressee’s. (shrink)

Language use can be viewed as a form of joint activity that requires the coordination of meaning between individuals. Because the linguistic signal is notoriously ambiguous, interlocutors need to draw upon additional sources of information to resolve ambiguity and achieve shared understanding. One way individuals can achieve coordination is by using inferences about the interlocutor’s intentions and mental states to adapt their behavior. However, such an inferential process can be demanding in terms of both time and cognitive resources. Here, we (...) suggest that interaction provides interlocutors with many cues that can support coordination of meaning, even when they are neither produced intentionally for that purpose nor interpreted as signaling speakers’ intention. In many circumstances, interlocutors can take advantage of these cues to adapt their behavior in ways that promote coordination, bypassing the need to resort to deliberative inferential processes. (shrink)

This paper asks why information should ever be expressed vaguely, re-assessing some previously proposed answers to this question and suggesting some new ones. Particular attention is paid to the benefits that vague expressions can have in situations where agreement over the meaning of an expression cannot be taken for granted. A distinction between two different versions of the above-mentioned question is advocated. The first asks why human languages contain vague expressions, the second question asks when and why a speaker should (...) choose a vague expression when communicating with a hearer. While the former question is purely theoretical, the latter has practical implications for the computational generation of utterances in Natural Language Generation (NLG). (shrink)

Research spanning linguistics, psychology, and philosophy suggests that speakers and hearers are finely attuned to perspectives and viewpoints that are not their own, even though perspectival information is not encoded directly in the morphosyntax of languages like English. While some terms seem to require a perspective or a judge for interpretation (e.g., epithets, evaluative adjectives, locational PPs, etc.), perspective may also be determined on the basis of subtle information spanning multiple sentences, especially in vivid styles of narrative reporting. In this (...) paper, I develop an account of the cues that are involved in evaluating and maintaining non-speaker perspectives, and present an economy-based discourse processing model of perspective that embodies two core principles. First, perspectives are subject to a “speaker-default,” but may shift to a non-speaker perspective if sufficient contextual cues are provided. Second, the processor follows the path of least resistance to maintaining perspective, opting to maintain the current perspective across sentences as long as the shifted perspective continues to be coherent. The predictions of the model are tested in a series of offline and online studies, manipulating the form of an attitude report and the tense of the sentence that follows. Implications for processing perspective and viewpoint in speech and narrative forms are explored. (shrink)

Healey et al. introduce the special issue with a brief overview of work on communication in the Cognitive Sciences and some of the historical and conceptual influences that have marginalized the study of miscommunication. Drawing on more recent work in Cognitive Science and Conversation Analysis they argue that miscommunication is in fact a highly structured, ubiquitous phenomenon that is fundamental to human interaction.

Integrating different perspectives is a sophisticated strategy for developing constructive interactions in collaborative problem solving. However, cognitive aspects such as individuals’ knowledge and bias often obscure group consensus and produce conflict. This study investigated collaborative problem solving, focusing on a group member interacting with another member having a different perspective. It was predicted that mavericks might mitigate disadvantages and facilitate perspective taking during problem solving. Thus, 344 university students participated in two laboratory-based experiments by engaging in a simple rule-discovery task (...) that raised conflicts among perspectives. They interacted with virtual partners whose conversations were controlled by multiple conversational agents. Results show that when participants interacted with a maverick during the task, they were able to take others’ perspectives and integrate different perspectives to solve the problem. Moreover, when participants interacted in groups with a positive mood, groups with a maverick outperformed groups having several perspectives. (shrink)

We report on two experiments investigating the effect of an increased cognitive load for speakers on the choice of referring expressions. Speakers produced story continuations to addressees, in which they referred to characters that were either salient or non-salient in the discourse. In Experiment 1, referents that were salient for the speaker were non-salient for the addressee, and vice versa. In Experiment 2, all discourse information was shared between speaker and addressee. Cognitive load was manipulated by the presence or absence (...) of a secondary task for the speaker. The results show that speakers under load are more likely to produce pronouns, at least when referring to less salient referents. We take this finding as evidence that speakers under load have more difficulties taking discourse salience into account, resulting in the use of expressions that are more economical for themselves. (shrink)

This article introduces the topic ‘‘Production of Referring Expressions: Bridging the Gap between Computational and Empirical Approaches to Reference’’ of the journal Topics in Cognitive Science. We argue that computational and psycholinguistic approaches to reference production can benefit from closer interaction, and that this is likely to result in the construction of algorithms that differ markedly from the ones currently known in the computational literature. We focus particularly on determinism, the feature of existing algorithms that is perhaps most clearly at (...) odds with psycholinguistic results, discussing how future algorithms might include non-determinism, and how new psycholinguistic experiments could inform the development of such algorithms. (shrink)

Recent debates over adults' theory of mind use have been fueled by surprising failures of perspective-taking in communication, suggesting that perspective-taking may be relatively effortful. Yet adults routinely engage in effortful processes when needed. How, then, should speakers and listeners allocate their resources to achieve successful communication? We begin with the observation that the shared goal of communication induces a natural division of labor: The resources one agent chooses to allocate toward perspective-taking should depend on their expectations about the other's (...) allocation. We formalize this idea in a resource-rational model augmenting recent probabilistic weighting accounts with a mechanism for (costly) control over the degree of perspective-taking. In a series of simulations, we first derive an intermediate degree of perspective weighting as an optimal trade-off between expected costs and benefits of perspective-taking. We then present two behavioral experiments testing novel predictions of our model. In Experiment 1, we manipulated the presence or absence of occlusions in a director–matcher task. We found that speakers spontaneously modulated the informativeness of their descriptions to account for “known unknowns” in their partner's private view, reflecting a higher degree of speaker perspective-taking than previously acknowledged. In Experiment 2, we then compared the scripted utterances used by confederates in prior work with those produced in interactions with unscripted directors. We found that confederates were systematically less informative than listeners would initially expect given the presence of occlusions, but listeners used violations to adaptively make fewer errors over time. Taken together, our work suggests that people are not simply “mindblind”; they use contextually appropriate expectations to navigate the division of labor with their partner. We discuss how a resource-rational framework may provide a more deeply explanatory foundation for understanding flexible perspective-taking under processing constraints. (shrink)

Horton and Gerrig outlined a memory-based processing model of conversational common ground that provided a description of how speakers could both strategically and automatically gain access to information about others through domain-general memory processes acting over ordinary memory traces. In this article, we revisit this account, reviewing empirical findings that address aspects of this memory-based model. In doing so, we also take the opportunity to clarify what we believe this approach implies about the cognitive psychology of common ground, and just (...) as important, what it does not imply. We also highlight related areas of research demonstrating how general cognitive processes can constrain access to relevant knowledge in ways that shape both language production and comprehension. (shrink)

No one denies that people adapt what they say and how they interpret what is said to them, depending on their interactive partners. What is controversial is when and how they do so. Several psycholinguistics research programs have found what appear to be failures to adapt to partners in the early moments of processing and have used this evidence to argue for modularity in the language processing architecture, claiming that the system cannot take into account a partner’s distinct needs or (...) knowledge early in processing. We review the evidence for both early and delayed partner‐specific adaptations, and we identify some challenges and difficulties with interpreting this evidence. We then discuss new analyses from a previously published referential communication experiment (Metzing & Brennan, 2003) demonstrating that partner‐specific effects need not occur late in processing. In contrast to Pickering and Garrod (2004) and Keysar, Barr, and Horton (1998b), we conclude that there is no good evidence that early processing has to be be “egocentric,”“dumb,” or encapsulated from social knowledge or common ground, but that under some circumstances, such as when one partner has made an attribution about another’s knowledge or needs, processing can be nimble enough to adapt quite early to a perspective different from one’s own. (shrink)

In the absence of pre‐established communicative conventions, people create novel communication systems to successfully coordinate their actions toward a joint goal. In this study, we address two types of such novel communication systems: sensorimotor communication, where the kinematics of instrumental actions are systematically modulated, versus symbolic communication. We ask which of the two systems co‐actors preferentially create when aiming to communicate about hidden object properties such as weight. The results of three experiments consistently show that actors who knew the weight (...) of an object transmitted this weight information to their uninformed co‐actors by systematically modulating their instrumental actions, grasping objects of particular weights at particular heights. This preference for sensorimotor communication was reduced in a fourth experiment where co‐actors could communicate with weight‐related symbols. Our findings demonstrate that the use of sensorimotor communication extends beyond the communication of spatial locations to non‐spatial, hidden object properties. (shrink)

Cognitive Science, Volume 46, Issue 1, January 2022.