Recent debates over adults' theory of mind use have been fueled by surprising failures of perspective-taking in communication, suggesting that perspective-taking may be relatively effortful. Yet adults routinely engage in effortful processes when needed. How, then, should speakers and listeners allocate their resources to achieve successful communication? We begin with the observation that the shared goal of communication induces a natural division of labor: The resources one agent chooses to allocate toward perspective-taking should depend on their expectations about the other's (...) allocation. We formalize this idea in a resource-rational model augmenting recent probabilistic weighting accounts with a mechanism for (costly) control over the degree of perspective-taking. In a series of simulations, we first derive an intermediate degree of perspective weighting as an optimal trade-off between expected costs and benefits of perspective-taking. We then present two behavioral experiments testing novel predictions of our model. In Experiment 1, we manipulated the presence or absence of occlusions in a director–matcher task. We found that speakers spontaneously modulated the informativeness of their descriptions to account for “known unknowns” in their partner's private view, reflecting a higher degree of speaker perspective-taking than previously acknowledged. In Experiment 2, we then compared the scripted utterances used by confederates in prior work with those produced in interactions with unscripted directors. We found that confederates were systematically less informative than listeners would initially expect given the presence of occlusions, but listeners used violations to adaptively make fewer errors over time. Taken together, our work suggests that people are not simply “mindblind”; they use contextually appropriate expectations to navigate the division of labor with their partner. We discuss how a resource-rational framework may provide a more deeply explanatory foundation for understanding flexible perspective-taking under processing constraints. (shrink)

When people are engaged in social interaction, they can repeat aspects of each other’s communicative behavior, such as words or gestures. This kind of behavioral alignment has been studied across a wide range of disciplines and has been accounted for by diverging theories. In this paper, we review various operationalizations of lexical and gestural alignment. We reveal that scholars have fundamentally different takes on when and how behavior is considered to be aligned, which makes it difficult to compare findings and (...) draw uniform conclusions. Furthermore, we show that scholars tend to focus on one particular dimension of alignment (traditionally, whether two instances of behavior overlap in form), while other dimensions remain understudied. This hampers theory testing and building, which requires a well‐defined account of the factors that are central to or might enhance alignment. To capture the complex nature of alignment, we identify five key dimensions to formalize the relationship between any pair of behavior: time, sequence, meaning, form, and modality. We show how assumptions regarding the underlying mechanism of alignment (placed along the continuum of priming vs. grounding) pattern together with operationalizations in terms of the five dimensions. This integrative framework can help researchers in the field of alignment and related phenomena (including behavior matching, mimicry, entrainment, and accommodation) to formulate their hypotheses and operationalizations in a more transparent and systematic manner. The framework also enables us to discover unexplored research avenues and derive new hypotheses regarding alignment. (shrink)

Adults design utterances to match listeners' informational needs by making both “generic” adjustments (e.g., mentioning atypical more often than typical information) and “particular” adjustments tailored to their specific interlocutor (e.g., including things that their addressee cannot see). For children, however, relevant evidence is mixed. Three experiments investigated how generic and particular factors affect children's production. In Experiment 1, 4‐ to 5‐year‐old children and adults described typical and atypical instrument events to a silent listener who could either see or not see (...) the events. In later extensions, participants described the same events to either a silent (Experiment 2) or an interactive (Experiment 3) addressee with a specific goal. Both adults and 4‐ to 5‐year‐olds performed generic adjustments but, unlike adults, children made listener‐particular adjustments inconsistently. These and prior findings can be explained by assuming that particular adjustments can be costlier for children to implement compared to generic adjustments. (shrink)

I argue, in this thesis, that proper name reference is a wholly pragmatic phenomenon. The reference of a proper name is neither constitutive of, nor determined by, the semantic content of that name, but is determined, on an occasion of use, by pragmatic factors. The majority of views in the literature on proper name reference claim that reference is in some way determined by the semantics of the name, either because their reference simply constitutes their semantics (which generally requires a (...) very fine-grained individuation of names), or because names have an indexical-like semantics that returns a referent given certain specific contextual parameters. I discuss and criticize these views in detail, arguing, essentially, in both cases, that there can be no determinate criteria for reference determination—a claim required by both types of semantic view. I also consider a less common view on proper name reference: that it is determined wholly by speakers’ intentions. I argue that the most plausible version of this view—a strong neo-Gricean position whereby all utterance content is determined by the communicative intentions of the speaker—is implausible in light of psychological data. In the positive part of my thesis, I develop a pragmatic view of proper name reference that is influenced primarily by the work of Charles Travis. I argue that the reference of proper names can only be satisfactorily accounted for by claiming that reference occurs not at the level of word meaning, but at the pragmatic level, on an occasion of utterance. I claim that the contextual mechanisms that determine the reference of a name on an occasion are the same kinds of thing that determine the truth-values of utterances according to Travis. Thus, names are, effectively, occasion sensitive in the way that Travis claims predicates and sentences (amongst other expressions) are. Finally, I discuss how further research might address how my pragmatic view of reference affects traditional issues in the literature on names, and the consequences of the view for the semantics of names. (shrink)

Evidence suggests that speakers can take account of the addressee's needs when referring. However, what representations drive the speaker's audience design has been less clear. This study aims to go beyond previous studies by investigating the interplay between the visual and linguistic context during audience design. Speakers repeated subordinate descriptions given in the prior linguistic context less and used basic-level descriptions more when the addressee did not hear the linguistic context than when s/he did. But crucially, this effect happened only (...) when the referent lacked the visual attributes associated with the expressions, so there was no other contextual cue available for the identification of the referent. This suggests that speakers flexibly use different contextual cues to help their addressee map the referring expression onto the intended referent. In addition, speakers used fewer pronouns when the addressee did not hear the linguistic antecedent than when s/he did. This suggests that although speakers may be egocentric during anaphoric reference, they can cooperatively avoid pronouns when the linguistic antecedents were not shared with their addressee during initial reference. (shrink)

No one denies that people adapt what they say and how they interpret what is said to them, depending on their interactive partners. What is controversial is when and how they do so. Several psycholinguistics research programs have found what appear to be failures to adapt to partners in the early moments of processing and have used this evidence to argue for modularity in the language processing architecture, claiming that the system cannot take into account a partner’s distinct needs or (...) knowledge early in processing. We review the evidence for both early and delayed partner‐specific adaptations, and we identify some challenges and difficulties with interpreting this evidence. We then discuss new analyses from a previously published referential communication experiment (Metzing & Brennan, 2003) demonstrating that partner‐specific effects need not occur late in processing. In contrast to Pickering and Garrod (2004) and Keysar, Barr, and Horton (1998b), we conclude that there is no good evidence that early processing has to be be “egocentric,”“dumb,” or encapsulated from social knowledge or common ground, but that under some circumstances, such as when one partner has made an attribution about another’s knowledge or needs, processing can be nimble enough to adapt quite early to a perspective different from one’s own. (shrink)

How do communities establish shared communication systems? The Common Knowledge view assumes that symbolic conventions develop through the accumulation of common knowledge regarding communication practices among the members of a community. In contrast with this view, it is proposed that coordinated communication emerges a by‐product of local interactions among dyads. A set of multi‐agent computer simulations show that a population of “egocentric” agents can establish and maintain symbolic conventions without common knowledge. In the simulations, convergence to a single conventional system (...) was most likely and most efficient when agents updated their behavior on the basis of local rather than global, system‐level information. The massive feedback and parallelism present in the simulations gave rise to phenomena that are often assumed to result from complex strategic processing on the part of individual agents. The implications of these findings for the development of theories of language use are discussed. (shrink)

Traditional mechanistic accounts of language processing derive almost entirely from the study of monologue. Yet, the most natural and basic form of language use is dialogue. As a result, these accounts may only offer limited theories of the mechanisms that underlie language processing in general. We propose a mechanistic account of dialogue, the interactive alignment account, and use it to derive a number of predictions about basic language processes. The account assumes that, in dialogue, the linguistic representations employed by the (...) interlocutors become aligned at many levels, as a result of a largely automatic process. This process greatly simplifies production and comprehension in dialogue. After considering the evidence for the interactive alignment model, we concentrate on three aspects of processing that follow from it. It makes use of a simple interactive inference mechanism, enables the development of local dialogue routines that greatly simplify language processing, and explains the origins of self-monitoring in production. We consider the need for a grammatical framework that is designed to deal with language in dialogue rather than monologue, and discuss a range of implications of the account. Key Words: common ground; dialogue; dialogue routines; language comprehension; language production; monitoring; perception-behavior link. (shrink)

In everyday life it is often important to have a mental model of the knowledge, beliefs, desires, and intentions of other people. Sometimes it is even useful to to have a correct model of their model of our own mental states: a second-order Theory of Mind. In order to investigate to what extent adults use and acquire complex skills and strategies in the domains of Theory of Mind and the related skill of natural language use, we conducted an experiment. It (...) was based on a strategic game of imperfect information, in which it was beneficial for participants to have a good mental model of their opponent, and more specifically, to use second-order Theory of Mind. It was also beneficial for them to be aware of pragmatic inferences and of the possibility to choose between logical and pragmatic language use. We found that most participants did not seem to acquire these complex skills during the experiment when being exposed to the game for a number of different trials. Nevertheless, some participants did make use of advanced cognitive skills such as second-order Theory of Mind and appropriate choices between logical and pragmatic language use from the beginning. Thus, the results differ markedly from previous research. (shrink)

Grice's notion of conversational implicature requires that speaker meaning be calculable on the basis of sentence meaning, and presumptions about the speaker's adherence to cooperative principles of conversation and the ability of the hearer to work out the speaker's meaning. However, the actual real‐time consideration of cooperative principles by both the hearer and speaker runs up against severe temporal constraints during language processing. This article considers the role of language processing research in the shaping of a theory of implicature, and (...) provides an empirical overview of pertinent current work in real‐time language production and comprehension. (shrink)

Explanations are conceived to ensure the trustworthiness of AI systems. Yet, relying solemnly on algorithmic solutions, as provided by explainable artificial intelligence (XAI), might fall short to account for sociotechnical risks jeopardizing their factuality and informativeness. To mitigate these risks, we delve into the complex landscape of ethical risks surrounding XAI systems and their generated explanations. By employing a literature review combined with rigorous thematic analysis, we uncover a diverse array of technical risks tied to the robustness, fairness, and evaluation (...) of XAI systems. Furthermore, we address a broader range of contextual risks jeopardizing their security, accountability, reception alongside other cognitive, social, and ethical concerns of explanations. We advance a multi-layered risk assessment framework, where each layer advances strategies for practical intervention, management, and documentation of XAI systems within organizations. Recognizing the theoretical nature of the framework advanced, we discuss it in a conceptual case study. For the XAI community, our multifaceted investigation represents a path to practically address XAI risks while enriching our understanding of the ethical ramifications of incorporating XAI in decision-making processes. (shrink)

Through theoretical discussion, literature review, and a computational model, this paper poses a challenge to the notion that perspective-taking involves a fixed architecture in which particular processes have priority. For example, some research suggests that egocentric perspectives can arise more quickly, with other perspectives (such as of task partners) emerging only secondarily. This theoretical dichotomy–between fast egocentric and slow other-centric processes–is challenged here. We propose a general view of perspective-taking as an emergent phenomenon governed by the interplay among cognitive mechanisms (...) that accumulate information at different timescales. We first describe the pervasive relevance of perspective-taking to cognitive science. A dynamical systems model is then introduced that explicitly formulates the timescale interaction proposed. This model illustrates that, rather than having a rigid time course, perspective-taking can be fast or slow depending on factors such as task context. Implications are discussed, with ideas for future empirical research. (shrink)

During communication, we form assumptions about what our communication partners know and believe. Information that is mutually known between the discourse partners—their common ground—serves as a backdrop for successful communication. Here we present an introduction to the focus of this topic, which is the role of memory in common ground and language use. Two types of questions emerge as central to understanding the relationship between memory and common ground, specifically questions having to do with the representation of common ground in (...) memory, and the use of common ground during language processing. (shrink)

Paulina Sliwa (2015) argues that knowing why p is necessary and sufficient for understanding why p. She tries to rebut recent attacks against the necessity and sufficiency claims, and explains the gradability of understanding why in terms of knowledge. I argue that her attempts do not succeed, but I indicate more promising ways to defend reductionism about understanding why throughout the discussion.

We report on two experiments investigating the effect of an increased cognitive load for speakers on the choice of referring expressions. Speakers produced story continuations to addressees, in which they referred to characters that were either salient or non-salient in the discourse. In Experiment 1, referents that were salient for the speaker were non-salient for the addressee, and vice versa. In Experiment 2, all discourse information was shared between speaker and addressee. Cognitive load was manipulated by the presence or absence (...) of a secondary task for the speaker. The results show that speakers under load are more likely to produce pronouns, at least when referring to less salient referents. We take this finding as evidence that speakers under load have more difficulties taking discourse salience into account, resulting in the use of expressions that are more economical for themselves. (shrink)

This article introduces the topic ‘‘Production of Referring Expressions: Bridging the Gap between Computational and Empirical Approaches to Reference’’ of the journal Topics in Cognitive Science. We argue that computational and psycholinguistic approaches to reference production can benefit from closer interaction, and that this is likely to result in the construction of algorithms that differ markedly from the ones currently known in the computational literature. We focus particularly on determinism, the feature of existing algorithms that is perhaps most clearly at (...) odds with psycholinguistic results, discussing how future algorithms might include non-determinism, and how new psycholinguistic experiments could inform the development of such algorithms. (shrink)

Cognitive Science, Volume 46, Issue 1, January 2022.

Integrating different perspectives is a sophisticated strategy for developing constructive interactions in collaborative problem solving. However, cognitive aspects such as individuals’ knowledge and bias often obscure group consensus and produce conflict. This study investigated collaborative problem solving, focusing on a group member interacting with another member having a different perspective. It was predicted that mavericks might mitigate disadvantages and facilitate perspective taking during problem solving. Thus, 344 university students participated in two laboratory-based experiments by engaging in a simple rule-discovery task (...) that raised conflicts among perspectives. They interacted with virtual partners whose conversations were controlled by multiple conversational agents. Results show that when participants interacted with a maverick during the task, they were able to take others’ perspectives and integrate different perspectives to solve the problem. Moreover, when participants interacted in groups with a positive mood, groups with a maverick outperformed groups having several perspectives. (shrink)

It is well established that language production and comprehension are influenced by information status, for example, whether information is given, new, topical, or predictable, and many scholars suggest that an important component of information status is keeping track of what information is in common ground, and what is not. Information status affects both speakers' choices and how listeners interpret the speaker's meaning. Although there is a wealth of scholarly work on information status, there is no consensus on the mechanisms by (...) which it is used, and in fact relatively little discussion of the underlying representations and psycholinguistic mechanisms. Moreover, a major challenge to understanding information status is that its effects are notoriously variable. This study considers existing proposals about information status, focusing on two questions: how is it represented; and by what mechanisms is it used? I propose that it is important to consider whether representations and mechanisms can be classified as either explicit or emergent. Based on a review of existing evidence, I argue that information status representations are most likely emergent, but the mechanisms by which they are used are both explicit and emergent. This review provides one of the first considerations of information status processing across multiple domains. (shrink)

A long‐standing debate in the study of human communication centers on the degree to which communicators tune their communicative signals (e.g., speech, gestures) for specific addressees, as opposed to taking a neutral or egocentric perspective. This tuning, called recipient design, is known to occur under special conditions (e.g., when errors in communication need to be corrected), but several researchers have argued that it is not an intrinsic feature of human communication, because that would be computationally too demanding. In this study, (...) we contribute to this debate by studying a simple communicative behavior, communicative pointing, under conditions of successful (error‐free) communication. Using an information‐theoretic measure, called legibility, we present evidence of recipient design in communicative pointing. The legibility effect is present early in the movement, suggesting that it is an intrinsic part of the communicative plan. Moreover, it is reliable only from the viewpoint of the addressee, suggesting that the motor plan is tuned to the addressee. These findings suggest that recipient design is an intrinsic feature of human communication. (shrink)

Why is interaction so simple? This article presents a theory of interaction based on the use of shared representations as “coordination tools” (e.g., roundabouts that facilitate coordination of drivers). By aligning their representations (intentionally or unintentionally), interacting agents help one another to solve interaction problems in that they remain predictable, and offer cues for action selection and goal monitoring. We illustrate how this strategy works in a joint task (building together a tower of bricks) and discuss its requirements from a (...) computational viewpoint. (shrink)

In order to investigate whether addressees can make immediate use of speaker‐based constraints during reference resolution, participant addressees' eye movements were monitored as they helped a confederate cook follow a recipe. Objects were located in the helper's area, which the cook could not reach, and the cook's area, which both could reach. Critical referring expressions matched one object (helper's area) or two objects (helper's and cook's areas), and were produced when the cook's hands were empty or full, which defined the (...) cook's reaching ability constraints. Helper's first and total fixations showed that they restricted their domain of interpretation to their own objects when the cook's hands were empty, and widened it to include the cook's objects only when the cook's hands were full. These results demonstrate that addressees can quickly take into account task‐relevant constraints to restrict their referential domain to referents that are plausible given the speaker's goals and constraints. (shrink)

This paper asks why information should ever be expressed vaguely, re-assessing some previously proposed answers to this question and suggesting some new ones. Particular attention is paid to the benefits that vague expressions can have in situations where agreement over the meaning of an expression cannot be taken for granted. A distinction between two different versions of the above-mentioned question is advocated. The first asks why human languages contain vague expressions, the second question asks when and why a speaker should (...) choose a vague expression when communicating with a hearer. While the former question is purely theoretical, the latter has practical implications for the computational generation of utterances in Natural Language Generation (NLG). (shrink)

In this paper we consider the potential role of metarepresentation—the representation of another representation, or as commonly considered within cognitive science, the mental representation of another individual's knowledge and beliefs—in mediating definite reference and common ground in conversation. Using dialogues from a referential communication study in which speakers conversed in succession with two different addressees, we highlight ways in which interlocutors work together to successfully refer to objects, and achieve shared conceptualizations. We briefly review accounts of how such shared conceptualizations (...) could be represented in memory, from simple associations between label and referent, to “triple co-presence” representations that track interlocutors in an episode of referring, to more elaborate metarepresentations that invoke theory of mind, mutual knowledge, or a model of a conversational partner. We consider how some forms of metarepresentation, once created and activated, could account for definite reference in conversation by appealing to ordinary processes in memory. We conclude that any representations that capture information about others' perspectives are likely to be relatively simple and subject to the same kinds of constraints on attention and memory that influence other kinds of cognitive representations. (shrink)

In the absence of pre‐established communicative conventions, people create novel communication systems to successfully coordinate their actions toward a joint goal. In this study, we address two types of such novel communication systems: sensorimotor communication, where the kinematics of instrumental actions are systematically modulated, versus symbolic communication. We ask which of the two systems co‐actors preferentially create when aiming to communicate about hidden object properties such as weight. The results of three experiments consistently show that actors who knew the weight (...) of an object transmitted this weight information to their uninformed co‐actors by systematically modulating their instrumental actions, grasping objects of particular weights at particular heights. This preference for sensorimotor communication was reduced in a fourth experiment where co‐actors could communicate with weight‐related symbols. Our findings demonstrate that the use of sensorimotor communication extends beyond the communication of spatial locations to non‐spatial, hidden object properties. (shrink)

Rational accounts of language use such as the uniform information density hypothesis, which asserts that speakers distribute information uniformly across their utterances, and the rational speech act (RSA) model, which suggests that speakers optimize the formulation of their message by reasoning about what the comprehender would understand, have been hypothesized to account for a wide range of language use phenomena. We here specifically focus on the production of discourse connectives. While there is some prior work indicating that discourse connective production (...) may be governed by RSA, that work uses a strongly gamified experimental setting. In this study, we aim to explore whether speakers reason about the interpretation of their conversational partner also in more realistic settings. We thereby systematically vary the task setup to tease apart effects of task instructions and effects of the speaker explicitly seeing the interpretation alternatives for the listener. Our results show that the RSA-predicted effect of connective choice based on reasoning about the listener is only found in the original setting where explicit interpretation alternatives of the listener are available for the speaker. The effect disappears when the speaker has to reason about listener interpretations. We furthermore find that rational effects are amplified by the gamified task setting, indicating that meta-reasoning about the specific task may play an important role and potentially limit the generalizability of the found effects to more naturalistic every-day language use. (shrink)