Several evolutionary accounts of human social cognition posit that language has co-evolved with the sophisticated mindreading abilities of modern humans. It has also been argued that these mindreading abilities are the product of cultural, rather than biological, evolution. Taken together, these claims suggest that the evolution of language has played an important role in the cultural evolution of human social cognition. Here we present a new computational model which formalises the assumptions that underlie this hypothesis, in order to explore how (...) language and mindreading interact through cultural evolution. This model treats communicative behaviour as an interplay between the context in which communication occurs, an agent’s individual perspective on the world, and the agent’s lexicon. However, each agent’s perspective and lexicon are private mental representations, not directly observable to other agents. Learners are therefore confronted with the task of jointly inferring the lexicon and perspective of their cultural parent, based on their utterances in context. Simulation results show that given these assumptions, an informative lexicon evolves not just under a pressure to be successful at communicating, but also under a pressure for accurate perspective-inference. When such a lexicon evolves, agents become better at inferring others’ perspectives; not because their innate ability to learn about perspectives changes, but because sharing a language with others helps them to do so. (shrink)

Dans cette enquête, j’affirme que les signes occupent une place centrale dans la cosmologie de Peirce, et que le fait de soutenir de nouvelles propositions à travers le dialogue a le pouvoir de favoriser l’unité nécessaire pour souder les membres de son continuum. Le dialogue tel que conçu par Peirce devient le moyen de souder chaque membre du continuum. Le principal moteur dans la réalisation de cette «soudure», selon Peirce, est le hasard/l’habitude dans l’utilisation des signes elle-même. Bien que la (...) place du soi, conçu comme une expression de toutes les composantes du monde physique, sera considérée, je m’intéresserai principalement aux changements logiques constatés par le passage du dialogue inter-actionnel au dialogue intra-actionnel. (shrink)

When people engage in conversation, they tailor their utterances to their conversational partners, whether these partners are other humans or computational systems. This tailoring, or adaptation to the partner takes place in all facets of human language use, and is based on a mental model or a user model of the conversational partner. Such adaptation has been shown to improve listeners' comprehension, their satisfaction with an interactive system, the efficiency with which they execute conversational tasks, and the likelihood of achieving (...) higher level goals such as changing the listener's beliefs and attitudes. We focus on one aspect of adaptation, namely the tailoring of the content of dialogue system utterances for the higher level processes of persuasion, argumentation and advice‐giving. Our hypothesis is that algorithms that adapt content for these processes, according to a user model, will improve the usability, efficiency, and effectiveness of dialogue systems. We describe a multimodal dialogue system and algorithms for adaptive content selection based on multi‐attribute decision theory. We demonstrate experimentally the improved efficacy of system responses through the use of user models to both tailor the content of system utterances and to manipulate their conciseness. (shrink)

When people engage in conversation, they tailor their utterances to their conversational partners, whether these partners are other humans or computational systems. This tailoring, or adaptation to the partner takes place in all facets of human language use, and is based on a mental model or a user model of the conversational partner. Such adaptation has been shown to improve listeners' comprehension, their satisfaction with an interactive system, the efficiency with which they execute conversational tasks, and the likelihood of achieving (...) higher level goals such as changing the listener's beliefs and attitudes. We focus on one aspect of adaptation, namely the tailoring of the content of dialogue system utterances for the higher level processes of persuasion, argumentation and advice-giving. Our hypothesis is that algorithms that adapt content for these processes, according to a user model, will improve the usability, efficiency, and effectiveness of dialogue systems. We describe a multimodal dialogue system and algorithms for adaptive content selection based on multi-attribute decision theory. We demonstrate experimentally the improved efficacy of system responses through the use of user models to both tailor the content of system utterances and to manipulate their conciseness. (shrink)

This article introduces the topic ‘‘Production of Referring Expressions: Bridging the Gap between Computational and Empirical Approaches to Reference’’ of the journal Topics in Cognitive Science. We argue that computational and psycholinguistic approaches to reference production can benefit from closer interaction, and that this is likely to result in the construction of algorithms that differ markedly from the ones currently known in the computational literature. We focus particularly on determinism, the feature of existing algorithms that is perhaps most clearly at (...) odds with psycholinguistic results, discussing how future algorithms might include non-determinism, and how new psycholinguistic experiments could inform the development of such algorithms. (shrink)

A substantial amount of recent work in natural language generation has focused on the generation of ‘‘one-shot’’ referring expressions whose only aim is to identify a target referent. Dale and Reiter's Incremental Algorithm (IA) is often thought to be the best algorithm for maximizing the similarity to referring expressions produced by people. We test this hypothesis by eliciting referring expressions from human subjects and computing the similarity between the expressions elicited and the ones generated by algorithms. It turns out that (...) the success of the IA depends substantially on the ‘‘preference order’’ (PO) employed by the IA, particularly in complex domains. While some POs cause the IA to produce referring expressions that are very similar to expressions produced by human subjects, others cause the IA to perform worse than its main competitors; moreover, it turns out to be difficult to predict the success of a PO on the basis of existing psycholinguistic findings or frequencies in corpora. We also examine the computational complexity of the algorithms in question and argue that there are no compelling reasons for preferring the IA over some of its main competitors on these grounds. We conclude that future research on the generation of referring expressions should explore alternatives to the IA, focusing on algorithms, inspired by the Greedy Algorithm, which do not work with a fixed PO. (shrink)

The regulative and semantic ‘distance’ of electronic conferencing may impede the topical alignment and the unambiguous interpretation of messages, hindering collaborative learning processes. Compared to a face-to-face environment, in electronic conferencing this distance may be caused by a reduced strength of online ‘context’. Explicitly defining the context of messages in an electronic environment may increase the writers’ co-intentionality and co-reference. An annotation tool is presented, strengthening the context by providing a document under discussion and enabling users to anchor their messages (...) in specific passages of the document. Preliminary results indicate that the tool does indeed reinforce the context, focusing the online discussion around a certain topic (increasing co-intentionality) and providing a frame of reference for single messages (increasing co-reference). (shrink)

In referential communication, Grice's Maxim of Quantity is thought to imply that utterances conveying unnecessary information should incur comprehension difficulties. There is, however, considerable evidence that speakers frequently encode redundant information in their referring expressions, raising the question as to whether such overspecifications hinder listeners’ processing. Evidence from previous work is inconclusive, and mostly comes from offline studies. In this article, we present two event‐related potential (ERP) experiments, investigating the real‐time comprehension of referring expressions that contain redundant adjectives in complex (...) visual contexts. Our findings provide support for both Gricean and bounded‐rational accounts. We argue that these seemingly incompatible results can be reconciled if common ground is taken into account. We propose a bounded‐rational account of overspecification, according to which even redundant words can be beneficial to comprehension to the extent that they facilitate the reduction of listeners’ uncertainty regarding the target referent. (shrink)

Observing others in conversation is a common format for comprehending language, yet little work has been done to understand dialog comprehension. We tested whether overhearers use addressee backchannels as predictive cues for how to integrate information across speaker turns during comprehension of spontaneously produced collaborative narration. In Experiment 1, words that followed specific backchannels were recognized more slowly than words that followed either generic backchannels or pauses. In Experiment 2, we found that when the turn after the backchannel was a (...) continuation of the narrative, specific backchannels prompted the fastest verification of prior information. When the turn after was an elaboration, they prompted the slowest, indicating that overhearers took specific backchannels as cues to integrate preceding talk with subsequent talk. These findings demonstrate that overhearers capitalize on the predictive relationship between backchannels and the development of speakers’ talk, coordinating information across conversational roles. (shrink)

In this paper we investigate the effect of level of understanding revealed by feedback in the form of clarification requests from a route follower on a route giver’s spatial perspective choice in their response in route instruction dialogues. In an experiment varying the level of understanding displayed by route follower clarification requests (the independent variable), route giver perspective switching in response to this feedback is investigated. Three levels of understanding displayed by feedback are investigated: (1) low-level clarification requests indicating that (...) the instruction was not processed, (2) semantic-level clarification requests indicating that the spatial direction given in the instruction could not be resolved as the speaker of the clarification request could not interpret which perspective was intended, and (3) high-level feedback which indicates that the route giver’s instruction was understood but which note an obstacle to following the instruction. Results show that perspective choice, which is a conceptual feature of language use, is sensitive to perceived level of addressee understanding. We found that route givers consistently switch perspectives in responding to semantic-level clarification requests but not in response to low-level ones, and also that switching occurs more for high-level feedback than for low-level feedback. We address how dialogue systems can take advantage of these findings by modelling our results in an Information State model of dialogue, presenting update rules for response generation which account for our findings and also update rules which enable generation of the feedback themselves. (shrink)

This study concerns topic selection in conversational reports of a personal event, the birth of a baby. Ninety phone calls from 12 fathers and 7 mothers were analyzed in terms of the subject's prior concerns (prenatal questionnaire) and the outcome of events (postpartum questionnaire). Four analyses were conducted. The first showed that subjects were likely to mention topics of high, rather than low, prior concern, and unusual, rather than ordinary, outcome. The second showed that chronologically early topics were discussed before (...) late topics. These findings were compatible with either a memory (i.e., “knowledge telling”) or a communication (i.e., “knowledge processing”) model of topic selection. Two additional analyses were conducted to evaluate predictions derived from each of these models. The first analysis showed that the conversations also contained a small set of pro forma topics that appeared earlier and more frequently than other topics. The second showed that these topics were more likely to be recipient‐initiated. These results suggest that reporters deviated from an optimal retrieval plan to take the recipient into account. The results as a whole support a communication‐based, “knowledge processing” (Bereiter & Scardomalia, 1980) model of topic selection. (shrink)

Collaborative interaction pervades many everyday practices: work meetings, innovation and product design, education and arts. Previous studies have pointed to the central role of acknowledgement and acceptance for the success of joint action, by creating affiliation and signaling understanding. We argue that various forms of explicit miscommunication are just as critical to challenge, negotiate and integrate individual contributions in collaborative creative activities. Through qualitative microanalysis of spontaneous coordination in collective creative LEGO constructions, we individuate three interactional styles: inclusive, characterized by (...) acknowledgment and praise; instructional, characterized by self-repair; and integrative, characterized by widespread self- and other-repair. We then investigate how different interaction styles leave distinct material traces in the resulting LEGO models. The inclusive interaction style generally results in concatenations of individual contributions with little coherence and core narrative. The instructional style produces coherent, but largely individually driven models. Finally, the integrative style generates more innovative models, synthesizing individual contributions in shared narratives or schemas. (shrink)

Smith gives an excellent overview on research in language evolution, in which he discusses several recent models of how linguistic systems and the cognitive capacities involved in language learning may have co‐evolved. He illustrates how combined pressures on language learning and communication/use produce compositionally structured languages. Once in place, a (culturally transmitted) communication system creates new selection pressures on the capacity for acquiring these systems.

Schober et al. describe two studies on how survey interview respondents misunderstand interview questions. After answering a survey, participants are given standardized definitions of the questions they have just answered. Even apparently simple questions such as “Have you smoked more than 100 cigarettes?” are interpreted very differently by participants. Moreover, clarifying the meaning of the definitions with the interviewer does not always help resolve the miscommunication.

In workplace settings, skilled participants cooperate on the basis of shared routines in smooth and often implicit ways. Our study shows how interactional histories provide the basis for routine coordination. We draw on theater rehearsals as a perspicuous setting for tracking interactional histories. In theater rehearsals, the process of building performing routines is in focus. Our study builds on collections of consecutive performances of the same instructional task coming from a corpus of video-recordings of 30 h of theater rehearsals of (...) professional actors in German. Over time, instructions and their implementations are routinely coordinated by virtue of accumulated shared interactional experience: Instructions become shorter, the timing of responses becomes increasingly compacted and long negotiations are reduced to a two-part sequence of instruction and implementation. Overall, a routine of how to perform the scene emerges. Over interactional histories, patterns of projection of next actions emanating from instructions become reliable and can be used by respondents as sources for anticipating and performing relevant next actions. The study contributes to our understanding of how shared knowledge and routines accumulate over shared interactional experiences in publicly performed and reciprocally perceived ways and how this impinges on the efficiency of joint action. (shrink)

In game-theoretic signaling models, evolution tends to favor perfectly precise signaling systems, but in the natural world communication is almost always imprecise. I argue that standard explanations for this discrepancy are only partially sufficient, and I show that communication is often ambiguous because signal senders take advantage of context sensitivity. As evidence, I make two additions to the signaling model: a cost for more complex signaling strategies and the ability to combine information in signals with independent information. Analysis and simulation (...) of the altered model shows that it leads to the predicted outcome of evolution favoring ambiguous signaling. (shrink)

A pragmatic account of referential communication is developed which presents an alternative to traditional Gricean accounts by focusing on cooperativeness and efficiency, rather than informativity. The results of four language‐production experiments support the view that speakers can be cooperative when producing redundant adjectives, doing so more often when color modification could facilitate the listener's search for the referent in the visual display (Experiment 1a). By contrast, when the listener knew which shape was the target, speakers did not produce redundant color (...) adjectives (Experiment 1b). English speakers used redundant color adjectives more often than Spanish speakers, suggesting that speakers are sensitive to the differential efficiency of prenominal and postnominal modification (Experiment 2). Speakers were also cooperative when using redundant size adjectives (Experiment 3). Overall, these results show how discriminability affects a speaker's choice of referential expression above and beyond considerations of informativity, supporting the view that redundant speakers can be cooperative. (shrink)

Accounts of video game play developed from an ethnomethodological and conversation analytic perspective remain relatively scarce. This study collects together an emerging, if scattered, body of research which focuses on the material, practical “work” of video game players. The study offers an example-driven explication of an EMCA perspective on video game play phenomena. The materials are arranged as a “tactical zoom.” We start very much “outside” the game, beginning with a wide view of how massive-multiplayer online games are played within (...) dedicated gaming spaces; here, we find multiple players, machines, and many different sorts of activities going on. Still remaining somewhat distanced from the play of the game itself, we then take a closer look at the players themselves by examining a notionally simpler setting involving pairs taking part in a football game at a games console. As we draw closer to the technical details of play, we narrow our focus further still to examine a player and spectator situated “at the screen” but jointly analyzing play as the player competes in an online first-person shooter. Finally, we go “inside” the game entirely and look at the conduct of avatars on-screen via screen recordings of a massively multiplayer online game. Having worked through specific examples, we provide an elaboration of a selection of core topics of ethnomethodology and conversation analysis that is used to situate some of the unstated orientations in the presentation of data fragments. In this way, recurrent issues raised in the fragments are shown as coherent, interconnected phenomena. In closing, we suggest caution regarding the way game play phenomena have been analyzed in this study, while remarking on challenges present for the development of further EMCA-oriented research on video game play. (shrink)

Accounts of video game play developed from an ethnomethodological and conversation analytic perspective remain relatively scarce. This study collects together an emerging, if scattered, body of research which focuses on the material, practical “work” of video game players. The study offers an example-driven explication of an EMCA perspective on video game play phenomena. The materials are arranged as a “tactical zoom.” We start very much “outside” the game, beginning with a wide view of how massive-multiplayer online games are played within (...) dedicated gaming spaces; here, we find multiple players, machines, and many different sorts of activities going on. Still remaining somewhat distanced from the play of the game itself, we then take a closer look at the players themselves by examining a notionally simpler setting involving pairs taking part in a football game at a games console. As we draw closer to the technical details of play, we narrow our focus further still to examine a player and spectator situated “at the screen” but jointly analyzing play as the player competes in an online first-person shooter. Finally, we go “inside” the game entirely and look at the conduct of avatars on-screen via screen recordings of a massively multiplayer online game. Having worked through specific examples, we provide an elaboration of a selection of core topics of ethnomethodology and conversation analysis that is used to situate some of the unstated orientations in the presentation of data fragments. In this way, recurrent issues raised in the fragments are shown as coherent, interconnected phenomena. In closing, we suggest caution regarding the way game play phenomena have been analyzed in this study, while remarking on challenges present for the development of further EMCA-oriented research on video game play. (shrink)

This paper uses examples of conversational understandings, misunderstandings and non-understandings to explore the role of prototypes and schemata in conversational understanding. An investigation of the procedures by which we make sense of lexical items in utterances by fitting prototypes into schemata is followed by an examination of how schemata are instantiated across conversational sequences by means of topics. In interaction, conflicts over meaning illuminate the decisive role of social and cultural factors in understanding. Overall, understanding is seen to be critically (...) dependent on principles of categorisation and contrast, which form the basis of both cognitive and sociocultural means of organisation. (shrink)

When people are engaged in social interaction, they can repeat aspects of each other’s communicative behavior, such as words or gestures. This kind of behavioral alignment has been studied across a wide range of disciplines and has been accounted for by diverging theories. In this paper, we review various operationalizations of lexical and gestural alignment. We reveal that scholars have fundamentally different takes on when and how behavior is considered to be aligned, which makes it difficult to compare findings and (...) draw uniform conclusions. Furthermore, we show that scholars tend to focus on one particular dimension of alignment (traditionally, whether two instances of behavior overlap in form), while other dimensions remain understudied. This hampers theory testing and building, which requires a well‐defined account of the factors that are central to or might enhance alignment. To capture the complex nature of alignment, we identify five key dimensions to formalize the relationship between any pair of behavior: time, sequence, meaning, form, and modality. We show how assumptions regarding the underlying mechanism of alignment (placed along the continuum of priming vs. grounding) pattern together with operationalizations in terms of the five dimensions. This integrative framework can help researchers in the field of alignment and related phenomena (including behavior matching, mimicry, entrainment, and accommodation) to formulate their hypotheses and operationalizations in a more transparent and systematic manner. The framework also enables us to discover unexplored research avenues and derive new hypotheses regarding alignment. (shrink)

The present study investigated whether humans are more likely to trust people who are coordinated with them. We examined a well-known type of linguistic coordination, lexical entrainment, typically involving the elaboration of “conceptual pacts,” or partner-specific agreements on how to conceptualize objects. In two experiments, we manipulated lexical entrainment in a referential communication task and measured the effect of this manipulation on epistemic and practical trust. Our results showed that participants were more likely to trust a coordinated partner than an (...) uncoordinated one, but only when the latter broke previously established conceptual pacts. (shrink)

Traditional mechanistic accounts of language processing derive almost entirely from the study of monologue. Yet, the most natural and basic form of language use is dialogue. As a result, these accounts may only offer limited theories of the mechanisms that underlie language processing in general. We propose a mechanistic account of dialogue, the interactive alignment account, and use it to derive a number of predictions about basic language processes. The account assumes that, in dialogue, the linguistic representations employed by the (...) interlocutors become aligned at many levels, as a result of a largely automatic process. This process greatly simplifies production and comprehension in dialogue. After considering the evidence for the interactive alignment model, we concentrate on three aspects of processing that follow from it. It makes use of a simple interactive inference mechanism, enables the development of local dialogue routines that greatly simplify language processing, and explains the origins of self-monitoring in production. We consider the need for a grammatical framework that is designed to deal with language in dialogue rather than monologue, and discuss a range of implications of the account. Key Words: common ground; dialogue; dialogue routines; language comprehension; language production; monitoring; perception-behavior link. (shrink)

Our target article proposed that language production and comprehension are interwoven, with speakers making predictions of their own utterances and comprehenders making predictions of other people's utterances at different linguistic levels. Here, we respond to comments about such issues as cognitive architecture and its neural basis, learning and development, monitoring, the nature of forward models, communicative intentions, and dialogue.

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

We analyzed the processing of noun-noun metaphors, which have been relatively understudied, compared to other types of figurative expressions, such as X is Y metaphors (e.g., He...

Norrick focuses on the interactional aspects of conversational remembering in everyday situations. He examines the ways in which the narrators’ uncertainty leads to collaboration from interlocutors in conversational remembering and how such co‐construction of memories can instantiate instances of distributed cognition (Hutchins, 1995).

Why do some groups succeed where others fail? We hypothesise that collaborative success is achieved when the relationship between the dyad's prior expertise and the complexity of the task creates a situation that affords constructive and interactive processes between group members. We call this state the zone of proximal facilitation in which the dyad's prior knowledge and experience enables them to benefit from both knowledge-based problem-solving processes (e.g., elaboration, explanation, and error correction) andcollaborative skills (e.g., creating common ground, maintaining joint (...) attention to the task). To test this hypothesis we conducted an experiment in which participants with different levels of aviation expertise, experts (flight instructors), novices (student pilots), and non-pilots, read flight problem scenarios of varying complexity and had to identify the problem and generate a solution with either another participant of the same level of expertise or alone. The non-pilots showed collaborative inhibition on problem identification in which dyads performed worse than their predicted potential for both simple and complex scenarios, whereas the novices and experts did not. On solution generation the non-pilot and novice dyads performed at their predicted potential with no collaborative inhibition on either simple or complex scenarios. In contrast, expert dyads showed collaborative gains, withdyads performing above their predicted potential, but only for the complex scenarios. On simple scenarios the expert dyads showed collaborative inhibition and performed worse than their predicted potential. We discuss the implications of these results for theories of collaborative problem solving. (shrink)

Recent research suggests that language evolution is a process of cultural change, in which linguistic structures are shaped through repeated cycles of learning and use by domain-general mechanisms. This paper draws out the implications of this viewpoint for understanding the problem of language acquisition, which is cast in a new, and much more tractable, form. In essence, the child faces a problem of induction, where the objective is to coordinate with others (C-induction), rather than to model the structure of the (...) natural world (N-induction). We argue that, of the two, C-induction is dramatically easier. More broadly, we argue that understanding the acquisition of any cultural form, whether linguistic or otherwise, during development, requires considering the corresponding question of how that cultural form arose through processes of cultural evolution. This perspective helps resolve the “logical” problem of language acquisition and has far-reaching implications for evolutionary psychology. (shrink)

An ideography is a general-purpose code made of pictures that do not encode language, which can be used autonomously – not just as a mnemonic prop – to encode information on a broad range of topics. Why are viable ideographies so hard to find? I contend that self-sufficient graphic codes need to be narrowly specialized. Writing systems are only an apparent exception: At their core, they are notations of a spoken language. Even if they also encode nonlinguistic information, they are (...) useless to someone who lacks linguistic competence in the encoded language or a related one. The versatility of writing is thus vicarious: Writing borrows it from spoken language. Why is it so difficult to build a fully generalist graphic code? The most widespread answer points to a learnability problem. We possess specialized cognitive resources for learning spoken language, but lack them for graphic codes. I argue in favor of a different account: What is difficult about graphic codes is not so much learning or teaching them as getting every user to learn and teach the same code. This standardization problem does not affect spoken or signed languages as much. Those are based on cheap and transient signals, allowing for easy online repairing of miscommunication, and require face-to-face interactions where the advantages of common ground are maximized. Graphic codes lack these advantages, which makes them smaller in size and more specialized. (shrink)