The emergence of human communication systems is typically investigated via 2 approaches with complementary strengths and weaknesses: naturalistic studies and computer simulations. This study was conducted with a method that combines these approaches. Pairs of participants played video games requiring communication. Members of a pair were physically separated but exchanged graphic signals through a medium that prevented the use of standard symbols (e.g., letters). Communication systems emerged and developed rapidly during the games, integrating the use of explicit signs with information (...) implicitly available to players and silent behavior-coordinating procedures. The systems that emerged suggest 3 conclusions: (a) signs originate from different mappings; (b) sign systems develop parsimoniously; (c) sign forms are perceptually distinct, easy to produce, and tolerant to variations. (shrink)

Evidence suggests that speakers can take account of the addressee's needs when referring. However, what representations drive the speaker's audience design has been less clear. This study aims to go beyond previous studies by investigating the interplay between the visual and linguistic context during audience design. Speakers repeated subordinate descriptions given in the prior linguistic context less and used basic-level descriptions more when the addressee did not hear the linguistic context than when s/he did. But crucially, this effect happened only (...) when the referent lacked the visual attributes associated with the expressions, so there was no other contextual cue available for the identification of the referent. This suggests that speakers flexibly use different contextual cues to help their addressee map the referring expression onto the intended referent. In addition, speakers used fewer pronouns when the addressee did not hear the linguistic antecedent than when s/he did. This suggests that although speakers may be egocentric during anaphoric reference, they can cooperatively avoid pronouns when the linguistic antecedents were not shared with their addressee during initial reference. (shrink)

Cultural evolutionary theory has identified a range of cognitive biases that guide human social learning. Naturalistic and experimental studies indicate transmission biases favoring negative and positive information. To address these conflicting findings, the present study takes a socially situated view of information transmission, which predicts that bias expression will depend on the social context. We report a large‐scale experiment (N = 425) that manipulated the social context and examined its effect on the transmission of the positive and negative information contained (...) in a narrative text. In each social context, information was progressively lost as it was transmitted from person to person, but negative information survived better than positive information, supporting a negative transmission bias. Importantly, the negative transmission bias was moderated by the social context: Higher social connectivity weakened the bias to transmit negative information, supporting a socially situated account of information transmission. Our findings indicate that our evolved cognitive preferences can be moderated by our social goals. (shrink)

How might a human communication system be bootstrapped in the absence of conventional language? We argue that motivated signs play an important role (i.e., signs that are linked to meaning by structural resemblance or by natural association). An experimental study is then reported in which participants try to communicate a range of pre-specified items to a partner using repeated non-linguistic vocalization, repeated gesture, or repeated non-linguistic vocalization plus gesture (but without using their existing language system). Gesture proved more effective (measured (...) by communication success) and more efficient (measured by the time taken to communicate) than non-linguistic vocalization across a range of item categories (emotion, object, and action). Combining gesture and vocalization did not improve performance beyond gesture alone. We experimentally demonstrate that gesture is a more effective means of bootstrapping a human communication system. We argue that gesture outperforms non-linguistic vocalization because it lends itself more naturally to the production of motivated signs. (shrink)

Human cognition and behavior are dominated by symbol use. This paper examines the social learning strategies that give rise to symbolic communication. Experiment 1 contrasts an individual-level account, based on observational learning and cognitive bias, with an inter-individual account, based on social coordinative learning. Participants played a referential communication game in which they tried to communicate a range of recurring meanings to a partner by drawing, but without using their conventional language. Individual-level learning, via observation and cognitive bias, was sufficient (...) to produce signs that became increasingly effective, efficient, and shared over games. However, breaking a referential precedent eliminated these benefits. The most effective, most efficient, and most shared signs arose when participants could directly interact with their partner, indicating that social coordinative learning is important to the creation of shared symbols. Experiment 2 investigated the contribution of two distinct aspects of social interaction: behavior alignment and concurrent partner feedback. Each played a complementary role in the creation of shared symbols: Behavior alignment primarily drove communication effectiveness, and partner feedback primarily drove the efficiency of the evolved signs. In conclusion, inter-individual social coordinative learning is important to the evolution of effective, efficient, and shared symbols. (shrink)

This paper explores the role of iconicity in spoken language and other human communication systems. First, we concentrate on graphical and gestural communication and show how semantically motivated iconic signs play an important role in creating such communication systems from scratch. We then consider how iconic signs tend to become simplified and symbolic as the communication system matures and argue that this process is driven by repeated interactive use of the signs. We then consider evidence for iconicity at the level (...) of the system in graphical communication and finally draw comparisons between iconicity in graphical and gestural communication systems and in spoken language. (shrink)

This article focuses on the question of the function of imitation and whether current accounts of imitative function are consistent with our knowledge about imitation's origins. We first review theories of imitative origin concluding that empirical evidence suggests that imitation arises from domain‐general learning mechanisms. Next, we lay out a selective account of function that allows normative functions to be ascribed to learned behaviours. We then describe and review four accounts of the function of imitation before evaluating the relationship between (...) the claim that imitation arises out of domain‐general learning mechanisms and theories of the function of imitation. (shrink)

Anecdotal evidence suggests that participants in conversation can sometimes act as a coalition. This implies a level of conversational organization in which groups of individuals form a coherent unit. This paper investigates the implications of this phenomenon for psycholinguistic and semantic models of shared context in dialog. We present a corpus study of multiparty dialog which shows that, in certain circumstances, people with different levels of overt involvement in a conversation, that is, one responding and one not, can nonetheless access (...) the same shared context. We argue that contemporary models of shared context need to be adapted to capture this situation. To address this, we propose “grounding by proxy,” in which one person can respond on behalf of another, as a simple mechanism by which shared context can accumulate for a coalition as a whole. We explore this hypothesis experimentally by investigating how people in a task-oriented coalition respond when their shared context appears to be weakened. The results provide evidence that, by default, coalition members act on each other's behalf, and when this fails they work to compensate. We conclude that this points to the need for a new concept of collective grounding acts and a corresponding concept of collective contexts in psycholinguistic and semantic models of dialog. (shrink)

Utterances of natural language sentences can be used to communicate not just contents, but also forces. This paper examines this topic from a cross-linguistic perspective on sentential mood. Recent work in this area focuses on conversational dynamics: the three sentence types can be associated with distinctive kinds of conversational effects called sentential forces, modeled as three kinds of updates to the discourse context. This paper has two main goals. First, it provides two arguments, on empirical and methodological grounds, for treating (...) sentential force as part of a compositional dynamic semantics, rather than a dynamic pragmatics. Second, it formulates a minimal dynamic semantic analysis that covers the data at the heart of these arguments, incorporating existing analyses of the three major moods, evidentials and conjunction. A further aim of the paper is to sharpen the distinction between sentential force and utterance force, and discuss its implications. (shrink)

We investigate partner effects on spatial perspective taking behavior in listeners, comparing behavior with a human versus a computer partner (Experiments 1 and 2), and with computer partners of different perceived capabilities (Experiment 3). Participants responded to spoken instructions from their partner which could be interpreted egocentrically (from their own perspective) or othercentrically (from their partner's perspective). In contrast to earlier work, we found that participants were more egocentric with a computer than a human partner. Participants were also more egocentric (...) with a computer partner that appeared more modern and capable, compared to one that appeared outdated and limited in ability. Our results show that perspective taking behavior is sensitive to information about one's partner; in particular, listeners consider their partner's potential ability to collaborate, adjusting their egocentric tendencies accordingly. Moreover, we highlight what appears to be a shift in listeners' expectations regarding computers' collaborative capabilities, leading to greater willingness to push the burden of perspective taking onto a computer partner. (shrink)

In examining the utility of the action view advanced in the Pickering & Garrod (P&G) target article, I first consider its contribution to the analysis of language vis-à-vis earlier language-as-action approaches. Second, I assess the relation between coordinated joint action, which serves as a blueprint for dialogue coordination, and the experience of shared reality, a key concomitant and product of interpersonal communication.

Cocreating meaning in collaboration is challenging. Success is often determined by people's abilities to coordinate their language to converge upon shared mental representations. Here we explore one set of low‐level linguistic behaviors, linguistic alignment, that both emerges from, and facilitates, outcomes of high‐level convergence. Linguistic alignment captures the ways people reuse, that is, “align to,” the lexical, syntactic, and semantic forms of others' utterances. Our focus is on the temporal change of multi‐level linguistic alignment, as well as how alignment is (...) related to communicative outcomes within a unique collaborative problem‐solving paradigm. The primary task, situated within a virtual educational video game, requires creative thinking between three people where the paths for possible solutions are highly variable. We find that over time interactions are marked by decreasing lexical and syntactic alignment, with a trade‐off of increasing semantic alignment. However, greater semantic alignment does not translate into better team performance. Overall, these findings provide greater clarity on the role of linguistic coordination within complex and dynamic collaborative problem‐solving tasks. (shrink)

How good are we at understanding what others communicate? It often seems to us, at least, that we understand quite well what others convey when speaking in a familiar language. However, a growing body of evidence from the psychology of language suggests that in various communicative settings comprehenders routinely form linguistic representations that are underdetermined, “sketchy”, “shallow” or imprecise, often without noticing it. The paper discusses some important consequences of this evidence. Following recent discussions in this strand of research, I (...) outline how the evidence is currently best interpreted as supporting a view on which operating at a certain level of imprecision and underdetermination is a functional feature of the system responsible for comprehension of linguistic utterances in humans. That this kind of imprecision and underdetermination is part and parcel of linguistic interactions, makes the exact success rate of comprehension particularly hard to estimate. This poses a unique and interesting challenge for assessing the quality of linguistic comprehension. Understanding what a speaker intended to convey with a linguistic utterance may be less transparent than it appears to us. I will discuss the extent to which this evidence may lead to pessimism about how good we are at comprehending what others communicate. However, as I will argue in the last part of the paper, in various cases language users can be sensitive to some types of imprecision and underdetermination in comprehension and make up for it by means of various forms of post hoc deliberation. I will describe some such clarificatory contexts and end by charting a map of important issues that require further investigation. (shrink)

Cognitive Science, Volume 46, Issue 1, January 2022.

Establishing and maintaining mutual understanding in everyday conversations is crucial. To do so, people employ a variety of conversational devices, such as backchannels, repair, and linguistic entrainment. Here, we explore whether the use of conversational devices might be influenced by cross‐linguistic differences in the speakers’ native language, comparing two matched languages—Danish and Norwegian—differing primarily in their sound structure, with Danish being more opaque, that is, less acoustically distinguished. Across systematically manipulated conversational contexts, we find that processes supporting mutual understanding in (...) conversations vary with external constraints: across different contexts and, crucially, across languages. In accord with our predictions, linguistic entrainment was overall higher in Danish than in Norwegian, while backchannels and repairs presented a more nuanced pattern. These findings are compatible with the hypothesis that native speakers of Danish may compensate for its opaque sound structure by adopting a top‐down strategy of building more conversational redundancy through entrainment, which also might reduce the need for repairs. These results suggest that linguistic differences might be met by systematic changes in language processing and use. This paves the way for further cross‐linguistic investigations and critical assessment of the interplay between cultural and linguistic factors on the one hand and conversational dynamics on the other. (shrink)

The following list contains a survey of some important and recent research in modeling face-to-face conversation. The list below is a presented as a guide to the literature by topic and date; we include complete citations afterwards in alphabetical order. For brevity, research works are keyed by first author and date only (we use these keys on the slides as well as in this list). Of course, most papers are multiply authored. The list is not intended to be exhaustive. Our (...) primary aim is simply to provide bibliographic information for all the research that we will refer to during the ESSLLI class itself. The entries also provide a sampling from ongoing research projects so that you can get an overall sense of the state of the field and begin to follow up topics of particular interest to you. (shrink)

This chapter investigates the computational consequences of a broadly Gricean view of language use as intentional activity. In this view, dialogue rests on coordinated reasoning about communicative intentions. The speaker produces each utterance by formulating a suitable communicative intention. The hearer understands it by recognizing the communicative intention behind it. When this coordination is successful, interlocutors succeed in considering the same intentions— that is, the same representations of utterance meaning—as the dialogue proceeds. In this paper, I emphasize that these intentions (...) can be formalized; we can provide abstract but systematic representations that spell out what a speaker is trying to do with an utterance. Such representations describe utterances simultaneously as the product of our knowledge of grammar and as actions chosen for a reason. In particular, they must characterize the speaker’s utterance in grammatical terms, provide the links to the context that the grammar requires, and so arrive at a contribution that the speaker aims to achieve. Because I have implemented this formalism, we can regard it as a possible analysis of conversational processes at the level of computational theory. Nevertheless, this analysis leaves open what the nature of the biological computation involved in inference to intentions is, and what regularities in language use support this computation. (shrink)

This paper pursues a formal analogy between natural language dialogue and collaborative real-world action in general. The analogy depends on an analysis of two aspects of collaboration that figure crucially in language use. First, agents must be able to coordinate abstractly about future decisions which cannot be made on present information. Second, when agents finally take such decisions, they must again coordinate in order to interpret one anothers’ actions as collaborative. The contribution of this paper is a general representation of (...) collaborative plans and intentions, inspired by representations of deductions in logics of knowledge, action and time, which supports these two kinds of coordination. Such representations.. (shrink)

We describe a methodology for learning a disambiguation model for deep pragmatic interpretations in the context of situated task-oriented dialogue. The system accumulates training examples for ambiguity resolution by tracking the fates of alternative interpretations across dialogue, including subsequent clarificatory episodes initiated by the system itself. We illustrate with a case study building maximum entropy models over abductive interpretations in a referential communication task. The resulting model correctly resolves 81% of ambiguities left unresolved by an initial handcrafted baseline. A key (...) innovation is that our method draws exclusively on a system’s own skills and experience and requires no human annotation. (shrink)

Imitation and mirroring processes are necessary but not sufficient conditions for children to develop human sociality. Human sociality entails more than the equivalence and connectedness of perceptual experiences. It corresponds to the sense of a shared world made of shared values. It originates from complex ‘open’ systems of reciprocation and negotiation, not just imitation and mirroring processes that are by definition ‘closed’ systems. From this premise, we argue that if imitation and mirror processes are important foundations for sociality, human inter-subjectivity (...) develops primarily in reciprocation, not just imitation. Imitation provides a basic sense of social connectedness and mutual acknowledgment of existing with others that are ‘like me.’ However, it does not allow for the co-construction of meanings with others. For human sociality to develop, imitation and mirroring processes need to be supplemented by an open system of reciprocation. Developmental research shows that from the second month, mirroring, imitative, and other contagious emotional responses are by-passed. Imitation gives way to first signs of reciprocation (primary intersubjectivity), joint attention to objects (secondary intersubjectivity), the emergence of values that are jointly represented and negotiated with others (tertiary intersubjectivity), and eventually the development of an ethical stance accompanying theories of mind by 4 years of age. We review this development and propose that if mirroring processes enable individuals to bridge their subjective experiences, human inter-subjectivity proper develops from reciprocal social exchanges that lead to value negotiation and mutual recognition, both cardinal trademarks of human sociality. (shrink)

In recent years, the growing scientific interest in design has led to great advances in our knowledge of authentic design processes. However, as these findings go counter to the existing theories in both design research and cognitive science, they pose a serious challenge for both disciplines: there is a wide gap between what the existing theories predict and what designers actually do. At the same time, there is a growing movement of research on authentic cognitive activities, which has among other (...) things documented the central roles of action and the physical environment in these activities, something that existing cognitive theories have overlooked and cannot properly account for. This creates an explanatory gap analogous to the one found in design. This book aims to fill both of these gaps with a cognitive theory of how designers work. It revolves around the roles of physical activities and working materials in design, and the theory explains at length how these have functions that are essential to cognition. The two threads of design and cognition run in parallel throughout the book: the cognitive theory is applied to design, but is also consistently related to cognition in general. The result is, in back cover text parlance, a 'provocative' account of cognition and human performance, which should be of interest to cognitive scientists as well as to design researchers. (shrink)

This chapter reviews empirical evidence bearing on the design of online forums for deliberative civic engagement. Dimensions of design are defined for different aspects of the deliberation: its purpose, the target population, the spatiotemporal distance separating participants, the communication medium, and the deliberative process to be followed. After a brief overview of criteria for evaluating different design options, empirical findings are organized around design choices. Research has evolved away from treating technology for online deliberation dichotomously (either present or not) toward (...) nuanced findings that differentiate between technological features, ways of using them, and cultural settings. The effectiveness of online deliberation depends on how well the communicative environment is matched to the deliberative task. Tradeoffs, e.g. between rich and lean media and between anonymous and identifiable participation, suggest different designs depending on the purpose and participants. Findings are limited by existing technologies, and may change as technologies and users co-evolve. (shrink)

This chapter aims to relate two fields of research that have been rarely – if ever – associated, namely embodied communication and metacognition. Exploring this relationship offers a new perspective for understanding the relationship between self-knowledge and mindreading. "Embodied communication" refers to the process of conveying information to one or several interlocutors through speech and associated bodily gestures, or through gestures only. It is prima facie plausible that embodied communication crucially involves metacognitive interventions. Let the term ‘conversational metacognition’ refer to (...) the set of abilities that allow an embodied speaker to make available to others and to receive from them specific markers concerning his/her "conversing adequacy". The hypothesis explored is that embodied communication in humans involve metacognitive gestures. Examples are offered from manual gesturing and from orofacial expressions. A final discussion examines the respective roles of altruistic and Machiavellian pressures in conversational metacognition. (shrink)

This paper links the conjecture that the physical world is a virtual reality to the findings of modern physics. What is usually the subject of science fiction is here proposed as a scientific theory open to empirical evaluation. We know from physics how the world behaves, and from computing how information behaves, so whether the physical world arises from ongoing information processing is a question science can evaluate. A prima facie case for the virtual reality conjecture is presented. If a (...) photon is a pixel on a multi-dimensional grid that gives rise to space, the speed of light could reflect its refresh rate. If mass, charge and energy all arise from processing, the many conservation laws of physics could reduce to a single law of dynamic information conservation. If the universe is a virtual reality, then its big bang creation could be simply when the system was booted up. Deriving core physics from information processing could reconcile relativity and quantum theory, with the former how processing creates the space-time operating system and the latter how it creates energy and matter applications. (shrink)

A growing conceptual and empirical literature is advancing the idea that language extends our cognitive skills. One of the most influential positions holds that language – qua material symbols – facilitates individual thought processes by virtue of its material properties (Clark, 2006a). Extending upon this model, we argue that language enhances our cognitive capabilities in a much more radical way: the skilful engagement of public material symbols facilitates evolutionarily unprecedented modes of collective perception, action and reasoning (interpersonal synergies) creating dialogically (...) extended minds. We relate our approach to other ideas about collective minds ( Gallagher, 2011, Theiner et al., 2010 and Tollefsen, 2006) and review a number of empirical studies to identify the mechanisms enabling the constitution of interpersonal cognitive systems. (shrink)

Paulina Sliwa (2015) argues that knowing why p is necessary and sufficient for understanding why p. She tries to rebut recent attacks against the necessity and sufficiency claims, and explains the gradability of understanding why in terms of knowledge. I argue that her attempts do not succeed, but I indicate more promising ways to defend reductionism about understanding why throughout the discussion.

Most people find it obvious that concepts like APPLE, DOG, WATER, CACTUS, SWIM, CHIRP, FURRY, and SMOOTH are acquired from perceptual experiences along with some kind of inferential procedure. Models of how these concepts are inferentially acquired, however, force the acquired concepts to be representationally complex, built from, and composed by, the more primitive representations. Since at least the time of Plato, philosophers and psychologists have struggled to find complex sets of representations that have the same meanings, definitionally or probabilistically, (...) as these concepts. For example, to think about the property-kind being gold is not the same as to think about the complex property-kind being yellowish & shiny & malleable.... I call this Fodor's Challenge: Find an acquisition process that is genuinely inferential and yields a concept that genuinely is one of these lexical concepts. Rather than continue the pursuit of a complex representation that has the same meaning as our concept GOLD. I offer a model on which many lexical concepts are acquired from perception and inference, without being built up from, and composed by, the representations involved. The model, Baptizing Meanings for Concepts, is inspired in part by Saul Kripke's baptism process for assigning meanings to linguistic terms. Many lexical concepts, according to the BMC, are acquired by inferring the presence a new property-kind, picking out the property-kind in terms of those perceptible features, and then assigning a simple mental term, a concept, for that property-kind. (shrink)

In this paper, I discuss how the principle of identifying knowledge which Strawson advances in ‘Singular Terms and Predication’ (1961), and in ‘Identifying Reference and Truth-Values’ (1964) turns out to constrain communication. The principle states that a speaker’s use of a referring expression should invoke identifying knowledge on the part of the hearer, if the hearer is to understand what the speaker is saying, and also that, in so referring, speakers are attentive to hearers’ epistemic states. In contrasting it with (...) Russell’s Principle (Evans 1982), as well as with the principle of identifying descriptions (Donnellan 1970), I try to show that the principle of identifying knowledge, ultimately a condition for understanding, makes sense only in a situation of conversation. This allows me to conclude that the cooperative feature of communication (Grice 1975) and reference (Clark andWilkes-Gibbs 1986) holds also at the understanding level. Finally, I discuss where Strawson’s views seem to be unsatisfactory, and suggest how they might be improved. (shrink)

In this paper we investigate how the dynamic nature of words’ meanings plays a role in a philosophical theory of meaning. For ‘dynamic nature’ we intend the characteristic of being flexible, of changing according to many factors (speakers, contexts, and more). We consider meaning as something that gradually takes shape from the dynamic processes of communication. Accordingly, we present a draft of a theory of meaning that, on the one hand, describes how a private meaning is formed as a mental (...) state of individual agents during a lifetime of experiences, and, on the other hand, shows how a public meaning emerges from the interaction of agents. When communicating with each other, agents need to converge on a shared meaning of the words used, by means of a negotiation process. A public meaning is the abstract product of many of these processes while, at the same time, the private meanings are continually reshaped by each negotiation. Exploring this dynamics, we have been looking at the work done by computer scientists dealing with problems of heterogeneity of sources of information. We argue that a suitable solution for both disciplines lies in a systematic characterization of the processes of meaning negotiation. (shrink)