In a series of papers, Donald Davidson :3–17, 1984, The philosophical grounds of rationality, 1986, Midwest Stud Philos 16:1–12, 1991) developed a powerful argument against the claim that linguistic conventions provide any explanatory purchase on an account of linguistic meaning and communication. This argument, as I shall develop it, turns on cases of what I call lexical innovation: cases in which a speaker uses a sentence containing a novel expression-meaning pair, but nevertheless successfully communicates her intended meaning to her audience. (...) I will argue that cases of lexical innovation motivate a dynamic conception of linguistic conventions according to which background linguistic conventions may be rapidly expanded to incorporate new word meanings or shifted to revise the meanings of words already in circulation. I argue that this dynamic account of conventions both resolves the problem raised by cases of lexical innovation and that it does so in a way that is preferable to those who—like Davidson—deny important explanatory roles for linguistic conventions. (shrink)

When people engage in conversation, they tailor their utterances to their conversational partners, whether these partners are other humans or computational systems. This tailoring, or adaptation to the partner takes place in all facets of human language use, and is based on a mental model or a user model of the conversational partner. Such adaptation has been shown to improve listeners' comprehension, their satisfaction with an interactive system, the efficiency with which they execute conversational tasks, and the likelihood of achieving (...) higher level goals such as changing the listener's beliefs and attitudes. We focus on one aspect of adaptation, namely the tailoring of the content of dialogue system utterances for the higher level processes of persuasion, argumentation and advice‐giving. Our hypothesis is that algorithms that adapt content for these processes, according to a user model, will improve the usability, efficiency, and effectiveness of dialogue systems. We describe a multimodal dialogue system and algorithms for adaptive content selection based on multi‐attribute decision theory. We demonstrate experimentally the improved efficacy of system responses through the use of user models to both tailor the content of system utterances and to manipulate their conciseness. (shrink)

We present an account of semantics that is not construed as a mapping of language to the world but rather as a mapping between individual meaning spaces. The meanings of linguistic entities are established via a “meeting of minds.” The concepts in the minds of communicating individuals are modeled as convex regions in conceptual spaces. We outline a mathematical framework, based on fixpoints in continuous mappings between conceptual spaces, that can be used to model such a semantics. If concepts are (...) convex, it will in general be possible for interactors to agree on joint meaning even if they start out from different representational spaces. Language is discrete, while mental representations tend to be continuous—posing a seeming paradox. We show that the convexity assumption allows us to address this problem. Using examples, we further show that our approach helps explain the semantic processes involved in the composition of expressions. (shrink)

When people engage in conversation, they tailor their utterances to their conversational partners, whether these partners are other humans or computational systems. This tailoring, or adaptation to the partner takes place in all facets of human language use, and is based on a mental model or a user model of the conversational partner. Such adaptation has been shown to improve listeners' comprehension, their satisfaction with an interactive system, the efficiency with which they execute conversational tasks, and the likelihood of achieving (...) higher level goals such as changing the listener's beliefs and attitudes. We focus on one aspect of adaptation, namely the tailoring of the content of dialogue system utterances for the higher level processes of persuasion, argumentation and advice-giving. Our hypothesis is that algorithms that adapt content for these processes, according to a user model, will improve the usability, efficiency, and effectiveness of dialogue systems. We describe a multimodal dialogue system and algorithms for adaptive content selection based on multi-attribute decision theory. We demonstrate experimentally the improved efficacy of system responses through the use of user models to both tailor the content of system utterances and to manipulate their conciseness. (shrink)

Collaborators generally coordinate their activities through communication, during which they readily negotiate a shared lexicon for activity-related objects. This social-pragmatic activity both recruits and affects cognitive and social-cognitive processes ranging from selective attention to perspective taking. We ask whether negotiating reference also facilitates category learning or might private verbalization yield comparable facilitation? Participants in three referential conditions learned to classify imaginary creatures according to combinations of functional features—nutritive and destructive—that implicitly defined four categories. Remote partners communicated in the Dialogue condition. (...) In the Monologue condition, participants recorded audio descriptions for their own later use. Controls worked silently. Dialogue yielded better category learning, with wider distribution of attention. Monologue offered no benefits over working silently. We conclude that negotiating reference compels collaborators to find communicable structure in their shared activity; this social-pragmatic constraint accelerates category learning and likely provides much of the benefit recently ascribed to learning labeled categories. (shrink)

How is linguistic communication possible? How do we come to share the same meanings of words and utterances? One classical position holds that human beings share a transcendental “platonic” ideality independent of individual cognition and language use (Frege 1948). Another stresses immanent linguistic relations (Saussure 1959), and yet another basic embodied structures as the ground for invariant aspects of meaning (Lakoff and Johnson 1999). Here we propose an alternative account in which the possibility for sharing meaning is motivated by four (...) sources of structural stability: 1) the physical constraints and affordances of our surrounding material environment, 2) biological constraints of our human bodies, 3) social normative constraints of culture and society, and 4) the local history of social interactions. These structures and constraints interact in dynamical ways in actual language usage situations: local dialogical and social dynamics motivate and stabilize the profiling of a conceptual space already highly structured by our shared biology, culture, and environment. We will substantiate this perspective with reference to recent studies in experimental pragmatics and semiotics in which participants interact linguistically to solve cooperative tasks. Three main cases will be considered: The dynamic grounding of linguistic categories, the construction of conceptual models to relate entities in a scene, and the construction of shared conceptual scales for assessing and appraising subjective experiences. (shrink)

Observing others in conversation is a common format for comprehending language, yet little work has been done to understand dialog comprehension. We tested whether overhearers use addressee backchannels as predictive cues for how to integrate information across speaker turns during comprehension of spontaneously produced collaborative narration. In Experiment 1, words that followed specific backchannels were recognized more slowly than words that followed either generic backchannels or pauses. In Experiment 2, we found that when the turn after the backchannel was a (...) continuation of the narrative, specific backchannels prompted the fastest verification of prior information. When the turn after was an elaboration, they prompted the slowest, indicating that overhearers took specific backchannels as cues to integrate preceding talk with subsequent talk. These findings demonstrate that overhearers capitalize on the predictive relationship between backchannels and the development of speakers’ talk, coordinating information across conversational roles. (shrink)

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

In this paper we investigate the effect of level of understanding revealed by feedback in the form of clarification requests from a route follower on a route giver’s spatial perspective choice in their response in route instruction dialogues. In an experiment varying the level of understanding displayed by route follower clarification requests (the independent variable), route giver perspective switching in response to this feedback is investigated. Three levels of understanding displayed by feedback are investigated: (1) low-level clarification requests indicating that (...) the instruction was not processed, (2) semantic-level clarification requests indicating that the spatial direction given in the instruction could not be resolved as the speaker of the clarification request could not interpret which perspective was intended, and (3) high-level feedback which indicates that the route giver’s instruction was understood but which note an obstacle to following the instruction. Results show that perspective choice, which is a conceptual feature of language use, is sensitive to perceived level of addressee understanding. We found that route givers consistently switch perspectives in responding to semantic-level clarification requests but not in response to low-level ones, and also that switching occurs more for high-level feedback than for low-level feedback. We address how dialogue systems can take advantage of these findings by modelling our results in an Information State model of dialogue, presenting update rules for response generation which account for our findings and also update rules which enable generation of the feedback themselves. (shrink)

Recent work on the emergence and evolution of human communication has focused on getting novel systems to evolve from scratch in the laboratory. Many of these studies have adopted an interactive construction approach, whereby pairs of participants repeatedly interact with one another to gradually develop their own communication system whilst engaged in some shared task. This paper describes four recent studies that take a different approach, showing how adaptive structure can emerge purely as a result of cultural transmission through single (...) chains of learners. By removing elements of interactive communication and focusing only on the way in which language is repeatedly acquired by learners, we hope to gain a better understanding of how useful structural properties of language could have emerged without being intentionally designed or innovated. (shrink)

Human communication is often thought about in terms of transmitted messages in a conventional code like a language. But communication requires a specialized interactive intelligence. Senders have to be able to perform recipient design, while receivers need to be able to do intention recognition, knowing that recipient design has taken place. To study this interactive intelligence in the lab, we developed a new task that taps directly into the underlying abilities to communicate in the absence of a conventional code. We (...) show that subjects are remarkably successful communicators under these conditions, especially when senders get feedback from receivers. Signaling is accomplished by the manner in which an instrumental action is performed, such that instrumentally dysfunctional components of an action are used to convey communicative intentions. The findings have important implications for the nature of the human communicative infrastructure, and the task opens up a line of experimentation on human communication. (shrink)

This article proposes a number of models to examine through which mechanisms a population of autonomous agents could arrive at a repertoire of perceptually grounded categories that is sufficiently shared to allow successful communication. The models are inspired by the main approaches to human categorisation being discussed in the literature: nativism, empiricism, and culturalism. Colour is taken as a case study. Although we take no stance on which position is to be accepted as final truth with respect to human categorisation (...) and naming, we do point to theoretical constraints that make each position more or less likely and we make clear suggestions on what the best engineering solution would be. Specifically, we argue that the collective choice of a shared repertoire must integrate multiple constraints, including constraints coming from communication. Key Words: autonomous agents; colour categorisation; colour naming; connectionism; cultural evolution; genetic evolution; memes; origins of language; self-organisation; semiotic dynamics; symbol grounding. (shrink)

In the last few years, researchers have begun to investigate the emergence of novel forms of human communication in the laboratory. I survey this growing line of research, which may be called experimental semiotics, from three distinct angles. First, I situate the new approach in its theoretical and historical context. Second, I review a sample of studies that exemplify experimental semiotics. Third, I present an empirical study that illustrates how the new approach can help us understand the socio‐cognitive underpinnings of (...) human communication. The main conclusion of the paper will be that, by reproducing micro samples of historical processes in the laboratory, experimental semiotics offers new powerful tools for investigating human communication as a form of joint action. (shrink)

Smith gives an excellent overview on research in language evolution, in which he discusses several recent models of how linguistic systems and the cognitive capacities involved in language learning may have co‐evolved. He illustrates how combined pressures on language learning and communication/use produce compositionally structured languages. Once in place, a (culturally transmitted) communication system creates new selection pressures on the capacity for acquiring these systems.

Language use can be viewed as a form of joint activity that requires the coordination of meaning between individuals. Because the linguistic signal is notoriously ambiguous, interlocutors need to draw upon additional sources of information to resolve ambiguity and achieve shared understanding. One way individuals can achieve coordination is by using inferences about the interlocutor’s intentions and mental states to adapt their behavior. However, such an inferential process can be demanding in terms of both time and cognitive resources. Here, we (...) suggest that interaction provides interlocutors with many cues that can support coordination of meaning, even when they are neither produced intentionally for that purpose nor interpreted as signaling speakers’ intention. In many circumstances, interlocutors can take advantage of these cues to adapt their behavior in ways that promote coordination, bypassing the need to resort to deliberative inferential processes. (shrink)

With human language, the same utterance can have different meanings in different contexts. Nevertheless, listeners almost invariably converge upon the correct intended meaning. The classic Gricean explanation of how this is achieved posits the existence of four maxims of conversation, which speakers are assumed to follow. Armed with this knowledge, listeners are able to interpret utterances in a contextually sensible way. This account enjoys wide acceptance, but it has not gone unchallenged. Specifically, Relevance Theory offers an explicitly cognitive account of (...) utterance interpretation that presents a radical challenge to the neo‐Gricean paradigm. Evolutionary considerations are one way in which we can choose between competing theories. A simple game‐theoretic model of the evolution of communication is presented, and it is used to derive a number of basic qualities that will be satisfied by all evolved communication systems. These qualities are observed to precisely predict the foundational principles of Relevance Theory. The model thus provides biological support for that enterprise in general, and for the plausibility of the cognitive mechanisms that it describes in particular. (shrink)

How do communities establish shared communication systems? The Common Knowledge view assumes that symbolic conventions develop through the accumulation of common knowledge regarding communication practices among the members of a community. In contrast with this view, it is proposed that coordinated communication emerges a by‐product of local interactions among dyads. A set of multi‐agent computer simulations show that a population of “egocentric” agents can establish and maintain symbolic conventions without common knowledge. In the simulations, convergence to a single conventional system (...) was most likely and most efficient when agents updated their behavior on the basis of local rather than global, system‐level information. The massive feedback and parallelism present in the simulations gave rise to phenomena that are often assumed to result from complex strategic processing on the part of individual agents. The implications of these findings for the development of theories of language use are discussed. (shrink)

A growing conceptual and empirical literature is advancing the idea that language extends our cognitive skills. One of the most influential positions holds that language – qua material symbols – facilitates individual thought processes by virtue of its material properties (Clark, 2006a). Extending upon this model, we argue that language enhances our cognitive capabilities in a much more radical way: the skilful engagement of public material symbols facilitates evolutionarily unprecedented modes of collective perception, action and reasoning (interpersonal synergies) creating dialogically (...) extended minds. We relate our approach to other ideas about collective minds ( Gallagher, 2011, Theiner et al., 2010 and Tollefsen, 2006) and review a number of empirical studies to identify the mechanisms enabling the constitution of interpersonal cognitive systems. (shrink)

A variety of theoretical frameworks predict the resemblance of behaviors between two people engaged in communication, in the form of coordination, mimicry, or alignment. However, little is known about the time course of the behavior matching, even though there is evidence that dyads synchronize oscillatory motions (e.g., postural sway). This study examined the temporal structure of nonoscillatory actions—language, facial, and gestural behaviors—produced during a route communication task. The focus was the temporal relationship between matching behaviors in the interlocutors (e.g., facial (...) behavior in one interlocutor vs. the same facial behavior in the other interlocutor). Cross-recurrence analysis revealed that within each category tested (language, facial, gestural), interlocutors synchronized matching behaviors, at temporal lags short enough to provide imitation of one interlocutor by the other, from one conversational turn to the next. Both social and cognitive variables predicted the degree of temporal organization. These findings suggest that the temporal structure of matching behaviors provides low-level and low-cost resources for human interaction. (shrink)

Theoretical and empirical contributions to the understanding of communicative interactions between heterospecifics are scarce and tend to apply a monological model of communication that focuses on the transfer of information from signallers to receivers. This study relies on an alternative model of communication, semiotic alignment, which sees communicative interaction as a dialogical process of joint semiosis resulting in the alignment of the interactants’ own-worlds. We conducted an experiment where dyads composed of an elephant instruction-giver and a human instruction-receiver needed to (...) engage in dynamic and interactive communication in order to solve a cooperative object-choice task. Our results showed that dyads were able to solve the task well above chance levels. Moreover, cross-recurrence analysis revealed that interactants were synchronizing referential indexical gestures throughout the experiment. However, we were not able to confirm a direct correlation between joint deixis and experimental outcomes, presumably because these outcomes are dependent on other forms of joint semiosis not analysed in this study. (shrink)

When people are engaged in social interaction, they can repeat aspects of each other’s communicative behavior, such as words or gestures. This kind of behavioral alignment has been studied across a wide range of disciplines and has been accounted for by diverging theories. In this paper, we review various operationalizations of lexical and gestural alignment. We reveal that scholars have fundamentally different takes on when and how behavior is considered to be aligned, which makes it difficult to compare findings and (...) draw uniform conclusions. Furthermore, we show that scholars tend to focus on one particular dimension of alignment (traditionally, whether two instances of behavior overlap in form), while other dimensions remain understudied. This hampers theory testing and building, which requires a well‐defined account of the factors that are central to or might enhance alignment. To capture the complex nature of alignment, we identify five key dimensions to formalize the relationship between any pair of behavior: time, sequence, meaning, form, and modality. We show how assumptions regarding the underlying mechanism of alignment (placed along the continuum of priming vs. grounding) pattern together with operationalizations in terms of the five dimensions. This integrative framework can help researchers in the field of alignment and related phenomena (including behavior matching, mimicry, entrainment, and accommodation) to formulate their hypotheses and operationalizations in a more transparent and systematic manner. The framework also enables us to discover unexplored research avenues and derive new hypotheses regarding alignment. (shrink)

The authors' claim that analogical reasoning is the product of relational priming is compatible with language processing work that emphasizes the role of low-level automatic processes in the alignment of situation models in dialogue. However, their model ignores recent behavioral evidence demonstrating a effect on relational priming. We discuss implications of these data.

Traditional mechanistic accounts of language processing derive almost entirely from the study of monologue. Yet, the most natural and basic form of language use is dialogue. As a result, these accounts may only offer limited theories of the mechanisms that underlie language processing in general. We propose a mechanistic account of dialogue, the interactive alignment account, and use it to derive a number of predictions about basic language processes. The account assumes that, in dialogue, the linguistic representations employed by the (...) interlocutors become aligned at many levels, as a result of a largely automatic process. This process greatly simplifies production and comprehension in dialogue. After considering the evidence for the interactive alignment model, we concentrate on three aspects of processing that follow from it. It makes use of a simple interactive inference mechanism, enables the development of local dialogue routines that greatly simplify language processing, and explains the origins of self-monitoring in production. We consider the need for a grammatical framework that is designed to deal with language in dialogue rather than monologue, and discuss a range of implications of the account. Key Words: common ground; dialogue; dialogue routines; language comprehension; language production; monitoring; perception-behavior link. (shrink)

Dialog is a joint action at different levels. At the highest level, the goal of interlocutors is to align their mental representations. This emerges from joint activity at lower levels, both concerned with linguistic decisions (e.g., choice of words) and nonlinguistic processes (e.g., alignment of posture or speech rate). Because of the high‐level goal, the interlocutors are particularly concerned with close coupling at these lower levels. As we illustrate with examples, this means that imitation and entrainment are particularly pronounced during (...) interactive communication. We then argue that the mechanisms underlying such processes involve covert imitation of interlocutors’ communicative behavior, leading to emulation of their expected behavior. In other words, communication provides a very good example of predictive emulation, in a way that leads to successful joint activity. (shrink)

Our target article proposed that language production and comprehension are interwoven, with speakers making predictions of their own utterances and comprehenders making predictions of other people's utterances at different linguistic levels. Here, we respond to comments about such issues as cognitive architecture and its neural basis, learning and development, monitoring, the nature of forward models, communicative intentions, and dialogue.

The truth-conditions of many utterances have components that do not correspond to any uttered morpheme. This happens because linguistic acts are always a supplement to whatever else is available to agents engaged in a conversation. Unarticulated constituents result from the informational trade-off between what is available in the situation of utterance and what needs to be linguistically articulated. Unarticulated constituents are constituents of propositions, that is, of classifying tools that are neutral with respect to the way in which what is (...) given in a situation interacts with the words uttered. (shrink)

We analyzed the processing of noun-noun metaphors, which have been relatively understudied, compared to other types of figurative expressions, such as X is Y metaphors (e.g., He...

While individuals interact, they coordinate their feelings and emotions. They also coordinate several kinds of expression while interacting, like facial expressions and gestures. Inspired by Karl Bühler’s Organon model and Henri Bergson’s description of remembering experiences, we explore interpersonal coordination during a collaborative remembering task between two people. We present a case study of one dyad employing videography to identify and distinguish two types of spontaneous interpersonal coordination. In a later stage, separate interviews of both participants are analyzed to establish (...) whether content, freely remembered, is related to the previously observed coordination. The data describes that expressive-affective coordination during interaction is directly linked to the subjective organization of experience in individual remembering. We discuss these results, emphasizing the intersubjective aspects of lived experience and their relationship to expressive and representational aspects of coordination and remembering. (shrink)

When interlocutors repeatedly describe referents to each other, they rapidly converge on referring expressions which become increasingly systematized and abstract as the interaction progresses. Previous experimental research suggests that interactive repair mechanisms in dialogue underpin convergence. However, this research has so far only focused on the role of other-initiated repair and has not examined whether self-initiated repair might also play a role. To investigate this question, we report the results from a computer-mediated maze task experiment. In this task, participants communicate (...) with each other via an experimental chat tool, which selectively transforms participants’ private turn-revisions into public self-repairs that are made visible to the other participant. For example, if a participant, A, types “On the top square,” and then before sending, A revises the turn to “On the top row,” the server automatically detects the revision and transforms the private turn-revisions into a public self-repair, for example, “On the top square umm I meant row.” Participants who received these transformed turns used more abstract and systematized referring expressions, but performed worse at the task. We argue that this is due to the artificial self-repairs causing participants to put more effort into diagnosing and resolving the referential coordination problems they face in the task, yielding better grounded spatial semantics and consequently increased use of abstract referring expressions. (shrink)

Recent research indicates that interpersonal communication is noisy, and that people exhibit considerable insensitivity to problems in communication. Using a dyadic referential communication task, the goal of which is accurate information transfer, this study examined the extent to which interlocutors are sensitive to problems in communication and use other‐initiated repairs (OIRs) to address them. Participants were randomly assigned to dyads (N = 88 participants, or 44 dyads) and tried to communicate a series of recurring abstract geometric shapes to a partner (...) across a text–chat interface. Participants alternated between directing (describing shapes) and matching (interpreting shape descriptions) roles across 72 trials of the task. Replicating prior research, over repeated social interactions communication success improved and the shape descriptions became increasingly efficient. In addition, confidence in having successfully communicated the different shapes increased over trials. Importantly, matchers were less confident on trials in which communication was unsuccessful, communication success was lower on trials that contained an OIR compared to those that did not contain an OIR, and OIR trials were associated with lower Director Confidence. This pattern of results demonstrates that (a) interlocutors exhibit (a degree of) sensitivity to problems in communication, (b) they appropriately use OIRs to address problems in communication, and (c) OIRs signal problems in communication. (shrink)

The target article says surprisingly little about the possible role of shared circuits in language and communication. This commentary considers how they might contribute to linguistic communication, particularly during dialogue. We argue that shared circuits are used to promote alignment between linguistic representations at many levels and to support production-based emulation of linguistic input during comprehension.

Goldstein reported multiple cases of failure to categorise colours in patients that he termed amnesic or anomic aphasics. These patients have a particular difficulty in producing perceptual categories in the absence of other aphasic impairments. We hold that neuropsychological evidence supports the view that the task of colour categorisation is logically impossible without labels.

Despite its strengths, Leech et al.'s model fails to address the important benefits that derive from self-explanation and task feedback in analogical reasoning development. These components encourage explicit, self-reflective processes that do not necessarily link to knowledge accretion. We wonder, therefore, what mechanisms can be included within a connectionist framework to model self-reflective involvement and its beneficial consequences.

Machery argues that concepts are too heterogeneous to be a natural kind. I argue that the book does not go far enough. Theories of concepts assume that the task of categorizing warrants a unique set of cognitive constructs. Instead, cognitive science must look across tasks to find a fundamental set of cognitive mechanisms.

Following a synthesis of naturalistic and experimental studies of language creation, we propose a theoretical model that describes the process through which human communication systems might arise and evolve. Three key processes are proposed that give rise to effective, efficient and shared human communication systems: motivated signs that directly resemble their meaning facilitate cognitive alignment, improving communication success; behavioral alignment onto an inventory of shared sign-to-meaning mappings bolsters cognitive alignment between interacting partners; sign refinement, through interactive feedback, enhances the efficiency (...) of the evolving communication system. By integrating the findings across a range of diverse studies, we propose a theoretical model of the process through which the earliest human communication systems might have arisen and evolved. Importantly, because our model is not bound to a single modality it can describe the creation of shared sign systems across a range of contexts, informing theories of language creation and evolution. (shrink)