In a recent article, Carlos Santana shows that in common interest signaling games when signals are costly and when receivers can observe contextual environmental cues, ambiguous signaling strategies outperform precise ones and can, as a result, evolve. I show that if one assumes a realistic structure on the state space of a common interest signaling game, ambiguous strategies can be explained without appeal to contextual cues. I conclude by arguing that there are multiple types of cases of payoff-beneficial ambiguity, some (...) of which are better explained by Santana’s models and some of which are better explained by models presented here. (shrink)

Traditional mechanistic accounts of language processing derive almost entirely from the study of monologue. Yet, the most natural and basic form of language use is dialogue. As a result, these accounts may only offer limited theories of the mechanisms that underlie language processing in general. We propose a mechanistic account of dialogue, the interactive alignment account, and use it to derive a number of predictions about basic language processes. The account assumes that, in dialogue, the linguistic representations employed by the (...) interlocutors become aligned at many levels, as a result of a largely automatic process. This process greatly simplifies production and comprehension in dialogue. After considering the evidence for the interactive alignment model, we concentrate on three aspects of processing that follow from it. It makes use of a simple interactive inference mechanism, enables the development of local dialogue routines that greatly simplify language processing, and explains the origins of self-monitoring in production. We consider the need for a grammatical framework that is designed to deal with language in dialogue rather than monologue, and discuss a range of implications of the account. Key Words: common ground; dialogue; dialogue routines; language comprehension; language production; monitoring; perception-behavior link. (shrink)

Vague predicates, those that exhibit borderline cases, pose a persistent problem for philosophers and logicians. Although they are ubiquitous in natural language, when used in a logical context, vague predicates lead to contradiction. This paper will address a question that is intimately related to this problem. Given their inherent imprecision, why do vague predicates arise in the first place? I discuss a variation of the signaling game where the state space is treated as contiguous, i.e., endowed with a metric that (...) captures a similarity relation over states. This added structure is manifested in payoffs that reward approximate coordination between sender and receiver as well as perfect coordination. I evolve these games using a variation of Herrnstein reinforcement learning that better reflects the generalizing learning strategies real-world actors use in situations where states of the world are similar. In these simulations, signaling can develop very quickly, and the signals are vague in much the way ordinary language predicates are vague—they each exclusively apply to certain items, but for some transition period both signals apply to varying degrees. Moreover, I show that under certain parameter values, in particular when state spaces are large and time is limited, learning generalization of this sort yields strategies with higher payoffs than standard Herrnstein reinforcement learning. These models may then help explain why the phenomenon of vagueness arises in natural language: the learning strategies that allow actors to quickly and effectively develop signaling conventions in contiguous state spaces make it unavoidable. (shrink)

Vague predicates, those that exhibit borderline cases, pose a persistent problem for philosophers and logicians. Although they are ubiquitous in natural language, when used in a logical context, vague predicates lead to contradiction. This paper will address a question that is intimately related to this problem. Given their inherent imprecision, why do vague predicates arise in the first place? I discuss a variation of the signaling game where the state space is treated as contiguous, i.e., endowed with a metric that (...) captures a similarity relation over states. This added structure is manifested in payoffs that reward approximate coordination between sender and receiver as well as perfect coordination. I evolve these games using a variation of Herrnstein reinforcement learning that better reflects the generalizing learning strategies real-world actors use in situations where states of the world are similar. In these simulations, signaling can develop very quickly, and the signals are vague in much the way ordinary language predicates are vague—they each exclusively apply to certain items, but for some transition period both signals apply to varying degrees. Moreover, I show that under certain parameter values, in particular when state spaces are large and time is limited, learning generalization of this sort yields strategies with higher payoffs than standard Herrnstein reinforcement learning. These models may then help explain why the phenomenon of vagueness arises in natural language: the learning strategies that allow actors to quickly and effectively develop signaling conventions in contiguous state spaces make it unavoidable. (shrink)

In game-theoretic signaling models, evolution tends to favor perfectly precise signaling systems, but in the natural world communication is almost always imprecise. I argue that standard explanations for this discrepancy are only partially sufficient, and I show that communication is often ambiguous because signal senders take advantage of context sensitivity. As evidence, I make two additions to the signaling model: a cost for more complex signaling strategies and the ability to combine information in signals with independent information. Analysis and simulation (...) of the altered model shows that it leads to the predicted outcome of evolution favoring ambiguous signaling. (shrink)

The emergence of signaling systems has been observed in numerous experimental and real-world contexts, but there is no consensus on which shared mechanisms underlie such phenomena. A number of explanatory mechanisms have been proposed within several disciplines, all of which have been instantiated as credible working models. However, they are usually framed as being mutually incompatible. Using an exemplar-based framework, we replicate these models in a minimal configuration which allows us to directly compare them. This reveals that the development of (...) optimal signaling is driven by similar mechanisms in each model, which leads us to propose three requirements for the emergence of conventional signaling. These are the creation and transmission of referential information, a systemic bias against ambiguity, and finally some form of information loss. Considering this, we then discuss some implications for theoretical and experimental approaches to the emergence of learned communication. (shrink)

We reopen the investigation into the formal and conceptual relationship between bidirectional optimality theory (Blutner in J Semant 15(2):115–162, 1998 , J Semant 17(3):189–216, 2000 ) and game theory. Unlike a likeminded previous endeavor by Dekker and van Rooij (J Semant 17:217–242, 2000 ), we consider signaling games not strategic games, and seek to ground bidirectional optimization once in a model of rational step-by-step reasoning and once in a model of reinforcement learning. We give sufficient conditions for equivalence of bidirectional (...) optimality and the former, and show based on numerical simulations that bidirectional optimization may be thought of as a process of reinforcement learning with lateral inhibition. (shrink)

Analyzes the nature of international disagreements and conflict resolution in terms of game theory and non-zero-sum games.

Compositionality is a key design feature of human language: the meaning of complex expressions is, for the most part, systematically constructed from the meanings of its parts and their manner of composition. This paper demonstrates that rudimentary forms of compositional communicative behavior can emerge from a variant of reinforcement learning applied to signaling games. This helps explain how compositionality could have emerged gradually: if unsophisticated agents can evolve prevalent dispositions to communicate compositional-like, there is a direct evolutionary benefit for adaptations (...) that exploit the systematicity in form-meaning mappings more rigorously. (shrink)

The emergence of signaling systems has been observed in numerous experimental and real‐world contexts, but there is no consensus on which (if any) shared mechanisms underlie such phenomena. A number of explanatory mechanisms have been proposed within several disciplines, all of which have been instantiated as credible working models. However, they are usually framed as being mutually incompatible. Using an exemplar‐based framework, we replicate these models in a minimal configuration which allows us to directly compare them. This reveals that the (...) development of optimal signaling is driven by similar mechanisms in each model, which leads us to propose three requirements for the emergence of conventional signaling. These are the creation and transmission of referential information, a systemic bias against ambiguity, and finally some form of information loss. Considering this, we then discuss some implications for theoretical and experimental approaches to the emergence of learned communication. (shrink)

We study a low-rationality learning dynamics called probe and adjust. Our emphasis is on its properties in games of information transfer such as the Lewis signaling game or the Bala-Goyal network game. These games fall into the class of weakly better reply games, in which, starting from any action profile, there is a weakly better reply path to a strict Nash equilibrium. We prove that probe and adjust will be close to strict Nash equilibria in this class of games with (...) arbitrarily high probability. In addition, we compare these asymptotic properties to short-run behavior. (shrink)

Lewis signaling games illustrate how language might evolve from random behavior. The probability of evolving an optimal signaling language is, in part, a function of what learning strategy the agents use. Here we investigate three learning strategies, each of which allows agents to forget old experience. In each case, we find that forgetting increases the probability of evolving an optimal language. It does this by making it less likely that past partial success will continue to reinforce suboptimal practice. The learning (...) strategies considered here show how forgetting past experience can promote learning in the context of games with suboptimal equilibria. (shrink)

No one denies that people adapt what they say and how they interpret what is said to them, depending on their interactive partners. What is controversial is when and how they do so. Several psycholinguistics research programs have found what appear to be failures to adapt to partners in the early moments of processing and have used this evidence to argue for modularity in the language processing architecture, claiming that the system cannot take into account a partner’s distinct needs or (...) knowledge early in processing. We review the evidence for both early and delayed partner‐specific adaptations, and we identify some challenges and difficulties with interpreting this evidence. We then discuss new analyses from a previously published referential communication experiment (Metzing & Brennan, 2003) demonstrating that partner‐specific effects need not occur late in processing. In contrast to Pickering and Garrod (2004) and Keysar, Barr, and Horton (1998b), we conclude that there is no good evidence that early processing has to be be “egocentric,”“dumb,” or encapsulated from social knowledge or common ground, but that under some circumstances, such as when one partner has made an attribution about another’s knowledge or needs, processing can be nimble enough to adapt quite early to a perspective different from one’s own. (shrink)

Sharing a public language facilitates particularly efficient forms of joint perception and action by giving interlocutors refined tools for directing attention and aligning conceptual models and action. We hypothesized that interlocutors who flexibly align their linguistic practices and converge on a shared language will improve their cooperative performance on joint tasks. To test this prediction, we employed a novel experimental design, in which pairs of participants cooperated linguistically to solve a perceptual task. We found that dyad members generally showed a (...) high propensity to adapt to each other’s linguistic practices. However, although general linguistic alignment did not have a positive effect on performance, the alignment of particular task-relevant vocabularies strongly correlated with collective performance. In other words, the more dyad members selectively aligned linguistic tools fit for the task, the better they performed. Our work thus uncovers the interplay between social dynamics and sensitivity to task affordances in successful cooperation. (shrink)