Recent years have seen a surge in accounts motivated by information theory that consider language production to be partially driven by a preference for communicative efficiency. Evidence from discourse production (i.e., production beyond the sentence level) has been argued to suggest that speakers distribute information across discourse so as to hold the conditional per-word entropy associated with each word constant, which would facilitate efficient information transfer (Genzel & Charniak, 2002). This hypothesis implies that the conditional (contextualized) probabilities of linguistic units (...) affect speakers’ preferences during production. Here, we extend this work in two ways. First, we explore how preceding cues are integrated into contextualized probabilities, a question which so far has received little to no attention. Specifically, we investigate how a cue's maximal informativity about upcoming words (the cue's effectiveness) decays as a function of the cue's recency. Based on properties of linguistic discourses as well as properties of human memory, we analytically derive a model of cue effectiveness decay and evaluate it against cross-linguistic data from 12 languages. Second, we relate the information theoretic accounts of discourse production to well-established mechanistic (activation-based) accounts: We relate contextualized probability distributions over words to their relative activation in a lexical network given preceding discourse. (shrink)

It is widely assumed that human learning and the structure of human languages are intimately related. This relationship is frequently suggested to derive from a language-specific biological endowment, which encodes universal, but communicatively arbitrary, principles of language structure (a Universal Grammar or UG). How might such a UG have evolved? We argue that UG could not have arisen either by biological adaptation or non-adaptationist genetic processes, resulting in a logical problem of language evolution. Specifically, as the processes of language change (...) are much more rapid than processes of genetic change, language constitutes a both over time and across different human populations, and, hence, cannot provide a stable environment to which language genes could have adapted. We conclude that a biologically determined UG is not evolutionarily viable. Instead, the original motivation for UG arises because language has been shaped to fit the human brain, rather than vice versa. Following Darwin, we view language itself as a complex and interdependent which evolves under selectional pressures from human learning and processing mechanisms. That is, languages themselves are shaped by severe selectional pressure from each generation of language users and learners. This suggests that apparently arbitrary aspects of linguistic structure may result from general learning and processing biases deriving from the structure of thought processes, perceptuo-motor factors, cognitive limitations, and pragmatics. (shrink)

Analyzing the rate at which languages change can clarify whether similarities across languages are solely the result of cognitive biases or might be partially due to descent from a common ancestor. To demonstrate this approach, we use a simple model of language evolution to mathematically determine how long it should take for the distribution over languages to lose the influence of a common ancestor and converge to a form that is determined by constraints on language learning. We show that modeling (...) language learning as Bayesian inference ofnbinary parameters or the ordering ofnconstraints results in convergence in a number of generations that is on the order ofn log n. We relax some of the simplifying assumptions of this model to explore how different assumptions about language evolution affect predictions about the time to convergence; in general, convergence time increases as the model becomes more realistic. This allows us to characterize the assumptions about language learning (given the models that we consider) that are sufficient for convergence to have taken place on a timescale that is consistent with the origin of human languages. These results clearly identify the consequences of a set of simple models of language evolution and show how analysis of convergence rates provides a tool that can be used to explore questions about the relationship between accounts of language learning and the origins of similarities across languages. (shrink)

It is a reasonable assumption that universal properties of natural languages are not accidental. They occur either because they are underwritten by genetic code, because they assist in language processing or language learning, or due to some combination of the two. In this paper we investigate one such language universal: the suffixing preference across the world’s languages, whereby inflections tend to be added to the end of words. A corpus analysis of child‐directed speech in English found that suffixes were more (...) accurate at cuing the grammatical category of the root word than were prefixes. An artificial language experiment found that there was a learning advantage for suffixes over prefixes in terms of grammatical categorization within an artificial language. The results are consistent with an account of language universals that originate in general purpose learning mechanisms. (shrink)

The transition from Middle English to Modern English in the second half of the 14th century is a turning point in the syntax of the language. It is at once the point when several constraints on nominal arguments that had been gaining ground since Old English become categorical, and the point when a reorganization of the functional category Infl is initiated, whose completion over the next several centuries yields essentially the syntactic system of the present day. From this time on, (...) subjects are obligatory, and they must be placed in Spec-IP position. In the VP, the last traces of OV order disappear, the order of direct and indirect object becomes fixed, the first “recipient passives” enter the language, and objects cease to be separable from the verb by adverbs or adjuncts. The V2 constraint of Old and Middle English is lost, as topicalized constituents cease to trigger verb-fronting. Concurrently, in the Infl system, the first instances of periphrastic do-support begin to replace fronting of the finite main verb, and, with the appearance of split infinitives and pro-infinitives, to starts to pattern as a non-finite Aux rather than, as in earlier stages, as a prefix marking the infinitive. All these changes have been dated to the second half of the 14th century, most of them specifically to the period between 1360 and 1380. (shrink)