The mathematical theory of communication.

Word Order Universals is a detailed account of word order universals and their role in theories of historical change. The starting point is the Greenberg data set, which is comprised of a sample of 142 languages for certain limited co-occurrences of basic word orders, and a 30-language sample for more detailed information. In the Language Index, the 142 have been expanded to some 350 languages. Using the original Greenberg samples and the Expanded Sample, an alternative set of descriptive word order (...) statements is provided. Comprised of eight chapters, this book begins with an introduction to the theory of word order universals, encompassing topics such as word order variation across languages and theories of universal grammar. The reader is then introduced to the work of Joseph Greenberg and Theo Vennemann on word order universals; implicational universals in Greenberg's data and the Expanded Sample; and the predictions made by implicational and distributional universals for word order change. Reformulated universals for historical reconstruction are also discussed, along with some laws of reconstruction derived from synchronic universals. The final chapter is devoted to the Expanded Sample, with particular reference to its quantities as well as its typological and genetic classification. This monograph will be a useful resource for specialists in grammar and linguistics. (shrink)

Presenting a landmark in linguistics and cognitive science, Ray Jackendoff proposes a new holistic theory of the relation between the sounds, structure, and meaning of language and their relation to mind and brain. Foundations of Language exhibits the most fundamental new thinking in linguistics since Noam Chomsky's Aspects of the Theory of Syntax in 1965—yet is readable, stylish, and accessible to a wide readership. Along the way it provides new insights on the evolution of language, thought, and communication.

According to classical arguments, language learning is both facilitated and constrained by cognitive biases. These biases are reflected in linguistic typology—the distribution of linguistic patterns across the world's languages—and can be probed with artificial grammar experiments on child and adult learners. Beginning with a widely successful approach to typology (Optimality Theory), and adapting techniques from computational approaches to statistical learning, we develop a Bayesian model of cognitive biases and show that it accounts for the detailed pattern of results of artificial (...) grammar experiments on noun-phrase word order (Culbertson, Smolensky, & Legendre, 2012). Our proposal has several novel properties that distinguish it from prior work in the domains of linguistic theory, computational cognitive science, and machine learning. This study illustrates how ideas from these domains can be synthesized into a model of language learning in which biases range in strength from hard (absolute) to soft (statistical), and in which language-specific and domain-general biases combine to account for data from the macro-level scale of typological distribution to the micro-level scale of learning by individuals. (shrink)

A more extensive discussion of certain of the more technical notions appears in my paper "On Binding" (Chomsky,; henceforth, OB). ...

Noam Chomsky's book on syntactic structures is a serious attempts on the part of a linguist to construct within the tradition of scientific theory-construction ...

There is an active debate within the field of phonology concerning the cognitive status of substantive phonetic factors such as ease of articulation and perceptual distinctiveness. A new framework is proposed in which substance acts as a bias, or prior, on phonological learning. Two experiments tested this framework with a method in which participants are first provided highly impoverished evidence of a new phonological pattern, and then tested on how they extend this pattern to novel contexts and novel sounds. Participants (...) were found to generalize velar palatalization (e.g., the change from [k] as in keep to [t⌢∫S] as in cheap) in a way that accords with linguistic typology, and that is predicted by a cognitive bias in favor of changes that relate perceptually similar sounds. Velar palatalization was extended from the mid front vowel context (i.e., before [e] as in cape) to the high front vowel context (i.e., before [i] as in keep), but not vice versa. The key explanatory notion of perceptual similarity is quantified with a psychological model of categorization, and the substantively biased framework is formalized as a conditional random field. Implications of these results for the debate on substance, theories of phonological generalization, and the formalization of similarity are discussed. (shrink)

This interdisciplinary new work explores one of the central theoretical problems in linguistics: learnability. The authors, from different backgrounds---linguistics, philosophy, computer science, psychology and cognitive science-explore the idea that language acquisition proceeds through general purpose learning mechanisms, an approach that is broadly empiricist both methodologically and psychologically. Written by four researchers in the full range of relevant fields: linguistics, psychology, computer science, and cognitive science, the book sheds light on the central problems of learnability and language, and traces their implications (...) for key questions of theoretical linguistics and the study of language acquisition. (shrink)

Scientific knowledge grows at a phenomenal pace--but few books have had as lasting an impact or played as important a role in our modern world as The Mathematical Theory of Communication, published originally as a paper on communication theory more than fifty years ago. Republished in book form shortly thereafter, it has since gone through four hardcover and sixteen paperback printings. It is a revolutionary work, astounding in its foresight and contemporaneity. The University of Illinois Press is pleased and honored (...) to issue this commemorative reprinting of a classic. (shrink)

Already hailed as a masterpiece, Foundations of Language offers a brilliant overhaul of the last thirty-five years of research in generative linguistics and related fields. "Few books really deserve the cliché 'this should be read by every researcher in the field'," writes Steven Pinker, author of The Language Instinct, "but Ray Jackendoff's Foundations of Language does." Foundations of Language offers a radically new understanding of how language, the brain, and perception intermesh. The book renews the promise of early generative linguistics: (...) that language can be a valuable entrée into understanding the human mind and brain. The approach is remarkably interdisciplinary. Behind its innovations is Jackendoff's fundamental proposal that the creativity of language derives from multiple parallel generative systems linked by interface components. This shift in basic architecture makes possible a radical reconception of mental grammar and how it is learned. As a consequence, Jackendoff is able to reintegrate linguistics with philosophy of mind, cognitive and developmental psychology, evolutionary biology, neuroscience, and computational linguistics. Among the major topics treated are language processing, the relation of language to perception, the innateness of language, and the evolution of the language capacity, as well as more standard issues in linguistic theory such as the roles of syntax and the lexicon. In addition, Jackendoff offers a sophisticated theory of semantics that incorporates insights from philosophy of language, logic and formal semantics, lexical semantics of various stripes, cognitive grammar, psycholinguistic and neurolinguistic approaches, and the author's own conceptual semantics. (shrink)

Harmonic Grammar (HG) and Optimality Theory (OT) are closely related formal frameworks for the study of language. In both, the structure of a given language is determined by the relative strengths of a set of constraints. They differ in how these strengths are represented: as numerical weights (HG) or as ranks (OT). Weighted constraints have advantages for the construction of accounts of language learning and other cognitive processes, partly because they allow for the adaptation of connectionist and statistical models. HG (...) has been little studied in generative linguistics, however, largely due to influential claims that weighted constraints make incorrect predictions about the typology of natural languages, predictions that are not shared by the more popular OT. This paper makes the case that HG is in fact a promising framework for typological research, and reviews and extends the existing arguments for weighted over ranked constraints. (shrink)

This paper reports the findings from an interconnected set of experiments designed to assess children’s knowledge of the semantic interactions between negation and quantified NPs. Our main finding is that young children, unlike adults, systematically interpret these elements on the basis of their position in overt syntax. We argue that this observation can be derived from an interplay between fundamental properties of universal grammar and basic learning principles. We show that even when children’s semantic knowledge appears to differ from that (...) of adults, the observed differences.. (shrink)

This book explores issues at the core of modern linguistics and cognitive science. Why are all languages similar in some ways and in others utterly different? Why do languages change and change variably? How did the human capacity for language evolve, and how far did it do so as an innate ability? Simon Kirby looks at these questions from a broad perspective, arguing that they can be studied together. The author begins by examining how far the universal properties of language (...) may be explained by examining the way it is used, and how far by the way it is structured. He then considers what insights may be gained by combining functional and formal approaches. In doing so he develops a way of treating language as an adaptive system, in which its communicative and formal roles are both crucial and complementary. In order to test the effectiveness of competing theories and explanations, Simon Kirby develops computational models to show what universals emerge given a particular theory of language use or acquisition. He presents here both the methodology and the results. Function, Selection, and Innateness is important for its argument, its methodology, and its conclusions. It is a powerful demonstration of the value of looking at language as an adaptive system and goes to the heart of current debates on the evolution and nature of language. (shrink)

In this article, we develop a hierarchical Bayesian model of learning in a general type of artificial language‐learning experiment in which learners are exposed to a mixture of grammars representing the variation present in real learners’ input, particularly at times of language change. The modeling goal is to formalize and quantify hypothesized learning biases. The test case is an experiment (Culbertson, Smolensky, & Legendre, 2012) targeting the learning of word‐order patterns in the nominal domain. The model identifies internal biases of (...) the experimental participants, providing evidence that learners impose (possibly arbitrary) properties on the grammars they learn, potentially resulting in the cross‐linguistic regularities known as typological universals. Learners exposed to mixtures of artificial grammars tended to shift those mixtures in certain ways rather than others; the model reveals how learners’ inferences are systematically affected by specific prior biases. These biases are in line with a typological generalization—Greenberg's Universal 18—which bans a particular word‐order pattern relating nouns, adjectives, and numerals. (shrink)