Rumelhart and McClelland's chapter about learning the past tense created a degree of controversy extraordinary even in the adversarial culture of modern science. It also stimulated a vast amount of research that advanced the understanding of the past tense, inflectional morphology in English and other languages, the nature of linguistic representations, relations between language and other phenomena such as reading and object recognition, the properties of artificial neural networks, and other topics. We examine the impact of the Rumelhart and McClelland (...) model with the benefit of 25 years of hindsight. It is not clear who “won” the debate. It is clear, however, that the core ideas that the model instantiated have been assimilated into many areas in the study of language, changing the focus of research from abstract characterizations of linguistic competence to an emphasis on the role of the statistical structure of language in acquisition and processing. (shrink)

The range of hypotheses considered is surprising in that the most arguably plausible one is not included: the invariant principles of language are available for life, while the parameters of variation cannot be set after puberty. This hypothesis provides a better explanation than the author's for both the deep similarities and the vast differences between child “language growth” and adult language acquisition.

Curiously, two central areas are unaddressed by Epstein et al.: (i) L1A–L2A differences; (ii) L2 development. Here, findings relevant to (i) and (ii) – as well as their significance – are discussed. Together these form the basis for contesting Epstein et al.'s “Full Access” approach, but nonetheless analyses of the L2 data argue for UG-constrained L2A. Also discussed is the inadequacy of accounts (like Epstein et al.'s) without an explicit and prominent role for the L1.

The role of metalinguistic ability in L2 development is seriously underestimated. It may be seen both (1) as a means of initiating or boosting the flow of primary linguistic data and (2) as a generator of substitute knowledge (derived, but epistemologically distinct from domain-specific knowledge) that may compete with or compensate for perceived gaps in the learners current underlying competence. It cannot serve as a simple means of distinguishing the rival theoretical positions.

Epstein et al.'s “full access to Universal Grammar” position is conceptually and empirically problematic. Its shortcomings are illustrated through a brief discussion of the following issues: (1) initial versus final states of grammatical knowledge in a second language, (2) knowledge of gradience of grainmaticality, (3) optionality and retention in non-native grammars, and (4) the empirical measurement of syntactic knowledge.

Much second language acquisition (SLA) research confuses the representational and the developmental problems of language acquisition, assuming that attributes of a property theory will explain the transitions between the stages of a psychogrammar, or that induction will explain the properties of the representational systems which encode language. I argue that Principles and Parameter-setting theory deals only with the representational problem, and that induction must play a role in explaining the developmental problem. The conclusion is that both Epstein et al. and (...) the papers they criticize are right; they are just not right about the same issues. (shrink)

We argue that the model developed in Epstein et al.'s target article does not explain differences between child first language (LI) acquisition and adult second language (L2) acquisition. We therefore sketch an alternative view, originally developed in Clahsen and Muysken (1989), in the light of new empirical findings and theoretical developments.

The current conception of the relation between UG and the grammar of a language rules out the no-access hypothesis, but does not distinguish between the full-access and partial-access hypotheses. The former raises the issue of why language acquisition in child and adult should be so different. The evidence presented in Epstein et al.'s target article seems inconclusive regarding a choice between hypotheses.

Although theFull-accesshypothesis accounts for a range of empirical generalizations of L2A, it underrepresents the role of language transfer in the construction of the L2 grammar. We suggest the possibility that linguistic principles which constrain the L2 grammar are available both directly from UG and via the L1, a logical hypothesis which Epstein et al. do not consider.

While child language development theory must explain invariant “success,” foreign language learning theory must explain variation and lack of success. The fundamental difference hypothesis (FDH) outlines such a theory. Epstein et al. ignore the explanatory burden, mischaracterize the FDH, and underestimate the resources of human cognition. The field of second language acquisition is not divided into camps by views on “access” to UG.

Chomskyian claims of a genetically hard-wired and cognitively autonomous “universal grammar” are being promoted by generative linguistics as facts about language to the present day. The related doctrine of an evolutionary discontinuity in language emergence, however, is based on misconceptions about the notions of homology and preadaptation. The obvious lack of equivalence between symbolic communicative capacities in existing nonhuman primates and human language does not preclude common roots. Normal and disordered language development is strongly influenced by the genome, but there (...) is no evidence for the existence of specific genes underlying “universal grammar.” In the mature brain, stages of language processing can be distinguished and “first-pass” syntactic analyses appear to precede semantic decoding. However, this partial seriality – as well as behavioral and clinical dissociations between lexical and functional categories – can be best described, not in terms of serially activated and discrete modules, but in terms of classes of cell assemblies that differ in their distributional properties. Whereas cell assemblies involved in semantic interpretation (“content word” assemblies) are widely distributed and are generally less vulnerable to focal lesion, those involved in structural decoding (functor assemblies) are primarily distributed within the left perisylvian cortices and are selectively vulnerable to left perisylvian lesion. These distributional differences are explained in terms of the perceptuomotor components involved in the acquisition of relevant representations. The emerging “motivated” or “toposemantic” brain regional specificity can only be accommodated with “soft” and maturational versions of modularity. The failure to reproduce double dissociations in current connectionist models is due to overly simple neuroscientific assumptions, notably that of overall equipotentiality. Linguistic models should not be expected to be “implemented” in the brain, but need to be constrained by neuroscientific evidence on how biological brains function. (shrink)

One can disagree with Müller that it is neurobiologically questionable to suppose that human language is innate, specialized, and species-specific, yet agree that the precise brain mechanisms controlling language in any individual will be influenced by epigenesis and genetic variability, and that the interplay between inherited and acquired aspects of linguistic capacity deserves to be investigated.

The belief that syntax is an innate, autonomous, species-specific module is highly questionable. Syntax demonstrates the mosaic nature of evolutionary change, in that it made use of (and led to the enhancement of) numerous preexisting neurocognitive features. It is best understood as an emergent characteristic of the explosion of semantic complexity that occurred during hominid evolution.

Müller's review of the neuroscientific evidence undermines nativist claims for autonomous syntax and the argument from the poverty of the stimulus. Generativists will appeal to data from language acquisition, but here too there is growing evidence against the nativist position. Epigenetic naturalism, the developmental alternative to nativism, can be extended to epigenetic socionaturalism, acknowledging the importance of sociocultural processes in language and cognitive development.

Evidence is presented from a polyglot savant to suggest that double dissociations between linguistic and nonverbal abilities are more important than Müller's target article implies. It is also argued that the special nature of syntax makes its assimilation to other aspects of language or to nonhuman communication systems radically implausible.

Contrary to Müller's claims, and in support of modular theories, genetic factors play a substantial and significant role in language. The finding that some children with specific language impairment (SLI) have nonlinguistic impairments may reflect improper diagnosis of SLI or impairments that are secondary to linguistic impairments. Thus, such findings do not argue against the modularity thesis. The lexical/functional distinction appears to be innate and specifically linguistic and could be instantiated in either symbolic or connectionist systems.

Neurobiological models of language need a level of analysis that can account for the typical range of language phenomena. Because linguistically motivated models have been successful in explaining numerous language properties, it is premature to dismiss them as biologically irrelevant. Models attempting to unify neurobiology and linguistics need to be sensitive to both sources of evidence.

Müller's target article aims to summarize approaches to the question of how language elements (phonemes, morphemes, etc.) and rules are laid down in the brain. However, it suffers from being too vague about basic assumptions and empirical predictions of neurobiological models, and the empirical evidence available to test the models is not appropriately evaluated. (1) In a neuroscientific model of language, different cortical localizations of words can only be based on biological principles. These need to be made explicit. (2) Evidence (...) for and against word class differences could be evaluated more rigorously. (3) All (and only) humans are able to learn languages with complex syntactic structures; it is, therefore, not appropriate to deny innateness and universality of syntactic principles. The real question appears to be the following: Which neurobiological principles are the linguistic principles based on? (shrink)

We agree with Müller's epigenetic view of evolution and ontogeny and applaud his multilevel perspective. With him, we stress the importance in ontogeny of progressive specialisation rather than prewired structures. However, we argue that he slips from “speech” to “language” and that, in seeking homologies, these two levels need to be kept separate in the analysis of evolution and ontogeny.

Because Müiller fails to distinguish between two senses of the term “autonomy,” there is a danger that his results will be misinterpreted by both linguists and neuroscientists. Although he may very well have been successful in refuting one sense of autonomy, he may actually have helped to provide an explanation for the correctness of autonomy in its other sense.

Müller attempts to downplay cases of dissociation between language and cognition as evidence against the modularity of language. We review cases of associations between verbal and nonverbal abilities as further evidence against the notion of language as an autonomous subsystem. We also point out a discrepancy between his proposal of homologies between nonhuman primates' communication and human language and recent proposals on the evolution of language.

The conclusion that language is not really innate or modular is based on several fallacies. I show that the target article confuses communicative skills with linguistic abilities, and that its discussion of brain/language relations is replete with factual errors. I also criticize its attempt to contrast biological and linguistic principles. Finally, I argue that no case is made for the “alternative” approach proposed here.

The study of signed languages has inspired scientific' speculation regarding foundations of human language. Relationships between the acquisition of sign language in apes and man are discounted on logical grounds. Evidence from the differential hreakdown of sign language and manual pantomime places limits on the degree of overlap between language and nonlanguage motor systems. Evidence from functional magnetic resonance imaging reveals neural areas of convergence and divergence underlying signed and spoken languages.

Both autonomy and local specificity are compatible with observed interconnectivity at the cell level when considering two different levels: cell assemblies and brain systems. Early syntactic structuring processes in particular are likely to representan autonomous module in the language/brain system.

I enlarge on the theme that the brain mechanisms required for languageand other aspects of the human mind evolved through selective changes in the regulatory genes governing growth. Extension of the period of postnatal growth increases the role of the environment in structuring the brain, and spatiotemporal programming (heterochrony) ofgrowth might explain hierarchical representation, hemispheric specialization, and perhaps sex differences.

This article brings together two independent lines of research on numerally quantified expressions, e.g. two girls. One stems from work in linguistic theory and asks what truth conditional contributions such expressions make to the utterances in which they are used--in other words, what do numerals mean? The other comes from the study of language development and asks when and how children learn the meaning of such expressions. My goal is to show that when integrated, these two perspectives can both constrain (...) and enrich each other in ways hitherto not considered. Specifically, work in linguistic theory suggests that in addition to their 'exactly n' interpretation, numerally quantified NPs such as two hoops can also receive an 'at least n' and an 'at most n' interpretation, e.g. you need to put two hoops on the pole to win (i.e. at least two hoops) and you can miss two shots and still win (i.e. at most two shots). I demonstrate here through the results of three sets of experiments that by the age of 5 children have implicit knowledge of the fact that expressions like two N can be interpreted as 'at least two N' and 'at most two N' while they do not yet know the meaning of corresponding expressions such as at least/most two N which convey these senses explicitly. I show that these results have important implications for theories of the semantics of numerals and that they raise new questions for developmental accounts of the number vocabulary. (shrink)

Issues concerning UG access for L2 acquisition as formulated by Epstein et al. are misleading as well as poorly discussed. UG accessibility can only be fully evaluated with respect to the steady state gram mar reached by the learner. The steady state for LI learners is self evidently the adult grammar in the speech community. For L2 learners, however, the steady state is not obvious. Yet, without its clear characterization, debates concerning stages of L2 acquisition and direct and indirect UG (...) accessibility cannot be resolved. (shrink)

To what extent, if any, does Universal Grammar (UG) constrain second language (L2) acquisition? This is not only an empirical question, but one which is currently investigable. In this context, L2 acquisition is emerging as an important new domain of psycholinguistic research. Three logical possibilities have been articulated regarding the role of UG in L2 acquisition: The first is the hypothesis that claims that no aspect of UG is available to the L2 learner. The second is the hypothesis that claims (...) that only LI instantiated principles and LI instantiated parameter-values of UG are available to the learner. The third, called the hypothesis, asserts that UG in its entirety constrains L2 acquisition. (shrink)

Our response takes advantage of the wide-ranging commentary to clarify some aspects of our original proposal and augment others. We argue against the generative critics of our coevolutionary program for the language sciences, defend the use of close-to-surface models as minimizing cross-linguistic data distortion, and stress the growing role of stochastic simulations in making generalized historical accounts testable. These methods lead the search for general principles away from idealized representations and towards selective processes. Putting cultural evolution central in understanding language (...) diversity makes learning fundamental in the cognition of language: increasingly powerful models of general learning, paired with channelled caregiver input, seem set to manage language acquisition without recourse to any innate “universal grammar.” Understanding why human language has no clear parallels in the animal world requires a cross-species perspective: crucial ingredients are vocal learning (for which there are clear non-primate parallels) and an intention-attributing cognitive infrastructure that provides a universal base for language evolution. We conclude by situating linguistic diversity within a broader trend towards understanding human cognition through the study of variation in, for example, human genetics, neurocognition, and psycholinguistic processing. (shrink)

Talk of linguistic universals has given cognitive scientists the impression that languages are all built to a common pattern. In fact, there are vanishingly few universals of language in the direct sense that all languages exhibit them. Instead, diversity can be found at almost every level of linguistic organization. This fundamentally changes the object of enquiry from a cognitive science perspective. This target article summarizes decades of cross-linguistic work by typologists and descriptive linguists, showing just how few and unprofound the (...) universal characteristics of language are, once we honestly confront the diversity offered to us by the world's 6,000 to 8,000 languages. After surveying the various uses of “universal,” we illustrate the ways languages vary radically in sound, meaning, and syntactic organization, and then we examine in more detail the core grammatical machinery of recursion, constituency, and grammatical relations. Although there are significant recurrent patterns in organization, these are better explained as stable engineering solutions satisfying multiple design constraints, reflecting both cultural-historical factors and the constraints of human cognition.Linguistic diversity then becomes the crucial datum for cognitive science: we are the only species with a communication system that is fundamentally variable at all levels. Recognizing the true extent of structural diversity in human language opens up exciting new research directions for cognitive scientists, offering thousands of different natural experiments given by different languages, with new opportunities for dialogue with biological paradigms concerned with change and diversity, and confronting us with the extraordinary plasticity of the highest human skills. (shrink)

Inflectional morphology has been taken as a paradigmatic example of rule-governed grammatical knowledge (Pinker, 1999). The plausibility of this claim may be related to the fact that it is mainly based on studies of English, which has a very simple inflectional system. We examined the representation of inflectional morphology in Serbian, which encodes number, gender, and case for nouns. Linguists standardly characterize this system as a complex set of rules, with disagreements about their exact form. We present analyses of a (...) large corpus of nouns which showed that, as in English, Serbian inflectional morphology is quasiregular: It exhibits numerous partial regularities creating neighborhoods that vary in size and consistency. We then asked whether a simple connectionist network could encode this statistical information in a manner that also supported generalization. A network trained on 3,244 Serbian nouns learned to produce correctly inflected phonological forms from a specification of a word's lemma, gender, number, and case, and generalized to untrained cases. The model's performance was sensitive to variables that also influence human performance, including surface and lemma frequency. It was also influenced by inflectional neighborhood size, a novel measure of the consistency of meaning to form mapping. A word-naming experiment with native Serbian speakers showed that this measure also affects human performance. The results suggest that, as in English, generating correctly inflected forms involves satisfying a small number of simultaneous probabilistic constraints relating form and meaning. Thus, common computational mechanisms may govern the representation and use of inflectional information across typologically diverse languages. (shrink)

Natural language is full of patterns that appear to fit with general linguistic rules but are ungrammatical. There has been much debate over how children acquire these “linguistic restrictions,” and whether innate language knowledge is needed. Recently, it has been shown that restrictions in language can be learned asymptotically via probabilistic inference using the minimum description length (MDL) principle. Here, we extend the MDL approach to give a simple and practical methodology for estimating how much linguistic data are required to (...) learn a particular linguistic restriction. Our method provides a new research tool, allowing arguments about natural language learnability to be made explicit and quantified for the first time. We apply this method to a range of classic puzzles in language acquisition. We find some linguistic rules appear easily statistically learnable from language experience only, whereas others appear to require additional learning mechanisms (e.g., additional cues or innate constraints). (shrink)

Poverty of the Stimulus Arguments have convinced many linguists and philosophers of language that a domain specific language acquisition device (LAD) is necessary to account for language learning. Here we review empirical evidence that casts doubt on the necessity of this domain specific device. We suggest that more attention needs to be paid to the early stages of language acquisition. Many seemingly innate language-related abilities have to be learned over the course of several months. Further, the language input contains rich (...) stochastic information that can be accessed by domain-general learning mechanisms. Computer simulation has shown how mechanisms that are not domain specific can exploit the information contained in language. We conclude that (i) Poverty of the Stimulus Arguments need to be conceptually clarified and (ii) more empirical research needs to be carried out before we can rule out that data driven general purpose mechanisms can account for language learning. (shrink)

Evidence from aphasia is considered that leads to a distinction between abstract and concrete thought processes and hence for a distinction between rules and similarity. It is argued that perceptual classification is inherently a rule-following procedure and these rules are unable to be followed when a patient has difficulty with name comprehension and retrieval.

It is widely assumed that human learning and the structure of human languages are intimately related. This relationship is frequently suggested to derive from a language-specific biological endowment, which encodes universal, but communicatively arbitrary, principles of language structure (a Universal Grammar or UG). How might such a UG have evolved? We argue that UG could not have arisen either by biological adaptation or non-adaptationist genetic processes, resulting in a logical problem of language evolution. Specifically, as the processes of language change (...) are much more rapid than processes of genetic change, language constitutes a both over time and across different human populations, and, hence, cannot provide a stable environment to which language genes could have adapted. We conclude that a biologically determined UG is not evolutionarily viable. Instead, the original motivation for UG arises because language has been shaped to fit the human brain, rather than vice versa. Following Darwin, we view language itself as a complex and interdependent which evolves under selectional pressures from human learning and processing mechanisms. That is, languages themselves are shaped by severe selectional pressure from each generation of language users and learners. This suggests that apparently arbitrary aspects of linguistic structure may result from general learning and processing biases deriving from the structure of thought processes, perceptuo-motor factors, cognitive limitations, and pragmatics. (shrink)

Amidst the progress being made in the various (sub-)disciplines of the behavioural and brain sciences a somewhat neglected subject is the problem of how everything fits into one world and, derivatively, how the relation between different levels of discourse should be understood and to what extent different levels, domains, approaches, or disciplines are autonomous or dependent. In this paper I critically review the most recent proposals to specify the nature of interdiscourse relations, focusing on the concept of supervenience. Ideally supervenience (...) is a relation between different discourses which has all the advantages of reduction, but without its disadvantages. I apply the more abstract considerations to two concrete cases: schizophrenia and colour. Usually an interlevel or interdiscourse relation is seen as asymmetrical: the overlaying discourse depends on the underlying discourse (and not vice versa), where the out- or un-spoken assumption is that the ultimate underlying discourse is physical. Instead I argue that scientific categories referred to in interdiscourse relations are, ultimately, dependent on common sense categories and common sense normative criteria. It is the manifest categories and common sense ideas about what is reasonable and what is right that determine the relevant categorisations at the deeper, underlying levels. I suggest that the implications of this are not merely methodological or epistemological. (shrink)

For many years the evolution of language has been seen as a disreputable topic, mired in fanciful “just so stories” about language origins. However, in the last decade a new synthesis of modern linguistics, cognitive neuroscience and neo-Darwinian evolutionary theory has begun to make important contributions to our understanding of the biology and evolution of language. I review some of this recent progress, focusing on the value of the comparative method, which uses data from animal species to draw inferences about (...) language evolution. Discussing speech first, I show how data concerning a wide variety of species, from monkeys to birds, can increase our understanding of the anatomical and neural mechanisms underlying human spoken language, and how bird and whale song provide insights into the ultimate evolutionary function of language. I discuss the “descended larynx” of humans, a peculiar adaptation for speech that has received much attention in the past, which despite earlier claims is not uniquely human. Then I will turn to the neural mechanisms underlying spoken language, pointing out the difficulties animals apparently experience in perceiving hierarchical structure in sounds, and stressing the importance of vocal imitation in the evolution of a spoken language. Turning to ultimate function, I suggest that communication among kin (especially between parents and offspring) played a crucial but neglected role in driving language evolution. Finally, I briefly discuss phylogeny, discussing hypotheses that offer plausible routes to human language from a non-linguistic chimp-like ancestor. I conclude that comparative data from living animals will be key to developing a richer, more interdisciplinary understanding of our most distinctively human trait: language. (shrink)

In just a few years, children achieve a stable state of linguistic competence, making them effectively adults with respect to: understanding novel sentences, discerning relations of paraphrase and entailment, acceptability judgments, etc. One familiar account of the language acquisition process treats it as an induction problem of the sort that arises in any domain where the knowledge achieved is logically underdetermined by experience. This view highlights the cues that are available in the input to children, as well as childrens skills (...) in extracting relevant information and forming generalizations on the basis of the data they receive. Nativists, on the other hand, contend that language-learners project beyond their experience in ways that the input does not even suggest. Instead of viewing language acqusition as a special case of theory induction, nativists posit a Universal Grammar, with innately specified linguistic principles of grammar formation. The nature versus nurture debate continues, as various poverty of stimulus arguments are challenged or supported by developments in linguistic theory and by findings from psycholinguistic investigations of child language. In light of some recent challenges to nativism, we rehearse old poverty-of stimulus arguments, and supplement them by drawing on more recent work in linguistic theory and studies of child language. (shrink)

Nativists inspired by Chomsky are apt to provide arguments with the following general form: languages exhibit interesting generalizations that are not suggested by casual (or even intensive) examination of what people actually say; correspondingly, adults (i.e., just about anyone above the age of four) know much more about language than they could plausibly have learned on the basis of their experience; so absent an alternative account of the relevant generalizations and speakers' (tacit) knowledge of them, one should conclude that there (...) are substantive "universal" principles of human grammar and, as a result of human biology, children can only acquire languages that conform to these principles. According to Pullum and Scholz, linguists need not suppose that children are innately endowed with "specific contingent facts about natural languages." But Pullum and Scholz don't consider the kinds of facts that really impress nativists. Nor do they offer any plausible acquisition scenarios that would culminate in the acquisition of languages that exhibit the kinds of rich and interrelated generalizations that are exhibited by natural languages. As we stress, good poverty-of-stimulus arguments are based on specific principles - - confirmed by drawing on (negative and crosslinguistic) data unavailable to children -- that help explain a range of independently established linguistic phenomena. If subsequent psycholinguistic experiments show that very young children already know such principles, that strengthens the case for nativism; and if further investigation shows that children sometimes "try out" constructions that are unattested in the local language, but only if such constructions are attested in other human languages, then the case for nativism is made stronger still. We illustrate these points by considering an apparently disparate -- but upon closer inspection, interestingly related -- cluster of phenomena involving: negative polarity items, the interpretation of 'or', binding theory, and displays of Romance and Germanic constructions in child- English.. (shrink)

One of the classic debates in cognitive science is between nativism and empiricism about the development of psychological capacities. In principle, the debate is empirical. However, in practice nativist hypotheses have also been challenged for relying on an ill-defined, or even unscientific, notion of innateness as that which is “not learned”. Here this minimal conception of innateness is defended on four fronts. First, it is argued that the minimal conception is crucial to understanding the nativism-empiricism debate, when properly construed; Second, (...) various objections to the minimal conception—that it risks overgeneralization, lacks an account of learning, frustrates genuine explanations of psychological development, and fails to unify different notions of innateness across the sciences—are rebutted. Third, it is argued that the minimal conception avoids the shortcomings of primitivism, the prominent view that innate capacities are those that are not acquired via a psychological process in development. And fourth, the minimal conception undermines some attempts to identify innateness with a natural kind. So in short, we have little reason to reject, and good reason to accept, the minimal conception of innateness in cognitive science. (shrink)