In this commentary, I examine the experiment reported by Epstein et al. in section 5. What I show here is that the experiment is so poorly executed that little, if anything, can be concluded from it regarding the role of UG in L2 acquisition.

I enlarge on the theme that the brain mechanisms required for languageand other aspects of the human mind evolved through selective changes in the regulatory genes governing growth. Extension of the period of postnatal growth increases the role of the environment in structuring the brain, and spatiotemporal programming (heterochrony) ofgrowth might explain hierarchical representation, hemispheric specialization, and perhaps sex differences.

The acquisition of English noun and verb morphology is modeled using a single-system connectionist network. The network is trained to produce the plurals and past tense forms of a large corpus of monosyllabic English nouns and verbs. The developmental trajectory of network performance is analyzed in detail and is shown to mimic a number of important features of the acquisition of English noun and verb morphology in young children. These include an initial error-free period of performance on both nouns and (...) verbs followed by a period of intermittent over-regularization of irregular nouns and verbs. Errors in the model show evidence of phonological conditioning and frequency effects. Furthermore, the network demonstrates a strong tendency to regularize denominal verbs and deverbal nouns and masters the principles of voicing assimilation. Despite their incorporation into a single-system network, nouns and verbs exhibit some important differences in their profiles of acquisition. Most importantly, noun inflections are acquired earlier than verb inflections. The simulations generate several empirical predictions that can be used to evaluate further the suitability of this type of cognitive architecture in the domain of inflectional morphology. (shrink)

This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing (PDP), a two-volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary (...) developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes. (shrink)

The target article advanced the null, unified and widely misinterpreted generative hypothesis regarding second language (L2) acquisition. Postulating that UG (Universal Grammar) constrains L2 knowledge growth does not entail identical developmental trajectories for L2 and first language (LI) acquisition; nor does it preclude a role for the L1. In embracing this hypothesis, we maintain a distinction between competence and performance. Those who conflate the two repeat fundamental and by no means unprecedented misconstruals of the generative enterprise, and more specifically, of (...) the empirical content of the null hypothesis regarding L2 linguistic knowledge growth. We hope to have identified certain common goals, the adoption of which might constitute a firm foundation for continued productive interdisciplinary development of contemporary theoretical and experimental L2 acquisition research. (shrink)

Epstein et al.'s theory of SLA is heavily dependent on assumptions about both the nature of the acquisition device and the grammar that it produces. This commentary briefly explores the consequences of an alternative set of assumptions, focusing on the possibility that the acquisition device does not include UG and that syntactic representations do not contain functional projections.

Curiously, two central areas are unaddressed by Epstein et al.: (i) L1A–L2A differences; (ii) L2 development. Here, findings relevant to (i) and (ii) – as well as their significance – are discussed. Together these form the basis for contesting Epstein et al.'s “Full Access” approach, but nonetheless analyses of the L2 data argue for UG-constrained L2A. Also discussed is the inadequacy of accounts (like Epstein et al.'s) without an explicit and prominent role for the L1.

The concepts of the innateness, universality, species-specificity, and autonomy of the human language capacity have had an extreme impact on the psycholinguistic debate for over thirty years. These concepts are evaluated from several neurobiological perspectives, with an emphasis on the emergence of language and its decay due to brain lesion and progressive brain disease.Evidence of perceptuomotor homologies and preadaptations for human language in nonhuman primates suggests a gradual emergence of language during hominid evolution. Regarding ontogeny, the innate component of language (...) capacity is likely to be polygenic and shared with other developmental domains. Dissociations between verbal and nonverbal development are probably rooted in the perceptuomotor specializations of neural substrates rather than the autonomy of a grammar module. Aphasiologicaldata often assumed to suggest modular linguistic subsystems can be accounted for in terms of a neurofunctional model incorporating perceptuomotor-based regional specializationsand distributivity of representations. Thus, dissociations between grammatical functors and content words are due to different conditions of acquisition and resulting differences in neural representation. Human brains are characterized by multifactorial interindividual variability, and strict universality of functional organization is biologically unrealistic.A theoretical alternative is proposed according to which (1) linguistic specialization of brain areas is due to epigenetic and probabilistic maturational events, not to genetic ”hard-wiring,” and (2) linguistic knowledge is neurally represented in distributed cell assemblies whose topography reflects the perceptuomotor modalities involved in the acquisition and use of a given item of knowledge. (shrink)

In a series of studies children show increasing mastery of irregular plural forms (such as mice) simply by producing erroneous over‐regularized versions of them (such as mouses). We explain this phenomenon in terms of successive approximation in imitation: Children over‐regularize early in acquisition because the representations of frequent, regular plural forms develop more quickly, such that at the earliest stages of production they interfere with children's attempts to imitatively reproduce irregular forms they have heard in the input. As the strength (...) of the representations that determine children's productions settle asymptotically, the early advantage for the frequent regular forms is negated, and children's attempts to imitate the irregular forms they have observed become more likely to succeed (a process that produces the classic U‐shape in children's acquisition of plural inflection). These data show that children can acquire correct linguistic behavior without feedback in a situation where, as a result of philosophical and linguistic analyses, it has often been argued that it is logically impossible for them to do so. (shrink)

In recent years, the family of algorithms collected under the term ``deep learning'' has revolutionized artificial intelligence, enabling machines to reach human-like performances in many complex cognitive tasks. Although deep learning models are grounded in the connectionist paradigm, their recent advances were basically developed with engineering goals in mind. Despite of their applied focus, deep learning models eventually seem fruitful for cognitive purposes. This can be thought as a kind of biological exaptation, where a physiological structure becomes applicable for a (...) function different from that for which it was selected. In this paper, it will be argued that it is time for cognitive science to seriously come to terms with deep learning, and we try to spell out the reasons why this is the case. First, the path of the evolution of deep learning from the connectionist project is traced, demonstrating the remarkable continuity, and the differences as well. Then, it will be considered how deep learning models can be useful for many cognitive topics, especially those where it has achieved performance comparable to humans, from perception to language. It will be maintained that deep learning poses questions that cognitive sciences should try to answer. One of such questions is the reasons why deep convolutional models that are disembodied, inactive, unaware of context, and static, are by far the closest to the patterns of activation in the brain visual system. (shrink)

Rumelhart and McClelland's chapter about learning the past tense created a degree of controversy extraordinary even in the adversarial culture of modern science. It also stimulated a vast amount of research that advanced the understanding of the past tense, inflectional morphology in English and other languages, the nature of linguistic representations, relations between language and other phenomena such as reading and object recognition, the properties of artificial neural networks, and other topics. We examine the impact of the Rumelhart and McClelland (...) model with the benefit of 25 years of hindsight. It is not clear who “won” the debate. It is clear, however, that the core ideas that the model instantiated have been assimilated into many areas in the study of language, changing the focus of research from abstract characterizations of linguistic competence to an emphasis on the role of the statistical structure of language in acquisition and processing. (shrink)

The role of metalinguistic ability in L2 development is seriously underestimated. It may be seen both (1) as a means of initiating or boosting the flow of primary linguistic data and (2) as a generator of substitute knowledge (derived, but epistemologically distinct from domain-specific knowledge) that may compete with or compensate for perceived gaps in the learners current underlying competence. It cannot serve as a simple means of distinguishing the rival theoretical positions.

Children in a given linguistic environment all uniformly acquire their target language, but adult learners of L2 do not. UG accounts for children's uniform linguistic behavior, but it cannot serve a similar role in accounting for adult learners' linguistic behavior. I argue that Epstein etal.'s study does not answer the question of why L2 learners end up with nonuniform and imperfect linguistic competence in learning a second language.

Segregated neural circuits that effect particular domain-specific behaviors can be differentiated from neuroanatomical structures implicated in many different aspects of behavior. The basal ganglionic components of circuits regulating nonlinguistic motor behavior, speech, and syntax all function in a similar manner. Hence, it is unlikely that special properties and evolutionary mechanisms are associated with the neural bases of human language.

Müller's review of the neuroscientific evidence undermines nativist claims for autonomous syntax and the argument from the poverty of the stimulus. Generativists will appeal to data from language acquisition, but here too there is growing evidence against the nativist position. Epigenetic naturalism, the developmental alternative to nativism, can be extended to epigenetic socionaturalism, acknowledging the importance of sociocultural processes in language and cognitive development.

Müller argues that double dissociations do not imply underlying modularity of the cognitive system, citing neural networks as examples of fully distributed systems that can give rise to double dissociations. We challenge this claim, noting that suchdouble dissociations typically do not “scale-up,” and that even some singledissociations can be difficult to account for in a distributed system.

I consider the role of cognitive modeling in cognitive science. Modeling, and the computers that enable it, are central to the field, but the role of modeling is often misunderstood. Models are not intended to capture fully the processes they attempt to elucidate. Rather, they are explorations of ideas about the nature of cognitive processes. In these explorations, simplification is essential—through simplification, the implications of the central ideas become more transparent. This is not to say that simplification has no downsides; (...) it does, and these are discussed. I then consider several contemporary frameworks for cognitive modeling, stressing the idea that each framework is useful in its own particular ways. Increases in computer power (by a factor of about 4 million) since 1958 have enabled new modeling paradigms to emerge, but these also depend on new ways of thinking. Will new paradigms emerge again with the next 1,000‐fold increase? (shrink)

The acquisition of English noun and verb morphology is modeled using a single-system connectionist network. The network is trained to produce the plurals and past tense forms of a large corpus of monosyllabic English nouns and verbs. The developmental trajectory of network performance is analyzed in detail and is shown to mimic a number of important features of the acquisition of English noun and verb morphology in young children. These include an initial error-free period of performance on both nouns and (...) verbs followed by a period of intermittent over-regularization of irregular nouns and verbs. Errors in the model show evidence of phonological conditioning and frequency effects. Furthermore, the network demonstrates a strong tendency to regularize denominal verbs and deverbal nouns and masters the principles of voicing assimilation. Despite their incorporation into a single-system network, nouns and verbs exhibit some important differences in their profiles of acquisition. Most importantly, noun inflections are acquired earlier than verb inflections. The simulations generate several empirical predictions that can be used to evaluate further the suitability of this type of cognitive architecture in the domain of inflectional morphology. (shrink)

Our results support the idea that adults have access to the principles and parameters of Universal Grammar (UG), contrary to Epstein et al.'s misrepresentation of our work as involvingpartial access toUG. For both LI and L2 acquisition, functional projections appear to develop in a gradual fashion, but in L2 acquisition there ispartial transferin that the lowest projection (VP) is transferred from the speaker's LI.

Epstein et al. attribute second language learning to the forces of transfer and language universals. They show that transfer is minimally involved in certain types of learning and therefore conclude that universals are involved. However, they forget to consider the important role of learning in second language acquisition.

We argue that the model developed in Epstein et al.'s target article does not explain differences between child first language (LI) acquisition and adult second language (L2) acquisition. We therefore sketch an alternative view, originally developed in Clahsen and Muysken (1989), in the light of new empirical findings and theoretical developments.

The current conception of the relation between UG and the grammar of a language rules out the no-access hypothesis, but does not distinguish between the full-access and partial-access hypotheses. The former raises the issue of why language acquisition in child and adult should be so different. The evidence presented in Epstein et al.'s target article seems inconclusive regarding a choice between hypotheses.

Müller provides a valuable synthesis of neurobiological evidence on the epigenetic development of neural structures involved in language acquisition. The pluripotentiality of developing neural tissue crucially constrains linguistic/cognitive theorizing about supposedly innate neural mechanisms and contributes significantly to our understanding of experience–dependent processes involved in language acquisition. Without this understanding, any proposed explanation of language acquisition is suspect.

The study of signed languages has inspired scientific' speculation regarding foundations of human language. Relationships between the acquisition of sign language in apes and man are discounted on logical grounds. Evidence from the differential hreakdown of sign language and manual pantomime places limits on the degree of overlap between language and nonlanguage motor systems. Evidence from functional magnetic resonance imaging reveals neural areas of convergence and divergence underlying signed and spoken languages.

Müller argues that general cognitive skills and linguistic skills are not necessarily independent. However, cross-linguistic evidence from an inherited specific language disorder affecting productive rules suggests significant degrees of modularity, innateness, and universality of language. Confident claims about the overall nature of such a complex system still await more interdisciplinary research.

Müller attempts to downplay cases of dissociation between language and cognition as evidence against the modularity of language. We review cases of associations between verbal and nonverbal abilities as further evidence against the notion of language as an autonomous subsystem. We also point out a discrepancy between his proposal of homologies between nonhuman primates' communication and human language and recent proposals on the evolution of language.

Comments on G. Marcus' criticisms (see record 1996-24670-001) of K. Plunkett's and V. Marcham's (see record 1994-35650-001) connectionist account of the acquisition of the English past tense (verb morphology). The original model is reviewed. Graphing, overregularization, and other criticisms are addressed (PsycINFO Database Record (c) 2000 APA, all rights reserved).

What is the interaction between storage and computation in language processing? What is the psychological status of grammatical rules? What are the relative strengths of connectionist and symbolic models of cognition? How are the components of language implemented in the brain? The English past tense has served as an arena for debates on these issues. We defend the theory that irregular past-tense forms are stored in the lexicon, a division of declarative memory, whereas regular forms can be computed by a (...) concatenation rule, which requires the procedural system. Irregulars have the psychological, linguistic and neuropsychological signatures of lexical memory, whereas regulars often have the signatures of grammatical processing. Furthermore, because regular inflection is rule-driven, speakers can apply it whenever memory fails. (shrink)

The study of human intelligence was once dominated by symbolic approaches, but over the last 30 years an alternative approach has arisen. Symbols and processes that operate on them are often seen today as approximate characterizations of the emergent consequences of sub- or nonsymbolic processes, and a wide range of constructs in cognitive science can be understood as emergents. These include representational constructs (units, structures, rules), architectural constructs (central executive, declarative memory), and developmental processes and outcomes (stages, sensitive periods, neurocognitive (...) modules, developmental disorders). The greatest achievements of human cognition may be largely emergent phenomena. It remains a challenge for the future to learn more about how these greatest achievements arise and to emulate them in artificial systems. (shrink)

As children gradually master grammatical rules, they often go through a period of producing form‐meaning associations that were not observed in the input. For example, 2‐ to 3‐year‐old English‐learning children use the bare form of verbs in settings that require obligatory past tense meaning while already starting to produce the grammatical –ed inflection. While many studies have focused on overgeneralization errors, fewer studies have attempted to explain the root of this earlier stage of rule acquisition. In this work, we use (...) computational modeling to replicate children's production behavior prior to the generalization of past tense production in English. We illustrate how seemingly erroneous productions emerge in a model, without being licensed in the grammar and despite the model aiming at conforming to grammatical forms. Our results show that bare form productions stem from a tension between two factors: (1) trying to produce a less frequent meaning (the past tense) and (2) being unable to restrict the production of frequent forms (the bare form) as learning progresses. Like children, our model goes through a stage of bare form production and then converges on adult‐like production of the regular past tense, showing that these different stages can be accounted for through a single learning mechanism. (shrink)

Epstein, Flynn, and Martohardjono's presentation of the principal approaches to UG access in L2 acquisition is misleading; they have neglected the possibility that the L1 grammar forms the learner's initial representation of the L2, with subsequent modifications constrained by UG. Furthermore, their experimental data are open to several interpretations and are consistent with a number of different positions in the field.

Connectionist models aiming to reveal the mechanisms of atypical development must in their undamaged form constitute plausible models of normal development and follow a developmental trajectory that matches empirical data. Constructivist models that adapt their structure to the learning task satisfy this demand. They are therefore more informative in the study of atypical development than the static models employed by Thomas & Karmiloff-Smith (T&K-S).

One can disagree with Müller that it is neurobiologically questionable to suppose that human language is innate, specialized, and species-specific, yet agree that the precise brain mechanisms controlling language in any individual will be influenced by epigenesis and genetic variability, and that the interplay between inherited and acquired aspects of linguistic capacity deserves to be investigated.

This target article is mostly a presentation of experimental research devoted to the larger issue of the role of Universal Grammar in second language learning. Deliberately excluding the aspects of human cognition that makes second language (L2) so variant, Epstein et al. focus on what the learners may know and how they come to know it. This is the aspect of Epstein et al.'s work which is more limiting, and potentially more interesting.

While child language development theory must explain invariant “success,” foreign language learning theory must explain variation and lack of success. The fundamental difference hypothesis (FDH) outlines such a theory. Epstein et al. ignore the explanatory burden, mischaracterize the FDH, and underestimate the resources of human cognition. The field of second language acquisition is not divided into camps by views on “access” to UG.

Epstein et al. fail to show that L2 learners have full access to UG because they do not explain the relationship between UG and functional categories (FCs). Nor do they provide an explanation of why learners with (supposed) full knowledge of FCs fail to use them in a native-like way.

This commentary addresses two pervasive misconceptions which emerge in Epstein et al.'s target article: (1) that study of second language acquisition (SLA) began in the mid-twentieth century; (2) that SLA has only recently become able to contribute to linguistic theory. There is abundant historical counterevidence; I argue that (1) and (2) obscure the legitimacy of Epstein et al.'s “full access” hypothesis.

It is often assumed that similar domain-specific behavioural impairments found in cases of adult brain damage and developmental disorders correspond to similar underlying causes, and can serve as convergent evidence for the modular structure of the normal adult cognitive system. We argue that this correspondence is contingent on an unsupported assumption that atypical development can produce selective deficits while the rest of the system develops normally (Residual Normality), and that this assumption tends to bias data collection in the field. Based (...) on a review of connectionist models of acquired and developmental disorders in the domains of reading and past tense, as well as on new simulations, we explore the computational viability of Residual Normality and the potential role of development in producing behavioural deficits. Simulations demonstrate that damage to a developmental model can produce very different effects depending on whether it occurs prior to or following the training process. Because developmental disorders typically involve damage prior to learning, we conclude that the developmental process is a key component of the explanation of endstate impairments in such disorders. Further simulations demonstrate that in simple connectionist learning systems, the assumption of Residual Normality is undermined by processes of compensation or alteration elsewhere in the system. We outline the precise computational conditions required for Residual Normality to hold in development, and suggest that in many cases it is an unlikely hypothesis. We conclude that in developmental disorders, inferences from behavioural deficits to underlying structure crucially depend on developmental conditions, and that the process of ontogenetic development cannot be ignored in constructing models of developmental disorders. Key Words: Acquired and developmental disorders; connectionist models; modularity; past tense; reading. (shrink)

Contrary to Müller's claims, and in support of modular theories, genetic factors play a substantial and significant role in language. The finding that some children with specific language impairment (SLI) have nonlinguistic impairments may reflect improper diagnosis of SLI or impairments that are secondary to linguistic impairments. Thus, such findings do not argue against the modularity thesis. The lexical/functional distinction appears to be innate and specifically linguistic and could be instantiated in either symbolic or connectionist systems.

Regularly inflected forms often behave differently in language production than irregular forms. These differences are often used to argue that irregular forms are listed in the lexicon but regular forms are produced by rule. Using an experimental speech production task with adults, it is shown that overtensing errors, where a tensed verb is used in place of an infinitive, predominantly involve irregular forms, but that the differences may be due to phonological confounds, not to regularity per se. Errors involve vowel‐changing (...) irregular forms more than suffixing inflected forms, with at best a small difference between regular ‐ed and irregular ‐en. Frequency effects on overtensing errors require a model in which the past‐tense and base forms of the verb are in competition and in which activation functions are nonlinear, and rule out models with specialized subnetworks for past‐tense forms. Implications for theories of language production are discussed. (shrink)

The most compelling evidence for Epstein et al.'s central thesis that adult second language acquisition is constrained by the innate cognitive structures that constrain native language acquisition would be evidence of poverty of the stimulus. Although there are studies that point to such evidence, Epstein et al.'s primary form of argumentation, targetlike performance by second-language acquiring adults, is much less convincing.

Epstein et al.'s “full access to Universal Grammar” position is conceptually and empirically problematic. Its shortcomings are illustrated through a brief discussion of the following issues: (1) initial versus final states of grammatical knowledge in a second language, (2) knowledge of gradience of grainmaticality, (3) optionality and retention in non-native grammars, and (4) the empirical measurement of syntactic knowledge.

Evidence is presented from a polyglot savant to suggest that double dissociations between linguistic and nonverbal abilities are more important than Müller's target article implies. It is also argued that the special nature of syntax makes its assimilation to other aspects of language or to nonhuman communication systems radically implausible.