Connectionism and classicism, it generally appears, have at least this much in common: both place some notion of internal representation at the heart of a scientific study of mind. In recent years, however, a much more radical view has gained increasing popularity. This view calls into question the commitment to internal representation itself. More strikingly still, this new wave of anti-representationalism is rooted not in armchair theorizing but in practical attempts to model and understand intelligent, adaptive behavior. In this paper (...) we first present, and then critically assess, a variety of recent anti-representationalist treatments. We suggest that so far, at least, the sceptical rhetoric outpaces both evidence and argument. Some probable causes of this premature scepticism are isolated. Nonetheless, the anti-representationalist challenge is shown to be both important and progressive insofar as it forces us to see beyond the bare representational/non-representational dichotomy and to recognize instead a rich continuum of degrees and types of representationality. (shrink)

Children learning to read in two different orthographic systems are exposed to cross-linguistic interferences. We explored the effects of school and grade on phonological activation during a visual word recognition task. Elementary school children from Spain completed a lexical decision task in English. The task included real words and pseudohomophones following Spanish or English phonological rules. Using the mouse-tracking paradigm, we analyzed errors, reaction times, and computer mouse movements. Children in the bilingual school performed better than children in the monolingual (...) school. Children in higher grades performed better than children in lower grades. The interference effect of Spanish phonology was weak and became weaker in higher grades. Spanish children differentiate between first and second language grapheme-to-phoneme correspondences since early on in the educational process. In 6th grade, children from the bilingual school responded better to words and Spanish pseudohomophones, while children from the monolingual school were less distracted by the English pseudohomophones. Children in the bilingual school had stronger inhibition of Spanish phonology and stronger activation of English phonology. Instructional method plays an important role on the processing strategies Spanish children rely on when reading in English. School and grade influence the link between orthographic and phonological representations. (shrink)

Several studies have highlighted that reading comprehension is determined by different linguistic skills: semantics, syntax, and morphology, in addition to one’s own competence in reading fluency. On the other hand, according to the Linguistic Interdependence Hypothesis, linguistic skills developed in one’s own native language facilitate the development of these skills in a second one. In this study, we wanted to explore the linguistic abilities that determine reading comprehension in Spanish and in English in Secondary Education students. To do this, 73 (...) Secondary Education Students participated in this study. The students carried out a battery of tasks in English and Spanish, all of them related to reading comprehension and different linguistic skills, which included syntactic awareness tasks, synonymy judgment tasks, and morphological awareness tasks. The results indicated a positive correlation between linguistic competencies in both languages, which were determined by school year, with a lower performance in the 1st year than in the 3rd year. Moreover, we found more skills with correlations in English reading comprehension than in Spanish. Finally, reading comprehension in L1 was mainly explained English reading comprehension, while English reading comprehension was predicted by grade, and syntactic awareness, as well as Spanish reading comprehension. This could be explained by the different levels of exposure to L1 and L2 of sample subjects, as the linguistic variables have different influences on the reading comprehension of both languages. (shrink)

A large body of psycholinguistic research demonstrates that both language processing and language acquisition are sensitive to the distributions of linguistic constructions in usage. Here we investigate how statistical distributions at different linguistic levels – morphological and lexical (Experiments 1 and 2), and phrasal (Experiment 2) – contribute to the ease with which morphosyntax is processed and produced by second language learners. We analyze Chinese ESL learners’ knowledge of four English inflectional morphemes:-ed,-ing, and third-person-son verbs, and plural-son nouns. In Elicited (...) Imitation Tasks, participants listened to length- and difficulty-matched sentences each containing one target morpheme and typed the whole sentence as accurately as they could after a short delay. Experiment 1 investigated lexical and morphemic levels, testing the hypotheses that a morpheme is expected to be more easily processed when it is (1) highlyavailable(i.e., occurring in frequent word-forms), and (2) highlyreliable(i.e., occurring in lemma words that are consistently conjugated in the form containing this morpheme). Thirty sentences were made for each morpheme, divided into three Availability-Reliability Distribution (ARD) groups on the basis of corpus analysis in the Corpus of Contemporary American English (COCA;Davies, 2008-): 10 target words high in availability, 10 high in reliability, and 10 low in both reliability and availability. Responses were scored on whether the target morpheme was accurately reproduced given the provision of the correct lemma. A generalized linear mixed-effects logit model (GLMM) revealed fixed effects of morpheme type, availability, and reliability on the accuracy of morpheme provision. There were no effects of lemma frequency. Experiment 2 successfully replicated these results and extended the investigation to explore phrasal formulaicity by manipulating the frequency of the four-word strings in which the morpheme was embedded. GLMMs replicated the effects of word-form availability and reliability and additionally revealed independentphrase-superiority effectswhere morphemes were better reproduced in contexts of higher string-frequency. Taken together, these findings demonstrate that morpheme acquisition reflects the distributional properties of learners’ experience and the mappings therein between lexis, morphology, phraseology, and semantics. These conclusions support an emergentist view of the statistical symbolic learning of morphology where language acquisition involves the satisfaction of competing constraints across multiple grain-sizes of units. (shrink)

This thesis investigates the representation of phonological language aspects in the healthy human brain, especially the contribution of the right hemisphere. Using functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS), it is demonstrated that the left and right supramarginal gyri are essential for phonological processing. It is also shown that the left as well as the right posterior inferior frontal gyri contribute to efficient phonological decisions. Finally, an fMRI study reveals a frontal network for phonological aspects of language (...) production. These results demonstrate a contribution of both hemispheres to efficient phonological aspects of language comprehension as well as production. Together, these results question the notion of a left-dominant network of brain regions for language processing. (shrink)

The effects of psycholinguistic variables on reading development are critical to the evaluation of theories about the reading system. Although we know that the development of reading depends on both individual differences (endogenous) and item-level effects (exogenous), developmental research has focused mostly on average-level performance, ignoring individual differences. We investigated how the development of word recognition in Chinese children in both Chinese and English is affected by (a) item-level, exogenous effects (word frequency, radical consistency, and curricular grade level); (b) subject-level, (...) endogenous individual differences (orthographic awareness and phonological awareness); and (c) their interactive effect. We tested native Chinese (Putonghua)-speaking children (n = 763) in grades 1 to 6 with both Chinese character and English word identification (lexical) decision tasks. Our findings show that (a) there were effects of both word frequency and age of acquisition in both Chinese and English, but these item-level effects generally weakened with increasing age; (b) individual differences in phonological and orthographic awareness each contributed to successful performance; and (c) in Chinese, item-level effects were weaker for more proficient readers. We contend that our findings can be explained by theoretical models that incorporate cumulative learning as the basis for development of item-level effects in the reading system. (shrink)

Inner speech emerges in early childhood, in parallel with the maturation of the dorsal language stream. To date, the developmental relations between these two processes have not been examined. We review evidence that the dorsal language stream has a role in supporting the psychological phenomenon of inner speech, before considering paediatric studies of the dorsal stream’s anatomical development and evidence for its emerging functional roles. We examine possible causal accounts of the relations between these two developmental processes, and consider their (...) implications for phylogenetic theories about the evolution of inner speech and the accounts of the ontogenetic relations between language and cognition. (shrink)

Memory is fleeting. New material rapidly obliterates previous material. How, then, can the brain deal successfully with the continual deluge of linguistic input? We argue that, to deal with this “Now-or-Never” bottleneck, the brain must compress and recode linguistic input as rapidly as possible. This observation has strong implications for the nature of language processing: (1) the language system must “eagerly” recode and compress linguistic input; (2) as the bottleneck recurs at each new representational level, the language system must build (...) a multilevel linguistic representation; and (3) the language system must deploy all available information predictively to ensure that local linguistic ambiguities are dealt with “Right-First-Time”; once the original input is lost, there is no way for the language system to recover. This is “Chunk-and-Pass” processing. Similarly, language learning must also occur in the here and now, which implies that language acquisition is learning to process, rather than inducing, a grammar. Moreover, this perspective provides a cognitive foundation for grammaticalization and other aspects of language change. Chunk-and-Pass processing also helps explain a variety of core properties of language, including its multilevel representational structure and duality of patterning. This approach promises to create a direct relationship between psycholinguistics and linguistic theory. More generally, we outline a framework within which to integrate often disconnected inquiries into language processing, language acquisition, and language change and evolution. (shrink)

Understanding spoken words involves a rapid mapping from speech to conceptual representations. One distributed feature-based conceptual account assumes that the statistical characteristics of concepts’ features—the number of concepts they occur in and likelihood of co-occurrence —determine conceptual activation. To test these claims, we investigated the role of distinctiveness/sharedness and correlational strength in speech-to-meaning mapping, using a lexical decision task and computational simulations. Responses were faster for concepts with higher sharedness, suggesting that shared features are facilitatory in tasks like lexical decision (...) that require access to them. Correlational strength facilitated responses for slower participants, suggesting a time-sensitive co-occurrence-driven settling mechanism. The computational simulation showed similar effects, with early effects of shared features and later effects of correlational strength. These results support a general-to-specific account of conceptual processing, whereby early activation of shared features is followed by the gradual emergence of a specific target representation. (shrink)

Research on psychopathy among incarcerated, Caucasian males has consistently demonstrated deficits in emotion processing and response inhibition. Using the PCL-R to classify participants as psychopathic or non-psychopathic, this study examined the performance of incarcerated, Caucasian females on two laboratory tasks: A lexical decision task used to assess emotion processing and a passive avoidance task used to assess response inhibition. Contrary to prediction, deficits in performance typically exhibited by psychopathic males were not exhibited by psychopathic females in this sample. Implications of (...) these findings are discussed and an interpretation of the results in the context of the Response Modulation Hypothesis is presented. (shrink)

Background -/- Previous literature suggests that those with reading disability (RD) have more pronounced deficits during semantic processing in reading as compared to listening comprehension. This discrepancy has been supported by recent neuroimaging studies showing abnormal activity in RD during semantic processing in the visual but not in the auditory modality. Whether effective connectivity between brain regions in RD could also show this pattern of discrepancy has not been investigated. Methodology/Principal Findings -/- Children (8- to 14-year-olds) were given a semantic (...) task in the visual and auditory modality that required an association judgment as to whether two sequentially presented words were associated. Effective connectivity was investigated using Dynamic Causal Modeling (DCM) on functional magnetic resonance imaging (fMRI) data. Bayesian Model Selection (BMS) was used separately for each modality to find a winning family of DCM models separately for typically developing (TD) and RD children. BMS yielded the same winning family with modulatory effects on bottom-up connections from the input regions to middle temporal gyrus (MTG) and inferior frontal gyrus(IFG) with inconclusive evidence regarding top-down modulations. Bayesian Model Averaging (BMA) was thus conducted across models in this winning family and compared across groups. The bottom-up effect from the fusiform gyrus (FG) to MTG rather than the top-down effect from IFG to MTG was stronger in TD compared to RD for the visual modality. The stronger bottom-up influence in TD was only evident for related word pairs but not for unrelated pairs. No group differences were noted in the auditory modality. Conclusions/Significance -/- This study revealed a modality-specific deficit for children with RD in bottom-up effective connectivity from orthographic to semantic processing regions. There were no group differences in connectivity from frontal regions, suggesting that the core deficit in RD is not in top-down modulation. (shrink)

Rumelhart and McClelland's chapter about learning the past tense created a degree of controversy extraordinary even in the adversarial culture of modern science. It also stimulated a vast amount of research that advanced the understanding of the past tense, inflectional morphology in English and other languages, the nature of linguistic representations, relations between language and other phenomena such as reading and object recognition, the properties of artificial neural networks, and other topics. We examine the impact of the Rumelhart and McClelland (...) model with the benefit of 25 years of hindsight. It is not clear who “won” the debate. It is clear, however, that the core ideas that the model instantiated have been assimilated into many areas in the study of language, changing the focus of research from abstract characterizations of linguistic competence to an emphasis on the role of the statistical structure of language in acquisition and processing. (shrink)

This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing (PDP), a two-volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary (...) developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes. (shrink)

A number of ways of taxonomizing human learning have been proposed. We examine the evidence for one such proposal, namely, that there exist independent explicit and implicit learning systems. This combines two further distinctions, between learning that takes place with versus without concurrent awareness, and between learning that involves the encoding of instances versus the induction of abstract rules or hypotheses. Implicit learning is assumed to involve unconscious rule learning. We examine the evidence for implicit learning derived from subliminal learning, (...) conditioning, artificial grammar learning, instrumental learning, and reaction times in sequence learning. We conclude that unconscious learning has not been satisfactorily established in any of these areas. The assumption that learning in some of these tasks is predominantly based on rule abstraction is questionable. When subjects cannot report the “implicitly learned” rules that govern stimulus selection, this is often because their knowledge consists of instances or fragments of the training stimuli rather than rules. In contrast to the distinction between conscious and unconscious learning, the distinction between instance and rule learning is a sound and meaningful way of taxonomizing human learning. We discuss various computational models of these two forms of learning. (shrink)

This Special Issue on Connectionist Models of Human Language Processing provides an opportunity for an appraisal both of specific connectionist models and of the status and utility of connectionist models of language in general. This introduction provides the background for the papers in the Special Issue. The development of connectionist models of language is traced, from their intellectual origins, to the state of current research. Key themes that arise throughout different areas of connectionist psycholinguistics are highlighted, and recent developments in (...) speech processing, morphology, sentence processing, language production, and reading are described. We argue that connectionist psycholinguistics has already had a significant impact on the psychology of language, and that connectionist models are likely to have an important influence on future research. (shrink)

This article provides an overview of a probabilistic constraints framework for thinking about language acquisition and processing. The generative approach attempts to characterize knowledge of language (i.e., competence grammar) and then asks how this knowledge is acquired and used. Our approach is performance oriented: the goal is to explain how people comprehend and produce utterances and how children acquire this skill. Use of language involves exploiting multiple probabilistic constraints over various types of linguistic and nonlinguistic information. Acquisition is the process (...) of accumulating this information, which begins in infancy. The constraint satisfaction processes that are central to language use are the same as the bootstrapping processes that provide entry to language for the child. Framing questions about acquisition in terms of models of adult performance unifies the two topics under a set of common principles and has important consequences for arguments concerning language learnability. (shrink)

Contrary to Müller's claims, and in support of modular theories, genetic factors play a substantial and significant role in language. The finding that some children with specific language impairment (SLI) have nonlinguistic impairments may reflect improper diagnosis of SLI or impairments that are secondary to linguistic impairments. Thus, such findings do not argue against the modularity thesis. The lexical/functional distinction appears to be innate and specifically linguistic and could be instantiated in either symbolic or connectionist systems.

Müller argues that general cognitive skills and linguistic skills are not necessarily independent. However, cross-linguistic evidence from an inherited specific language disorder affecting productive rules suggests significant degrees of modularity, innateness, and universality of language. Confident claims about the overall nature of such a complex system still await more interdisciplinary research.

Müller attempts to downplay cases of dissociation between language and cognition as evidence against the modularity of language. We review cases of associations between verbal and nonverbal abilities as further evidence against the notion of language as an autonomous subsystem. We also point out a discrepancy between his proposal of homologies between nonhuman primates' communication and human language and recent proposals on the evolution of language.

Müller misconstrues autonomy to mean strict locality of brain function, something quite different from the functional autonomy that linguists claim. Similarly, he misperceives the interaction of learned and innate components hypothesized in current generative models. Evidence from sign languages, Creole languages, and neurological studies of rare forms of aphasia also argues against his conclusions.