Naturally occurring speech contains only a limited amount of complex recursive structure, and this is reflected in the empirically documented difficulties that people experience when processing such structures. We present a connectionist model of human performance in processing recursive language structures. The model is trained on simple artificial languages. We find that the qualitative performance profile of the model matches human behavior, both on the relative difficulty of center‐embedding and cross‐dependency, and between the processing of these complex recursive structures and (...) right‐branching recursive constructions. We analyze how these differences in performance are reflected in the internal representations of the model by performing discriminant analyses on these representations both before and after training. Furthermore, we show how a network trained to process recursive structures can also generate such structures in a probabilistic fashion. This work suggests a novel explanation of people's limited recursive performance, without assuming the existence of a mentally represented competence grammar allowing unbounded recursion. (shrink)

Many theorists have dismissed a priori the idea that distributional information could play a significant role in syntactic category acquisition. We demonstrate empirically that such information provides a powerful cue to syntactic category membership, which can be exploited by a variety of simple, psychologically plausible mechanisms. We present a range of results using a large corpus of child‐directed speech and explore their psychological implications. While our results show that a considerable amount of information concerning the syntactic categories can be obtained (...) from distributional information alone, we stress that many other sources of information may also be potential contributors to the identification of syntactic classes. (shrink)

While the study of implicit learning is nothing new, the field as a whole has come to embody — over the last decade or so — ongoing questioning about three of the most fundamental debates in the cognitive sciences: The nature of consciousness, the nature of mental representation (in particular the difficult issue of abstraction), and the role of experience in shaping the cognitive system. Our main goal in this chapter is to offer a framework that attempts to integrate current (...) thinking about these three issues in a way that specifically links consciousness with adaptation and learning. Our assumptions about this relationship are rooted in further assumptions about the nature of processing and of representation in cognitive systems. When considered together, we believe that these assumptions offer a new perspective on the relationships between conscious and unconscious processing and on the function of consciousness in cognitive systems. (shrink)

People tend to perceive ongoing continuous activity as series of discrete events. This partitioning of continuous activity may occur, in part, because events correspond to dynamic patterns that have recurred across different contexts. Recurring patterns may lead to reliable sequential dependencies in observers' experiences, which then can be used to guide perception. The current set of simulations investigated whether this statistical structure within events can be used 1) to develop stable internal representations that facilitate perception and 2) to learn when (...) to update such representations in a self-organizing manner. These simulations demonstrate that experience with recurring patterns enables a system to accurately predict upcoming stimuli within an event, to identify boundaries between such events based on transient increases in prediction error, and to use such boundaries to improve prediction about subsequent activities. (shrink)

Natural languages contain many layers of sequential structure, from the distribution of phonemes within words to the distribution of phrases within utterances. However, most research modeling language acquisition using artificial languages has focused on only one type of distributional structure at a time. In two experiments, we investigated adult learning of an artificial language that contains dependencies between both adjacent and non-adjacent words. We found that learners rapidly acquired both types of regularities and that the strength of the adjacent statistics (...) influenced learning of both adjacent and non-adjacent dependencies. Additionally, though accuracy was similar for both types of structure, participants’ knowledge of the deterministic non-adjacent dependencies was more explicit than their knowledge of the probabilistic adjacent dependencies. The results are discussed in the context of current theories of statistical learning and language acquisition. (shrink)

Consciousness remains a mystery—“a phenomenon that people do not know how to think about—yet” (Dennett, , p. 21). Here, I consider how the connectionist perspective on information processing may help us progress toward the goal of understanding the computational principles through which conscious and unconscious processing differ. I begin by delineating the conceptual challenges associated with classical approaches to cognition insofar as understanding unconscious information processing is concerned, and to highlight several contrasting computational principles that are constitutive of the connectionist (...) approach. This leads me to suggest that conscious and unconscious processing are fundamentally connected, that is, rooted in the very same computational principles. I further develop a perspective according to which the brain continuously and unconsciously learns to redescribe its own activity itself based on constant interaction with itself, with the world, and with other minds. The outcome of such interactions is the emergence of internal models that are metacognitive in nature and that function so as to make it possible for an agent to develop a (limited, implicit, practical) understanding of itself. In this light, plasticity and learning are constitutive of what makes us conscious, for it is in virtue of our own experiences with ourselves and with other people that our mental life acquires its subjective character. The connectionist framework continues to be uniquely positioned in the Cognitive Sciences to address the challenge of identifying what one could call the “computational correlates of consciousness” (Mathis & Mozer, ) because it makes it possible to focus on the mechanisms through which information processing takes place. (shrink)

The hallmark of implicit learning is that complex knowledge can be acquired unconsciously. The second order conditionals of Reed and Johnson were developed to be complex, and they are popular materials for implicit learning research. Recently, it was demonstrated that in a sequence made noisy , shared features of the SOCs may be learned explicitly . What are these shared features? We hypothesized that low reversal frequency may play a significant role. We have varied reversal frequency, and discovered that reversal (...) frequency affected response times, inclusion exclusion behavior, and recognition ratings. Not only does it appear to be important to distinguish implicit and explicit knowledge, but also to distinguish what the knowledge is of. (shrink)

Eliminative materialism is a popular view of the mind which holds that propositional attitudes, the typical units of our traditional understanding, are unsupported by modern connectionist psychology and neuroscience, and consequently that propositional attitudes are a poor scientific postulate, and do not exist. Since our traditional folk psychology employs propositional attitudes, the usual argument runs, it too represents a poor theory, and may in the future be replaced by a more successful neurologically grounded theory, resulting in a drastic improvement in (...) our interpersonal relationships. I contend that these eliminativist arguments typically run together two distinct capacities: the folk psychological mechanisms which we use to understand one another, and scientific and philosophical guesses about the structure of those understandings. Both capacities are ontologically committed and therefore empirical. However, the commitments whose prospects look so dismal to the eliminativist, in particular the causal and logical image of propositional attitudes, belong to the guesses, and not necessarily to the underlying mechanisms. It is the commitments of traditional philosophical perspectives about the operation of our folk psychology which are contradicted by␣new evidence and modeling methods in connectionist psychology. Our actual folk psychology was not clearly committed to causal, sentential propositional attitudes, and thus is not directly threatened by connectionist psychology. (shrink)