This book is an outstanding contribution to the philosophical study of language and mind, by one of the most influential thinkers of our time. In a series of penetrating essays, Chomsky cuts through the confusion and prejudice which has infected the study of language and mind, bringing new solutions to traditional philosophical puzzles and fresh perspectives on issues of general interest, ranging from the mind-body problem to the unification of science. Using a range of imaginative and deceptively simple linguistic analyses, (...) Chomsky defends the view that knowledge of language is internal to the human mind. He argues that a proper study of language must deal with this mental construct. According to Chomsky, therefore, human language is a 'biological object' and should be analyzed using the methodology of the sciences. His examples and analyses come together in this book to give a unique and compelling perspective on language and the mind. (shrink)

In this book, Newell makes the case for unified theories by setting forth a candidate.

We discuss the role of synchrony of activationin higher-level cognitive processes. Inparticular, we analyze the question of whethersynchrony of activation provides a mechanismfor compositional representation in neuralsystems. We will argue that synchrony ofactivation does not provide a mechanism forcompositional representation in neural systems.At face value, one can identify a level ofcompositional representation in the models thatintroduce synchrony of activation for thispurpose. But behavior in these models isalways produced by means conjunctiverepresentations in the form of coincidencedetectors. Therefore, models that rely onsynchrony (...) of activation lack the systematicityand productivity of true compositional systems.As a result, they cannot distinguish betweentype and token representations, which resultsin misrepresentations of spatial relations andpropositions. Furthermore, higher-levelcognitive processes will likely integrateinformation from widely distributed areas inthe brain, which puts severe restrictions onthe underlying neural dynamics if synchrony ofactivation is to play a role in theseprocesses. We will briefly discuss theserestrictions in the case of feature binding invisual cognition. (shrink)

Pulvermüller assumes that words are represented as associations of two cell assemblies formed according to Hebb's coincidence rule. This seems to correspond to the linguistic notion that words consist of lexemes connected to lemmas. Standard examples from theoretical linguistics, however, show that lemmas and lexemes have properties that go beyond coincidence-based assemblies. In particular, they are inherently disposed toward combinatorial operations; push-down storage, modelled by decreasing reverberation in cell assemblies, cannot capture this. Hence, even if the language capacity has an (...) associationist characterization at some level, it cannot just be co-occurrence-based assembly formation. (shrink)

Human agents draw a variety of inferences effortlessly, spontaneously, and with remarkable efficiency – as though these inferences were a reflexive response of their cognitive apparatus. Furthermore, these inferences are drawn with reference to a large body of background knowledge. This remarkable human ability seems paradoxical given the complexity of reasoning reported by researchers in artificial intelligence. It also poses a challenge for cognitive science and computational neuroscience: How can a system of simple and slow neuronlike elements represent a large (...) body of systemic knowledge and perform a range of inferences with such speed? We describe a computational model that takes a step toward addressing the cognitive science challenge and resolving the artificial intelligence paradox. We show how a connectionist network can encode millions of facts and rules involving n-ary predicates and variables and perform a class of inferences in a few hundred milliseconds. Efficient reasoning requires the rapid representation and propagation of dynamic bindings. Our model (which we refer to as SHRUTI) achieves this by representing (1) dynamic bindings as the synchronous firing of appropriate nodes, (2) rules as interconnection patterns that direct the propagation of rhythmic activity, and (3) long-term facts as temporal pattern-matching subnetworks. The model is consistent with recent neurophysiological evidence that synchronous activity occurs in the brain and may play a representational role in neural information processing. The model also makes specific psychologically significant predictions about the nature of reflexive reasoning. It identifies constraints on the form of rules that may participate in such reasoning and relates the capacity of the working memory underlying reflexive reasoning to biological parameters such as the lowest frequency at which nodes can sustain synchronous oscillations and the coarseness of synchronization. (shrink)

This paper explores the difference between Connectionist proposals for cognitive a r c h i t e c t u r e a n d t h e s o r t s o f m o d e l s t hat have traditionally been assum e d i n c o g n i t i v e s c i e n c e . W e c l a i m t h a t t h (...) e m a j o r d i s t i n c t i o n i s t h a t , w h i l e b o t h Connectionist and Classical architectures postulate representational mental states, the latter but not the former are committed to a symbol-level of representation, or to a ‘language of thought’: i.e., to representational states that have combinatorial syntactic and semantic structure. Several arguments for combinatorial structure in mental representations are then reviewed. These include arguments based on the ‘systematicity’ of mental representation: i.e., on the fact that cognitive capacities always exhibit certain symmetries, so that the ability to entertain a given thought implies the ability to entertain thoughts with semantically related contents. We claim that such arguments make a powerful case that mind/brain architecture is not Connectionist at the cognitive level. We then consider the possibility that Connectionism may provide an account of the neural (or ‘abstract neurological’) structures in which Classical cognitive architecture is implemented. We survey a n u m b e r o f t h e s t a n d a r d a r g u m e n t s t h a t h a v e b e e n o f f e r e d i n f a v o r o f Connectionism, and conclude that they are coherent only on this interpretation. (shrink)

There has been much discussion recently about the scope and limits of purely symbolic models of the mind and about the proper role of connectionism in cognitive modeling. This paper describes the symbol grounding problem : How can the semantic interpretation of a formal symbol system be made intrinsic to the system, rather than just parasitic on the meanings in our heads? How can the meanings of the meaningless symbol tokens, manipulated solely on the basis of their shapes, be grounded (...) in anything but other meaningless symbols? The problem is analogous to trying to learn Chinese from a Chinese/Chinese dictionary alone. A candidate solution is sketched: Symbolic representations must be grounded bottom-up in nonsymbolic representations of two kinds: iconic representations, which are analogs of the proximal sensory projections of distal objects and events, and categorical representations, which are learned and innate feature-detectors that pick out the invariant features of object and event categories from their sensory projections. Elementary symbols are the names of these object and event categories, assigned on the basis of their categorical representations. Higher-order symbolic representations, grounded in these elementary symbols, consist of symbol strings describing category membership relations. Connectionism is one natural candidate for the mechanism that learns the invariant features underlying categorical representations, thereby connecting names to the proximal projections of the distal objects they stand for. In this way connectionism can be seen as a complementary component in a hybrid nonsymbolic/symbolic model of the mind, rather than a rival to purely symbolic modeling. Such a hybrid model would not have an autonomous symbolic module, however; the symbolic functions would emerge as an intrinsically dedicated symbol system as a consequence of the bottom-up grounding of categories ' names in their sensory representations. Symbol manipulation would be governed not just by the arbitrary shapes of the symbol tokens, but by the nonarbitrary shapes of the icons and category invariants in which they are grounded. (shrink)

Prior to the twentieth century, theories of knowledge were inherently perceptual. Since then, developments in logic, statis- tics, and programming languages have inspired amodal theories that rest on principles fundamentally different from those underlying perception. In addition, perceptual approaches have become widely viewed as untenable because they are assumed to implement record- ing systems, not conceptual systems. A perceptual theory of knowledge is developed here in the context of current cognitive science and neuroscience. During perceptual experience, association areas in the (...) brain capture bottom-up patterns of activation in sensory-motor areas. Later, in a top-down manner, association areas partially reactivate sensory-motor areas to implement perceptual symbols. The stor- age and reactivation of perceptual symbols operates at the level of perceptual components – not at the level of holistic perceptual expe- riences. Through the use of selective attention, schematic representations of perceptual components are extracted from experience and stored in memory (e.g., individual memories of green, purr, hot). As memories of the same component become organized around a com- mon frame, they implement a simulator that produces limitless simulations of the component (e.g., simulations of purr). Not only do such simulators develop for aspects of sensory experience, they also develop for aspects of proprioception (e.g., lift, run) and introspec- tion (e.g., compare, memory, happy, hungry). Once established, these simulators implement a basic conceptual system that represents types, supports categorization, and produces categorical inferences. These simulators further support productivity, propositions, and ab- stract concepts, thereby implementing a fully functional conceptual system. Productivity results from integrating simulators combinato- rially and recursively to produce complex simulations. Propositions result from binding simulators to perceived individuals to represent type-token relations. Abstract concepts are grounded in complex simulations of combined physical and introspective events. Thus, a per- ceptual theory of knowledge can implement a fully functional conceptual system while avoiding problems associated with amodal sym- bol systems. Implications for cognition, neuroscience, evolution, development, and artificial intelligence are explored. (shrink)

Little, Brown, 1992 Review by Glenn Branch on Jul 5th 1999 Volume: 3, Number: 27.

Naturally occurring speech contains only a limited amount of complex recursive structure, and this is reflected in the empirically documented difficulties that people experience when processing such structures. We present a connectionist model of human performance in processing recursive language structures. The model is trained on simple artificial languages. We find that the qualitative performance profile of the model matches human behavior, both on the relative difficulty of center‐embedding and cross‐dependency, and between the processing of these complex recursive structures and (...) right‐branching recursive constructions. We analyze how these differences in performance are reflected in the internal representations of the model by performing discriminant analyses on these representations both before and after training. Furthermore, we show how a network trained to process recursive structures can also generate such structures in a probabilistic fashion. This work suggests a novel explanation of people's limited recursive performance, without assuming the existence of a mentally represented competence grammar allowing unbounded recursion. (shrink)

A provocative assessment of human thought and behavior, reissued with a new afterword, explores a range of conundrums from the ability of the mind to perceive three dimensions to the nature of consciousness, in an account that draws on ...

For the uninitiated, there are two major tendencies in the modeling of human cognition. The older, tradtional school believes, in essence, that full human cognition can be modeled by dividing the world up into distinct entities -- called __symbol s__-- such as “dog”, “cat”, “run”, “bite”, “happy”, “tumbleweed”, and so on, and then manipulating this vast set of symbols by a very complex and very subtle set of rules. The opposing school claims that this system, while it might be good (...) at concluding that Paris is the capital of France or that there must be blood flowing in the left-rear leg of a cow, can never capture the full measure -- indeed, the essence -- of human cognition. For them, the essential features of cognition emerge from the combined effects of myriad, tiny actions far below the surface of consciousness. This is the camp to which Paul Churchland belongs. (shrink)

The first comprehensive presentation of the dynamical approach to cognition. It contains a representative sampling of original, current research on topics such as perception, motor control, speech and language, decision making, and development.

1 Cognitive Architectures 2 Multilayer Perceptrons 3 Relations between Variables 4 Structured Representations 5 Individuals 6 Where does the Machinery of Symbol Manipulation Come From? 7 Conclusions.

It is generally accepted that there is something special about reasoning by using mental images. The question of how it is special, however, has never been satisfactorily spelled out, despite more than thirty years of research in the post-behaviorist tradition. This article considers some of the general motivation for the assumption that entertaining mental images involves inspecting a picture-like object. It sets out a distinction between phenomena attributable to the nature of mind to what is called the cognitive architecture, and (...) ones that are attributable to tacit knowledge used to simulate what would happen in a visual situation. With this distinction in mind, the paper then considers in detail the widely held assumption that in some important sense images are spatially displayed or are depictive, and that examining images uses the same mechanisms that are deployed in visual perception. I argue that the assumption of the spatial or depictive nature of images is only explanatory if taken literally, as a claim about how images are physically instantiated in the brain, and that the literal view fails for a number of empirical reasons – for example, because of the cognitive penetrability of the phenomena cited in its favor. Similarly, while it is arguably the case that imagery and vision involve some of the same mechanisms, this tells us very little about the nature of mental imagery and does not support claims about the pictorial nature of mental images. Finally, I consider whether recent neuroscience evidence clarifies the debate over the nature of mental images. I claim that when such questions as whether images are depictive or spatial are formulated more clearly, the evidence does not provide support for the picture-theory over a symbol-structure theory of mental imagery. Even if all the empirical claims were true, they do not warrant the conclusion that many people have drawn from them: that mental images are depictive or are displayed in some (possibly cortical) space. Such a conclusion is incompatible with what is known about how images function in thought. We are then left with the provisional counterintuitive conclusion that the available evidence does not support rejection of what I call the “null hypothesis”; namely, that reasoning with mental images involves the same form of representation and the same processes as that of reasoning in general, except that the content or subject matter of thoughts experienced as images includes information about how things would look. (shrink)

Something remarkable is happening in the cognitive sciences. After a quarter of a century of cognitive models that were inspired by the metaphor of the digital computer, the newest cognitive models are inspired by the properties of the brain itself. Variously referred to as connectionist, parallel distributed processing, or neutral network models, they explore the idea that complex intellectual operations can be carried out by large networks of simple, neuron-like units. The units themselves are identical, very low-level and 'stupid'. Intelligent (...) performance is derived from the pattern of connection strengths between units, and the fundamental cognitive activity is pattern recognition and completion. Connectionism and the Mind provides an introduction to this newly emerging approach to understanding the mind. The first few chapters focus on network architecture, offering accessible treatment of the equations that describe learning and the propagation of activation. Furthermore, the reader is walked step-by-step through the activities of networks engaged in pattern recognition, learning, and cognitive tasks such as memory retrieval and prototype formation. The remainder of the book addresses the implications of connectionism for theories of the mind, both philosophical and psychological. Foe example: What Role is played by pattern recognition and completion as basic as cognitive functions? Connectionist models have particular strength in learning and pattern recognition; should they be limited to those functions, or can they provide an overall account of cognitive functioning? In particular, can connectionist models provide an adequate account of the ability to employ linguistic and other symbol systems, or must an adequate system incorporate symbol processing as a basic cognitive capacity? Finally, Connectionism and the Mind examines the relation of connectionist models to philosophical accounts of propositional attitudes, and to a variety of other inquiries in cognitive psychology, linguistics, developmental psychology, artificial intelligence and neuroscience. (shrink)

The idea of representing words with cell assemblies is very appealing. However, syntactic sequences need to be represented as well. This cannot be done by using the activity levels of assemblies. Instead, structural relations and operations between assemblies are needed to achieve serial order in syntactic word strings.

A new view of the functional role of the left anterior cortex in language use is proposed. The experimental record indicates that most human linguistic abilities are not localized in this region. In particular, most of syntax (long thought to be there) is not located in Broca's area and its vicinity (operculum, insula, and subjacent white matter). This cerebral region, implicated in Broca's aphasia, does have a role in syntactic processing, but a highly specific one: It is the neural home (...) to receptive mechanisms involved in the computation of the relation between transformationally moved phrasal constituents and their extraction sites (in line with the Trace-Deletion Hypothesis). It is also involved in the construction of higher parts of the syntactic tree in speech production. By contrast, basic combinatorial capacities necessary for language processing – for example, structure-building operations, lexical insertion – are not supported by the neural tissue of this cerebral region, nor is lexical or combinatorial semantics. The dense body of empirical evidence supporting this restrictive view comes mainly from several angles on lesion studies of syntax in agrammatic Broca's aphasia. Five empirical arguments are presented: experiments in sentence comprehension, cross-linguistic considerations (where aphasia findings from several language types are pooled and scrutinized comparatively), grammaticality and plausibility judgments, real-time processing of complex sentences, and rehabilitation. Also discussed are recent results from functional neuroimaging and from structured observations on speech production of Broca's aphasics. Syntactic abilities are nonetheless distinct from other cognitive skills and are represented entirely and exclusively in the left cerebral hemisphere. Although more widespread in the left hemisphere than previously thought, they are clearly distinct from other human combinatorial and intellectual abilities. The neurological record (based on functional imaging, split-brain and right-hemisphere-damaged patients, as well as patients suffering from a breakdown of mathematical skills) indicates that language is a distinct, modularly organized neurological entity. Combinatorial aspects of the language faculty reside in the human left cerebral hemisphere, but only the transformational component (or algorithms that implement it in use) is located in and around Broca's area. Key Words: agrammatism; aphasia; Broca's area; cerebral localization; dyscalculia; functional neuroanatomy; grammatical transformation; modularity; neuroimaging; syntax; trace deletion. (shrink)

A distributed neural network model called SPEC for processing sentences with recursive relative clauses is described. The model is based on separating the tasks of segmenting the input word sequence into clauses, forming the case‐role representations, and keeping track of the recursive embeddings into different modules. The system needs to be trained only with the basic sentence constructs, and it generalizes not only to new instances of familiar relative clause structures but to novel structures as well. SPEC exhibits plausible memory (...) degradation as the depth of the center embeddings increases, its memory is primed by earlier constituents, and its performance is aided by semantic constraints between the constituents. The ability to process structure is largely due to a central executive network that monitors and controls the execution of the entire system. This way, in contrast to earlier subsymbolic systems, parsing is modeled as a controlled high‐level process rather than one based on automatic reflex responses. (shrink)

High temporal resolution event-related brain potential and electroencephalographic coherence studies of the neural substrate of short-term storage in working memory indicate that the sustained coactivation of both prefrontal cortex and the posterior cortical systems that participate in the initial perception and comprehension of the retained information are involved in its storage. These studies further show that short-term storage mechanisms involve an increase in neural synchrony between prefrontal cortex and posterior cortex and the enhanced activation of long-term memory representations of material (...) held in short-term memory. This activation begins during the encoding/comprehension phase and evidently is prolonged into the retention phase by attentional drive from prefrontal cortex control systems. A parsimonious interpretation of these findings is that the long-term memory systems associated with the posterior cortical processors provide the necessary representational basis for working memory, with the property of short-term memory decay being primarily due to the posterior system. In this view, there is no reason to posit specialized neural systems whose functions are limited to those of short-term storage buffers. Prefrontal cortex provides the attentional pointer system for maintaining activation in the appropriate posterior processing systems. Short-term memory capacity and phenomena such as displacement of information in short-term memory are determined by limitations on the number of pointers that can be sustained by the prefrontal control systems. Key Words: coherence; event-related potentials; imaging; long-term memory; memory; short-term memory; working memory. (shrink)

The neurophysiological evidence from the Miyashita group's experiments on monkeys as well as cognitive experience common to us all suggests that local neuronal spike rate distributions might persist in the absence of their eliciting stimulus. In Hebb's cell-assembly theory, learning dynamics stabilize such self-maintaining reverberations. Quasi-quantitive modeling of the experimental data on internal representations in association-cortex modules identifies the reverberations (delay spike activity) as the internal code (representation). This leads to cognitive and neurophysiological predictions, many following directly from the language (...) used to describe the activity in the experimental delay period, others from the details of how the model captures the properties of the internal representations. (shrink)

A promising approach to more refined models consistent with the Caplan & Waters hypothesis is based on similarity-based interference, a general principle that applies across working memory domains. This may explain both the fine details of syntactic working memory phenomena and the gross fractionation for which Caplan & Waters have found evidence. Detailed models of syntactic processing that embody similarity-based interference fare well cross-linguistically.