This paper explores the difference between Connectionist proposals for cognitive a r c h i t e c t u r e a n d t h e s o r t s o f m o d e l s t hat have traditionally been assum e d i n c o g n i t i v e s c i e n c e . W e c l a i m t h a t t h (...) e m a j o r d i s t i n c t i o n i s t h a t , w h i l e b o t h Connectionist and Classical architectures postulate representational mental states, the latter but not the former are committed to a symbol-level of representation, or to a ‘language of thought’: i.e., to representational states that have combinatorial syntactic and semantic structure. Several arguments for combinatorial structure in mental representations are then reviewed. These include arguments based on the ‘systematicity’ of mental representation: i.e., on the fact that cognitive capacities always exhibit certain symmetries, so that the ability to entertain a given thought implies the ability to entertain thoughts with semantically related contents. We claim that such arguments make a powerful case that mind/brain architecture is not Connectionist at the cognitive level. We then consider the possibility that Connectionism may provide an account of the neural (or ‘abstract neurological’) structures in which Classical cognitive architecture is implemented. We survey a n u m b e r o f t h e s t a n d a r d a r g u m e n t s t h a t h a v e b e e n o f f e r e d i n f a v o r o f Connectionism, and conclude that they are coherent only on this interpretation. (shrink)

Having laid the groundwork in his critically acclaimed books Neural Darwinism (Basic Books, 1987) and Topobiology (Basic Books, 1988), Nobel laureate Gerald M. Edelman now proposes a comprehensive theory of consciousness in The Remembered ...

Anydomainofscientificresearchhasitssustainingorthodoxy. Thatis, research on a problem, whether in astronomy, physics, or biology, is con- ducted against a backdrop of broadly shared assumptions. It is these as- sumptionsthatguideinquiryandprovidethecanonofwhatisreasonable-- of what "makes sense." And it is these shared assumptions that constitute a framework for the interpretation of research results. Research on the problem of how we see is likewise sustained by broadly shared assump- tions, where the current orthodoxy embraces the very general idea that the business of the visual system is to (...) create a detailed replica of the visual world, and that it accomplishes its business via hierarchical organization and by operatingessentiallyindependently of other sensorymodalitiesas well as independently of previous learning, goals, motor planning, and motor execution. (shrink)

The general problem of visual search can be shown to be computationally intractable in a formal, complexity-theoretic sense, yet visual search is extensively involved in everyday perception, and biological systems manage to perform it remarkably well. Complexity level analysis may resolve this contradiction. Visual search can be reshaped into tractability through approximations and by optimizing the resources devoted to visual processing. Architectural constraints can be derived using the minimum cost principle to rule out a large class of potential solutions. The (...) evidence speaks strongly against bottom-up approaches to vision. In particular, the constraints suggest an attentional mechanism that exploits knowledge of the specific problem being solved. This analysis of visual search performance in terms of attentional influences on visual information processing and complexity satisfaction allows a large body of neurophysiological and psychological evidence to be tied together. (shrink)

Received by the IRE, October 24, 1960. The author's work summarized here—which was done at the MIT Lincoln Laboratory, a center for research operated by MIT at Lexington, Mass., with the joint Support of the U. S. Army, Navy, and Air Force under Air Force Contract AF 19-5200; and at the Res. Lab. of Electronics, MIT, Cambridge, Mass., which is supported in part by the U. S. Army Signal Corps, the Air Force Office of Scientific Research, and the ONR—is based (...) on earlier work done by the author as a Junior Fellow of the Society of Fellows, Harvard University. (shrink)

Human agents draw a variety of inferences effortlessly, spontaneously, and with remarkable efficiency – as though these inferences were a reflexive response of their cognitive apparatus. Furthermore, these inferences are drawn with reference to a large body of background knowledge. This remarkable human ability seems paradoxical given the complexity of reasoning reported by researchers in artificial intelligence. It also poses a challenge for cognitive science and computational neuroscience: How can a system of simple and slow neuronlike elements represent a large (...) body of systemic knowledge and perform a range of inferences with such speed? We describe a computational model that takes a step toward addressing the cognitive science challenge and resolving the artificial intelligence paradox. We show how a connectionist network can encode millions of facts and rules involving n-ary predicates and variables and perform a class of inferences in a few hundred milliseconds. Efficient reasoning requires the rapid representation and propagation of dynamic bindings. Our model (which we refer to as SHRUTI) achieves this by representing (1) dynamic bindings as the synchronous firing of appropriate nodes, (2) rules as interconnection patterns that direct the propagation of rhythmic activity, and (3) long-term facts as temporal pattern-matching subnetworks. The model is consistent with recent neurophysiological evidence that synchronous activity occurs in the brain and may play a representational role in neural information processing. The model also makes specific psychologically significant predictions about the nature of reflexive reasoning. It identifies constraints on the form of rules that may participate in such reasoning and relates the capacity of the working memory underlying reflexive reasoning to biological parameters such as the lowest frequency at which nodes can sustain synchronous oscillations and the coarseness of synchronization. (shrink)

The processes whereby our brains continue to learn about a changing world in a stable fashion throughout life are proposed to lead to conscious experiences. These processes include the learning of top-down expectations, the matching of these expectations against bottom-up data, the focusing of attention upon the expected clusters of information, and the development of resonant states between bottom-up and top-down processes as they reach an attentive consensus between what is expected and what is there in the outside world. It (...) is suggested that all conscious states in the brain are resonant states and that these resonant states trigger learning of sensory and cognitive representations. The models which summarize these concepts are therefore called Adaptive Resonance Theory, or ART, models. Psychophysical and neurobiological data in support of ART are presented from early vision, visual object recognition, auditory streaming, variable-rate speech perception, somatosensory perception, and cognitive-emotional interactions, among others. It is noted that ART mechanisms seem to be operative at all levels of the visual system, and it is proposed how these mechanisms are realized by known laminar circuits of visual cortex. It is predicted that the same circuit realization of ART mechanisms will be found in the laminar circuits of all sensory and cognitive neocortex. Concepts and data are summarized concerning how some visual percepts may be visibly, or modally, perceived, whereas amodal percepts may be consciously recognized even though they are perceptually invisible. It is also suggested that sensory and cognitive processing in the What processing stream of the brain obey top-down matching and learning laws that are often complementary to those used for spatial and motor processing in the brain's Where processing stream. This enables our sensory and cognitive representations to maintain their stability as we learn more about the world, while allowing spatial and motor representations to forget learned maps and gains that are no longer appropriate as our bodies develop and grow from infanthood to adulthood. Procedural memories are proposed to be unconscious because the inhibitory matching process that supports these spatial and motor processes cannot lead to resonance. (shrink)

It is worthwhile to search for forms of coding, processing, and learning common to various cortical regions and cognitive functions. Local cortical processors may coordinate their activity by maximizing the transmission of information coherently related to the context in which it occurs, thus forming synchronized population codes. This coordination involves contextual field (CF) connections that link processors within and between cortical regions. The effects of CF connections are distinguished from those mediating receptive field (RF) input; it is shown how CFs (...) can guide both learning and processing without becoming confused with the transmission of RF information. Simulations explore the capabilities of networks built from local processors with both RF and CF connections. Physiological evidence for synchronization, CFs, and plasticity of the RF and CF connections is described. Coordination via CFs is related to perceptual grouping, the effects of context on contrast sensitivity, amblyopia, implicit influences of color in achromotopsia, object and word perception, and the discovery of distal environmental variables and their interactions through self-organization. Cortical computation could thus involve the flexible evaluation of relations between input signals by locally specialized but adaptive processors whose activity is dynamically associated and coordinated within and between regions through specialized contextual connections. Key Words: cell assemblies; cerebral cortex; context; coordination; dynamic binding; epistemology; functional specialization; learning; neural coding; neural computation; neuropsychology; object recognition; perception; reading; self-organization; synaptic plasticity; synchronization. (shrink)

Experiments are presented showing that visual search for Mueller-Lyer (ML) stimuli is based on complete configurations, rather than component segments. Segments easily detected in isolation were difficult to detect when embedded in a configuration, indicating preemption by low-level groups. This preemption—which caused stimulus components to become inaccessible to rapid search—was an all-or-nothing effect, and so could serve as a powerful test of grouping. It is shown that these effects are unlikely to be due to blurring by simple spatial filters at (...) early visual levels. It is proposed instead that they are due to more sophisticated processes that rapidly bind contour fragments into spatially-extended assemblies. These results support the view that rapid visual search cannot access the primitives formed at the earliest stages of visual processing; rather, it can access only higher-level, more ecologically-relevant structures. (shrink)

Logothetis, N.K.: Single units and conscious vision. Philosophical Transactions of the Royal Society of London Series B-Biological Sciences 353, 1801-1818 (1998) Abstract.

Two major functions of the visual system are discussed and contrasted. One function of vision is the creation of an internal model or percept of the external world. Most research in object perception has concentrated on this aspect of vision. Vision also guides the control of object-directed action. In the latter case, vision directs our actions with respect to the world by transforming visual inputs into appropriate motor outputs. We argue that separate, but interactive, visual systems have evolved for the (...) perception of objects on the one hand and the control of actions directed at those objects on the other. This 'duplex' approach to high-level vision suggests that Marrian or 'reconstructive' approaches and Gibsonian or 'purposive-animate-behaviorist' approaches need not be seen as mutually exclusive, but rather as complementary in their emphases on different aspects of visual function. (shrink)