This paper is a commentary on the target article by Dana H. Ballard, “Cortical connections and parallel processing: Structure and function”, in the same issue of the journal, pp. 67–120. -/- I raise some issues about the connectionist or neural-network implementation of information and information processing. Issues include the sharing of information by different parts of a connectionist/neural network, the copying of complex information from one place to another in a network, the possibility of connection weights not being synaptic weights, (...) and the possibility of fast communication within single neurons as complex systems in their own right. (shrink)

The cerebral cortex is a rich and diverse structure that is the basis of intelligent behavior. One of the deepest mysteries of the function of cortex is that neural processing times are only about one hundred times as fast as the fastest response times for complex behavior. At the very least, this would seem to indicate that the cortex does massive amounts of parallel computation.This paper explores the hypothesis that an important part of the cortex can be modeled as a (...) connectionist computer that is especially suited for parallel problem solving. The connectionist computer uses a special representation, termed value unit encoding, that represents small subsets of parameters in a way that allows parallel access to many different parameter values. This computer can be thought of as computing hierarchies of sensorimotor invariants. The neural substrate can be interpreted as a commitment to data structures and algorithms that compute invariants fast enough to explain the behavioral response times. A detailed consideration of this model has several implications for the underlying anatomy and physiology. (shrink)

We show how an epistemology informed by cognitive science promises to shed light on an ancient problem in the philosophy of mathematics: the problem of exactness. The problem of exactness arises because geometrical knowledge is thought to concern perfect geometrical forms, whereas the embodiment of such forms in the natural world may be imperfect. There thus arises an apparent mismatch between mathematical concepts and physical reality. We propose that the problem can be solved by emphasizing the ways in which the (...) brain can transform and organize its perceptual intake. It is not necessary for a geometrical form to be perfectly instantiated in order for perception of such a form to be the basis of a geometrical concept. (shrink)

In a seminal 1977 article, Rumelhart argued that perception required the simultaneous use of multiple sources of information, allowing perceivers to optimally interpret sensory information at many levels of representation in real time as information arrives. Building on Rumelhart's arguments, we present the Interactive Activation hypothesis—the idea that the mechanism used in perception and comprehension to achieve these feats exploits an interactive activation process implemented through the bidirectional propagation of activation among simple processing units. We then examine the interactive activation (...) model of letter and word perception and the TRACE model of speech perception, as early attempts to explore this hypothesis, and review the experimental evidence relevant to their assumptions and predictions. We consider how well these models address the computational challenge posed by the problem of perception, and we consider how consistent they are with evidence from behavioral experiments. We examine empirical and theoretical controversies surrounding the idea of interactive processing, including a controversy that swirls around the relationship between interactive computation and optimal Bayesian inference. Some of the implementation details of early versions of interactive activation models caused deviation from optimality and from aspects of human performance data. More recent versions of these models, however, overcome these deficiencies. Among these is a model called the multinomial interactive activation model, which explicitly links interactive activation and Bayesian computations. We also review evidence from neurophysiological and neuroimaging studies supporting the view that interactive processing is a characteristic of the perceptual processing machinery in the brain. In sum, we argue that a computational analysis, as well as behavioral and neuroscience evidence, all support the Interactive Activation hypothesis. The evidence suggests that contemporary versions of models based on the idea of interactive activation continue to provide a basis for efforts to achieve a fuller understanding of the process of perception. (shrink)

Purely parallel neural networks can model object recognition in brief displays – the same conditions under which illusory conjunctions have been demonstrated empirically. Correcting errors of illusory conjunction is the “tag-assignment” problem for a purely parallel processor: the problem of assigning a spatial tag to nonspatial features, feature combinations, and objects. This problem must be solved to model human object recognition over a longer time scale. Our model simulates both the parallel processes that may underlie illusory conjunctions and the serial (...) processes that may solve the tag-assignment problem in normal perception. One component of the model extracts pooled features and another provides attentional tags that correct illusory conjunctions. Our approach addresses two questions: How can objects be identified from simultaneously attended features in a parallel, distributed representation? How can the spatial selectional requirements of such an attentional process be met by a separation of pathways for spatial and nonspatial processing? Our analysis of these questions yields a neurally plausible simulation of tag assignment based on synchronizing feature processing activity in a spatial focus of attention. (shrink)

A neurally plausible model of how the process of visually perceiving a letter in the context of a word is learned, and how such processing occurs in adults is proposed. The model consists of a collection of abstract letter feature detector neurons and their interconnections. The model also includes a learning rule that specifies how these interconnections evolve with experience. The interconnections between neurons can be interpreted as representing the spatially redundant, sequentially redundant, and transgraphemic information in letter string displays. (...) Anderson, Silverstein, Ritz, and Jones's (1977) “Brain‐State‐in‐a‐Box” (BSB) neural mechanism is then used to implement the proposed model. The resulting system makes explicit qualitative predictions using both letter recognition accuracy and reaction time as dependent measures. In particular, the model offers an integrated explanation of some experiments involving manipulations of orthographic regularity, masking, case alternations, and experience with words. The similarities and differences between the model and models proposed by Adams (1979) and McClelland and Rumelhart (1981) are also discussed. (shrink)

“Hardwired” is a term commonly used to describe the properties of certain behaviors or brain regions. As its usage has increased exponentially in the past 50 years, both in popular media and the scholarly literature, the concept appears to have gained a cloak of respectability in scientific discourse. However, its specific meaning is difficult to pinpoint. In this paper, I examine how “hardwired” has been used in the psychological and neuroscientific literature. The analysis reveals two major themes: one centers on (...) certain purported characteristics of behaviors or brain regions, such as fixedness; the other places these and other characteristics within an evolutionary framework. Overall, the analysis reveals a degree of overlap between “hardwiring” and the folk biology concept of innateness. Various complications arise from such overlap, casting doubts on the usefulness and legitimacy of “hardwired” in scientific discourse. (shrink)

A possible relation between Derrida's deconstruction of metaphysics and connectionism is explored by considering diffeacuterance in neural nets terms. First diffeacuterance, as the crossing of Saussurian difference and Freudian deferral, is modeled and then the fuller 'sheaf of diffeacuterance is taken up. The metaphysically conceived brain has two versions: in the traditional computational version the brain processes information like a computer and in the connectionist version the brain computes input vector to output vector transformations non-symbolically. The 'deconstructed brain' neither processes (...) information nor computes functions but is spontaneously economical. (shrink)

The cerebral cortex is a rich and diverse structure that is the basis of intelligent behavior. One of the deepest mysteries of the function of cortex is that neural processing times are only about one hundred times as fast as the fastest response times for complex behavior. At the very least, this would seem to indicate that the cortex does massive amounts of parallel computation.This paper explores the hypothesis that an important part of the cortex can be modeled as a (...) connectionist computer that is especially suited for parallel problem solving. The connectionist computer uses a special representation, termed value unit encoding, that represents small subsets of parameters in a way that allows parallel access to many different parameter values. This computer can be thought of as computing hierarchies of sensorimotor invariants. The neural substrate can be interpreted as a commitment to data structures and algorithms that compute invariants fast enough to explain the behavioral response times. A detailed consideration of this model has several implications for the underlying anatomy and physiology. (shrink)