If the cortex is an associative memory, strongly connected cell assemblies will form when neurons in different cortical areas are frequently active at the same time. The cortical distributions of these assemblies must be a consequence of where in the cortex correlated neuronal activity occurred during learning. An assembly can be considered a functional unit exhibiting activity states such as full activation (“ignition”) after appropriate sensory stimulation (possibly related to perception) and continuous reverberation of excitation within the assembly (a putative (...) memory process). This has implications for cortical topographies and activity dynamics of cell assemblies forming during language acquisition, in particular for those representing words. Cortical topographies of assemblies should be related to aspects of the meaning of the words they represent, and physiological signs of cell assembly ignition should be followed by possible indicators of reverberation. The following postulates are discussed in detail: (1) assemblies representing phonological word forms are strongly lateralized and distributed over perisylvian cortices; (2) assemblies representing highly abstract words such as grammatical function words are also strongly lateralized and restricted to these perisylvian regions; (3) assemblies representing concrete content words include additional neurons in both hemispheres; (4) assemblies representing words referring to visual stimuli include neurons in visual cortices; and (5) assemblies representing words referring to actions include neurons in motor cortices. Two main sources of evidence are used to evaluate these proposals: (a) imaging studies focusing on localizing word processing in the brain, based on stimulus-triggered event-related potentials (ERPs), positron emission tomography (PET), and functional magnetic resonance imaging (fMRI), and (b) studies of the temporal dynamics of fast activity changes in the brain, as revealed by high-frequency responses recorded in the electroencephalogram (EEG) and magnetoencephalogram (MEG). These data provide evidence for processing differences between words and matched meaningless pseudowords, and between word classes, such as concrete content and abstract function words, and words evoking visual or motor associations. There is evidence for early word class-specific spreading of neuronal activity and for equally specific high-frequency responses occurring later. These results support a neurobiological model of language in the Hebbian tradition. Competing large-scale neuronal theories of language are discussed in light of the data summarized. Neurobiological perspectives on the problem of serial order of words in syntactic strings are considered in closing. Key Words: associative learning; cell assembly; cognition; cortex; ERP; EEG; fMRI; language; lexicon; MEG; PET; word category. (shrink)

During active vision, the eyes continually scan the visual environment using saccadic scanning movements. This target article presents an information processing model for the control of these movements, with some close parallels to established physiological processes in the oculomotor system. Two separate pathways are concerned with the spatial and the temporal programming of the movement. In the temporal pathway there is spatially distributed coding and the saccade target is selected from a Both pathways descend through a hierarchy of levels, the (...) lower ones operating automatically. Visual onsets have automatic access to the eye control system via the lower levels. Various centres in each pathway are interconnected via reciprocal inhibition. The model accounts for a number of well-established phenomena in target-elicited saccades: the gap effect, express saccades, the remote distractor effect, and the global effect. High-level control of the pathways in tasks such as visual search and reading is discussed; it operates through spatial selection and search selection, which generally combine in an automated way. The model is examined in relation to data from patients with unilateral neglect. (shrink)

Visual information follows at least two branches in the human nervous system, following a common input stage: a cognitive ''what'' branch governs perception and experience, while a sensorimotor ''how'' branch handles visually guided behavior though its outputs are unconscious. The sensorimotor system is probed with an isomorphic task, requiring a 1:1 relationship between target position and motor response. The cognitive system, in contrast, is probed with a forced qualitative decision, expressed verbally, about the location of a target. Normally, the cognitive (...) system is influenced by context-induced illusions of visual direction, while the sensorimotor system is not. Here, we inquire whether the process of making a spatially based decision is critical in forcing subjects to use the information in the cognitive system for spatial tasks. Subjects hear a tone that determines whether they jab an ''X'' or an ''O'' with the forefinger. Despite making a decision about which target to contact, the jab is not influenced by the position of a surrounding frame, indicating that choice can be handled within the context-insensitive sensorimotor system. (shrink)

This article reviews experimental evidence for a specific sensorimotor function which can be dissociated from higher level representations of space. It attempts to delineate this function on the basis of results obtained by psychophysical experiments performed with brain damaged and healthy subjects. Eye and hand movement control exhibit automatic features, such that they are incompatible with conscious control. In addition, they rely on a reference frame different from the one used by conscious perception. Neuropsychological cases provide a strong support for (...) this specific motor representation of space, which can be spared in patients with lesions of primary sensory systems who have lost conscious perception of visual, tactile or proprioceptive stimuli. Observation of these patients also showed that their motor behavior can be ''attracted'' by a goal only under specific conditions, that is, when the response is immediate and when no cognitive representation of this goal is elaborated at the same time. Beyond the issue of the dissociation between an implicit motor representation and more cognitive processing of spatial information, the issue of the interaction between these two systems is thus a matter of interest. It is suggested that the conscious, cognitive representation of a stimulus can contaminate or override the short-lived motor representation, but no reciprocal influence seem to occur. The interaction observed in patients can also be investigated in normals. The literature provides examples of interaction between sensorimotor and cognitive framing of space, which confirm that immediate action is not mediated by the same system as delayed action, and that elaborating a categorial representation of the action goal prevents the expression of the short-lived sensorimotor representation. It is concluded that action can be controlled by a sensory system which is specialized for on-line processing of relevant goal characteristics. The temporal constraints of this system are such that it can affect the action before a full sensory analysis of this goal has been completed. The performance obtained on the basis of this spatial sensory processing suggests that short-lived motor representations may rather be considered as real ''presentation'' of the action world, which share its metric properties. (shrink)

Although the mechanics of how the eye works are well understood, debate still exists as to how the complex machinery of the brain interprets neural impulses...

Marr (1982) may have been one of the rst vision researchers to insist that in modeling vision it is important to separate the location of visual features from their type. He argued that in early stages of visual processing there must be “place tokens” that enable subsequent stages of the visual system to treat locations independent of what specic feature type was at that location. Thus, in certain respects a collinear array of diverse features could still be perceived as a (...) line, and under certain conditions could function as such in perceptual phenomena like the Poggendorf illusion. (shrink)

In three experiments, subjects attempted to track multiple items as they moved independently and unpredictably about a display. Performance was not impaired when the items were briefly (but completely) occluded at various times during their motion, suggesting that occlusion is taken into account when computing enduring perceptual objecthood. Unimpaired performance required the presence of accretion and deletion cues along fixed contours at the occluding boundaries. Performance was impaired when items were present on the visual field at the same times and (...) to the same degrees as in the occlusion conditions, but disappeared and reappeared in ways which did not implicate the presence of occluding surfaces (e.g. by imploding and exploding into and out of existence, instead of accreting and deleting along a fixed contour). Unimpaired performance did not require visible occluders (i.e. Michotte’s tunnel effect) or globally consistent occluder positions. We discuss implications of these results for theories of objecthood in visual attention. (shrink)

To describe phenomena that occur at different time scales, computational models of the brain must incorporate different levels of abstraction. At time scales of approximately 1/3 of a second, orienting movements of the body play a crucial role in cognition and form a useful computational level embodiment level,” the constraints of the physical system determine the nature of cognitive operations. The key synergy is that at time scales of about 1/3 of a second, the natural sequentiality of body movements can (...) be matched to the natural computational economies of sequential decision systems through a system of implicit reference called deictic in which pointing movements are used to bind objects in the world to cognitive programs. This target article focuses on how deictic bindings make it possible to perform natural tasks. Deictic computation provides a mechanism for representing the essential features that link external sensory data with internal cognitive programs and motor actions. One of the central features of cognition, working memory, can be related to moment-by-moment dispositions of body features such as eye movements and hand movements. (shrink)

Change-blindness occurs when large changes are missed under natural viewing conditions because they occur simultaneously with a brief visual disruption, perhaps caused by an eye movement, a flicker, a blink, or a camera cut in a film sequence. We have found that this can occur even when the disruption does not cover or obscure the changes. When a few small, high-contrast shapes are briefly spattered over a picture, like mudsplashes on a car windscreen, large changes can be made simultaneously in (...) the scene without being noticed. (shrink)

The cortical visual mechanisms involved in processing spatial relationships remain subject to debate. According to one current view, the ''dorsal stream'' of visual areas, emanating from primary visual cortex and culminating in the posterior parietal cortex, mediates this aspect of visual processing. More recently, others have argued that while the dorsal stream provides egocentric coding of visual location for motor control, the separate ''ventral'' stream is needed for allocentric spatial coding. We have assessed the visual form agnosic patient DF, whose (...) lesion mainly affects the ventral stream, on a prehension task requiring allocentric spatial coding. She was presented with transparent circular disks. Each disk had circular holes cut in it. DF was asked to reach out and grasp the disk by placing her fingers through the holes. The disks either had three holes (for forefinger, middle finger, and thumb) or two holes (for forefinger and thumb). The distance between the forefinger and thumb holes, and the orientation of the line formed by them, were independently varied. DF was quite unable to adjust her grip aperture or her hand orientation in the three-hole task. Although she was able to orient her hand appropriately for the two-hole disks, she still remained unable to adjust her grip aperture to the distance between the holes. These findings are consistent with the idea that allocentric processing of spatial information requires a functioning ventral stream, even when the information is being used to guide a motor response. (shrink)

We identify two aspects of the problem of maintaining perceptual stability despite an observer's eye movements. The first, visual direction constancy, is the (egocentric) stability of apparent positions of objects in the visual world relative to the perceiver. The second, visual position constancy, is the (exocentric) stability of positions of objects relative to each other. We analyze the constancy of visual direction despite saccadic eye movements.Three information sources have been proposed to enable the visual system to achieve stability: the structure (...) of the visual field, proprioceptive inflow, and a copy of neural efference or outflow to the extraocular muscles. None of these sources by itself provides adequate information to achieve visual direction constancy; present evidence indicates that all three are used.Our final question concerns how information processing operations result in a stable world. The three traditionally suggested means have been elimination, translation, or evaluation. All are rejected. From a review of the physiological and psychological evidence we conclude that no subtraction, compensation, or evaluation need take place. The problem for which these solutions were developed turns out to be a false one. We propose a “calibration” solution: correct spatiotopic positions are calculated anew for each fixation. Inflow, outflow, and retinal sources are used in this calculation: saccadic suppression of displacement bridges the errors between these sources and the actual extent of movement. (shrink)

First published in 1995, The Visual Brain in Action remains a seminal publication in the cognitive sciences. It presents a model for understanding the visual processing underlying perception and action, proposing a broad distinction within the brain between two kinds of vision: conscious perception and unconscious 'online' vision. It argues that each kind of vision can occur quasi-independently of the other, and is separately handled by a quite different processing system. In the 11 years since publication, the book has provoked (...) considerable interest and debate - throughout both cognitive neuroscience and philosophy, while the field has continued to flourish and develop. -/- For this new edition, the text from the original edition has been left untouched, standing as a coherent statement of the authors' position. However, a very substantial epilogue has been added to the book in which Milner and Goodale review some of the key developments that support or challenge the views that were put forward in the first edition. The new chapter summarizes developments in various relevant areas of psychology, neuroscience and behaviour. It notably supplements the main text by updating the reader on the contributions that have emerged from the use of functional neuroimaging, which was in its infancy when the first edition was written. Neuroimaging, and functional MRI in particular, has revolutionized the field over the past 11 years by allowing investigators to plot in detail the patterns of activity within the visual brains of behaving and perceiving humans. The authors show how its use now allows scientists to test and confirm their proposals, based as they then were largely on evidence accrued from primate neuroscience in conjunction with studies of neurological patients. (shrink)

Two major functions of the visual system are discussed and contrasted. One function of vision is the creation of an internal model or percept of the external world. Most research in object perception has concentrated on this aspect of vision. Vision also guides the control of object-directed action. In the latter case, vision directs our actions with respect to the world by transforming visual inputs into appropriate motor outputs. We argue that separate, but interactive, visual systems have evolved for the (...) perception of objects on the one hand and the control of actions directed at those objects on the other. This 'duplex' approach to high-level vision suggests that Marrian or 'reconstructive' approaches and Gibsonian or 'purposive-animate-behaviorist' approaches need not be seen as mutually exclusive, but rather as complementary in their emphases on different aspects of visual function. (shrink)