To describe phenomena that occur at different time scales, computational models of the brain must incorporate different levels of abstraction. At time scales of approximately 1/3 of a second, orienting movements of the body play a crucial role in cognition and form a useful computational level embodiment level,” the constraints of the physical system determine the nature of cognitive operations. The key synergy is that at time scales of about 1/3 of a second, the natural sequentiality of body movements can (...) be matched to the natural computational economies of sequential decision systems through a system of implicit reference called deictic in which pointing movements are used to bind objects in the world to cognitive programs. This target article focuses on how deictic bindings make it possible to perform natural tasks. Deictic computation provides a mechanism for representing the essential features that link external sensory data with internal cognitive programs and motor actions. One of the central features of cognition, working memory, can be related to moment-by-moment dispositions of body features such as eye movements and hand movements. (shrink)

To understand the endogenous components of the event-related brain potential (ERP), we must use data about the components' antecedent conditions to form hypotheses about the information-processing function of the underlying brain activity. These hypotheses, in turn, generate testable predictions about the consequences of the component. We review the application of this approach to the analysis of the P300 component. The amplitude of the P300 is controlled multiplicatively by the subjective probability and the task relevance of the eliciting events, whereas its (...) latency depends on the duration of stimulus evaluation. These and other factors suggest that the P300 is a manifestation of activity occurring whenever one's model of the environment must be revised. Tests of three predictions based on this “context updating” model are reviewed. Verleger's critique is based on a misconstrual of the model as well as a partial and misleading reading of the relevant literature. (shrink)

Five aspects of visual change detection are reviewed. The first concerns the concept of change itself, in particular the ways it differs from the related notions of motion and difference. The second involves the various methodological approaches that have been developed to study change detection; it is shown that under a variety of conditions observers are often unable to see large changes directly in their field of view. Next, it is argued that this “change blindness” indicates that focused attention is (...) needed to detect change, and that this can help map out the nature of visual attention. The fourth aspect concerns how these results affect our understanding of visual perception—for example, the implication that a sparse, dynamic representation underlies much of our visual experience. Finally, a brief discussion is presented concerning the limits to our current understanding of change detection. (shrink)

Traditional approaches to human information processing tend to deal with perception and action planning in isolation, so that an adequate account of the perception-action interface is still missing. On the perceptual side, the dominant cognitive view largely underestimates, and thus fails to account for, the impact of action-related processes on both the processing of perceptual information and on perceptual learning. On the action side, most approaches conceive of action planning as a mere continuation of stimulus processing, thus failing to account (...) for the goal-directedness of even the simplest reaction in an experimental task. We propose a new framework for a more adequate theoretical treatment of perception and action planning, in which perceptual contents and action plans are coded in a common representational medium by feature codes with distal reference. Perceived events (perceptions) and to-be-produced events (actions) are equally represented by integrated, task-tuned networks of feature codes – cognitive structures we call event codes. We give an overview of evidence from a wide variety of empirical domains, such as spatial stimulus-response compatibility, sensorimotor synchronization, and ideomotor action, showing that our main assumptions are well supported by the data. Key Words: action planning; binding; common coding; event coding; feature integration; perception; perception-action interface. (shrink)

When the stored representation of the meaning of a stimulus is accessed through the processing of a sensory input it is maintained in an activated state for a certain amount of time that allows for further processing. This semantic activation is generally accompanied by conscious identification, which can be demonstrated by the ability of a person to perform discriminations on the basis of the meaning of the stimulus. The idea that a sensory input can give rise to semantic activation without (...) concomitant conscious identification was the central thesis of the controversial research in subliminal perception. Recently, new claims for the existence of such phenomena have arisen from studies in dichotic listening, parafoveal vision, and visual pattern masking. Because of the fundamental role played by these types of experiments in cognitive psychology, the new assertions have raised widespread interest. (shrink)

This paper presents a general computational treatment of how mammals are able to deal with visual objects and environments. The model tries to cover the entire range from behavior and phenomenological experience to detailed neural encodings in crude but computationally plausible reductive steps. The problems addressed include perceptual constancies, eye movements and the stable visual world, object descriptions, perceptual generalizations, and the representation of extrapersonal space.The entire development is based on an action-oriented notion of perception. The observer is assumed to (...) be continuously sampling the ambient light for information of current value. The central problem of vision is taken to be categorizing and locating objects in the environment. The critical step in this process is the linking of visual information to symbolic object descriptions; this is calledindexing, from the analogy of identifying a book from index terms. The system must also identifysituationsand use this knowledge to guide movement and other actions in the environment. The treatment focuses on the different representations of information used in the visual system.The four representational frames capture information in the following forms: retinotopic, head-based, symbolic, and allocentric. The functional roles of the four frames, the communication among them, and their suggested neurophysiological realization constitute the core of the paper. The model is perforce crude, but appears to be consistent with all relevant findings. (shrink)

This textbook on vision reflects the integrated computational approach of modern research scientists, combining psychological, computational and neuroscientific perspectives.

within-field task as testing proceeded. (In any case, the two-field task is presumably a more difficult one than the one-field task. ...

Although the mechanics of how the eye works are well understood, debate still exists as to how the complex machinery of the brain interprets neural impulses...

Arien Mack and Irvin Rock make the radical claim that there is no conscious perception of the visual world without attention to it.

In three experiments, subjects attempted to track multiple items as they moved independently and unpredictably about a display. Performance was not impaired when the items were briefly (but completely) occluded at various times during their motion, suggesting that occlusion is taken into account when computing enduring perceptual objecthood. Unimpaired performance required the presence of accretion and deletion cues along fixed contours at the occluding boundaries. Performance was impaired when items were present on the visual field at the same times and (...) to the same degrees as in the occlusion conditions, but disappeared and reappeared in ways which did not implicate the presence of occluding surfaces (e.g. by imploding and exploding into and out of existence, instead of accreting and deleting along a fixed contour). Unimpaired performance did not require visible occluders (i.e. Michotte’s tunnel effect) or globally consistent occluder positions. We discuss implications of these results for theories of objecthood in visual attention. (shrink)

First published in 1995, The Visual Brain in Action remains a seminal publication in the cognitive sciences. It presents a model for understanding the visual processing underlying perception and action, proposing a broad distinction within the brain between two kinds of vision: conscious perception and unconscious 'online' vision. It argues that each kind of vision can occur quasi-independently of the other, and is separately handled by a quite different processing system. In the 11 years since publication, the book has provoked (...) considerable interest and debate - throughout both cognitive neuroscience and philosophy, while the field has continued to flourish and develop. -/- For this new edition, the text from the original edition has been left untouched, standing as a coherent statement of the authors' position. However, a very substantial epilogue has been added to the book in which Milner and Goodale review some of the key developments that support or challenge the views that were put forward in the first edition. The new chapter summarizes developments in various relevant areas of psychology, neuroscience and behaviour. It notably supplements the main text by updating the reader on the contributions that have emerged from the use of functional neuroimaging, which was in its infancy when the first edition was written. Neuroimaging, and functional MRI in particular, has revolutionized the field over the past 11 years by allowing investigators to plot in detail the patterns of activity within the visual brains of behaving and perceiving humans. The authors show how its use now allows scientists to test and confirm their proposals, based as they then were largely on evidence accrued from primate neuroscience in conjunction with studies of neurological patients. (shrink)

It has often been assumed that when we use vision to become aware of an object or event in our surroundings, this must be accompanied by a corresponding visual experience (i.e., seeing). The studies reported here show that this assumption is incorrect. When observers view a sequence of displays alternating between an image of a scene and the same image changed in some way, they often feel (or sense) the change even though they have no visual experience of it. The (...) subjective difference between sensing and seeing is mirrored in several behavioral differences, suggesting that these are two distinct modes of conscious visual perception. (shrink)

One of the more powerful impressions created by vision is that of a coherent, richly-detailed world where everything is present simultaneously. Indeed, this impression is so compelling that we tend to ascribe these properties not only to the external world, but to our internal representations as well. But results from several recent experiments argue against this latter ascription. For example, changes in images of real-world scenes often go unnoticed when made during a saccade, flicker, blink, or movie cut. This "change (...) blindness" provides strong evidence against the idea that our brains contain a picture-like representation of the scene that is everywhere detailed and coherent. (shrink)

A set of visual search experiments tested the proposal that focused attention is needed to detect change. Displays were arrays of rectangles, with the target being the item that continually changed its orientation or contrast polarity. Five aspects of performance were examined: linearity of response, processing time, capacity, selectivity, and memory trace. Detection of change was found to be a self-terminating process requiring a time that increased linearly with the number of items in the display. Capacity for orientation was found (...) to be about 5 items, a value comparable to estimates of attentional capacity. Observers were able to filter out both static and dynamic variations in irrelevant properties. Analysis also indicated a memory for previously-attended locations. These results support the hypothesis that the process needed to detect change is much the same as the attentional process needed to detect complex static patterns. Interestingly, the features of orientation and polarity were found to be handled in somewhat different ways. Taken together, these results not only provide evidence that focused attention is needed to see change, but also show that change detection itself can provide new insights into the nature of attentional processing. (shrink)

Observers inspected normal, high quality color displays of everyday visual scenes while their eye movements were recorded. A large display change occurred each time an eye blink occurred. Display changes could either involve "Central Interest" or "Marginal Interest" locations, as determined from descriptions obtained from independent judges in a prior pilot experiment. Visual salience, as determined by luminance, color, and position of the Central and Marginal interest changes were equalized. -/- The results obtained were very similar to those obtained in (...) prior experiments showing failure to detect changes occurring simultaneously with saccades, flicker, or “mudsplashes” in the visual scene: Many changes were very hard to detect, and Marginal Interest changes were harder to detect than Central Interest changes. -/- Analysis of eye movements showed, as expected, that the probability of detecting a change depended on the eye’s distance from the change location. However a surprising finding was that both for Central and Marginal Interest changes, evenwhen observers were directly fixating the change locations (within 1 degree),more than 40% of the time they still failed to see the changes. It seems that looking at something does not guarantee you “ see” it. (shrink)

Running head: Implicit sequence learning ABSTRACT Can we learn without awareness? Although this issue has been extensively explored through studies of implicit learning, there is currently no agreement about the extent to which knowledge can be acquired and projected onto performance in an unconscious way. The controversy, like that surrounding implicit memory, seems to be at least in part attributable to unquestioned acceptance of the unrealistic assumption that tasks are process-pure, that is, that a given task exclusively involves either implicit (...) or explicit knowledge. (shrink)

Evidence from many different paradigms (e.g. change blindness, inattentional blindness, transsaccadic integration) indicate that observers are often very poor at reporting changes to their visual environment. Such evidence has been used to suggest that the spatio-temporal coherence needed to represent change can only occur in the presence of focused attention. In four experiments we use modified change blindness tasks to demonstrate (a) that sensitivity to change does occur in the absence of awareness, and (b) this sensitivity does not rely on (...) the redeploy- ment of attention. We discuss these results in relation to theories of scene percep- tion, and propose a reinterpretatio n of the role of attention in representing change. (shrink)

b>—Several paradigms (e.g. change blindness, inattentional blindness, transsaccadic integra- tion) indicate that observers are often very poor at reporting changes to their visual environment. Such evidence has been used to suggest that the spatio-temporal coherence needed to represent change can only occur in the presence of focused attention. However, those studies almost always rely on explicit reports. It remains a possibility that the visual system can implicitly detect change, but that in the absence of focused attention, the change does not (...) reach awareness and consequently is not reported. To test this possibility, we used a simple change detection paradigm coupled with a speeded orien- tation discrimination task. Even when observers reported being unaware of a change in an item’s orientation, its nal orientation effectively biased their response in the orientation discrimination task. Both in aware and unaware trials, errors were most frequent when the changed item and the probe had incongruent orientations. These results demonstrate that the _nature _of the change can be represented in the absence of awareness. (shrink)

Experiments on scene perception and change blindness suggest that the visual system does not construct detailed internal models of a scene. These experiments therefore call into doubt the traditional view that vision is a process in which detailed representations of the environment must be constructed. The non-existence of such detailed representations, however, does not entail that we do not perceive the detailed environment. The “grand illusion hypothesis” that our visual world is an illusion rests on (1) a problematic “reconstructionist” conception (...) of vision, and (2) a misconception about the character of perceptual experience. (shrink)