Change blindness is the striking failure to see large changes that normally would be noticed easily. Over the past decade this phenomenon has greatly contributed to our understanding of attention, perception, and even consciousness. The surprising extent of change blindness explains its broad appeal, but its counterintuitive nature has also engendered confusions about the kinds of inferences that legitimately follow from it. Here we discuss the legitimate and the erroneous inferences that have been drawn, and offer a set of requirements (...) to help separate them. In doing so, we clarify the genuine contributions of change blindness research to our understanding of visual perception and awareness, and provide a glimpse of some ways in which change blindness might shape future research. (shrink)

Saccadic eye movements create (at least) two related but distinct problems for the visual system: they cause rapid image motion and a displacement of the retinal image. Although it is often assumed that the motion is too fast to be resolved, this is certainly not the case for low-spatial-frequency images. Recent experiments have suggested that the reason we are unaware of the motion during saccades is because motion channels are selectively suppressed, possibly by suppression of the magno-cellular (but not the (...) parvocellular) pathway. This suppression may explain why there is no sensation of motion during saccades, but it leaves open the problem of perceiving a stable world despite continual image displacements. (shrink)

A theory of the structure and cognitive function of the human imagination that attempts to do justice to traditional intuitions about its psychological centrality is developed, largely through a detailed critique of the theory propounded by Colin McGinn. Like McGinn, I eschew the highly deflationary views of imagination, common amongst analytical philosophers, that treat it either as a conceptually incoherent notion, or as psychologically trivial. However, McGinn fails to develop his alternative account satisfactorily because (following Reid, Wittgenstein and Sartre) he (...) draws an excessively sharp, qualitative distinction between imagination and perception, and because of his flawed, empirically ungrounded conception of hallucination. His arguments in defense of these views are rebutted in detail, and the traditional, passive, Cartesian view of visual perception, upon which several of them implicitly rely, is criticized in the light of findings from recent cognitive science and neuroscience. It is also argued that the apparent intuitiveness of the passive view of visual perception is a result of mere historical contingency. An understanding of perception (informed by modern visual science) as an inherently active process enables us to unify our accounts of perception, mental imagery, dreaming, hallucination, creativity, and other aspects of imagination within a single coherent theoretical framework. (shrink)

Large changes that occur in clear view of an observer can become difficult to notice if made during an eye movement, blink, or other such disturbance. This change blindness is consistent with the proposal that focused visual attention is necessary to see change, with a change becoming difficult to notice whenever conditions prevent attention from being automatically drawn to it. -/- It is shown here how the phenomenon of change blindness can provide new results on the nature of visual attention, (...) including estimates of its capacity and the extent to which it can bind visual properties into coherent descriptions. It is also shown how the resultant characterization of attention can in turn provide new insights into the role that it plays in the perception of scenes and events. (shrink)

Large changes in a scene often become difficult to notice if made during an eye movement, image flicker, movie cut, or other such disturbance. It is argued here that this _change blindness_ can serve as a useful tool to explore various aspects of vision. This argument centers around the proposal that focused attention is needed for the explicit perception of change. Given this, the study of change perception can provide a useful way to determine the nature of visual attention, and (...) to cast new light on the way that it is?and is not?involved in visual perception. To illustrate the power of this approach, this paper surveys its use in exploring three different aspects of vision. The first concerns the general nature of _seeing_. To explain why change blindness can be easily induced in experiments but apparently not in everyday life, it is proposed that perception involves a _virtual representation_, where object representations do not accumulate, but are formed as needed. An architecture containing both attentional and nonattentional streams is proposed as a way to implement this scheme. The second aspect concerns the ability of observers to detect change even when they have no visual experience of it. This _sensing_ is found to take on at least two forms: detection without visual experience (but still with conscious awareness), and detection without any awareness at all. It is proposed that these are both due to the operation of a nonattentional visual stream. The final aspect considered is the nature of visual attention itself?the mechanisms involved when _scrutinizing_ items. Experiments using controlled stimuli show the existence of various limits on visual search for change. It is shown that these limits provide a powerful means to map out the attentional mechanisms involved. (shrink)

Our eyes, bodies, and perspectives are constantly shifting as we observe the world. Despite this, we are very good at distinguishing between self-caused visual changes and changes in the environment: the world appears mostly stable despite our visual field moving around. This, it seems, also occurs when we are dreaming. As we visually investigate the dream environment, we track moving objects with our dream eyes, examine objects, and shift focus. These movements, research suggests, are reflected in the rapid movements or (...) saccades of our sleeping eyes. Do we really see the dream world in the same way that we see the real world? If we do, how could dreaming, usually assumed to be mind-generated hallucinations, replicate such an experience? This problem would be deflated if dreams are not hallucinations at all, but rather imagination, illusion or simply unrealistic. I argue that imagination and illusion views do not satisfactorily explain away the problem of vision and action in sleep. The imagination model is not a complete description of dreaming that is consistent with empirical research, and it is unlikely that the visual dream world is an illusion. Given that the dreaming visual experience is most likely active, hallucinatory, and at times a realistic world simulation, there are important implications for our understanding of visual perception and its relationship to movement. Evidence suggests that our dream eyes investigate the dream world as our waking eyes investigate the waking world. If changes to the unconsciously generated dream environment are perceived as external and unintentional while dream body movements are perceived as self-generated and intentional, current theory of visual perception may have to be expanded to account for how the dreaming mind generates a stable world in which we track and visually explore mind-generated objects. (shrink)

According to the decomposition thesis, perceptual experiences resolve without remainder into their different modality-specific components. Contrary to this view, I argue that certain cases of multisensory integration give rise to experiences representing features of a novel type. Through the coordinated use of bodily awareness—understood here as encompassing both proprioception and kinaesthesis—and the exteroceptive sensory modalities, one becomes perceptually responsive to spatial features whose instances couldn’t be represented by any of the contributing modalities functioning in isolation. I develop an argument for (...) this conclusion focusing on two cases: 3D shape perception in haptic touch and experiencing an object’s egocentric location in crossmodally accessible, environmental space. (shrink)

Five aspects of visual change detection are reviewed. The first concerns the concept of change itself, in particular the ways it differs from the related notions of motion and difference. The second involves the various methodological approaches that have been developed to study change detection; it is shown that under a variety of conditions observers are often unable to see large changes directly in their field of view. Next, it is argued that this “change blindness” indicates that focused attention is (...) needed to detect change, and that this can help map out the nature of visual attention. The fourth aspect concerns how these results affect our understanding of visual perception—for example, the implication that a sparse, dynamic representation underlies much of our visual experience. Finally, a brief discussion is presented concerning the limits to our current understanding of change detection. (shrink)

A distinction should be made between the formation of stimulus-driven associations and cognitive concepts. To test the learning mode of a neural network, we propose a simple and classic input-output test: the discrimination shift task. Feed-forward PDP models appear to form stimulus-driven associations. A Hopfield network should be extended to apply the test.

Further tests of Amit's model are indicated. One strategy is to use the apparent coding sparseness of the model to make predictions about coding sparseness in Miyashita's network. A second approach is to use memory overload to induce false positive responses in modules and biological systems. In closing, the importance of temporal coding and timing requirements in developing biologically plausible attractor networks is mentioned.

Hebbian mechanisms are justified according to their functional utility in an evolutionary sense. The selective advantage of correlating content-contingent stimuli reflects the putative common cause of temporally or spatially contiguous inputs. The selective consequences of such correlations are discussed by using examples from the evolution of signal form in sexual selection and model-mimic coevolution. We suggest that evolutionary justification might be considered in addition to neurophysiology plansibility when constructing representational models.

We analysed location priming effects, and thus the ability to integrate visual information across subsequent trials in the three studies presented in the following chapters. Based on previous findings in healthy subjects priming effects occur under conditions that require no attentional shifts in-between subsequent trials, i.e. with the subject’s fixation maintained and the search displays presented at retinotopically equal locations with respect to the fixation cross. In study 1 we tested whether location-based priming effects would outlive spatial shifts of attention (...) in healthy subjects. The basic assumption, derived from Pisella and Mattingley´s account was they would, and that the outliving would be based on intact spatial remapping mechanisms operating in healthy subjects along with attention shifts. The aim of study 1 in view of further investigations in patients, i.e. in studies 2 and 3 was to test the suitability of the priming paradigm to serve our purpose to investigate spatial remapping abilities, and furthermore, in patients, purported deficits. To test whether priming effects would outlive saccadic shifts of overt attention, subjects had to re-fixate the fixation cross in turns on the left and on the right side of the monitor between subsequent trials. In two separate experiments priming effects were measured at post-saccadically retinotopic and spatiotopic locations, respectively, and compared to effects in a control experiment requiring no attention shifts. The experiments were also applied in study 2. To test whether priming effects would outlive covert shifts of attention subjects´ attention was distracted between subsequent trials while their fixation was maintained. In two separate experiments priming effects were measured after exogenous and endogenous distraction, respectively, and compared to a control experiment without distraction. The experiments were also applied in study 3. The presence of priming effects despite interfering attention shifts could be taken as evidence that processes that integrate visual information along with attention shifts, i.e. spatial remapping mechanisms, operate flawlessly in healthy subjects. The aim of study 2 was to test whether the parietal cortex provides the neural correlate of spatial remapping as assumed by Pisella and Mattingley. To that end, we tested whether spatial remapping deficits would occur after saccadic shifts of overt attention in patients with right parietal lesions. Deficits were expected to be indicated by altered or disturbed priming effects in those patients as compared to priming effects in healthy control subjects and furthermore, in patients with right-hemispheric lesions not involving the parietal lobe. Latter patients were tested, to control for and differentiate between deficits occurring more generally after right-hemispheric damages and specific deficits occurring after right parietal damages. Moreover, given the crucial role of priming for visual search disturbed priming as an indicator of deficient spatial remapping would provide support for the assumption made by Pisella and Mattingley that spatial remapping deficits contribute to visual search impairments as they are often observed in patients with right parietal lesions. The aim of study 3 was to test the model’s assumption that spatial remapping is required after spatial shifts of covert attention. Again, we compared priming effects of patients with right parietal lesions to those of patients with right-hemispheric lesions without parietal involvement, and healthy subjects. We expected priming effects to be disturbed in patients with right parietal lesions provided that covert attention shifts induce spatial remapping requirements, and that the anatomical site of spatial remapping mechanisms operating to integrate visual information across spatial shifts of covert attention is located in the parietal lobe. (shrink)

The cell assembly as a simple attractor cannot explain many cognitive phenomena. It must be a highly structured network that can sustain highly structured excitation patterns. Moreover, a cell assembly must be more widely distributed in space than on a square millimeter.

In Origins of Objectivity Burge advances a theory of perception according to which perceptions are, themselves, objective representations. The possession of veridicality conditions by perceptual states—roughly, non-propositional analogues of truth-conditions—is central to Burge’s account of how perceptual states differ, empirically and metaphysically, from sensory states. Despite an impressive examination of the relevant empirical literatures, I argue here that Burge has not succeeded in securing a distinction between perception and “mere” sensation.

The cell assembly is an important concept for cognitive psychology. Cognitive processing will to a large extent depend on the relations that can exist between different assemblies. A potential relation between assemblies can already be seen in the occurrence of (classical) conditioning. However, the resulting associations between assemblies only produce behavioristic processing or so-called regular computation. Higher-level cognitive abilities most likely result from nonregular computation. I discuss the possibility of this form of computation in terms of cell assemblies.

Amit's work addresses a critical issue in cognitive science: the structure of neural representations. The use of Hebbian cell assemblies is a positive step, and we now need to consider its role in a larger cognitive theory. When considering the dynamics of a system built out of attractors, a more limited version of reverberation becomes necessary.

Amit's “Attractor Neural Network” perspective on cognition raises difficult technical problems already met by prior dynamical models. This commentary sketches briefly some of them concerning the internal topological structure of attractors, the constituency problem, the possibility of activating simultaneously several attractors, and the different kinds of dynamical structures one can use to model brain activity: point attractors, strange attractors, synchronized arrays of oscillators, synfire chains, and so forth.

The neurophysiological evidence from the Miyashita group's experiments on monkeys as well as cognitive experience common to us all suggests that local neuronal spike rate distributions might persist in the absence of their eliciting stimulus. In Hebb's cell-assembly theory, learning dynamics stabilize such self-maintaining reverberations. Quasi-quantitive modeling of the experimental data on internal representations in association-cortex modules identifies the reverberations (delay spike activity) as the internal code (representation). This leads to cognitive and neurophysiological predictions, many following directly from the language (...) used to describe the activity in the experimental delay period, others from the details of how the model captures the properties of the internal representations. (shrink)

Amit's efforts to provide stronger theoretical and empirical support for Hebb's cell-assembly concept is admirable, but we have serious reservations about the perspective presented in the target article. For Hebb, the cell assembly was a building block; by contrast, the framework proposed here eschews the need to fit the assembly into a broader picture of its function.

The issue of the biological origin of consciousness is linked to that of its function. One source of evidence in this regard is the contrast between the types of information that are and are not included within its compass. Consciousness presents us with a stable arena for our actions—the world—but excludes awareness of the multiple sensory and sensorimotor transformations through which the image of that world is extracted from the confounding influence of self-produced motion of multiple receptor arrays mounted on (...) multijointed and swivelling body parts. Likewise excluded are the complex orchestrations of thousands of muscle movements routinely involved in the pursuit of our goals. This suggests that consciousness arose as a solution to problems in the logistics of decision making in mobile animals with centralized brains, and has correspondingly ancient roots. (shrink)

Persistent activity can be the product of mechanisms other than attractor reverberations. The single-unit data presented by Amit cannot discriminate between the different mechanisms. In fact, single-unit data do not appear to be adequate for testing neural network models.

Every immediate memory is unique; it is therefore unlikely to consist of an attractor or even a combination of attractors. In the present state of knowledge about the chemistry of synaptic transmission, there is no reason to look beyond neurons that directly receive sensory afferents for the afterdischarges that correspond to active memories.

Is vision informationally encapsulated from cognition or is it cognitively penetrated? I shall argue that intentions penetrate vision in the experience of visual spatial constancy: the world appears to be spatially stable despite our frequent eye movements. I explicate the nature of this experience and critically examine and extend current neurobiological accounts of spatial constancy, emphasizing the central role of motor signals in computing such constancy. I then provide a stringent condition for failure of informational encapsulation that emphasizes a computational (...) condition for cognitive penetration: cognition must serve as an informational resource for visual computation. This requires proposals regarding semantic information transfer, a crucial issue in any model of informational encapsulation. I then argue that intention provides an informational resource for computation of visual spatial constancy. Hence, intention penetrates vision. (shrink)

In this article we present a new experimental paradigm: comparative visual search. Each half of a display contains simple geometrical objects of three different colors and forms. The two display halves are identical except for one object mismatched in either color or form. The subject's task is to find this mismatch. We illustrate the potential of this paradigm for investigating the underlying complex processes of perception and cognition by means of an eye‐tracking study. Three possible search strategies are outlined, discussed, (...) and reexamined on the basis of experimental results. Each strategy is characterized by the way it partitions the field of objects into “chunks.” These strategies are: (i) Stimulus‐wise scanning with minimization of total scan path length (a “traveling salesman” strategy), (ii) scanning of the objects in fixed‐size areas (a “searchlight” strategy), and (iii) scanning of object sets based on variably sized clusters defined by object density and heterogeneity (a “clustering” strategy). To elucidate the processes underlying comparative visual search, we introduce besides object density a new entropy‐based measure for object heterogeneity. The effects of local density and entropy on several basic and derived eye‐movement variables clearly rule out the traveling salesman strategy, but are most compatible with the clustering strategy. (shrink)

Recurrent excitation is experimentally well documented in cortical populations. It provides for intracortical excitatory biases that linearize negative feedback interactions and induce macroscopic state transitions during perception. The concept of the local neighborhood should be expanded to spatial patterns as the basis for perception, in which large areas of cortex are bound into cooperative behavior with near-silent columns as important as active columns revealed by unit recording.

Amit's Hebbian model risks being overexplanatory, since it does not depend on specific physiological modelling of cortical ANNs, but concentrates on those phenomena which are modelled by a large class of ANNs. While offering a strong demonstration of the presence of Hebb's “cell assemblies,” it does not offer an equal account of Hebb's “phase sequence” concept.

Cortical reverberations may induce synaptic changes that underlie developmental plasticity as well as long-term memory. They may be especially important for the consolidation of synaptic changes. Reverberations in cortical networks should have particular significance during development, when large numbers of new representations are formed. This includes the formation of representations across different sensory modalities.

Amit defines cell assemblies aslocal cortical neuron populationswith strong internal connections. However, Hebb himself proposed that cell assemblies are distributed over different cortical areas (nonlocal ortranscortical assemblies). We review evidence from cognitive neuroscience and neuropsychology supporting the assumption that cell assemblies are transcortical.

The Miyashita experiments are very interesting and the results should be examined from a viewpoint of attractor dynamics. Amit's target article shows a path toward realistic modeling by artificial neural networks (ANN), but it is not necessarily the only one. I introduce another model that can explain a substantial part of the empirical observations and makes an interesting prediction. This model consists of such units that have nonmonotonic input-output characteristics with local inhibition neurons.

Hebbian cell-assembly theory and attractor networks are good starting points for modeling cortical processing. Detailed cell models can be useful in understanding the dynamics of attractor networks. Cell assemblies are likely to be distributed, with the cortical column as the local processing unit. Synaptic memory may be dominant in all but the first couple of seconds.

The concept of an attractor in a mathematical dynamical system is reviewed. Emphasis is placed on the distinction between a cell assembly, the corresponding attractor, and the attractor dynamics. The biological significance of these entities is discussed, especially the question of whether the representation of the stimulus requires the full attractor dynamics, or merely the cell assembly as a set of reverberating neurons. Comparison is made to Freeman's study of dynamic patterns in olfaction.

The array seen when saccading across a point light source blinking in the dark is displaced in the direction of the saccade. This displacement reflects an abrupt shift of spatiotopic coordinates that precedes the actual eye movement. The extraretinal signal mediating this discrete shift appears to be an oculomotor reference signal, specifying intended eye orientation, that changes discretely before saccades.

This commentary questions the target articles inferences from a limited set of empirical data to support this model and conceptual scheme. Especially questionable is the attribution of internal representation properties to an assembly of cells in a discrete cortical module firing at a discrete attractor frequency. Alternative inferences are drawn from cortical cooling and cell-firing data that point to the internal representation as a broad and specific cortical network defined by cortico-cortical connectivity. Active memory, it is proposed, consists in the (...) sustained activation of the component neuron populations of the network. (shrink)

A theory of representation is incomplete if it states “representations areX” whereXcan be symbols, cell assemblies, functional states, or the flock of birds fromTheaetetus, without explaining the nature of the link between the universe ofXs and the world. Amit's thesis, equating representations with reverberations in Hebbian cell assemblies, will only be considered a solution to the problem of representation when it is complemented by a theory of how a reverberation in the brain can be a representation of anything.

Interpreting the Miyashita et al. experiments in terms of a cellassembly representation does not adequately explain the performance of Miyashita's monkeys on novel stimuli. We will argue that the latter observations point to acompositionalrepresentation and suggest a dynamics involving rapid and reversible binding of distinct activity patterns.

The context of the target article is delimited again, underlining the intended locationof the argument in the bottomup hierarchy of brain study. The central message is that collective delay activity distributions (reverberations) in cortical modules extend the role of a spike (a potentialinformation carrier across long distances) to an active memory of structured, learned information that can be carried across long time intervals. Moreover, the population code of the reverberations makes them readable down the cortical processing stream. Most of the (...) critical comments are then interpreted and addressed in relation to misreading of the proper context. The price for the limitation of the context (in cognitive, behavioral, and computational terms) is compared with the advantages of a clear, direct contact with experiment on the one hand and with a well controlled body of modeling and analysis on the other. (shrink)