The predictive coding (PC) theory of attention identifies attention with the optimization of the precision weighting of prediction error. Here we provide some challenges for this identification. On the one hand, the precision weighting of prediction error is too broad a phenomenon to be identified with attention because such weighting plays a central role in multimodal integration. Cases of crossmodal illusions such as the rubber hand illusion and the McGurk effect involve the differential precision weighting of prediction error, yet attention (...) does not shift as one would predict. On the other hand, the precision weighting of prediction error is too narrow a phenomenon to be identified with attention, because it cannot accommodate the full range of attentional phenomena. We review criticisms that PC cannot account for volitional attention and affect-biased attention, and we propose that it may not be able to account for feature-based and intellectual attention. (shrink)

This report concerns the fragmented visual percepts in a woman, TR, following a right entorhinal–perirhinal infarct. In a previous report, Weddell [Weddell, R. A. . A visual disorder producing highly selective deletion of recurring letters. Cortex, 41, 471–485] linked TR’s highly selective tendency to delete recurrent letters with her fragmented percepts. The conflation of same-identity form elements was attributed to anterior extrastriate damage, which reduced the amount of information sustainable in fully resolved visual percepts, and the present experimental investigation of (...) her subjective account of segment formation and resolution completes the story. She said that complex objects and long words first appeared as blurred regions, which sometimes included form elements. It is argued that figure-centred attentional mechanisms subdivided this blurred region into up to 3–4 parts. String length, lexical status , and background colour and/or luminance determined fragment length. Two rules described the fragment resolution sequence: largest segments usually resolved first, left-to-right resolution accounting for a few sequences. This resolution sequence occurred when stimuli were exposed too briefly for saccadic exploration, implicating endogenous attentional shifts. Experiment 4 confirmed TR’s assertion that spatial, orthographic, and phonological information were stored during the fragment resolution process. Moreover, TR exerted considerable voluntarily control over the fragment resolution sequence and some influence over fragment length. Finally, these findings were interpreted in terms of an extended version of a neural network model of vision largely derived from nonhuman primate studies. (shrink)

This paper argues that a theory of situated vision, suited for the dual purposes of object recognition and the control of action, will have to provide something more than a system that constructs a conceptual representation from visual stimuli: it will also need to provide a special kind of direct (preconceptual, unmediated) connection between elements of a visual representation and certain elements in the world. Like natural language demonstratives (such as `this' or `that') this direct connection allows entities to be (...) referred to without being categorized or conceptualized. Several reasons are given for why we need such a preconcep- tual mechanism which individuates and keeps track of several individual objects in the world. One is that early vision must pick out and compute the relation among several individual objects while ignoring their properties. Another is that incrementally computing and updating representations of a dynamic scene requires keeping track of token individuals despite changes in their properties or locations. It is then noted that a mechanism meeting these requirements has already been proposed in order to account for a number of disparate empiri- cal phenomena, including subitizing, search-subset selection and multiple object tracking (Pylyshyn et al., Canadian Journal of Experimental Psychology 48(2) (1994) 260). This mechanism, called a visual index or FINST, is brie. (shrink)

Many have held that when a person visually attends to an object, her visual system deploys a representation that designates the object. Call the referential link between such representations and the objects they designate attentive visual reference. In this article I offer an account of attentive visual reference. I argue that the object representations deployed in visual attention—which I call attentive visual object representations —refer directly, and are akin to indexicals. Then I turn to the issue of how the reference (...) of an AVOR is determined relative to a context. After raising problems for existing accounts, I propose a mechanism of reference determination that is both causal and descriptive: For an AVOR to refer to a particular object, the object must appropriately cause the deployment of the AVOR, and the AVOR must be associated with descriptive information about some of the object's geometrical and mereological properties. (shrink)

6. Seeing With the Mind’s Eye 1: The Puzzle of Mental Imagery .................................................6-1 6.1 What is the puzzle about mental imagery?..............................................................................6-1 6.2 Content, form and substance of representations ......................................................................6-6 6.3 What is responsible for the pattern of results obtained in imagery studies?.................................6-8..

I recently discovered that work I was doing in the laboratory and in theoretical writings was implicitly taking a position on a set of questions that philosophers had been worrying about for much of the past 30 or more years. My clandestine involvement in philosophical issues began when a computer science colleague and I were trying to build a model of geometrical reasoning that would draw a diagram and notice things in the diagram as it drew it (Pylyshyn, Elcock, Marmor, (...) & Sander, 1978). One problem we found we had to face was that if the system discovered a right angle it had no way to tell whether this was the intersection of certain lines it had drawn earlier while constructing a certain figure, and if so which particular lines they were. Moreover, the model had no way of telling whether this particular right angle was identical to some bit of drawing it had earlier encountered and represented as, say, the base of a particular triangle. There was, in other words, no way to determined the identity of an element (I use the term “element” when referring to a graphical unit such as used in experiments. Otherwise when speaking informally I use the term “thing” on the grounds that nobody would mistake that term for a technical theoretical construct. Eventually I end up calling them “Visual Objects” to conform to usage in psychology) at two different times if it was represented differently at those times. This led to some speculation about the need for what we called a “finger” that could be placed at a particular element of interest and that could be used to identify it as particular token thing (the way you might identify a particular feature on paper by labeling it). In general we needed something like a finger that would stay attached to a particular element and could be used to maintain a correspondence between the individual element that was just noticed now and one that had been represented in some fashion at an earlier time. The idea of such fingers (which.... (shrink)

We previously reported that in the Multiple Object Tracking (MOT) task, which requires tracking several identical targets moving unpredictably among identical nontargets, the nontargets appear to be inhibited, as measured by a probe-dot detection method. The inhibition appears to be local to nontargets and does not extend to the space between objects – dropping off very rapidly away from targets and nontargets. In the present three experiments we show that (1) nontargets that are identical to targets but remain in a (...) fixed location are not inhibited and (2) moving objects that have a different shape from targets are inhibited as much as same-shape nontargets, and (3) nontargets that are on a different depth plane and so are easily filtered out are not inhibited. This is consistent with a taskdependent view of item inhibition wherein nontargets are inhibited if (and only if) they are likely to be mistaken for targets. (shrink)

We present three studies examining whether multiple-object tracking (MOT) benefits from the active inhibition of nontargets, as proposed in (Pylyshyn, 2004). Using a probedot technique, the first study showed poorer probe detection on nontargets than on either the targets being tracked or in the empty space between objects. The second study used a matching nontracking task to control for possible masking of probes, independent of target tracking. The third study examined how localized the inhibition is to individual nontargets. The result (...) of these three studies led to the conclusion that nontargets are subject to a highly localized object-based inhibition. Implications of this finding for the FINST visual index theory are discussed. We suggest that we need to distinguish between the differentiation (or individuation) of enduring token objects and the process of making the objects accessible through indexes, with only the latter being limited to 4 or 5 objects. (shrink)

In the visual search paradigm, participants’ task is to detect the presence or absence of a target item, which is presented in an array of distractor items. Usually it is found that performance is dependent on specific properties of the visual display, for example, the number of items to be searched or the similarity between display items. However, recent research has demonstrated that memory mechanisms can also affect search behaviour. Further, it was found that memory mechanisms can, in principle, be (...) either facilitatory or inhibitory, that is, that the processing of the item locations, features, or search objects themselves can be improved or impeded, respectively. This thesis investigated the effects of facilitatory and inhibitory memory mechanisms based on the element positions within the search display; facilitatory memory mechanisms based on the features of the search elements; and inhibitory memory mechanisms based on the search objects themselves. (shrink)

The task of tracking a small number (about four or five) visual targets within a larger set of identical items, each of which moves randomly and independently, has been used extensively to study object-based attention. Analysis of this multiple object tracking (MOT) task shows that it logically entails solving the correspondence problem for each target over time, and thus that the individuality of each of the targets must be tracked. This suggests that when successfully tracking objects, observers must also keep (...) track of them as unique individuals. Yet in the present studies we show that observers are poor at recalling the identity of successfully tracked objects (as specified by a unique identifier associated with each target, such as a number or starting location). Studies also show that the identity of targets tends to be lost when they come close together and that this tendency is greater between pairs of targets than between targets and nontargets. The significance of this finding in relation to the multiple object tracking paradigm is discussed. (shrink)