Cognitive scientists have long known that the modalities interact during perceptual processing. Cross-modal illusions like the ventriloquism effect show that the course of processing in one modality can alter the course of processing in another. But how do the modalities interact in the specific domain of object perception? This paper distinguishes and analyzes two kinds of multisensory interaction in object perception. First, the modalities may bind features to a single object or event. Second, the modalities may cooperate when differentiating an (...) object or event from its surroundings. I critically evaluate evidence for various forms of multisensory binding. I then consider the case for multisensory differentiation. I argue that existing evidence for multisensory differentiation is inconclusive. I highlight ways that the issue might be empirically resolved. (shrink)

Evidence for a dichotomy between the planning of an action and its on-line control in humans is reviewed. This evidence suggests that planning and control each serve a specialized purpose utilizing distinct visual representations. Evidence from behavioral studies suggests that planning is influenced by a large array of visual and cognitive information, whereas control is influenced solely by the spatial characteristics of the target, including such things as its size, shape, orientation, and so forth. Evidence from brain imaging and neuropsychology (...) suggests that planning and control are subserved by separate visual centers in the posterior parietal lobes, each constituting part of a larger network for planning and control. Planning appears to rely on phylogenetically newer regions in the inferior parietal lobe, along with the frontal lobes and basal ganglia, whereas control appears to rely on older regions in the superior parietal lobe, along with the cerebellum. Key Words: action; apraxia; control; illusions; optic ataxia; PET; planning; reaching;. (shrink)

The ontological question of what there is, from the perspective of common sense, is intricately bound to what can be perceived. The above observation, when combined with the fact that nouns within language can be divided between nouns that admit counting, such as ‘pen’ or ‘human’, and those that do not, such as ‘water’ or ‘gold’, provides the starting point for the following investigation into the foundations of our linguistic and conceptual phenomena. The purpose of this paper is to claim (...) that such phenomena are facilitated by, on the one hand, an intricate cognitive capacity, and on the other by the complex environment within which we live. We are, in a sense, cognitively equipped to perceive discrete instances of matter such as bodies of water. This equipment is related to, but also differs from, that devoted to the perception of objects such as this computer. Behind this difference in cognitive equipment underlies a rich ontology, the beginnings of which lies in the distinction between matter and objects. The following paper is an attempt to make explicit the relationship between matter and objects and also provide a window to our cognition of such entities. (shrink)

Bullot & Reber (B&R) put forth a design stance to fuse psychological and art historical accounts of visual thinking into a single theory. We argue that this aspect of their proposal needs further fine-tuning. Issues of transgression and coherence are necessary to provide stability to the design stance. We advocate looking to Art Education for such fundamentals of picture understanding.

Recent experimental psychological research on visual perception, auditory perception, and cross-modal perception has shed light on how these processes differ, and how the relations between visual and auditory stimuli shade our understanding of the events perceived. This work offers a possible way into considering the question of how music and dance “go together” or not, and particularly may shed light on the unusual twentieth-century human behavior of NOT having music and dance “go together.” Our paper presents relevant research in perception, (...) examines factors contributing to the separation of perceptual modalities that has often appeared in twentieth-century dance, and discusses the separation in terms of the specific behaviors of dancing and looking at dance. (shrink)

On a traditional or default view of the grasping or understanding of a singular proposition by an individual, it is assumed to be a unitary or holistic activity. However, naturalistic views of cognition plausibly could analyze propositional thinking in terms of more than one distinctive functional stage of cognitive processing, suggesting at least the potential legitimacy of a non-unitary analysis of propositional grasping. We outline a novel dual-component view of this kind, and show that it is well supported by current (...) cognitive science research. (shrink)

This text aims at presenting a general characterization of the act of perceiving a particular object, in a framework in which perception is conceived of as a mental and cognitive faculty having specific functions that other faculties such as imagination and memory do not possess. I introduce the problem of determining the occurrence of singular perception of a physical object, as opposed to the occurrence of other mental states or attitudes. I propose that clarifying this occurrence problem requires making explicit (...) the conditions of perceptual competence/faculty so as to explain the occurrence of each perceptual performance on the basis of the use of this competence. I argue then for a direct relational model according to which the singular perception of an object depends on a competence of connecting the perceiver directly with each target object. This model is compatible with a disjunctive approach to perception according to which each particular experience of an object corresponds either to a direct perceptual relation with this object or to the illusion of having the experience of this object. The arguments in favour of this relational model rest on the idea that the faculty of perception grounds the capacity to demonstratively identify physical objects. (shrink)

Our beliefs utilize various sources: perception, memory, induction, etc. We trust these sources to provide reliable information about the world around us. My dissertation investigates how this trust could be justified. Chapter one introduces background material. I argue that justification rather than knowledge is of primary epistemological importance, discuss the internalism/externalism debate, and introduce an evidentialist thesis that provides a starting point/framework for epistemological theorizing. Chapter two introduces a puzzle concerning justification. Can a belief source provide justification absent prior justification (...) for believing it's reliable? Any answer appears to either make justifying the reliability of a source intellectually unsatisfying or all together impossible. Chapter three considers and rejects a plethora of proposed solutions to our puzzle. Investigating these solutions illustrates the need to further investigate evidence, evidence possession, and evidential support. Chapter four discusses the metaphysics of evidence. I argue that evidence always consists of a set of facts and that fact-proposition pairs stand in confirmation relations isomorphic to those holding between pairs of propositions. Chapter five argues that justification requires what I call actually connected possession of supporting evidence: a subject must be aware of supporting evidence and of the support relation itself. Chapter six argues that the relation constitutive of a set of facts being justificatory evidence is a sui generis and irreducible relation that is knowable a priori. Chapter seven begins by showing how Richard Fumerton's acquaintance theory meets the constraints on a theory of justification laid down in previous chapters. I modify the theory so as to: make room for fallible foundational justification, and allow inferential justification absent higher-order beliefs about evidential connections. Chapter eight applies the developed theory of justification to our initial puzzle. I show how my modified acquaintance theory is in a unique position to vindicate the idea that necessarily a source provides a person with justification only if she is aware of evidence for the reliability of that source. However, this awareness of evidence for a source's reliability falls short of a justified belief and thereby avoids impalement from our dilemma's skeptical horn. (shrink)

1. Background: Representation in language and vision ................................................ 1 2. Some parallels between the study of vision and language......................................... 3..

��In four experiments we address the question whether several visual objects can be selected voluntarily (exogenously) and then tracked in a Multiple Object Tracking paradigm and, if so, whether the selection involves a different process. Experiment 1 showed that items can indeed be selected based on their labels. Experiment 2 showed that to select the complement set to a set that is automatically (exogenously) selected — e.g. to select all objects not flashed — observers require additional time and that given (...) 1080 ms they were able to select and track them as well as those selected automatically. Experiment 3 showed that the additional time needed in the previous experiment cannot be attributed solely to time required to disengage attention from the initially automatic selections. Experiment 4 showed that the added time provides a monotonically greater benefit when there are more targets, suggesting a serial process. These results are discussed in relation to the Visual Index (FINST) theory which assumes that visual indexes are captured by a data-driven process. It is suggested that voluntarily allocated attention can be used to facilitate the automatic attention capture by objects of interest. (shrink)

I recently discovered that work I was doing in the laboratory and in theoretical writings was implicitly taking a position on a set of questions that philosophers had been worrying about for much of the past 30 or more years. My clandestine involvement in philosophical issues began when a computer science colleague and I were trying to build a model of geometrical reasoning that would draw a diagram and notice things in the diagram as it drew it (Pylyshyn, Elcock, Marmor, (...) & Sander, 1978). One problem we found we had to face was that if the system discovered a right angle it had no way to tell whether this was the intersection of certain lines it had drawn earlier while constructing a certain figure, and if so which particular lines they were. Moreover, the model had no way of telling whether this particular right angle was identical to some bit of drawing it had earlier encountered and represented as, say, the base of a particular triangle. There was, in other words, no way to determined the identity of an element (I use the term “element” when referring to a graphical unit such as used in experiments. Otherwise when speaking informally I use the term “thing” on the grounds that nobody would mistake that term for a technical theoretical construct. Eventually I end up calling them “Visual Objects” to conform to usage in psychology) at two different times if it was represented differently at those times. This led to some speculation about the need for what we called a “finger” that could be placed at a particular element of interest and that could be used to identify it as particular token thing (the way you might identify a particular feature on paper by labeling it). In general we needed something like a finger that would stay attached to a particular element and could be used to maintain a correspondence between the individual element that was just noticed now and one that had been represented in some fashion at an earlier time. The idea of such fingers (which.... (shrink)

We previously reported that in the Multiple Object Tracking (MOT) task, which requires tracking several identical targets moving unpredictably among identical nontargets, the nontargets appear to be inhibited, as measured by a probe-dot detection method. The inhibition appears to be local to nontargets and does not extend to the space between objects – dropping off very rapidly away from targets and nontargets. In the present three experiments we show that (1) nontargets that are identical to targets but remain in a (...) fixed location are not inhibited and (2) moving objects that have a different shape from targets are inhibited as much as same-shape nontargets, and (3) nontargets that are on a different depth plane and so are easily filtered out are not inhibited. This is consistent with a taskdependent view of item inhibition wherein nontargets are inhibited if (and only if) they are likely to be mistaken for targets. (shrink)

The Emergic Cognitive Model (ECM) is a unified computational model of visual filling-in based on the Emergic Network architecture. The Emergic Network was designed to help realize systems undergoing continuous change. In this thesis, eight different filling-in phenomena are demonstrated under a regime of continuous eye movement (and under static eye conditions as well). -/- ECM indirectly demonstrates the power of unification inherent with Emergic Networks when cognition is decomposed according to finer-grained functions supporting change. These can interact to raise (...) additional emergent behaviours via cognitive re-use, hence the Emergic prefix throughout. Nevertheless, the model is robust and parameter free. Differential re-use occurs in the nature of model interaction with a particular testing paradigm. -/- ECM has a novel decomposition due to the requirements of handling motion and of supporting unified modelling via finer functional grains. The breadth of phenomenal behaviour covered is largely to lend credence to our novel decomposition. -/- The Emergic Network architecture is a hybrid between classical connectionism and classical computationalism that facilitates the construction of unified cognitive models. It helps cutting up of functionalism into finer-grains distributed over space (by harnessing massive recurrence) and over time (by harnessing continuous change), yet simplifies by using standard computer code to focus on the interaction of information flows. Thus while the structure of the network looks neurocentric, the dynamics are best understood in flowcentric terms. Surprisingly, dynamic system analysis (as usually understood) is not involved. An Emergic Network is engineered much like straightforward software or hardware systems that deal with continuously varying inputs. Ultimately, this thesis addresses the problem of reduction and induction over complex systems, and the Emergic Network architecture is merely a tool to assist in this epistemic endeavour. -/- ECM is strictly a sensory model and apart from perception, yet it is informed by phenomenology. It addresses the attribution problem of how much of a phenomenon is best explained at a sensory level of analysis, rather than at a perceptual one. As the causal information flows are stable under eye movement, we hypothesize that they are the locus of consciousness, howsoever it is ultimately realized. (shrink)

One of the more powerful impressions created by vision is that of a coherent, richly-detailed world where everything is present simultaneously. Indeed, this impression is so compelling that we tend to ascribe these properties not only to the external world, but to our internal representations as well. But results from several recent experiments argue against this latter ascription. For example, changes in images of real-world scenes often go unnoticed when made during a saccade, flicker, blink, or movie cut. This "change (...) blindness" provides strong evidence against the idea that our brains contain a picture-like representation of the scene that is everywhere detailed and coherent. (shrink)

An overview is presented of the ways that change blindness has been applied to the study of various issues in perception and cognition. Topics include mechanisms of change perception, allocation of attention, nonconscious perception, and cognitive beliefs. Recent work using change blindness to investigate these topics is surveyed, along with a brief discussion of some of the ways that these approaches may further develop over the next few years.

A set of visual search experiments tested the proposal that focused attention is needed to detect change. Displays were arrays of rectangles, with the target being the item that continually changed its orientation or contrast polarity. Five aspects of performance were examined: linearity of response, processing time, capacity, selectivity, and memory trace. Detection of change was found to be a self-terminating process requiring a time that increased linearly with the number of items in the display. Capacity for orientation was found (...) to be about 5 items, a value comparable to estimates of attentional capacity. Observers were able to filter out both static and dynamic variations in irrelevant properties. Analysis also indicated a memory for previously-attended locations. These results support the hypothesis that the process needed to detect change is much the same as the attentional process needed to detect complex static patterns. Interestingly, the features of orientation and polarity were found to be handled in somewhat different ways. Taken together, these results not only provide evidence that focused attention is needed to see change, but also show that change detection itself can provide new insights into the nature of attentional processing. (shrink)

In this paper we examine to what extent the lengths of the links in an animated articulated figure can be changed without the viewer being aware of the change. This is investigated in terms of a framework that emphasizes the role of attention in visual perception. We conducted a set of five experiments to establish bounds for the sen-sitivity to changes in length as a function of several parameters and the amount of attention available. We found that while length changes (...) of 3% can be perceived when the relevant links are given full attention, changes of over 20% can go unnoticed when attention is not focused in this way. These results provide general guidelines for algorithms that produce or process character motion data and also bring to light some of the potential gains that stand to be achieved with attention-based algorithms. (shrink)

Large changes in a scene often become difficult to notice if made during an eye movement, image flicker, movie cut, or other such disturbance. It is argued here that this _change blindness_ can serve as a useful tool to explore various aspects of vision. This argument centers around the proposal that focused attention is needed for the explicit perception of change. Given this, the study of change perception can provide a useful way to determine the nature of visual attention, and (...) to cast new light on the way that it is?and is not?involved in visual perception. To illustrate the power of this approach, this paper surveys its use in exploring three different aspects of vision. The first concerns the general nature of _seeing_. To explain why change blindness can be easily induced in experiments but apparently not in everyday life, it is proposed that perception involves a _virtual representation_, where object representations do not accumulate, but are formed as needed. An architecture containing both attentional and nonattentional streams is proposed as a way to implement this scheme. The second aspect concerns the ability of observers to detect change even when they have no visual experience of it. This _sensing_ is found to take on at least two forms: detection without visual experience (but still with conscious awareness), and detection without any awareness at all. It is proposed that these are both due to the operation of a nonattentional visual stream. The final aspect considered is the nature of visual attention itself?the mechanisms involved when _scrutinizing_ items. Experiments using controlled stimuli show the existence of various limits on visual search for change. It is shown that these limits provide a powerful means to map out the attentional mechanisms involved. (shrink)

In the not-too-distant past, vision was often said to involve three levels of processing: a low level concerned with descriptions of the geometric and photometric properties of the image, a high level concerned with abstract knowledge of the physical and semantic properties of the world, and a middle level concerned with anything not handled by the other two. The negative definition of mid-level vision contained in this description reflected a rather large gap in our understanding of visual processing: How could (...) the here-and-now descriptions of the low levels combine with the enduring knowledge of the high levels to produce our perception of the surrounding world? A number of experimental and theoretical efforts have been made over the past few decades to solve this "mid-level crisis". One of the more recent of these is based on the phenomenon of change blindness—the difficulty in seeing a large change in a scene when the transients accompanying that change no longer convey information about its location (Rensink, O'Regan, & Clark, 1997; Rensink, 2000a). Phenomenologically, this effect is quite striking: the change typically is not seen for several seconds, after which it suddenly snaps into awareness. During the time the change remains "invisible", there is an apparent disconnection of the low-level descriptions (which respond to the change) from subjective visual experience (which does not). As such, this effect would seem to have the potential to help us understand how mid-level mechanisms might knit low- and high-level processes into a coherent representation of our surroundings. -/- It is argued here that this potential can indeed be realized, and that change blindness can teach us much about the nature of mid-level vision.3 A number of studies are first reviewed showing that the perception of a scene does not involve a steady buildup of detailed representation: rather, it is a dynamic process, with focused attention playing one of the main roles, viz., forming coherent object representations whenever needed. It is then argued that change blindness can also shed considerable light on the nature of focused attention itself, such as its speed, capacity, selectivity, and ability to bind together visual properties into coherent structures. (shrink)

When looking at a scene, observers feel that they see its entire structure in great detail and can immediately notice any changes in it. However, when brief blank fields are placed between alternating displays of an original and a modified scene, a striking failure of perception is induced: identification of changes becomes extremely difficult, even when changes are large and made repeatedly. Identification is much faster when a verbal cue is provided, showing that poor visibility is not the cause of (...) this difficulty. Identification is also faster for objects mentioned in brief verbal descriptions of the scene. These results support the idea that observers never form a complete, detailed representation of their surroundings. In addition, results also indicate that attention is required to perceive change, and that in the absence of localized motion signals it is guided on the basis of high-level interest. (shrink)

Last year at VSS, Bullot, Droulez & Pylyshyn reported studies using a Modified Traveling Salesman Paradigm in which a virtual vehicle had to visit up to 10 targets once and only once, and in which the invisible targets were identified only by line segments pointing from the vehicle toward each target. We hypothesized that subjects used two distinct strategies: A “location-based strategy”, which kept track of where targets were located in screen coordinates, and a “segment-based strategy” that kept track of (...) which segments corresponded to visited targets. We report new studies that further explore these two strategies. Subjects passively observed a computer-controlled virtual vehicle that visited a number of targets. Two forms of display were used: an “Allocentric” display, in which the vehicle moved and the targets remained fixed in screen coordinates, and an “Egocentric” display, in which the vehicle's position on the screen remained fixed while the targets moved -- as if the environment were being viewed by an observer on the vehicle. At the end of each trial, the directional segments were extended to the edge of the screen and subjects were asked to perform two tasks by referring to these segments. In the “status task” observers had to indicate for each segment whether the corresponding target had been visited or not. In the “locating task” they had to locate each target along its directional segment. Performance on these two tasks measures the use of the two hypothesized strategies. Results showed that observers do well on the status task with 4 or 6 targets in both display conditions, but do poorly on the locating task, especially in the egocentric condition when there are more targets. These results are consistent with the hypothesis that in the egocentric condition the MTSP task is carried out primarily by segment-tracking, which can be viewed as a deictic strategy. (shrink)

We present three studies examining whether multiple-object tracking (MOT) benefits from the active inhibition of nontargets, as proposed in (Pylyshyn, 2004). Using a probedot technique, the first study showed poorer probe detection on nontargets than on either the targets being tracked or in the empty space between objects. The second study used a matching nontracking task to control for possible masking of probes, independent of target tracking. The third study examined how localized the inhibition is to individual nontargets. The result (...) of these three studies led to the conclusion that nontargets are subject to a highly localized object-based inhibition. Implications of this finding for the FINST visual index theory are discussed. We suggest that we need to distinguish between the differentiation (or individuation) of enduring token objects and the process of making the objects accessible through indexes, with only the latter being limited to 4 or 5 objects. (shrink)

The present empirical study investigates limitations of human visual working memory. The experiments of the present work involve the experimental paradigm of change detection using simple geometrical objects in the form of rectangles of different colour, length, and orientation. It can be shown, that a limited performance in the temporary storage of visual information has multiple sources. Limitations of VWM can be attributed to a limited capacity or a limited duration, but also to limitations in retrieval, which so far has (...) found only little attention. Key findings of the present study show, that a capacity limitation cannot be described by a simple and generally valid size of the store. It is in fact generally acknowledged that the capacity limitation of VWM is object-based, which means that the capacity can roughly be determined by the number of visual objects. However, it could be shown that the complexity of the objects has an influence on memory performance: Experimental evidence shows, e.g., that memory performance decreases, when an object is characterized not only by one feature, but by a number of features. The results are explained by increased storage demands for the binding of the features. Other key findings of the present study relate to the process of retrieval of information from VWM. For example, an asymmetric performance pattern could be observed: In a change detection task a memory performance was observed that corresponds to a capacity of 3 - 4 objects. In contrast a drastic decrease of performance corresponding to a capacity of only 1 object was observed, when the task was to find a matching item among changed distractors. These results lead to the idea of a change signal, by which the empirical data can be explained. The change signal is elicited by a local mismatch between the information stored in VSTM and perceptual online information. The retrieval process is efficient, when the change signal can be used in the memory task. However, retrieval is extremely limited, when in the presence of multiple changes a less efficient strategy has to be applied. In the course of the present study, moreover, it became evident that there are various links between VWM processes and visual attention. Visual attention is probably crucial for feature binding in VWM. In retrieval the change signal probably involves mechanisms of visual attention. The present study could, therefore, contribute to a clarification of the relation between VWM and visual attention. (shrink)

In the visual search paradigm, participants’ task is to detect the presence or absence of a target item, which is presented in an array of distractor items. Usually it is found that performance is dependent on specific properties of the visual display, for example, the number of items to be searched or the similarity between display items. However, recent research has demonstrated that memory mechanisms can also affect search behaviour. Further, it was found that memory mechanisms can, in principle, be (...) either facilitatory or inhibitory, that is, that the processing of the item locations, features, or search objects themselves can be improved or impeded, respectively. This thesis investigated the effects of facilitatory and inhibitory memory mechanisms based on the element positions within the search display; facilitatory memory mechanisms based on the features of the search elements; and inhibitory memory mechanisms based on the search objects themselves. (shrink)

The task of tracking a small number (about four or five) visual targets within a larger set of identical items, each of which moves randomly and independently, has been used extensively to study object-based attention. Analysis of this multiple object tracking (MOT) task shows that it logically entails solving the correspondence problem for each target over time, and thus that the individuality of each of the targets must be tracked. This suggests that when successfully tracking objects, observers must also keep (...) track of them as unique individuals. Yet in the present studies we show that observers are poor at recalling the identity of successfully tracked objects (as specified by a unique identifier associated with each target, such as a number or starting location). Studies also show that the identity of targets tends to be lost when they come close together and that this tendency is greater between pairs of targets than between targets and nontargets. The significance of this finding in relation to the multiple object tracking paradigm is discussed. (shrink)