This article describes an implemented architecture for intermediate vision. By integrating a variety of Intermediate visual mechanisms and putting them to use in support of concrete activity, the implementation demonstrates their utility. The sytem, SIVS, models psychophysical discoveries about visual attention and search. It is designed to be efficiently implementable in slow, massively parallel, locally connected hardware, such as that of the brain.SIVS addresses five fundamental problems. Visual attention is required to restrict processing to task-relevant locations in the image. Visual (...) search finds such locations. Visual routines are a means for nonuniform processing based on task demands. Intermediate objects keep track of intermediate results of this processing. Visual operators are a set of relatively abstract, general-purpose primitives for spatial analysis, out of which visual routines are assembled. (shrink)

Diagrams are a form of spatial representation that supports reasoning and problem solving. Even when diagrams are external, not to mention when there are no external representations, problem solving often calls for internal representations, that is, representations in cognition, of diagrammatic elements and internal perceptions on them. General cognitive architectures—Soar and ACT-R, to name the most prominent—do not have representations and operations to support diagrammatic reasoning. In this article, we examine some requirements for such internal representations and processes in cognitive (...) architectures. We discuss the degree to which DRS, our earlier proposal for such an internal representation for diagrams, meets these requirements. In DRS, the diagrams are not raw images, but a composition of objects that can be individuated and thus symbolized, while, unlike traditional symbols, the referent of the symbol is an object that retains its perceptual essence, namely, its spatiality. This duality provides a way to resolve what anti-imagists thought was a contradiction in mental imagery: the compositionality of mental images that seemed to be unique to symbol systems, and their support of a perceptual experience of images and some types of perception on them. We briefly review the use of DRS to augment Soar and ACT-R with a diagrammatic representation component. We identify issues for further research. (shrink)

Research seeking a scientific foundation for the theory of art appreciation has raised controversies at the intersection of the social and cognitive sciences. Though equally relevant to a scientific inquiry into art appreciation, psychological and historical approaches to art developed independently and lack a common core of theoretical principles. Historicists argue that psychological and brain sciences ignore the fact that artworks are artifacts produced and appreciated in the context of unique historical situations and artistic intentions. After revealing flaws in the (...) psychological approach, we introduce a psycho-historical framework for the science of art appreciation. This framework demonstrates that a science of art appreciation must investigate how appreciators process causal and historical information to classify and explain their psychological responses to art. Expanding on research about the cognition of artifacts, we identify three modes of appreciation: basic exposure to an artwork, the artistic design stance, and artistic understanding. The artistic design stance, a requisite for artistic understanding, is an attitude whereby appreciators develop their sensitivity to art-historical contexts by means of inquiries into the making, authorship, and functions of artworks. We defend and illustrate the psycho-historical framework with an analysis of existing studies on art appreciation in empirical aesthetics. Finally, we argue that the fluency theory of aesthetic pleasure can be amended to meet the requirements of the framework. We conclude that scientists can tackle fundamental questions about the nature and appreciation of art within the psycho-historical framework. (shrink)

In contrast to Constructivist Views, which construe perceptual cognition as an essentially reconstructive process, this article recommends the Deictic View, which grounds perception in perceptual-demonstrative reference and the use of deictic tracking strategies for acquiring and updating knowledge about individuals. The view raises the problem of how sensory-motor tracking connects to epistemic and integrated forms of tracking. To study the strategies used to solve this problem, we report a study of the ability to track distal individuals when only their directions (...) can be perceived and not their locations. We introduce a new experimental paradigm named the 'Modified Traveling Salesman Problem' (MTSP), which requires subjects to visit n invisible targets in a 2D display once each. Surprisingly, subjects are competent at this task for up to 10 targets. We consider two types of tracking strategies that subjects might use: 'location-based' strategies and 'deictic direction-based' strategies. A number of observations suggest that subjects used the latter, at least for larger numbers of targets. We hypothesize that subjects used perceptual-demonstrative reference and deictic strategies (i) to perform the sensory-motor tracking of directional segments, (ii) to bind the segments with their updated status in the task, and (iii) to perform the epistemic tracking of invisible targets by means of perception-based inferences. (shrink)

Animate vision systems have gaze control mechanisms that can actively position the camera coordinate system in response to physical stimuli. Compared to passive systems, animate systems show that visual computation can be vastly less expensive when considered in the larger context of behavior. The most important visual behavior is the ability to control the direction of gaze. This allows the use of very low resolution imaging that has a high virtual resolution. Using such a system in a controlled way provides (...) additional constraints that dramatically simplify the computations of early vision. Another important behavior is the way the environment “behaves‘. Animate systems under real-time constraints can further reduce their computational burden by using environmental cues that are perspicuous in the local context. A third source of economy is introduced when behaviors are learned. Because errors are rarely fatal, systems using learning algorithms can amortize computational cost over extended periods. Further economies can be achieved when the learning system uses indexical reference, which is a form of dynamic variable binding. Animate vision is a natural way of implementing this dynamic binding. (shrink)

When a piece of fruit is in a bowl, and the bowl is on a table, we appreciate not only the individual objects and their features, but also the relations containment and support, which abstract away from the particular objects involved. Independent representation of roles (e.g., containers vs. supporters) and “fillers” of those roles (e.g., bowls vs. cups, tables vs. chairs) is a core principle of language and higherlevel reasoning. But does such role-filler independence also arise in automatic visual processing? (...) Here, we show that it does, by exploring a surprising error that such independence can produce. In four experiments, participants saw a stream of images containing different objects arranged in forcedynamic relations — e.g., a phone contained in a basket, a marker resting on a garbage can, or a knife sitting in a cup. Participants had to respond to a single target image (e.g., a phone in a basket) within a stream of distractors presented under time constraints. Surprisingly, even though participants completed this task quickly and accurately, they false-alarmed more often to images matching the target’s relational category than to those that did not — even when those images involved completely different objects. In other words, participants searching for a phone in a basket were more likely to mistakenly respond to a knife in a cup than to a marker on a garbage can. Follow-up experiments ruled out strategic responses and also controlled for various confounding image features. We suggest that visual processing represents relations abstractly, in ways that separate roles from fillers. (shrink)

A set of hypotheses is formulated for a connectionist approach to cognitive modeling. These hypotheses are shown to be incompatible with the hypotheses underlying traditional cognitive models. The connectionist models considered are massively parallel numerical computational systems that are a kind of continuous dynamical system. The numerical variables in the system correspond semantically to fine-grained features below the level of the concepts consciously used to describe the task domain. The level of analysis is intermediate between those of symbolic cognitive models (...) and neural models. The explanations of behavior provided are like those traditional in the physical sciences, unlike the explanations provided by symbolic models.Higher-level analyses of these connectionist models reveal subtle relations to symbolic models. Parallel connectionist memory and linguistic processes are hypothesized to give rise to processes that are describable at a higher level as sequential rule application. At the lower level, computation has the character of massively parallel satisfaction of soft numerical constraints; at the higher level, this can lead to competence characterizable by hard rules. Performance will typically deviate from this competence since behavior is achieved not by interpreting hard rules but by satisfying soft constraints. The result is a picture in which traditional and connectionist theoretical constructs collaborate intimately to provide an understanding of cognition. (shrink)

It is generally accepted that there is something special about reasoning by using mental images. The question of how it is special, however, has never been satisfactorily spelled out, despite more than thirty years of research in the post-behaviorist tradition. This article considers some of the general motivation for the assumption that entertaining mental images involves inspecting a picture-like object. It sets out a distinction between phenomena attributable to the nature of mind to what is called the cognitive architecture, and (...) ones that are attributable to tacit knowledge used to simulate what would happen in a visual situation. With this distinction in mind, the paper then considers in detail the widely held assumption that in some important sense images are spatially displayed or are depictive, and that examining images uses the same mechanisms that are deployed in visual perception. I argue that the assumption of the spatial or depictive nature of images is only explanatory if taken literally, as a claim about how images are physically instantiated in the brain, and that the literal view fails for a number of empirical reasons – for example, because of the cognitive penetrability of the phenomena cited in its favor. Similarly, while it is arguably the case that imagery and vision involve some of the same mechanisms, this tells us very little about the nature of mental imagery and does not support claims about the pictorial nature of mental images. Finally, I consider whether recent neuroscience evidence clarifies the debate over the nature of mental images. I claim that when such questions as whether images are depictive or spatial are formulated more clearly, the evidence does not provide support for the picture-theory over a symbol-structure theory of mental imagery. Even if all the empirical claims were true, they do not warrant the conclusion that many people have drawn from them: that mental images are depictive or are displayed in some (possibly cortical) space. Such a conclusion is incompatible with what is known about how images function in thought. We are then left with the provisional counterintuitive conclusion that the available evidence does not support rejection of what I call the “null hypothesis”; namely, that reasoning with mental images involves the same form of representation and the same processes as that of reasoning in general, except that the content or subject matter of thoughts experienced as images includes information about how things would look. (shrink)

We approach the semantics of prepositions from the perspective of conceptual spaces. Focusing on purely spatial locative and directional prepositions, we analyze both types of prepositions in terms of polar coordinates instead of Cartesian coordinates. This makes it possible to demonstrate that the property of convexity holds quite generally in the domain of prepositions of location and direction, supporting the important role that this property plays in conceptual spaces.

A number of studies in the apparent motion literature were examined using the cognitive penetrability criterion to determine the extent to which beliefs affect the perception of apparent motion. It was found that the interaction between the perceptual processes mediating apparent motion and higher order processes appears to be limited. In addition, perceptual and inferential beliefs appear to have different effects on perceived motion optimality and direction. Our findings suggest that the system underlying apparent motion perception has more than one (...) stage and is informationally encapsulated from cognitive factors. (shrink)