This paper presents a general computational treatment of how mammals are able to deal with visual objects and environments. The model tries to cover the entire range from behavior and phenomenological experience to detailed neural encodings in crude but computationally plausible reductive steps. The problems addressed include perceptual constancies, eye movements and the stable visual world, object descriptions, perceptual generalizations, and the representation of extrapersonal space.The entire development is based on an action-oriented notion of perception. The observer is assumed to (...) be continuously sampling the ambient light for information of current value. The central problem of vision is taken to be categorizing and locating objects in the environment. The critical step in this process is the linking of visual information to symbolic object descriptions; this is calledindexing, from the analogy of identifying a book from index terms. The system must also identifysituationsand use this knowledge to guide movement and other actions in the environment. The treatment focuses on the different representations of information used in the visual system.The four representational frames capture information in the following forms: retinotopic, head-based, symbolic, and allocentric. The functional roles of the four frames, the communication among them, and their suggested neurophysiological realization constitute the core of the paper. The model is perforce crude, but appears to be consistent with all relevant findings. (shrink)

Visual information follows at least two branches in the human nervous system, following a common input stage: a cognitive ''what'' branch governs perception and experience, while a sensorimotor ''how'' branch handles visually guided behavior though its outputs are unconscious. The sensorimotor system is probed with an isomorphic task, requiring a 1:1 relationship between target position and motor response. The cognitive system, in contrast, is probed with a forced qualitative decision, expressed verbally, about the location of a target. Normally, the cognitive (...) system is influenced by context-induced illusions of visual direction, while the sensorimotor system is not. Here, we inquire whether the process of making a spatially based decision is critical in forcing subjects to use the information in the cognitive system for spatial tasks. Subjects hear a tone that determines whether they jab an ''X'' or an ''O'' with the forefinger. Despite making a decision about which target to contact, the jab is not influenced by the position of a surrounding frame, indicating that choice can be handled within the context-insensitive sensorimotor system. (shrink)