_Behavioral and Brain Sciences_ , 15, 183-247, 1992. Reprinted in _The Philosopher's Annual_ , Grim, Mar and Williams, eds., vol. XV-1992, 1994, pp. 23-68; Noel Sheehy and Tony Chapman, eds., _Cognitive Science_ , Vol. I, Elgar, 1995, pp.210-274.

This paper presents a general computational treatment of how mammals are able to deal with visual objects and environments. The model tries to cover the entire range from behavior and phenomenological experience to detailed neural encodings in crude but computationally plausible reductive steps. The problems addressed include perceptual constancies, eye movements and the stable visual world, object descriptions, perceptual generalizations, and the representation of extrapersonal space.The entire development is based on an action-oriented notion of perception. The observer is assumed to (...) be continuously sampling the ambient light for information of current value. The central problem of vision is taken to be categorizing and locating objects in the environment. The critical step in this process is the linking of visual information to symbolic object descriptions; this is calledindexing, from the analogy of identifying a book from index terms. The system must also identifysituationsand use this knowledge to guide movement and other actions in the environment. The treatment focuses on the different representations of information used in the visual system.The four representational frames capture information in the following forms: retinotopic, head-based, symbolic, and allocentric. The functional roles of the four frames, the communication among them, and their suggested neurophysiological realization constitute the core of the paper. The model is perforce crude, but appears to be consistent with all relevant findings. (shrink)

Purely parallel neural networks can model object recognition in brief displays – the same conditions under which illusory conjunctions have been demonstrated empirically. Correcting errors of illusory conjunction is the “tag-assignment” problem for a purely parallel processor: the problem of assigning a spatial tag to nonspatial features, feature combinations, and objects. This problem must be solved to model human object recognition over a longer time scale. Our model simulates both the parallel processes that may underlie illusory conjunctions and the serial (...) processes that may solve the tag-assignment problem in normal perception. One component of the model extracts pooled features and another provides attentional tags that correct illusory conjunctions. Our approach addresses two questions: How can objects be identified from simultaneously attended features in a parallel, distributed representation? How can the spatial selectional requirements of such an attentional process be met by a separation of pathways for spatial and nonspatial processing? Our analysis of these questions yields a neurally plausible simulation of tag assignment based on synchronizing feature processing activity in a spatial focus of attention. (shrink)

The cerebral cortex is a rich and diverse structure that is the basis of intelligent behavior. One of the deepest mysteries of the function of cortex is that neural processing times are only about one hundred times as fast as the fastest response times for complex behavior. At the very least, this would seem to indicate that the cortex does massive amounts of parallel computation.This paper explores the hypothesis that an important part of the cortex can be modeled as a (...) connectionist computer that is especially suited for parallel problem solving. The connectionist computer uses a special representation, termed value unit encoding, that represents small subsets of parameters in a way that allows parallel access to many different parameter values. This computer can be thought of as computing hierarchies of sensorimotor invariants. The neural substrate can be interpreted as a commitment to data structures and algorithms that compute invariants fast enough to explain the behavioral response times. A detailed consideration of this model has several implications for the underlying anatomy and physiology. (shrink)

Fundamental to spatial knowledge in all species are the representations underlying object recognition, object search, and navigation through space. But what sets humans apart from other species is our ability to express spatial experience through language. This target article explores the language ofobjectsandplaces, asking what geometric properties are preserved in the representations underlying object nouns and spatial prepositions in English. Evidence from these two aspects of language suggests there are significant differences in the geometric richness with which objects and places (...) are encoded. When an object is named (i.e., with count nouns), detailed geometric properties – principally the object's shape (axes, solid and hollow volumes, surfaces, and parts) – are represented. In contrast, when an object plays the role of either “figure” (located object) or “ground” (reference object) in a locational expression, only very coarse geometric object properties are represented, primarily the main axes. In addition, the spatial functions encoded by spatial prepositions tend to be nonmetric and relatively coarse, for example, “containment,” “contact,” “relative distance,” and “relative direction.” These properties are representative of other languages as well. The striking differences in the way language encodes objects versus places lead us to suggest two explanations: First, there is a tendency for languages to level out geometric detail from both object and place representations. Second, a nonlinguistic disparity between the representations of “what” and “where” underlies how language represents objects and places. The language of objects and places converges with and enriches our understanding of corresponding spatial representations. (shrink)

This article proposes a theoretical framework for external representation based problem solving. The Tic‐Tac‐Toe and its isomorphs are used to illustrate the procedures of the framework as a methodology and test the predictions of the framework as a functional model. Experimental results show that the behavior in the Tic‐Tac‐Toe is determined by the directly available information in external and internal representations in terms of perceptual and cognitive biases, regardless of whether the biases are consistent with, inconsistent with, or irrelevant to (...) the task. It is shown that external representations are not merely inputs and stimuli to the internal mind and that they have much more important functions than mere memory aids. A representational determinism is suggested—the form of a representation determines what information can be perceived, what processes can be activated, and what structures can be discovered from the specific representation. (shrink)

This article is interdisciplinary in its claims. Evolving around the ecological concept of affordance, it brings together pragmatics and ecological psychology. Starting from the theoretical writings of Peirce, Dewey and James, the biosemiotic claims of von Uexküll, Gibson’s ecological approach to perception and some empirical evidence from recent neurobiological research, it elaborates on the concepts of experiential and enactive cognition as applied to music. In order to provide an operational description of this approach, it introduces some conceptual tools from the (...) domain of cybernetics with a major focus on the concept of circularity, which links perception to action in a continuous process of sense-making and interaction with the environment. As such, it is closely related to some pragmatic, biosemiotic and ecosemiotic claims which can be subsumed under the general notion of functional significance. An attempt is made to apply this conceptual framework to the process of musical sense-making which involves the realisation of systemic cognition in the context of epistemic interactions that are grounded in our biology and possibilities for adaptive control. Central in this approach is the concept of coping with the environment, or, in musical terms, to perceive the sounding music in terms of what it affords for the consummation of musical behaviour. (shrink)

The universality, invariance, and elegance of principles governing the universe may be reflected in principles of the minds that have evolved in that universe – provided that the mental principles are formulated with respect to the abstract spaces appropriate for the representation of biologically significant objects and their properties. (1) Positions and motions of objects conserve their shapes in the geometrically fullest and simplest way when represented as points and connecting geodesic paths in the six-dimensional manifold jointly determined by the (...) Euclidean group of three-dimensional space and the symmetry group of each object. (2) Colors of objects attain constancy when represented as points in a three-dimensional vector space in which each variation in natural illumination is canceled by application of its inverse from the three-dimensional linear group of terrestrial transformations of the invariant solar source. (3) Kinds of objects support optimal generalization and categorization when represented, in an evolutionarily-shaped space of possible objects, as connected regions with associated weights determined by Bayesian revision of maximum-entropy priors. Key Words: apparent motion; Bayesian inference; cognition; color constancy; generalization; mental rotation; perception; psychological laws; psychological space; universal laws. (shrink)

The aim of this article is to expand the diet of examples considered in philosophical discussions of imagination and pretense, and to offer some preliminary observations about what we might learn about the nature of imagination as a result. The article presents a number of cases involving imaginative contagion: cases where merely imagining or pretending that P has effects that we would expect only perceiving or believing that P to have. Examples are offered that involve visual imagery, motor imagery, fictional (...) emotions, and social priming. It is suggested that imaginative contagion is a more prevalent phenomenon than has typically been recognized. (shrink)

The very expertise with which psychologists wield their tools for achieving laboratory control may have had the unwelcome effect of blinding psychologists to the possibilities of discovering principles of behavior without conducting experiments. When creatively interrogated, a diverse range of large, real-world data sets provides powerful diagnostic tools for revealing principles of human judgment, perception, categorization, decision-making, language use, inference, problem solving, and representation. Examples of these data sets include patterns of website links, dictionaries, logs of group interactions, collections of (...) images and image tags, text corpora, history of financial transactions, trends in twitter tag usage and propagation, patents, consumer product sales, performance in high-stakes sporting events, dialect maps, and scientific citations. The goal of this issue is to present some exemplary case studies of mining naturally existing data sets to reveal important principles and phenomena in cognitive science, and to discuss some of the underlying issues involved with conducting traditional experiments, analyses of naturally occurring data, computational modeling, and the synthesis of all three methods. (shrink)

Ecological psychologists and enactivists agree that the best explanation for a large share of cognition is nonrepresentational in kind. In both ecological psychology and enactivist philosophy, then, the task is to offer an explanans that does not rely on representations. Different theorists within these camps have contrasting notions of what the best kind of nonrepresentational explanation will look like, yet they agree on one central point: instead of focusing solely on factors interior to an agent, an important aspect of cognition (...) is found in the link or coupling between an agent and the external world. This link is fluid, dynamic, and active in a variety of ways, and we do not need to add any internal extra something in the perception-action-cognition process. At the same time, even devout defenders of ecological psychology and enactivism recognize that plenty happens inside an agent during cognition. In particular, no one denies that the brain plays an important role. What, then, is the role of the brain if it’s not in the game of representing the environment? One possible option is to describe the brain as a resonant organ instead of a representational organ. In this paper we consider the history of resonance in more detail. Particular focus will be placed on two different sets of approaches that have developed the concept of resonance: a representational reading of resonance and a nonrepresentational, dynamic account of resonance. We then apply these accounts to a case study on music performance, specifically in the context of standard tonal jazz. From this application, we propose that a nonrepresentational resonance account consistent with both enactivism and ecological psychology is a viable way of explaining jazz performance. We conclude with future considerations on research regarding the brain as a resonant organ. (shrink)

In the visual system, the represented features of individual objects (shape, colour, movement, and so on) are distributed both in space and time within the brain. Representations of inner and outer event sequences arrive through different sense organs at different times, and are likewise distributed. Objects are nevertheless perceived as integrated wholes - and event sequences are experienced to form a coherent "consciousness stream." In their thoughtful article, Dennett & Kinsbourne ask how this is achieved.

This paper addresses the question whether we can conceive of music cognition in ecosemiotic terms. It claims that music knowledge must be generated as a tool for adaptation to the sonic world and calls forth a shift from a structural description of music as an artifact to a process-like approach to dealing with music. As listeners, we are observers who construct and organize our knowledge and bring with us our observational tools. What matters is not merely the sonic world in (...) its objective qualities, but the world as perceived. In order to make these claims operational we can rely on the ecological concept of coping with the sonic world and the cybernetic concepts of artificial and adaptive devices. Listeners, on this view, are able to change their semantic relations with the sonic world through functional adaptations at the level of sensing, acting and coordinating between action and perception. This allows us to understand music in functional terms of what it affords to us and not merely in terms of its acoustic qualities. There are, however, degrees of freedom and constraints which shape the semiotization of the sonic world. As such we must consider the role of event perception and cognitive economy: listeners do not perceive the acoustical environment in terms of phenomenological descriptions but as ecological events. (shrink)

Visual space can be distinguished from physical space. The first is found in visual experience, while the second is defined independently of perception. Theorists have wondered about the relation between the two. Some investigators have concluded that visual space is non-Euclidean, and that it does not have a single metric structure. Here it is argued that visual space exhibits contraction in all three dimensions with increasing distance from the observer, that experienced features of this contraction are not the same as (...) would be the experience of a perspective projection onto a fronto-parallel plane, and that such contraction is consistent with size constancy. These properties of visual space are different from those that would be predicted if spatial perception resulted from the successful solution of the inverse problem. They are consistent with the notion that optical constraints have been internalized. More generally, they are also consistent with the notion that visual spatial structures bear a resemblance relation to physical spatial structures. This notion supports a type of representational relation that is distinct from mere causal correspondence. The reticence of some philosophers and psychologists to discuss the structure of phenomenal space is diagnosed in terms of the simple materialism and the functionalism of the 1970s and 1980s. (shrink)