Eye movements during mental imagery are not epiphenomenal but assist the process of image generation. Commands to the eyes for each fixation are stored along with the visual representation and are used as spatial index in a motor‐based coordinate system for the proper arrangement of parts of an image. In two experiments, subjects viewed an irregular checkerboard or color pictures of fish and were subsequently asked to form mental images of these stimuli while keeping their eyes open. During the perceptual (...) phase, a group of subjects was requested to maintain fixation onto the screen's center, whereas another group was free to inspect the stimuli. During the imagery phase, all of these subjects were free to move their eyes. A third group of subjects (in Experiment 2) was free to explore the pattern but was requested to maintain central fixation during imagery. For subjects free to explore the pattern, the percentage of time spent fixating a specific location during perception was highly correlated with the time spent on the same (empty) locations during imagery. The order of scanning of these locations during imagery was correlated to the original order during perception. The strength of relatedness of these scanpaths and the vividness of each image predicted performance accuracy. Subjects who fixed their gaze centrally during perception did the same spontaneously during imagery. Subjects free to explore during perception, but maintaining central fixation during imagery, showed decreased ability to recall the pattern. We conclude that the eye scanpaths during visual imagery reenact those of perception of the same visual scene and that they play a functional role. (shrink)

The appropriate methodology for psychological research depends on whether one is studying mental algorithms or their implementation. Mental algorithms are abstract specifications of the steps taken by procedures that run in the mind. Implementational issues concern the speed and reliability of these procedures. The algorithmic level can be explored only by studying across-task variation. This contrasts with psychology's dominant methodology of looking for within-task generalities, which is appropriate only for studying implementational issues.The implementation-algorithm distinction is related to a number of (...) other “levels” considered in cognitive science. Its realization in Anderson's ACT theory of cognition is discussed. Research at the algorithmic level is more promising because it is hard to make further fundamental scientific progress at the implementational level with the methodologies available. Protocol data, which are appropriate only for algorithm-level theories, provide a richer source than data at the implementational level. Research at the algorithmic level will also yield more insight into fundamental properties of human knowledge because it is the level at which significant learning transitions are defined.The best way to study the algorithmic level is to look for differential learning outcomes in pedagogical experiments that manipulate instructional experience. This provides control and prediction in realistically complex learning situations. The intelligent tutoring paradigm provides a particularly fruitful way to implement such experiments.The implications of this analysis for the issue of modularity of mind, the status of language, research on human/computer interaction, and connectionist models are also examined. (shrink)

Recent evidence in natural and semi-natural settings has revealed a variety of left-right perceptual asymmetries among vertebrates. These include preferential use of the left or right visual hemifield during activities such as searching for food, agonistic responses, or escape from predators in animals as different as fish, amphibians, reptiles, birds, and mammals. There are obvious disadvantages in showing such directional asymmetries because relevant stimuli may be located to the animal's left or right at random; there is no a priori association (...) between the meaning of a stimulus (e.g., its being a predator or a food item) and its being located to the animal's left or right. Moreover, other organisms (e.g., predators) could exploit the predictability of behavior that arises from population-level lateral biases. It might be argued that lateralization of function enhances cognitive capacity and efficiency of the brain, thus counteracting the ecological disadvantages of lateral biases in behavior. However, such an increase in brain efficiency could be obtained by each individual being lateralized without any need to align the direction of the asymmetry in the majority of the individuals of the population. Here we argue that the alignment of the direction of behavioral asymmetries at the population level arises as an “evolutionarily stable strategy” under “social” pressures occurring when individually asymmetrical organisms must coordinate their behavior with the behavior of other asymmetrical organisms of the same or different species. Key Words: asymmetry; brain evolution; brain lateralization; development; hemispheric specialization; laterality; lateralization of behavior; social behavior; theory of games. (shrink)

Because the visual system cannot process all of the objects, colors, and features present in a visual scene, visual attention allows some visual stimuli to be selected and processed over others. Most research on visual attention has focused on spatial or location-based attention, in which the locations occupied by stimuli are selected for further processing. Recent research, however, has demonstrated the importance of objects in organizing (or segregating) visual scenes and guiding attentional selection. Because of the long history of spatial (...) attention research, theories of spatial attention are more mature than theories of other visual processes, such as object segregation and object attention. In the present paper, I outline a biased competition account of object segregation and attention, following similar accounts that have been developed for spatial attention (Desimone and Duncan, 1995). In my biased competition account, I seek to understand how some objects can be segregated and selected over other objects in a complex visual scene. Under this account, there are two sources of visual information that allow an object to be processed over other objects: bottom-up information carried by the physical stimulus and top-down information based on an observer's goals. I use the biased competition account to combine many diverse findings from the object segregation and attention literatures into a common framework. (shrink)

A set of hypotheses is formulated for a connectionist approach to cognitive modeling. These hypotheses are shown to be incompatible with the hypotheses underlying traditional cognitive models. The connectionist models considered are massively parallel numerical computational systems that are a kind of continuous dynamical system. The numerical variables in the system correspond semantically to fine-grained features below the level of the concepts consciously used to describe the task domain. The level of analysis is intermediate between those of symbolic cognitive models (...) and neural models. The explanations of behavior provided are like those traditional in the physical sciences, unlike the explanations provided by symbolic models.Higher-level analyses of these connectionist models reveal subtle relations to symbolic models. Parallel connectionist memory and linguistic processes are hypothesized to give rise to processes that are describable at a higher level as sequential rule application. At the lower level, computation has the character of massively parallel satisfaction of soft numerical constraints; at the higher level, this can lead to competence characterizable by hard rules. Performance will typically deviate from this competence since behavior is achieved not by interpreting hard rules but by satisfying soft constraints. The result is a picture in which traditional and connectionist theoretical constructs collaborate intimately to provide an understanding of cognition. (shrink)

This article provides the first comprehensive conceptual account for the imagistic mental machinery that allows us to travel through time—for the time machine in our mind. It is argued that language reveals this imagistic machine and how we use it. Findings from a range of cognitive fields are theoretically unified and a recent proposal about spatialized mental time travel is elaborated on. The following novel distinctions are offered: external versus internal viewing of time; ‘‘watching” time versus projective ‘‘travel” through time; (...) optional versus obligatory mental time travel; mental time travel into anteriority or posteriority versus mental time travel into the past or future; single mental time travel versus nested dual mental time travel; mental time travel in episodic memory versus mental time travel in semantic memory; and ‘‘seeing” versus ‘‘sensing” mental imagery. Theoretical, empirical, and applied implications are discussed. (shrink)

When philosophers and psychologists think about consciousness, they generally focus on one or more of three features: phenomenality , intentionality , and introspectibility . Using examples from empirical psychology and neuroscience, I argue that consciousness is not a unitary state, that, instead, these three features characterize different and dissociable states, which often happen to occur together. Understanding these three features as dissociable from each other will resolve philosophical disputes and facilitate scientific investigation.

Robert Cummins [(1996) Representations, targets and attitudes, Cambridge, MA: Bradford/MIT, p. 1] has characterized the vexed problem of mental representation as "the topic in the philosophy of mind for some time now." This remark is something of an understatement. The same topic was central to the famous controversy between Nicolas Malebranche and Antoine Arnauld in the 17th century and remained central to the entire philosophical tradition of "ideas" in the writings of Locke, Berkeley, Hume, Reid and Kant. However, the scholarly, (...) exegetical literature has almost no overlap with that of contemporary cognitive science. I show that the recurrence of certain deep perplexities about the mind is a systematic and pervasive pattern arising not only throughout history, but also in a number of independent domains today such as debates over visual imagery, symbolic systems and others. Such historical and contemporary convergences suggest that the fundamental issues cannot arise essentially from the theoretical guise they take in any particular case. (shrink)

Euclidean diagrammatic reasoning refers to the diagrammatic inferential practice that originated in the geometrical proofs of Euclid’s Elements. A seminal philosophical analysis of this practice by Manders (‘The Euclidean diagram’, 2008) has revealed that a systematic method of reasoning underlies the use of diagrams in Euclid’s proofs, leading in turn to a logical analysis aiming to capture this method formally via proof systems. The central premise of this paper is that our understanding of Euclidean diagrammatic reasoning can be fruitfully advanced (...) by confronting these logical and philosophical analyses with the field of cognitive science. Surprisingly, central aspects of the philosophical and logical analyses resonate in very natural ways with research topics in mathematical cognition, spatial cognition and the psychology of reasoning. The paper develops these connections, concentrating on four issues: (1) the cognitive origins of Euclidean diagrammatic reasoning, (2) the cognitive representations of spatial relations in Euclidean diagrams, (3) the nature of the cognitive processes and cognitive representations involved in Euclidean diagrammatic reasoning seen as a form of visuospatial relational reasoning and (4) the complexity of Euclidean diagrammatic reasoning for the human cognitive system. For each of these issues, our analysis generates concrete experiment proposals, opening thereby the way for further empirical investigations. The paper is thus a prolegomenon to a research program on Euclidean diagrammatic reasoning at the crossroads of logic, philosophy and cognitive science. (shrink)

Neuropsychological studies suggest the existence of lateralized networks that represent categorical and coordinate types of spatial information. In addition, studies with neural networks have shown that they encode more effectively categorical spatial judgments or coordinate spatial judgments, if their input is based, respectively, on units with relatively small, nonoverlapping receptive fields, as opposed to units with relatively large, overlapping receptive fields. These findings leave open the question of whether interactive processes between spatial detectors and types of spatial relations can be (...) modulated by spatial attention. We hypothesized that spreading the attention window to encompass an area that includes two objects promotes coordinate spatial relations, based on coarse coding by large, overlapping, receptive fields. In contrast, narrowing attention to encompass an area that includes only one of the objects benefits categorical spatial relations, by effectively parsing space. By use of a cueing procedure, the spatial attention window was manipulated to select regions of differing areas. As predicted, when the attention window was large, coordinate spatial transformations were noticed faster than categorical transformations; in contrast, when the attention window was relatively smaller, categorical spatial transformations were noticed faster than coordinate transformations. Another novel finding was that coordinate changes were noticed faster when cueing an area that included both objects as well as the empty space between them than when simultaneously cueing both areas including the objects while leaving the gap between them uncued. (shrink)

In the first section of the article, we examine some recent criticisms of the connectionist enterprise: first, that connectionist models are fundamentally behaviorist in nature (and, therefore, non-cognitive), and second that connectionist models are fundamentally associationist in nature (and, therefore, cognitively weak). We argue that, for a limited class of connectionist models (feed-forward, pattern-associator models), the first criticism is unavoidable. With respect to the second criticism, we propose that connectionist modelsare fundamentally associationist but that this is appropriate for building models (...) of human cognition. However, we do accept the point that there are cognitive capacities for which any purely associative model cannot provide a satisfactory account. The implication that we draw from is this is not that associationist models and mechanisms should be scrapped, but rather that they should be enhanced.In the next section of the article, we identify a set of connectionist approaches which are characterized by “active symbols” — recurrent circuits which are the basis of knowledge representation. We claim that such approaches avoid criticisms of behaviorism and are, in principle, capable of supporting full cognition. In the final section of the article, we speculate at some length about what we believe would be the characteristics of a fully realized active symbol system. This includes both potential problems and possible solutions (for example, mechanisms needed to control activity in a complex recurrent network) as well as the promise of such systems (in particular, the emergence of knowledge structures which would constitute genuine internal models). (shrink)

The cognitive processing of spatial relations in Euclidean diagrams is central to the diagram-based geometric practice of Euclid's Elements. In this study, we investigate this processing through two dichotomies among spatial relations—metric vs topological and exact vs co-exact—introduced by Manders in his seminal epistemological analysis of Euclid's geometric practice. To this end, we carried out a two-part experiment where participants were asked to judge spatial relations in Euclidean diagrams in a visual half field task design. In the first part, we (...) tested whether the processing of metric vs topological relations yielded the same hemispheric specialization as the processing of coordinate vs categorical relations. In the second part, we investigated the specific performance patterns for the processing of five pairs of exact/co-exact relations, where stimuli for the co-exact relations were divided into three categories depending on their distance from the exact case. Regarding the processing of metric vs topological relations, hemispheric differences were found for only a few of the stimuli used, which may indicate that other processing mechanisms might be at play. Regarding the processing of exact vs co-exact relations, results show that the level of agreement among participants in judging co-exact relations decreases with the distance from the exact case, and this for the five pairs of exact/co-exact relations tested. The philosophical implications of these empirical findings for the epistemological analysis of Euclid's diagram-based geometric practice are spelled out and discussed. (shrink)

Looking at a pair of objects is easy when automatic grouping mechanisms bind these objects together, but visual exploration can also be more flexible. It is possible to mentally “re-group” two objects that are not only separate but belong to different pairs of objects. “Re-grouping” is in conflict with automatic grouping, since it entails a separation of each item from the set it belongs to. This ability appears to be impaired in patients with schizophrenia. Here we check if this impairment (...) is selective, which would suggest a dissociation between grouping and “re-grouping,” or if it impacts on usual, automatic grouping, which would call for a better understanding of the interactions between automatic grouping and “re-grouping.” Sixteen outpatients with schizophrenia and healthy controls had to identify two identical and contiguous target figures within a display of circles and squares alternating around a fixation point. Eye-tracking was used to check central fixation. The target pair could be located in the same or separate hemifields. Identical figures were grouped by a connector (grouped automatically) or not (to be re-grouped). Attention modulation of automatic grouping was tested by manipulating the proportion of connected and unconnected targets, thus prompting subjects to focalize on either connected or unconnected pairs. Both groups were sensitive to automatic grouping in most conditions, but patients were unusually slowed down for connected targets while focalizing on unconnected pairs. In addition, this unusual effect occurred only when targets were presented within the same hemifield. Patients and controls differed on this asymmetry between within- and acrosshemifield presentation, suggesting that patients with schizophrenia do not re-group figures in the same way as controls do.We discuss possible implications on how “re-grouping” ties in with ongoing, automatic perception in healthy volunteers. (shrink)

Experiences of qualia, subjective sensory-like aspects of stimuli, are central to imagistic representation. Following Raffman , qualia are considered to reflect experiential knowledge distinct from descriptive, abstract, and propositional knowledge; following Jackendoff , objective neural activity is distinguished from subjective experience. It is argued that descriptive physical knowledge does not provide an adequate accounting of qualia, and philosophical scenarios such as the Turing test and the Chinese Room are adapted to demonstrate inadequacies of accounts of cognition that ignore subjective experience. (...) Arguments by Dennett and others that qualia do not exist or that qualia do not provide additional explanatory power are addressed, and it is suggested that consideration of qualia is necessary in order to explain objective behavior. The hypotheses of functional equivalence, second-order isomorphism, and psychophysical complementarity between imagery and perception are discussed, and the ability of analog and schematic models of imagery to account for qualia is examined. (shrink)

This paper outlines the process of verbal communication of emotion as this occurs through the phases of the referential process, including arousal of an emotion schema; detailed and specific descriptions of images and episodes that are exemplars of emotion schemas; and reflection and reorganization, which may include emotion labels and other types of categorical terms. The concepts of emotion schemas and the referential process are defined in the theoretical framework of multiple code theory which includes subsymbolic sensory, visceral and motoric (...) processes, symbolic images and words. Emotion schemas are defined as clusters of representations of events incorporating similar bodily, sensory and motoric processes activated in relation to different people in different contexts. Through the referential process subsymbolic components of a schema that have been activated in a speaker or writer and that may be connected only partially to words may be evoked in a listener or reader. The concept of the emotion schemas is examined in relation to current work in emotion theory and neuroscience. The unique effects of detailed descriptions of episodes in conveying complex aspects of emotional experience are discussed, as recognized by writers, and as demonstrated in empirical research. Computerized measures of the phases of the referential process are presented, focusing particularly on the central measure, the Weighted Referential Activity Dictionary which identifies points of narrative and imagery. The operation of the function words that dominate the WRAD are examined in relation to the structure of narrative expression underlying the verbal representation of emotion schemas. (shrink)

Correlation analyses of recent back‐propagation neural networks show that network results are due to imbalances in stimulus input. Conclusions concerning the effects of receptive field size, hemispheric specialization, and other issues of relevance to psychology cannot therefore be drawn until the dominating effects of low‐level correlations are removed. Statistical techniques for evaluating the stimulus materials for neural networks are introduced.

Neuropsychological deficits have been widely used to elucidate normal cognitive functioning. Can patients with such deficits also be used to understand conscious visual experience? In this paper, we ask what it would be like to be a patient with apperceptive agnosia . Philosophical analyses of such questions have suggested that subjectively experiencing what another person experiences would be impossible. Although such roadblocks into the conscious experience of others exist, the experimental study of both patients and neurologically normal subjects can be (...) used to understand visual processing mechanisms. In order to understand the visual processes damaged in apperceptive agnosia, we first review this syndrome and present a case study of one such patient, patient J.W. We then review several theoretical accounts of apperceptive agnosia, and we conclude that studies of the patients themselves may not allow us to discriminate between the various explanations of the syndrome. To test these accounts, we have simulated apperceptive agnosia in neurologically normal subjects. The implications of our results for understanding both apperceptive agnosia and normal visual processing are discussed. (shrink)