In this article we present a new experimental paradigm: comparative visual search. Each half of a display contains simple geometrical objects of three different colors and forms. The two display halves are identical except for one object mismatched in either color or form. The subject's task is to find this mismatch. We illustrate the potential of this paradigm for investigating the underlying complex processes of perception and cognition by means of an eye‐tracking study. Three possible search strategies are outlined, discussed, (...) and reexamined on the basis of experimental results. Each strategy is characterized by the way it partitions the field of objects into “chunks.” These strategies are: (i) Stimulus‐wise scanning with minimization of total scan path length (a “traveling salesman” strategy), (ii) scanning of the objects in fixed‐size areas (a “searchlight” strategy), and (iii) scanning of object sets based on variably sized clusters defined by object density and heterogeneity (a “clustering” strategy). To elucidate the processes underlying comparative visual search, we introduce besides object density a new entropy‐based measure for object heterogeneity. The effects of local density and entropy on several basic and derived eye‐movement variables clearly rule out the traveling salesman strategy, but are most compatible with the clustering strategy. (shrink)

The human cognitive architecture consists of a set of largely independent modules associated with different brain regions. This book discusses in detail how these various modules can combine to produce behaviours as varied as driving a car and solving an algebraic equation.

In treating cognition as problem solving, Andy Clark suggests, we may often abstract too far from the very body and world in which our brains evolved to guide...

Artificial intelligence research has foundered on the issue of representation. When intelligence is approached in an incremental manner, with strict reliance on interfacing to the real world through perception and action, reliance on representation disappears. In this paper we outline our approach to incrementally building complete intelligent Creatures. The fundamental decomposition of the intelligent system is not into independent information processing units which must interface with each other via representations. Instead, the intelligent system is decomposed into independent and parallel activity (...) producers which all interface directly to the world through perception and action, rather than interface to each other particularly much. The notions of central and peripheral systems evaporateeverything is both central and peripheral. Based on these principles we have built a very successful series of mobile robots which operate without supervision as Creatures in standard office environments. (shrink)

We present data and argument to show that in Tetris - a real-time interactive video game - certain cognitive and perceptual problems are more quickly, easily, and reliably solved by performing actions in the world rather than by performing computational actions in the head alone. We have found that some translations and rotations are best understood as using the world to improve cognition. These actions are not used to implement a plan, or to implement a reaction; they are used to (...) change the world in order to simplify the problem-solving task. Thus, we distinguish pragmatic actions ñ actions performed to bring one physically closer to a goal - from epistemic actions - actions performed to uncover information that is hidden or hard to compute mentally. To illustrate the need for epistemic actions, we first develop a standard information-processing model of Tetris-cognition, and show that it cannot explain performance data from human players of the game - even when we relax the assumption of fully sequential processing. Standard models disregard many actions taken by players because they appear unmotivated or superfluous. However, we describe many such actions that are actually taken by players that are far from superfluous, and that play valuable roles in improving human performance. We argue that traditional accounts are limited because they regard action as having a single function: to change the world. By recognizing a second function of action - an epistemic function - we can explain many of the actions that a traditional model cannot. Although, our argument is supported by numerous examples specifically from Tetris, we outline how the one category of epistemic action can be incorporated into theories of action more generally. (shrink)

One of the fundamental issues in visual awareness is how we are able to perceive the scene in front of our eyes on time despite the delay in processing visual information. The prediction theory postulates that our visual system predicts the future to compensate for such delays. On the other hand, the postdiction theory postulates that our visual awareness is inevitably a delayed product. In the present study we used flash-lag paradigms in motion and color domains and examined how the (...) perception of visual information at the time of flash is influenced by prior and subsequent visual events. We found that both types of event additively influence the perception of the present visual image, suggesting that our visual awareness results from joint contribution of predictive and postdictive mechanisms. (shrink)