The emulation theory of representation is developed and explored as a framework that can revealingly synthesize a wide variety of representational functions of the brain. The framework is based on constructs from control theory (forward models) and signal processing (Kalman filters). The idea is that in addition to simply engaging with the body and environment, the brain constructs neural circuits that act as models of the body and environment. During overt sensorimotor engagement, these models are driven by efference copies in (...) parallel with the body and environment, in order to provide expectations of the sensory feedback, and to enhance and process sensory information. These models can also be run off-line in order to produce imagery, estimate outcomes of different actions, and evaluate and develop motor plans. The framework is initially developed within the context of motor control, where it has been shown that inner models running in parallel with the body can reduce the effects of feedback delay problems. The same mechanisms can account for motor imagery as the off-line driving of the emulator via efference copies. The framework is extended to account for visual imagery as the off-line driving of an emulator of the motor-visual loop. I also show how such systems can provide for amodal spatial imagery. Perception, including visual perception, results from such models being used to form expectations of, and to interpret, sensory input. I close by briefly outlining other cognitive functions that might also be synthesized within this framework, including reasoning, theory of mind phenomena, and language. Key Words: efference copies; emulation theory of representation; forward models; Kalman filters; motor control; motor imagery; perception; visual imagery. (shrink)

What triggers the execution of actions? What happens in that moment when an action is triggered? What mental state is there at the moment of action-execution that was not there a second before? My aim is to highlight the importance of a thus far largely ignored kind of mental state in the discussion of these old and much-debated questions: motor imagery. While there have been a fair amount of research in psychology and neuroscience on motor imagery in the last 30 (...) years or so, it is only recently that we start to understand the important role motor imagery plays in action initiation. And if, as these findings suggest, motor imagery plays an important role in action initiation, we can make progress not only in understanding action initiation in general but also in understanding what goes wrong in akratic actions and in relapse actions. Finally, this new picture of action-initiation also has far-reaching consequences for the relation between motivation and causation in naturalistic action-explanations. (shrink)

The mind of man is central to the structure and functioning of the physical world. Modern physical theory indicates that the mind stands in a relationship of equals to the physical world. Both are fundamental, neither can be reduced to the other, and both require each other for their full understanding. This thesis is at odds with the view of the universe found in Newtonian mechanics as well as the generally held view among contemporary physicists of modern physical theory. Since (...) the Renaissance, man has come to understand a great deal about the physical world, and he has gained significant control over it. This increased power over the physical world has occurred hand in hand with the assumption that the structure and functioning of the physical world is essentially independent from his cognitive functioning. According to this assumption, if man’s cognitive capacity did not exist, the functioning of the physical world would not be fundamentally altered. This last statement is not in fact correct, and modern physical theory, and even fundamentals underlying Newtonian mechanics, provide evidence to attest to this. Nonetheless, contemporary physicists for the most part do not see that the relationship of human cognition to the physical world is radically altered in their own modern theory, theory that is supported by a great deal of empirical data. Instead, attempting to preserve the thesis that the structure and functioning of the physical world is independent of the mind while on a practical level relying on modern theory that contradicts this thesis, physicists have placed themselves in the position of wondering at times exactly what is the nature of the physical world at the same time they obtain experimental results concerning the physical world that can only be labeled astonishing in their precision and the scope of their implications. Modern physical theory consists of three main components: 1) the special and general theories of relativity; 2) quantum mechanics; and 3) statistical mechanics. There are very successful theories that have been developed on the basis of these three bedrock areas. An example of one is quantum electrodynamics. But these theories owe their conceptual foundation to the three components mentioned. The basic issues at the core of these three components also are expressed in these later theories. In addition, there are new unresolved issues of a fundamental nature concerning the conceptual integrity of these later theories that do not apply to quantum mechanics, relativity theory, and statistical mechanics. Quantum mechanics and relativity theory are areas I have written about for over twelve years. The nature of statistical mechanics has also been of interest to me during this time. But when I took a serious look in 1993 at Tolman’s (1938) The Principles of Statistical Mechanics, it became clear that the mind is linked to the physical world in statistical mechanics, a relationship I had found earlier in both relativity theory and quantum mechanics. It was after reading Tolman’s justification of the method of statistical mechanics in the original that I decided to write this book. When I found that the three components of modern physical theory all pointed to the same relationship between mind and the physical world, it became clear that the fundamental isolation of the mind from the physical world that has characterized our experience since the development of Newtonian mechanics is unfounded. Based on empirically supported principles of modern physical theory, I determined that the appropriate assumption for one’s experience, that the mind is linked to the physical world, could be stated with confidence. The impact of this change in assumption concerning the relationship of man to the cosmos in modern physical theory will find its way into our everyday experience. It will perhaps have no greater effect than in reducing the sense of isolation of man from the world that has characterized modern existence. (shrink)

The overall goal of this target article is to demonstrate a mechanism for an embodied cognition. The particular vehicle is a much-studied, but still widely debated phenomenon seen in 7–12 month-old-infants. In Piaget's classic “A-not-B error,” infants who have successfully uncovered a toy at location “A” continue to reach to that location even after they watch the toy hidden in a nearby location “B.” Here, we question the traditional explanations of the error as an indicator of infants' concepts of objects (...) or other static mental structures. Instead, we demonstrate that the A-not-B error and its previously puzzling contextual variations can be understood by the coupled dynamics of the ordinary processes of goal-directed actions: looking, planning, reaching, and remembering. We offer a formal dynamic theory and model based on cognitive embodiment that both simulates the known A-not-B effects and offers novel predictions that match new experimental results. The demonstration supports an embodied view by casting the mental events involved in perception, planning, deciding, and remembering in the same analogic dynamic language as that used to describe bodily movement, so that they may be continuously meshed. We maintain that this mesh is a pre-eminently cognitive act of “knowing” not only in infancy but also in everyday activities throughout the life span. Key Words: cognitive development; dynamical systems theory; embodied cognition; infant development; motor control; motor planning; perception and action. (shrink)

Some recent arguments defending the genuine causal efficacy of the mental have been relying on empirical research on neuroprosthetics. This essay presents a critical analysis of these arguments. The problem of mental causation, and the basic idea and results of neuroprosthetics are reviewed. It is shown how appealing to the research on neuroprosthetics can be interpreted to give support to the idea of mental causation. However, it does so only in a rather deflationary sense: by holding the mental identical with (...) the neural. So contrary to what the arguments have been assuming, neuroprosthetics cannot be used to argue for nonreductive physicalism. It can rather be taken to illustrate just the opposite: how the mental and the physical are identical. (shrink)

Much indirect evidence supports the hypothesis that transformations of mental images are at least in part guided by motor processes, even in the case of images of abstract objects rather than of body parts. For example, rotation may be guided by processes that also prime one to see results of a specific motor action. We directly test the hypothesis by means of a dual-task paradigm in which subjects perform the Cooper-Shepard mental rotation task while executing an unseen motor rotation in (...) a given direction and at a previously learned speed. Four results support the inference that mental rotation relies on motor processes. First, motor rotation that is compatible with mental rotation results in faster times and fewer errors in the imagery task than when the two rotations are incompatible. Second, the angle through which subjects rotate their mental images, and the angle through which they rotate a joystick handle are correlated, but only if the directions of the two rotations are compatible. Third, motor rotation modifies the classical inverted V-shaped mental rotation response time function, favoring the direction of the motor rotation; indeed, in some cases motor rotation even shifts the location of the minimum of this curve in the direction of the motor rotation. Fourth, the preceding effect is sensitive not only to the direction of the motor rotation, but also to the motor speed. A change in the speed of motor rotation can correspondingly slow down or speed up the mental rotation. (shrink)

Behavior may be controlled by reactive systems. In a reactive system the motor output is exclusively driven by actual sensory input. An alternative solution to control behavior is given by “cognitive” systems capable of planning ahead. To this end the system has to be equipped with some kind of internal world model. A sensible basis of an internal world model might be a model of the system's own body. I show that a reactive system with the ability to control a (...) body of complex geometry requires only a slight reorganization to form a cognitive system. This implies that the assumption that the evolution of cognitive properties requires the introduction of new, additional modules, namely internal world models, is not justified. Rather, these modules may already have existed before the system obtained cognitive properties. Furthermore, I discuss whether the occurrence of such world models may lead to systems having internal perspective. (shrink)

Current views of the control of complex, purposeful movements acknowledge that organizational processes must reconcile multiple concerns. The central priority is of course accomplishing the actor's goal. But in specifying the manner in which this occurs, the action plan must accommodate such factors as the interaction of mechanical forces associated with the motion of a multilinked system (classical mechanics) and, in many cases, intrinsic bias toward preferred movement patterns, characterized by so-called “coordination dynamics.” The most familiar example of the latter (...) is the symmetry constraint, where spatial trajectories and/or temporal landmarks (e.g., reversal points) of concurrentlymoving body segments (limbs, digits, etc.) exhibit mutual attraction. The natural coordination tendencies that emerge through these constraints can facilitate or hinder motor control, depending on the degree of congruency with the desired movement pattern. Motor control theorists have long recognized the role of classical mechanics in theories of movement organization, but an appreciation of the importance of intrinsic interlimb bias has been gained only recently.Although detailed descriptions of temporal coordination dynamics have been provided, systematic attempts to identify additional salient dimensions of interlimb constraint have been lacking. We develop and implement here a novel method for examining this problem by exploiting two robust principles of psychomotor behavior, the symmetry constraint and the Two-Thirds Power Law. Empirical evidence is provided that the relative spatial patterns of concurrently moving limbs are naturally constrained in much the same manner as previously identified temporal constraints and, further, that apparent velocity interference is an indirect, secondary consequence of primary spatial assimilation. The theoretical implications of spatial interference are elaborated with respect to movement organization and motor learning. The need to carefully consider the appropriate dimensions with which to characterize coordination dynamics is also discussed. (shrink)