The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors, and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could (...) then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making. (shrink)

An exciting theory in neuroscience is that the brain is an organ for prediction error minimization. This theory is rapidly gaining influence and is set to dominate the science of mind and brain in the years to come. PEM has extreme explanatory ambition, and profound philosophical implications. Here, I assume the theory, briefly explain it, and then I argue that PEM implies that the brain is essentially self-evidencing. This means it is imperative to identify an evidentiary boundary between the brain (...) and its environment. This boundary defines the mind-world relation, opens the door to skepticism, and makes the mind transpire as more inferentially secluded and neurocentrically skull-bound than many would nowadays think. Therefore, PEM somewhat deflates contemporary hypotheses that cognition is extended, embodied and enactive; however, it can nevertheless accommodate the kinds of cases that fuel these hypotheses. (shrink)

In his paper, Jakob Hohwy outlines a theory of the brain as an organ for prediction-error minimization, which he claims has the potential to profoundly alter our understanding of mind and cognition. One manner in which our understanding of the mind is altered, according to PEM, stems from the neurocentric conception of the mind that falls out of the framework, which portrays the mind as “inferentially-secluded” from its environment. This in turn leads Hohwy to reject certain theses of embodied cognition. (...) Focusing on this aspect of Hohwy’s argument, we first outline the key components of the PEM framework such as the “evidentiary boundary,” before looking at why this leads Hohwy to reject certain theses of embodied cognition. We will argue that although Hohwy may be correct to reject specific theses of embodied cognition, others are in fact implied by the PEM framework and may contribute to its development. We present the metaphor of the “body as a laboratory” in order to highlight wha... (shrink)

Embodied cognition often challenges standard cognitive science. In this outstanding introduction, Lawrence Shapiro sets out the central themes and debates surrounding embodied cognition, explaining and assessing the work of many of the key figures in the field, including George Lakoff, Alva Noë, Andy Clark, and Arthur Glenberg. Beginning with an outline of the theoretical and methodological commitments of standard cognitive science, Shapiro then examines philosophical and empirical arguments surrounding the traditional perspective. He introduces topics such as dynamic systems theory, ecological (...) psychology, robotics, and connectionism, before addressing core issues in philosophy of mind such as mental representation and extended cognition. Including helpful chapter summaries and annotated further reading at the end of each chapter, _Embodied Cognition_ is essential reading for all students of philosophy of mind, psychology, and cognitive science. (shrink)

A new theory is taking hold in neuroscience. It is the theory that the brain is essentially a hypothesis-testing mechanism, one that attempts to minimise the error of its predictions about the sensory input it receives from the world. It is an attractive theory because powerful theoretical arguments support it, and yet it is at heart stunningly simple. Jakob Hohwy explains and explores this theory from the perspective of cognitive science and philosophy. The key argument throughout The Predictive Mind is (...) that the mechanism explains the rich, deep, and multifaceted character of our conscious perception. It also gives a unified account of how perception is sculpted by attention, and how it depends on action. The mind is revealed as having a fragile and indirect relation to the world. Though we are deeply in tune with the world we are also strangely distanced from it. (shrink)

It is widely held that Bayesian decision theory is the final word on how a rational person should make decisions. However, Leonard Savage--the inventor of Bayesian decision theory--argued that it would be ridiculous to use his theory outside the kind of small world in which it is always possible to "look before you leap." If taken seriously, this view makes Bayesian decision theory inappropriate for the large worlds of scientific discovery and macroeconomic enterprise. When is it correct to use Bayesian (...) decision theory--and when does it need to be modified? Using a minimum of mathematics, Rational Decisions clearly explains the foundations of Bayesian decision theory and shows why Savage restricted the theory's application to small worlds. The book is a wide-ranging exploration of standard theories of choice and belief under risk and uncertainty. Ken Binmore discusses the various philosophical attitudes related to the nature of probability and offers resolutions to paradoxes believed to hinder further progress. In arguing that the Bayesian approach to knowledge is inadequate in a large world, Binmore proposes an extension to Bayesian decision theory--allowing the idea of a mixed strategy in game theory to be expanded to a larger set of what Binmore refers to as "muddled" strategies. Written by one of the world's leading game theorists, Rational Decisions is the touchstone for anyone needing a concise, accessible, and expert view on Bayesian decision making. (shrink)

While philosophers of mind have been arguing over the status of mental representations in cognitive science, cognitive scientists have been quietly engaged in studying perception, action, and cognition without explaining them in terms of mental representation. In this book, Anthony Chemero describes this nonrepresentational approach, puts it in historical and conceptual context, and applies it to traditional problems in the philosophy of mind. Radical embodied cognitive science is a direct descendant of the American naturalist psychology of William James and John (...) Dewey, and follows them in viewing perception and cognition to be understandable only in terms of action in the environment. Chemero argues that cognition should be described in terms of agent-environment dynamics rather than in terms of computation and representation. After outlining this orientation to cognition, Chemero proposes a methodology: dynamical systems theory, which would explain things dynamically and without reference to representation. He also advances a background theory: Gibsonian ecological psychology, "shored up" and clarified. Chemero then looks at some traditional philosophical problems through the lens of radical embodied cognitive science and concludes that the comparative ease with which it resolves these problems, combined with its empirical promise, makes this approach to cognitive science a rewarding one. "Jerry Fodor is my favorite philosopher," Chemero writes in his preface, adding, "I think that Jerry Fodor is wrong about nearly everything." With this book, Chemero explains nonrepresentational, dynamical, ecological cognitive science as clearly and as rigorously as Jerry Fodor explained computational cognitive science in his classic work The Language of Thought. (shrink)

The paper explores the distinction between two doctrines, both of which inform theory construction in much of modern cognitive psychology: the representational theory of mind and the computational theory of mind. According to the former, propositional attitudes are to be construed as relations that organisms bear to mental representations. According to the latter, mental processes have access only to formal (nonsemantic) properties of the mental representations over which they are defined.The following claims are defended: (1) That the traditional dispute between (...) “rational” and “naturalistic” psychology is plausibly viewed as an argument about the status of the computational theory of mind. Rational psychologists accept a formality condition on the specification of mental processes; naturalists do not. (2) That to accept the formality condition is to endorse a version of methodological solipsism. (3) That the acceptance of some such condition is warranted, at least for that part of psychology which concerns itself with theories of the mental causation of behavior. This is because: (4) such theories require nontransparent taxonomies of mental states; and (5) nontransparent taxonomies individuate mental states without reference to their semantic properties. Equivalently, (6) nontransparent taxonomies respect the way that the organism represents the object of its propositional attitudes toitself, and it is this representation which functions in the causation of behavior.The final section of the paper considers the prospect for a naturalistic psychology: one which defines its generalizations over relations between mental representations and their environmental causes, thus seeking to account for the semantic properties of propositional attitudes. Two related arguments are proposed, both leading to the conclusion that no such research strategy is likely to prove fruitful. (shrink)

Brains, it has recently been argued, are essentially prediction machines. They are bundles of cells that support perception and action by constantly attempting to match incoming sensory inputs with top-down expectations or predictions. This is achieved using a hierarchical generative model that aims to minimize prediction error within a bidirectional cascade of cortical processing. Such accounts offer a unifying model of perception and action, illuminate the functional role of attention, and may neatly capture the special contribution of cortical processing to (...) adaptive success. This target article critically examines this approach, concluding that it offers the best clue yet to the shape of a unified science of mind and action. Sections 1 and 2 lay out the key elements and implications of the approach. Section 3 explores a variety of pitfalls and challenges, spanning the evidential, the methodological, and the more properly conceptual. The paper ends (sections 4 and 5) by asking how such approaches might impact our more general vision of mind, experience, and agency. (shrink)

Anydomainofscientificresearchhasitssustainingorthodoxy. Thatis, research on a problem, whether in astronomy, physics, or biology, is con- ducted against a backdrop of broadly shared assumptions. It is these as- sumptionsthatguideinquiryandprovidethecanonofwhatisreasonable-- of what "makes sense." And it is these shared assumptions that constitute a framework for the interpretation of research results. Research on the problem of how we see is likewise sustained by broadly shared assump- tions, where the current orthodoxy embraces the very general idea that the business of the visual system is to (...) create a detailed replica of the visual world, and that it accomplishes its business via hierarchical organization and by operatingessentiallyindependently of other sensorymodalitiesas well as independently of previous learning, goals, motor planning, and motor execution. (shrink)

Classic analysis of the subject and the development of personal probability; one of the greatest controversies in modern statistcal thought.

The representational dynamics of the brain is a subsymbolic process, and it has to be conceived as an "agent-free" type of dynamical self-organization. However, in generating a coherent internal world-model, the brain decomposes target space in a certain way. In doing so, it defines an "ontology": to have an ontology is to interpret a world. In this paper we argue that the brain, viewed as a representational system aimed at interpreting the world, possesses an ontology too. It decomposes target space (...) in a way that exhibits certain invariances, which in turn are functionally significant. A challenge for empirical research is to determine which are the functional regularities guiding this decomposition process. What are the explicit and implicit assumptions about the structure of reality, which at the same time shape the causal profile of the brain's motor output and the representational deep structure of the conscious mind arising from it (its "phenomenal output")? How do they constrain high-level phenomena like conscious experience, the emergence of a first-person perspective, or social cognition? By reviewing a series of neuroscientific results, we focus on the contribution the motor system makes to this process. As it turns out, the motor system constructs goals, actions, and intending selves as basic constituents of the world it interprets. It does so by assigning a single, unified causal role to them. Empirical evidence now clearly shows how the brain actually codes movements and action goals in terms of multimodal representations of organism-object relations. Under a representationalist analysis, this process can be interpreted as an internal representation of the intentionality relation itself. We try to show how such a more complex form of representational content, once it is in place, can later function as the building block for social cognition and a for more complex, consciously experienced representation of the first-person perspective as well. The motor system may therefore play a decisive role in understanding how the functional ontology of the human brain could be gradually extended into the subjective and social domains. (shrink)

As yet, there is no enactive account of social cognition. This paper extends the enactive concept of sense-making into the social domain. It takes as its departure point the process of interaction between individuals in a social encounter. It is a well-established finding that individuals can and generally do coordinate their movements and utterances in such situations. We argue that the interaction process can take on a form of autonomy. This allows us to reframe the problem of social cognition as (...) that of how meaning is generated and transformed in the interplay between the unfolding interaction process and the individuals engaged in it. The notion of sense-making in this realm becomes participatory sense-making. The onus of social understanding thus moves away from strictly the individual only. (shrink)

The question has long confounded philosophers and scientists, and it is this so-called explanatory gap between biological life and consciousness that Evan ...

This is a book about how we see: the environment around us (its surfaces, their layout, and their colors and textures); where we are in the environment; whether or not we are moving and, if we are, where we are going; what things are good for; how to do things (to thread a needle or drive an automobile); or why things look as they do.The basic assumption is that vision depends on the eye which is connected to the brain. The (...) author suggests that natural vision depends on the eyes in the head on a body supported by the ground, the brain being only the central organ of a complete visual system. When no constraints are put on the visual system, people look around, walk up to something interesting and move around it so as to see it from all sides, and go from one vista to another. That is natural vision—and what this book is about. (shrink)

Animate vision systems have gaze control mechanisms that can actively position the camera coordinate system in response to physical stimuli. Compared to passive systems, animate systems show that visual computation can be vastly less expensive when considered in the larger context of behavior. The most important visual behavior is the ability to control the direction of gaze. This allows the use of very low resolution imaging that has a high virtual resolution. Using such a system in a controlled way provides (...) additional constraints that dramatically simplify the computations of early vision. Another important behavior is the way the environment “behaves‘. Animate systems under real-time constraints can further reduce their computational burden by using environmental cues that are perspicuous in the local context. A third source of economy is introduced when behaviors are learned. Because errors are rarely fatal, systems using learning algorithms can amortize computational cost over extended periods. Further economies can be achieved when the learning system uses indexical reference, which is a form of dynamic variable binding. Animate vision is a natural way of implementing this dynamic binding. (shrink)

Many current neurophysiological, psychophysical, and psychological approaches to vision rest on the idea that when we see, the brain produces an internal representation of the world. The activation of this internal representation is assumed to give rise to the experience of seeing. The problem with this kind of approach is that it leaves unexplained how the existence of such a detailed internal representation might produce visual consciousness. An alternative proposal is made here. We propose that seeing is a way of (...) acting. It is a particular way of exploring the environment. Activity in internal representations does not generate the experience of seeing. The out- side world serves as its own, external, representation. The experience of seeing occurs when the organism masters what we call the gov- erning laws of sensorimotor contingency. The advantage of this approach is that it provides a natural and principled way of accounting for visual consciousness, and for the differences in the perceived quality of sensory experience in the different sensory modalities. Sev- eral lines of empirical evidence are brought forward in support of the theory, in particular: evidence from experiments in sensorimotor adaptation, visual “filling in,” visual stability despite eye movements, change blindness, sensory substitution, and color perception. (shrink)

The primary difference between direct and inferential theories of perception concerns the location of perceptual content, the meaning of our perceptions. In inferential theories of perception, these meanings arise inside animals, based upon their interactions with the physical environment. Light, for example, bumps into receptors causing a sensation. The animal (or its brain) performs inferences on the sensation, yielding a meaningful perception. In direct theories of perception, on the other hand, meaning is in the environment, and perception does not depend (...) upon meaning- conferring inferences. Instead the animal simply gathers information from a meaning- laden environment. But if the environment contains meanings, then it cannot be merely physical. This places a heavy theoretical burden on direct theories of perception, a burden so severe that it may outweigh all the advantages to conceiving perception as. (shrink)

The emulation theory of representation is developed and explored as a framework that can revealingly synthesize a wide variety of representational functions of the brain. The framework is based on constructs from control theory (forward models) and signal processing (Kalman filters). The idea is that in addition to simply engaging with the body and environment, the brain constructs neural circuits that act as models of the body and environment. During overt sensorimotor engagement, these models are driven by efference copies in (...) parallel with the body and environment, in order to provide expectations of the sensory feedback, and to enhance and process sensory information. These models can also be run off-line in order to produce imagery, estimate outcomes of different actions, and evaluate and develop motor plans. The framework is initially developed within the context of motor control, where it has been shown that inner models running in parallel with the body can reduce the effects of feedback delay problems. The same mechanisms can account for motor imagery as the off-line driving of the emulator via efference copies. The framework is extended to account for visual imagery as the off-line driving of an emulator of the motor-visual loop. I also show how such systems can provide for amodal spatial imagery. Perception, including visual perception, results from such models being used to form expectations of, and to interpret, sensory input. I close by briefly outlining other cognitive functions that might also be synthesized within this framework, including reasoning, theory of mind phenomena, and language. Key Words: efference copies; emulation theory of representation; forward models; Kalman filters; motor control; motor imagery; perception; visual imagery. (shrink)

Hutchins examines a set of phenomena that have fallen between the established disciplines of psychology and anthropology, bringing to light a new set of relationships between culture and cognition.

In this important book, Susan Hurley sheds new light on consciousness by examining its relationships to action from various angles. She assesses the role of agency in the unity of a conscious perspective, and argues that perception and action are more deeply interdependent than we usually assume. A standard view conceives perception as input from world to mind and action as output from mind to world, with the serious business of thought in between. Hurley criticizes this picture, and considers how (...) the interdependence of perceptual experience and agency at the personal level (of mental contents and norms) may emerge from the subpersonal level (of underlying causal processes and complex dynamic feedback systems). Her two-level view has wide implications, for topics that include self-consciousness, the modularity of mind, and the relations of mind to world. The self no longer lurks hidden somewhere between perceptual input and behavioral output, but reappears out in the open, embodied and embedded in its environment. Hurley traces these themes from Kantian and Wittgensteinian arguments through to intriguing recent work in neuropsychology and in dynamic systems approaches to the mind, providing a bridge from mainstream philosophy to work in other disciplines. Consciousness in Action is unique in the range of philosophical and scientific work it draws on, and in the deep criticism it offers of centuries-old habits of thought. (shrink)

Everybody knows that humans are cultural animals. Although this fact is universally acknowledged, many opportunities to exploit it are overlooked. In this article, I propose shifting our attention from local examples of extended mind to the cultural-cognitive ecosystems within which human cognition is embedded. I conclude by offering a set of conjectures about the features of cultural-cognitive ecosystems.

A line of research within embodied cognition seeks to show that an organism’s body is a determinant of its conceptual capacities. Comparison of this claim of body determinism to linguistic determinism bears interesting results. Just as Slobin’s (1996) idea of thinking for speaking challenges the main thesis of linguistic determinism, so too the possibility of thinking for acting raises difficulties for the proponent of body determinism. However, recent studies suggest that the body may, after all, have a determining role in (...) cognitive processes of sentence comprehension. (shrink)

It is widely held that Bayesian decision theory is the final word on how a rational person should make decisions. However, Leonard Savage--the inventor of Bayesian decision theory--argued that it would be ridiculous to use his theory outside the kind of small world in which it is always possible to "look before you leap." If taken seriously, this view makes Bayesian decision theory inappropriate for the large worlds of scientific discovery and macroeconomic enterprise. When is it correct to use Bayesian (...) decision theory--and when does it need to be modified? Using a minimum of mathematics, Rational Decisions clearly explains the foundations of Bayesian decision theory and shows why Savage restricted the theory's application to small worlds. The book is a wide-ranging exploration of standard theories of choice and belief under risk and uncertainty. Ken Binmore discusses the various philosophical attitudes related to the nature of probability and offers resolutions to paradoxes believed to hinder further progress. In arguing that the Bayesian approach to knowledge is inadequate in a large world, Binmore proposes an extension to Bayesian decision theory--allowing the idea of a mixed strategy in game theory to be expanded to a larger set of what Binmore refers to as "muddled" strategies. Written by one of the world's leading game theorists, Rational Decisions is the touchstone for anyone needing a concise, accessible, and expert view on Bayesian decision making. (shrink)

Researchers have wondered how the brain creates emotions since the early days of psychological science. With a surge of studies in affective neuroscience in recent decades, scientists are poised to answer this question. In this target article, we present a meta-analytic summary of the neuroimaging literature on human emotion. We compare the locationist approach (i.e., the hypothesis that discrete emotion categories consistently and specifically correspond to distinct brain regions) with the psychological constructionist approach (i.e., the hypothesis that discrete emotion categories (...) are constructed of more general brain networks not specific to those categories) to better understand the brain basis of emotion. We review both locationist and psychological constructionist hypotheses of brain–emotion correspondence and report meta-analytic findings bearing on these hypotheses. Overall, we found little evidence that discrete emotion categories can be consistently and specifically localized to distinct brain regions. Instead, we found evidence that is consistent with a psychological constructionist approach to the mind: A set of interacting brain regions commonly involved in basic psychological operations of both an emotional and non-emotional nature are active during emotion experience and perception across a range of discrete emotion categories. (shrink)

Philosophical inquiries into the nature of consciousness have long been intrinsically tied to questions regarding the nature of the self. Although philosophers of mind seldom make reference to the role of cultural context in shaping consciousness, since antiquity culture has played a notable role in philosophical conceptions of the self. Western philosophers, from Plato to Locke, have emphasized an individualistic view of the self that is autonomous and consistent across situations, while Eastern philosophers, such as Lao Tzu and Confucius, have (...) argued for a collectivistic view of the self, one that is interconnected to others and embedded within specific social contexts and situations. Here we argue that a comprehensive theory of consciousness needs to account for the role of cultural context and its bidirectional interaction with neural and genetic mechanisms in shaping a variety of conscious phenomena, from visual perception to self- awareness. We review recent evidence of cultural variation in neurobiological mechanisms underlying these phenomena and discuss the implications of these cultural neuroscience findings for the study of consciousness. (shrink)

Hurley’s is a difficult book to work through—partly because of its length and the complexity of its arguments, but also because each of the ten essays of which it is composed has a rather different starting point and focus, and because few of her arguments achieve real closure. Essay 2 discusses competing interpretations of Kant, essay 4 articulates nonconceptual forms of self-consciousness, essay 5 offers fresh interpretations of commissurotomy patients’ behavior, essay 6 develops an objection to Wittgenstein on rule following, (...) essay 8 attacks an alleged assumption of externalism, and chapter 10 explores the possibility of combining a “motor theory” and a “control theory” of perception. This is a very rich brew, and at least half the challenge this book presents consists in discerning its central argument and conclusion with enough precision to bring criticism to bear. (shrink)

The neural bases of behavior are often discussed in terms of perceptual, cognitive, and motor stages, defined within an information processing framework that was originally inspired by models of human abstract problem solving. Here, we review a growing body of neurophysiological data that is difficult to reconcile with this influential theoretical perspective. As an alternative foundation for interpreting neural data, we consider frameworks borrowed from ethology, which emphasize the kinds of real-time interactive behaviors that animals have engaged in for millions (...) of years. In particular, we discuss an ethologically-inspired view of interactive behavior as simultaneous processes that specify potential motor actions and select between them. We review how recent neurophysiological data from diverse cortical and subcortical regions appear more compatible with this parallel view than with the classical view of serial information processing stages. (shrink)