In this paper, we argue for a theoretical separation of the free-energy principle from Helmholtzian accounts of the predictive brain. The free-energy principle is a theoretical framework capturing the imperative for biological self-organization in information-theoretic terms. The free-energy principle has typically been connected with a Bayesian theory of predictive coding, and the latter is often taken to support a Helmholtzian theory of perception as unconscious inference. If our interpretation is right, however, a Helmholtzian view of perception is incompatible with Bayesian (...) predictive coding under the free-energy principle. We argue that the free energy principle and the ecological and enactive approach to mind and life make for a much happier marriage of ideas. We make our argument based on three points. First we argue that the free energy principle applies to the whole animal–environment system, and not only to the brain. Second, we show that active inference, as understood by the free-energy principle, is incompatible with unconscious inference understood as analagous to scientific hypothesis-testing, the main tenet of a Helmholtzian view of perception. Third, we argue that the notion of inference at work in Bayesian predictive coding under the free-energy principle is too weak to support a Helmholtzian theory of perception. Taken together these points imply that the free energy principle is best understood in ecological and enactive terms set out in this paper. (shrink)

In this paper, we address the question of how an agent can guide its behavior with respect to aspects of the sociomaterial environment that are not sensorily present. A simple example is how an animal can relate to a food source while only sensing a pheromone, or how an agent can relate to beer, while only the refrigerator is directly sensorily present. Certain cases in which something is absent have been characterized by others as requiring ‘higher’ cognition. An example of (...) this is how during the design process architects can let themselves be guided by the future behavior of visitors to an exhibit they are planning. The main question is what the sociomaterial environment and the skilled agent are like, such that they can relate to each other in these ways. We argue that this requires an account of the regularities in the environment. Introducing the notion of general ecological information, we will give an account of these regularities in terms of constraints, information and the form of life or ecological niche. In the first part of the paper, we will introduce the skilled intentionality framework as conceptualizing a special case of an animal’s informational coupling with the environment namely skilled action. We will show how skilled agents can pick up on the regularities in the environment and let their behavior be guided by the practices in the form of life. This conceptual framework is important for radical embodied and enactive cognitive science, because it allows these increasingly influential paradigms to extend their reach to forms of ‘higher’ cognition such as long-term planning and imagination. (shrink)

To describe phenomena that occur at different time scales, computational models of the brain must incorporate different levels of abstraction. At time scales of approximately 1/3 of a second, orienting movements of the body play a crucial role in cognition and form a useful computational level embodiment level,” the constraints of the physical system determine the nature of cognitive operations. The key synergy is that at time scales of about 1/3 of a second, the natural sequentiality of body movements can (...) be matched to the natural computational economies of sequential decision systems through a system of implicit reference called deictic in which pointing movements are used to bind objects in the world to cognitive programs. This target article focuses on how deictic bindings make it possible to perform natural tasks. Deictic computation provides a mechanism for representing the essential features that link external sensory data with internal cognitive programs and motor actions. One of the central features of cognition, working memory, can be related to moment-by-moment dispositions of body features such as eye movements and hand movements. (shrink)

Can theories of mental imagery, conscious mental contents, developed within cognitive science throw light on the obscure (but culturally very significant) concept of imagination? Three extant views of mental imagery are considered: quasi‐pictorial, description, and perceptual activity theories. The first two face serious theoretical and empirical difficulties. The third is (for historically contingent reasons) little known, theoretically underdeveloped, and empirically untried, but has real explanatory potential. It rejects the “traditional” symbolic computational view of mental contents, but is compatible with recentsituated (...) cognition and active visionapproaches in robotics. This theory is developed and elucidated. Three related key aspects of imagination (non‐discursiveness, creativity, and seeing as) raise difficulties for the other theories. Perceptual activity theory presents imagery as non‐discursive and relates it closely to seeing as. It is thus well placed to be the basis for a general theory of imagination and its role in creative thought. (shrink)

This is a book about how we see: the environment around us (its surfaces, their layout, and their colors and textures); where we are in the environment; whether or not we are moving and, if we are, where we are going; what things are good for; how to do things (to thread a needle or drive an automobile); or why things look as they do.The basic assumption is that vision depends on the eye which is connected to the brain. The (...) author suggests that natural vision depends on the eyes in the head on a body supported by the ground, the brain being only the central organ of a complete visual system. When no constraints are put on the visual system, people look around, walk up to something interesting and move around it so as to see it from all sides, and go from one vista to another. That is natural vision—and what this book is about. (shrink)

Delusions are currently characterised as false beliefs produced by incorrect inference about external reality (DSM IV). This inferential conception has proved hard to link to explanations pitched at the level of neurobiology and neuroanatomy. This paper provides that link via a neurocomputational theory, based on evolutionary considerations, of the role of the prefrontal cortex in regulating offline cognition. When pathologically neuromodulated the prefrontal cortex produces hypersalient experiences which monopolise offline cognition. The result is characteristic psychotic experiences and patterns of thought. (...) This bottom-up account uses neural network theory to integrate recent theories of the role of dopamine in delusion with the insights of inferential accounts. It also provides a general model for evolutionary psychiatry which avoids theoretical problems imported from evolutionary psychology. (shrink)

How is it that thoroughly physical material beings such as ourselves can think, dream, feel, create and understand ideas, theories and concepts? How does mere matter give rise to all these non-material mental states, including consciousness itself? An answer to this central question of our existence is emerging at the busy intersection of neuroscience, psychology, artificial intelligence, and robotics.In this groundbreaking work, philosopher and cognitive scientist Andy Clark explores exciting new theories from these fields that reveal minds like ours to (...) be prediction machines - devices that have evolved to anticipate the incoming streams of sensory stimulation before they arrive. These predictions then initiate actions that structure our worlds and alter the very things we need to engage and predict. Clark takes us on a journey in discovering the circular causal flows and the self-structuring of the environment that define "the predictive brain." What emerges is a bold, new, cutting-edge vision that reveals the brain as our driving force in the daily surf through the waves of sensory stimulation. (shrink)

The Cognitive Neuroscience of Vision begins by introducing the reader to the anatomy of the eye and visual cortex and then proceeds to discuss image and...

In treating cognition as problem solving, Andy Clark suggests, we may often abstract too far from the very body and world in which our brains evolved to guide...

According to Bickerton, the behavioral sciences have failed to give an adequate account of human nature at least partly because of the conjunction and mutual reinforcement of two widespread beliefs: that language is simply a means of communication and that human intelligence is the result of the rapid growth and unusual size of human brains. Bickerton argues that each of the properties distinguishing human intelligence and consciousness from that of other animals can be shown to derive straightforwardly from properties of (...) language. In essence, language arose as a representational system, not a means of communication or a skill, and not a product of culture but an evolutionary adaptation. The author stresses the necessity of viewing intelligence in evolutionary terms, seeing it not as problem solving but as a way of maintaining homeostasis - the preservation of those conditions most favorable to an organism, the optimal achievable conditions for survival and well-being. The term protolanguage is used to describe the stringing together of symbols that prehuman hominids employed. "It did not allow them to turn today's imagination into tomorrow's fact. But it is just this power to transform imagination into fact that distinguishes human behavior from that of our ancestral species, and indeed from that of all other species. It is exactly what enables us to change our behavior, or invent vast ranges of new behavior, practically overnight, with no concomitant genetic changes." Language and Human Behavior should be of interest to anyone in the behavioral and evolutionary sciences and to all those concerned with the role of language in human behavior. (shrink)

The neural bases of behavior are often discussed in terms of perceptual, cognitive, and motor stages, defined within an information processing framework that was originally inspired by models of human abstract problem solving. Here, we review a growing body of neurophysiological data that is difficult to reconcile with this influential theoretical perspective. As an alternative foundation for interpreting neural data, we consider frameworks borrowed from ethology, which emphasize the kinds of real-time interactive behaviors that animals have engaged in for millions (...) of years. In particular, we discuss an ethologically-inspired view of interactive behavior as simultaneous processes that specify potential motor actions and select between them. We review how recent neurophysiological data from diverse cortical and subcortical regions appear more compatible with this parallel view than with the classical view of serial information processing stages. (shrink)

When I am looking at my coffee machine that makes funny noises, this is an instance of multisensory perception – I perceive this event by means of both vision and audition. But very often we only receive sensory stimulation from a multisensory event by means of one sense modality, for example, when I hear the noisy coffee machine in the next room, that is, without seeing it. The aim of this paper is to bring together empirical findings about multimodal perception (...) and empirical findings about (visual, auditory, tactile) mental imagery and argue that on occasions like this, we have multimodal mental imagery: perceptual processing in one sense modality (here: vision) that is triggered by sensory stimulation in another sense modality (here: audition). Multimodal mental imagery is not a rare and obscure phenomenon. The vast majority of what we perceive are multisensory events: events that can be perceived in more than one sense modality – like the noisy coffee machine. And most of the time we are only acquainted with these multisensory events via a subset of the sense modalities involved – all the other aspects of these multisensory events are represented by means of multisensory mental imagery. This means that multisensory mental imagery is a crucial element of almost all instances of everyday perception. (shrink)

Enaction, as put forward by Varela and defended by other thinkers (notably Alva Noë, 2004; Susan Hurley, 2006; and Kevin O’Regan, 1992), departs from traditional accounts that treat mental processes (like perception, reasoning, and action) as discrete, independent processes that are causally related in a sequen- tial fashion. According to the main claim of the enactive approach, which Thompson seems to fully endorse, perceptual awareness is taken to be a skill-based activity. Our perceptual contact with the world, according to the (...) enactionists, is not mediated by representations but is enacted, and the notion of representation, belonging to the classic computational paradigm, has no place in this alternative approach. Though Thompson does not pronounce directly on the issue of representationalism, he is most definitely keeping the company of anti-representationalists, and in that context it is not unreasonable to take his silence for consent. In this paper, we will argue that the enactive approach to imagery is unworkable unless it makes appeal to representations, understood in a particular way. Not understood as pictures, to be sure. Or sentences for that matter. But those aren’t the only options. (shrink)