Brains, it has recently been argued, are essentially prediction machines. They are bundles of cells that support perception and action by constantly attempting to match incoming sensory inputs with top-down expectations or predictions. This is achieved using a hierarchical generative model that aims to minimize prediction error within a bidirectional cascade of cortical processing. Such accounts offer a unifying model of perception and action, illuminate the functional role of attention, and may neatly capture the special contribution of cortical processing to (...) adaptive success. This target article critically examines this approach, concluding that it offers the best clue yet to the shape of a unified science of mind and action. Sections 1 and 2 lay out the key elements and implications of the approach. Section 3 explores a variety of pitfalls and challenges, spanning the evidential, the methodological, and the more properly conceptual. The paper ends (sections 4 and 5) by asking how such approaches might impact our more general vision of mind, experience, and agency. (shrink)

Philosophical proponents of predictive processing cast the novelty of predictive models of perception in terms of differences in the functional role and information content of neural signals. However, they fail to provide constraints on how the crucial semantic mapping from signals to their informational contents is determined. Beyond a novel interpretative gloss on neural signals, they have little new to say about the causal structure of the system, or even what statistical information is carried by the signals. That means that (...) the predictive framework for perception can be relabeled in traditional, non-predictive terms, with no empirical consequences relevant to existing or future data. To the extent that neuroscientific research based on predictive processing is both innovative and productive, it will be due to the framework’s suggestive heuristic effects, or perhaps auxiliary empirical claims about implementation, rather than a difference in the information-processing structure that it describes. (shrink)

Tyler Burge presents an original study of the most primitive ways in which individuals represent the physical world. By reflecting on the science of perception and related psychological and biological sciences, he gives an account of constitutive conditions for perceiving the physical world, and thus aims to locate origins of representational mind.

In this paper, we argue for a theoretical separation of the free-energy principle from Helmholtzian accounts of the predictive brain. The free-energy principle is a theoretical framework capturing the imperative for biological self-organization in information-theoretic terms. The free-energy principle has typically been connected with a Bayesian theory of predictive coding, and the latter is often taken to support a Helmholtzian theory of perception as unconscious inference. If our interpretation is right, however, a Helmholtzian view of perception is incompatible with Bayesian (...) predictive coding under the free-energy principle. We argue that the free energy principle and the ecological and enactive approach to mind and life make for a much happier marriage of ideas. We make our argument based on three points. First we argue that the free energy principle applies to the whole animal–environment system, and not only to the brain. Second, we show that active inference, as understood by the free-energy principle, is incompatible with unconscious inference understood as analagous to scientific hypothesis-testing, the main tenet of a Helmholtzian view of perception. Third, we argue that the notion of inference at work in Bayesian predictive coding under the free-energy principle is too weak to support a Helmholtzian theory of perception. Taken together these points imply that the free energy principle is best understood in ecological and enactive terms set out in this paper. (shrink)

The prominence of Bayesian modeling of cognition has increased recently largely because of mathematical advances in specifying and deriving predictions from complex probabilistic models. Much of this research aims to demonstrate that cognitive behavior can be explained from rational principles alone, without recourse to psychological or neurological processes and representations. We note commonalities between this rational approach and other movements in psychology – namely, Behaviorism and evolutionary psychology – that set aside mechanistic explanations or make use of optimality assumptions. Through (...) these comparisons, we identify a number of challenges that limit the rational program's potential contribution to psychological theory. Specifically, rational Bayesian models are significantly unconstrained, both because they are uninformed by a wide range of process-level data and because their assumptions about the environment are generally not grounded in empirical measurement. The psychological implications of most Bayesian models are also unclear. Bayesian inference itself is conceptually trivial, but strong assumptions are often embedded in the hypothesis sets and the approximation algorithms used to derive model predictions, without a clear delineation between psychological commitments and implementational details. Comparing multiple Bayesian models of the same task is rare, as is the realization that many Bayesian models recapitulate existing (mechanistic level) theories. Despite the expressive power of current Bayesian models, we argue they must be developed in conjunction with mechanistic considerations to offer substantive explanations of cognition. We lay out several means for such an integration, which take into account the representations on which Bayesian inference operates, as well as the algorithms and heuristics that carry it out. We argue this unification will better facilitate lasting contributions to psychological theory, avoiding the pitfalls that have plagued previous theoretical movements. (shrink)

The prediction error minimization framework denotes a family of views that aim at providing a unified theory of perception, cognition, and action. In this paper, I discuss some of the theoretical limitations of PEM. It appears that PEM cannot provide a satisfactory explanation of motivated reasoning, as instantiated in phenomena such as self-deception, because its cognitive ontology does not have a separate category for motivational states such as desires. However, it might be thought that this objection confuses levels of explanation. (...) Self-deception is a personal level phenomenon, while PEM offers subpersonal explanations of psychological abilities. Thus, the paper examines how subpersonal explanations couched in the PEM framework can be thought of as related to personal level explanations underlying self-deception. In this regard, three views on the relation between personal and subpersonal explanations are investigated: the autonomist, the functionalist, and the co-evolutionary perspective. I argue that, depending on which view of the relation between the personal and subpersonal is adopted, the PEM paradigm faces a dilemma: either its explanatory ambitions should be reduced to the subpersonal domain, or it cannot provide a satisfactory account of motivated reasoning as instantiated in self-deception. (shrink)

Gualtiero Piccinini presents a systematic and rigorous philosophical defence of the computational theory of cognition. His view posits that cognition involves neural computation within multilevel neurocognitive mechanisms, and includes novel ideas about ontology, functions, neural representation, neural computation, and consciousness.

In 1890 William James distinguished two understandings of the self, the self as “Me” and the self as “I”. This distinction has recently regained popularity in cognitive science, especially in the context of experimental studies on the underpinnings of the phenomenal self. The goal of this paper is to take a step back from cognitive science and attempt to precisely distinguish between “Me” and “I” in the context of consciousness. This distinction was originally based on the idea that the former (...) (“Me”) corresponds to the self as an object of experience (self as object), while the latter (“I”) reflects the self as a subject of experience (self as subject). I will argue that in most of the cases (arguably all) this distinction maps onto the distinction between the phenomenal self (reflecting self-related content of consciousness) and the metaphysical self (representing the problem of subjectivity of all conscious experience), and as such these two issues should be investigated separately using fundamentally different methodologies. Moreover, by referring to Metzinger’s theory of phenomenal self-models, I will argue that what is usually investigated as the phenomenal-“I” (following understanding of self-as-subject introduced by Wittgenstein) can be interpreted as object, rather than subject of experience, and as such can be understood as an element of the hierarchical structure of the phenomenal self-model. This understanding relates to recent predictive coding and free energy theories of the self and bodily self from cognitive neuroscience and philosophy. (shrink)

Predictive processing has recently been advanced as a global cognitive architecture for the brain. I argue that its commitments concerning the nature and format of cognitive representation are inadequate to account for two basic characteristics of conceptual thought: first, its generality—the fact that we can think and flexibly reason about phenomena at any level of spatial and temporal scale and abstraction; second, its rich compositionality—the specific way in which concepts productively combine to yield our thoughts. I consider two strategies for (...) avoiding these objections and I argue that both confront formidable challenges. (shrink)

A large body of research in cognitive psychology and neuroscience draws on Bayesian statistics to model information processing within the brain. Many theorists have noted that this research seems to be in tension with a large body of experimental results purportedly documenting systematic deviations from Bayesian updating in human belief formation. In response, proponents of the Bayesian brain hypothesis contend that Bayesian models can accommodate such results by making suitable assumptions about model parameters. To make progress in this debate, I (...) argue that it is fruitful to focus not on specific experimental results but rather on what I call the ‘sources of epistemic irrationality’ in human cognition. I identify four such sources and I explore whether and, if so, how Bayesian models can be reconciled with them: processing costs, evolutionary suboptimality, motivated cognition, and error management. 1 Introduction 2 The Bayesian Brain 3 The Problem of Epistemic Irrationality 3.1 Bayesian inference and rationality 3.2 Intuitive Bayesian inference 4 Sources of Epistemic Irrationality 4.1 Processing costs 4.2 Evolutionary suboptimality 4.3 Motivational influences 4.4 Error management 5 Conclusion. (shrink)

The Newell Test as it is proposed by Anderson & Lebiere has the disadvantage of being too positivistic, stressing areas a theory should cover, instead of attempting to exclude false predictions. Nevertheless, Newell's list can be used as the basis for a more stringent test with a stress on the falsifiability of the theory.

Predictive processing (PP) has been repeatedly presented as a unificatory account of perception, action, and cognition. In this paper, we argue that this is premature: As a unifying theory, PP fails to deliver general, simple, homogeneous, and systematic explanations. By examining its current trajectory of development, we conclude that PP remains only loosely connected both to its computational framework and to its hypothetical biological underpinnings, which makes its fundamentals unclear. Instead of offering explanations that refer to the same set of (...) principles, we observe systematic equivocations in PP‐based models, or outright contradictions with its avowed principles. To make matters worse, PP‐based models are seldom empirically validated, and they are frequently offered as mere just‐so stories. The large number of PP‐based models is thus not evidence of theoretical progress in unifying perception, action, and cognition. On the contrary, we maintain that the gap between theory and its biological and computational bases contributes to the arrested development of PP as a unificatory theory. Thus, we urge the defenders of PP to focus on its critical problems instead of offering mere re‐descriptions of known phenomena, and to validate their models against possible alternative explanations that stem from different theoretical assumptions. Otherwise, PP will ultimately fail as a unified theory of cognition. (shrink)

The now-classic Metaphors We Live By changed our understanding of metaphor and its role in language and the mind. Metaphor, the authors explain, is a fundamental mechanism of mind, one that allows us to use what we know about our physical and social experience to provide understanding of countless other subjects. Because such metaphors structure our most basic understandings of our experience, they are "metaphors we live by"--metaphors that can shape our perceptions and actions without our ever noticing them. In (...) this updated edition of Lakoff and Johnson's influential book, the authors supply an afterword surveying how their theory of metaphor has developed within the cognitive sciences to become central to the contemporary understanding of how we think and how we express our thoughts in language. (shrink)

The so-called “dark room problem” makes vivd the challenges that purely predictive models face in accounting for motivation. I argue that the problem is a serious one. Proposals for solving the dark room problem via predictive coding architectures are either empirically inadequate or computationally intractable. The Free Energy principle might avoid the problem, but only at the cost of setting itself up as a highly idealized model, which is then literally false to the world. I draw at least one optimistic (...) conclusion, however. Real-world, real-time systems may embody motivational states in a variety of ways consistent with idealized principles like FEP, including ways that are intuitively embodied and extended. This may allow predictive coding theorists to reconcile their account with embodied principles, even if it ultimately undermines loftier ambitions. (shrink)

This paper starts by considering an argument for thinking that predictive processing (PP) is representational. This argument suggests that the Kullback–Leibler (KL)-divergence provides an accessible measure of misrepresentation, and therefore, a measure of representational content in hierarchical Bayesian inference. The paper then argues that while the KL-divergence is a measure of information, it does not establish a sufficient measure of representational content. We argue that this follows from the fact that the KL-divergence is a measure of relative entropy, which can (...) be shown to be the same as covariance (through a set of additional steps). It is well known that facts about covariance do not entail facts about representational content. So there is no reason to think that the KL-divergence is a measure of (mis-)representational content. This paper thus provides an enactive, non-representational account of Bayesian belief optimisation in hierarchical PP. (shrink)

An exciting theory in neuroscience is that the brain is an organ for prediction error minimization. This theory is rapidly gaining influence and is set to dominate the science of mind and brain in the years to come. PEM has extreme explanatory ambition, and profound philosophical implications. Here, I assume the theory, briefly explain it, and then I argue that PEM implies that the brain is essentially self-evidencing. This means it is imperative to identify an evidentiary boundary between the brain (...) and its environment. This boundary defines the mind-world relation, opens the door to skepticism, and makes the mind transpire as more inferentially secluded and neurocentrically skull-bound than many would nowadays think. Therefore, PEM somewhat deflates contemporary hypotheses that cognition is extended, embodied and enactive; however, it can nevertheless accommodate the kinds of cases that fuel these hypotheses. (shrink)

The free energy principle says that any self-organising system that is at nonequilibrium steady-state with its environment must minimize its free energy. It is proposed as a grand unifying principle for cognitive science and biology. The principle can appear cryptic, esoteric, too ambitious, and unfalsifiable—suggesting it would be best to suspend any belief in the principle, and instead focus on individual, more concrete and falsifiable ‘process theories’ for particular biological processes and phenomena like perception, decision and action. Here, I explain (...) the free energy principle, and I argue that it is best understood as offering a conceptual and mathematical analysis of the concept of existence of self-organising systems. This analysis offers a new type of solution to long-standing problems in neurobiology, cognitive science, machine learning and philosophy concerning the possibility of normatively constrained, self-supervised learning and inference. The principle can therefore uniquely serve as a regulatory principle for process theories, to ensure that process theories conforming to it enable self-supervision. This is, at least for those who believe self-supervision is a foundational explanatory task, good reason to believe the free energy principle. (shrink)

Predictive processing (PP) is now a prominent theoretical framework in the philosophy of mind and cognitive science. This review focuses on PP research with a relatively philosophical focus, taking stock of the framework and discussing new directions. The review contains an introduction that describes the full PP toolbox; an exploration of areas where PP has advanced understanding of perceptual and cognitive phenomena; a discussion of PP's impact on foundational issues in cognitive science; and a consideration of the philosophy of science (...) of PP. The overall picture is that PP is a fruitful framework, with exciting new directions awaiting exploration. (shrink)

I argue against a growing radical trend in current theoretical cognitive science that moves from the premises of embedded cognition, embodied cognition, dynamical systems theory and/or situated robotics to conclusions either to the effect that the mind is not in the brain or that cognition does not require representation, or both. I unearth the considerations at the foundation of this view: Haugeland's bandwidth-component argument to the effect that the brain is not a component in cognitive activity, and arguments inspired by (...) dynamical systems theory and situated robotics to the effect that cognitive activity does not involve representations. Both of these strands depend not only on a shift of emphasis from higher cognitive functions to things like sensorimotor processes, but also depend on a certain understanding of how sensorimotor processes are implemented - as closed-loop control systems. I describe a much more sophisticated model of sensorimotor processing that is not only more powerful and robust than simple closed-loop control, but for which there is great evidence that it is implemented in the nervous system. The is the emulation theory of representation, according to which the brain constructs inner dynamical models, or emulators, of the body and environment which are used in parallel with the body and environment to enhance motor control and perception and to provide faster feedback during motor processes, and can be run off-line to produce imagery and evaluate sensorimotor counterfactuals. I then show that the emulation framework is immune to the radical arguments, and makes apparent why the brain is a component in the cognitive activity, and exactly what the representations are in sensorimotor control. (shrink)

The ArgumentScientific tools—measurement and calculation instruments, techniques of inference—straddle the line between the context of discovery and the context of justification. In discovery, new scientific tools suggest new theoretical metaphors and concepts; and in justification, these tool-derived theoretical metaphors and concepts are morelikely to be accepted by the scientific community if the tools are already entrenched in scientific practice.Techniques of statistical inference and hypothesis testing entered American psychology first as tools in the 1940s and 1950s and then as cognitive theories (...) in the 1960s and 1970s. Not only did psychologists resists statistical metaphors of mind prior to the institutionalization of inference techniques in their own practice; the cognitive theories they ultimately developed about “the mind as intuitive statistician” still bear the telltale marks of the practical laboratory context in which the tool was used. (shrink)

Why do brains have so many connections? The principles exposed by Andy Clark provide answers to questions like this by appealing to the notion that brains distil causal regularities in the sensorium and embody them in models of their world. For example, connections embody the fact that causes have particular consequences. This commentary considers the imperatives for this form of embodiment.

The proposal that probabilistic inference and unconscious hypothesis testing are central to information processing in the brain has been steadily gaining ground in cognitive neuroscience and associated fields. One popular version of this proposal is the new theoretical framework of predictive processing or prediction error minimization, which couples unconscious hypothesis testing with the idea of ‘active inference’ and claims to offer a unified account of perception and action. Here we will consider one outstanding issue that still looms large at the (...) core of the PEM framework: the lack of a clear criterion for distinguishing conscious states from unconscious ones. In order to fulfill the promise of becoming a unifying framework for describing and modeling cognition, PEM needs to be able to differentiate between conscious and unconscious mental states or processes. We will argue that one currently popular view, that the contents of conscious experience are determined by the ‘winning hypothesis’, falls short of fully accounting for conscious experience. It ignores the possibility that some states of a system can control that system’s behavior even though they are apparently not conscious. What follows from this is that the ‘winning hypothesis’ view does not provide a complete account of the difference between conscious and unconscious states in the probabilistic brain. We show how this problem for the received view can be resolved by augmenting PEM with Daniel Dennett’s multiple drafts model of consciousness. This move is warranted by the similar roles that attention and internal competition play in both the PEM framework and the multiple drafts model. (shrink)

How is it that thoroughly physical material beings such as ourselves can think, dream, feel, create and understand ideas, theories and concepts? How does mere matter give rise to all these non-material mental states, including consciousness itself? An answer to this central question of our existence is emerging at the busy intersection of neuroscience, psychology, artificial intelligence, and robotics.In this groundbreaking work, philosopher and cognitive scientist Andy Clark explores exciting new theories from these fields that reveal minds like ours to (...) be prediction machines - devices that have evolved to anticipate the incoming streams of sensory stimulation before they arrive. These predictions then initiate actions that structure our worlds and alter the very things we need to engage and predict. Clark takes us on a journey in discovering the circular causal flows and the self-structuring of the environment that define "the predictive brain." What emerges is a bold, new, cutting-edge vision that reveals the brain as our driving force in the daily surf through the waves of sensory stimulation. (shrink)

In this book, Newell makes the case for unified theories by setting forth a candidate.

A new theory is taking hold in neuroscience. It is the theory that the brain is essentially a hypothesis-testing mechanism, one that attempts to minimise the error of its predictions about the sensory input it receives from the world. It is an attractive theory because powerful theoretical arguments support it, and yet it is at heart stunningly simple. Jakob Hohwy explains and explores this theory from the perspective of cognitive science and philosophy. The key argument throughout The Predictive Mind is (...) that the mechanism explains the rich, deep, and multifaceted character of our conscious perception. It also gives a unified account of how perception is sculpted by attention, and how it depends on action. The mind is revealed as having a fragile and indirect relation to the world. Though we are deeply in tune with the world we are also strangely distanced from it. (shrink)

In the book, I argue that the mind can be explained computationally because it is itself computational—whether it engages in mental arithmetic, parses natural language, or processes the auditory signals that allow us to experience music. All these capacities arise from complex information-processing operations of the mind. By analyzing the state of the art in cognitive science, I develop an account of computational explanation used to explain the capacities in question.

This book discusses principles and theories regarding perception and communication. Relevant research data is presented which support these theories. 2004 APA, all rights reserved).

The goal of this short chapter, aimed at philosophers, is to provide an overview and brief explanation of some central concepts involved in predictive processing (PP). Even those who consider themselves experts on the topic may find it helpful to see how the central terms are used in this collection. To keep things simple, we will first informally define a set of features important to predictive processing, supplemented by some short explanations and an alphabetic glossary. -/- The features described here (...) are not shared in all PP accounts. Some may not be necessary for an individual model; others may be contested. Indeed, not even all authors of this collection will accept all of them. To make this transparent, we have encouraged contributors to indicate briefly which of the features are necessary to support the arguments they provide, and which (if any) are incompatible with their account. For the sake of clarity, we provide the complete list here, very roughly ordered by how central we take them to be for “Vanilla PP” (i.e., a formulation of predictive processing that will probably be accepted by most researchers working on this topic). More detailed explanations will be given below. Note that these features do not specify individually necessary and jointly sufficient conditions for the application of the concept of “predictive processing”. All we currently have is a semantic cluster, with perhaps some overlapping sets of jointly sufficient criteria. The framework is still developing, and it is difficult, maybe impossible, to provide theory-neutral explanations of all PP ideas without already introducing strong background assumptions. (shrink)