Brains, it has recently been argued, are essentially prediction machines. They are bundles of cells that support perception and action by constantly attempting to match incoming sensory inputs with top-down expectations or predictions. This is achieved using a hierarchical generative model that aims to minimize prediction error within a bidirectional cascade of cortical processing. Such accounts offer a unifying model of perception and action, illuminate the functional role of attention, and may neatly capture the special contribution of cortical processing to (...) adaptive success. This target article critically examines this approach, concluding that it offers the best clue yet to the shape of a unified science of mind and action. Sections 1 and 2 lay out the key elements and implications of the approach. Section 3 explores a variety of pitfalls and challenges, spanning the evidential, the methodological, and the more properly conceptual. The paper ends (sections 4 and 5) by asking how such approaches might impact our more general vision of mind, experience, and agency. (shrink)

Fodor and Pylyshyn's critique of connectionism has posed a challenge to connectionists: Adequately explain such nomological regularities as systematicity and productivity without postulating a "language of thought" (LOT). Some connectionists like Smolensky took the challenge very seriously, and attempted to meet it by developing models that were supposed to be non-classical. At the core of these attempts lies the claim that connectionist models can provide a representational system with a combinatorial syntax and processes sensitive to syntactic structure. They are not (...) implementation models because, it is claimed, the way they obtain syntax and structure sensitivity is not "concatenative," hence "radically different" from the way classicists handle them. In this paper, I offer an analysis of what it is to physically satisfy/realize a formal system. In this context, I examine the minimal truth-conditions of LOT Hypothesis. From my analysis it will follow that concatenative realization of formal systems is irrelevant to LOTH since the very notion of LOT is indifferent to such an implementation level issue as concatenation. I will conclude that to the extent to which they can explain the law-like cognitive regularities, a certain class of connectionist models proposed as radical alternatives to the classical LOT paradigm will in fact turn out to be LOT models, even though new and potentially very exciting ones. (shrink)

The prominence of Bayesian modeling of cognition has increased recently largely because of mathematical advances in specifying and deriving predictions from complex probabilistic models. Much of this research aims to demonstrate that cognitive behavior can be explained from rational principles alone, without recourse to psychological or neurological processes and representations. We note commonalities between this rational approach and other movements in psychology – namely, Behaviorism and evolutionary psychology – that set aside mechanistic explanations or make use of optimality assumptions. Through (...) these comparisons, we identify a number of challenges that limit the rational program's potential contribution to psychological theory. Specifically, rational Bayesian models are significantly unconstrained, both because they are uninformed by a wide range of process-level data and because their assumptions about the environment are generally not grounded in empirical measurement. The psychological implications of most Bayesian models are also unclear. Bayesian inference itself is conceptually trivial, but strong assumptions are often embedded in the hypothesis sets and the approximation algorithms used to derive model predictions, without a clear delineation between psychological commitments and implementational details. Comparing multiple Bayesian models of the same task is rare, as is the realization that many Bayesian models recapitulate existing (mechanistic level) theories. Despite the expressive power of current Bayesian models, we argue they must be developed in conjunction with mechanistic considerations to offer substantive explanations of cognition. We lay out several means for such an integration, which take into account the representations on which Bayesian inference operates, as well as the algorithms and heuristics that carry it out. We argue this unification will better facilitate lasting contributions to psychological theory, avoiding the pitfalls that have plagued previous theoretical movements. (shrink)

Thomas Samuel Kuhn (1922–1996) is one of the most influential philosophers of science of the twentieth century, perhaps the most influential. His 1962 book The Structure of Scientific Revolutions is one of the most cited academic books of all time. Kuhn’s contribution to the philosophy of science marked not only a break with several key positivist doctrines, but also inaugurated a new style of philosophy of science that brought it closer to the history of science. His account of the development (...) of science held that science enjoys periods of stable growth punctuated by revisionary revolutions. To this thesis, Kuhn added the controversial ‘incommensurability thesis’, that theories from differing periods suffer from certain deep kinds of failure of comparability. (shrink)

Whilst much has been said about the implications of predictive processing for our scientific understanding of cognition, there has been comparatively little discussion of how this new paradigm fits with our everyday understanding of the mind, i.e. folk psychology. This paper aims to assess the relationship between folk psychology and predictive processing, which will first require making a distinction between two ways of understanding folk psychology: as propositional attitude psychology and as a broader folk psychological discourse. It will be argued (...) that folk psychology in this broader sense is compatible with predictive processing, despite the fact that there is an apparent incompatibility between predictive processing and a literalist interpretation of propositional attitude psychology. The distinction between these two kinds of folk psychology allows us to accept that our scientific usage of folk concepts requires revision, whilst rejecting the suggestion that we should eliminate folk psychology entirely. (shrink)

Predictive coding – sometimes also known as ‘predictive processing’, ‘free energy minimisation’, or ‘prediction error minimisation’ – claims to offer a complete, unified theory of cognition that stretches all the way from cellular biology to phenomenology. However, the exact content of the view, and how it might achieve its ambitions, is not clear. This series of articles examines predictive coding and attempts to identify its key commitments and justification. The present article begins by focusing on possible confounds with predictive coding: (...) claims that are often identified with predictive coding, but which are not predictive coding. These include the idea that the brain employs an efficient scheme for encoding its incoming sensory signals; that perceptual experience is shaped by prior beliefs; that cognition involves minimisation of prediction error; that the brain is a probabilistic inference engine; and that the brain learns and employs a generative model of the world. These ideas have garnered widespread support in modern cognitive neuroscience, but it is important not to conflate them with predictive coding. (shrink)

Predictive processing has recently been advanced as a global cognitive architecture for the brain. I argue that its commitments concerning the nature and format of cognitive representation are inadequate to account for two basic characteristics of conceptual thought: first, its generality—the fact that we can think and flexibly reason about phenomena at any level of spatial and temporal scale and abstraction; second, its rich compositionality—the specific way in which concepts productively combine to yield our thoughts. I consider two strategies for (...) avoiding these objections and I argue that both confront formidable challenges. (shrink)

Recent research in cognitive and computational neuroscience portrays the neocortex as a hierarchically structured prediction machine. Several theorists have drawn on this research to challenge the traditional distinction between perception and cognition – specifically, to challenge the very idea that perception and cognition constitute useful kinds from the perspective of cognitive neuroscience. In place of this traditional taxonomy, such theorists advocate a unified inferential hierarchy subject to substantial bi-directional message passing. I outline the nature of this challenge and then raise (...) two objections to the cognitive architecture it proposes as a replacement: first, standard ways of characterising this inferential hierarchy are in tension with the representational reach of conceptual thought; second, there is compelling evidence that commonsense reasoning is structured around highly domain-specific intuitive theories that are difficult to situate within a single hierarchy. (shrink)

In this paper I propose minimal criteria for a successful theory of the mechanisms of motivation, and argue that extant philosophical accounts fail to meet them. Further, I argue that a predictive processing framework gives us the theoretical power to meet these criteria, and thus ought to be preferred over existing theories. The argument proceeds as follows—motivational mental states are generally understood as mental states with the power to initiate, guide, and control action, though few existing theories of motivation explicitly (...) detail how they are meant to explain these functions. I survey two contemporary theories of motivational mental states, due to Wayne Wu and Bence Nanay, and argue that they fail to satisfactorily explain one or more of these functions. Nevertheless, I argue that together, they are capable of giving a strong account of the control function, which competing theories ought to preserve. I then go on to argue that what I call the ‘predictive theory’ of motivational mental states, which makes use of the notion of active inference, is able to explain all three of the key functions and preserves the central insights of Wu and Nanay on control. It thus represents a significant step forward in the contemporary debate. (shrink)

Do we think in a language-like format? Taking the marker of language-like formats to be the property of unconstrained systematicity, this paper considers the following master argument for the claim that we do: language is unconstrainedly systematic, if language is unconstrainedly systematic then so is thought, so thought is unconstrainedly systematic. It is easy to feel that there is something right about this argument, that there will be some way of filling in its details that will vindicate the idea that (...) our thought must be unconstrainedly systematic given that the language in which we express it is. Clearly, however, the second premise needs support—we need a principled reason for moving from the unconstrained systematicity of language to the unconstrained systematicity of thought. This paper gives three passes at formulating such a principle. This turns out to be much harder than it might seem. We should, I conclude, resist falling too easily for the lure of this master argument for the language-like format of thought. (shrink)

© The Authors 2017. Published by Oxford University Press on behalf of The Analysis Trust. All rights reserved. For Permissions, please email: [email protected] Clark is usually among the first in philosophy to ride a new and important wave on the frontiers of cognitive science research. His Microcognition and Associative Engines chronicled connectionism, Being There explored embodied cognition, Natural Born Cyborgs deals with BCIs and environmental and technological scaffolding, and Supersizing the Mind is an extended argument for extended minds. Clark's latest, (...) showcases his new enthusiasm about predictive coding, a computational framework for understanding cognition that is generating more excitement and controversy across diverse areas of cognitive science than an offshore wind at Maverick’s does among the boarding elite....Clark is a master at taking complex ideas in cognitive science and conveying them in less technical fashion to a wide audience, doing so with panache and wit.... (shrink)

Predictive processing framework has found wide applications in cognitive science and philosophy. It is an attractive candidate for a unified account of the mind in which perception, action, and cognition fit together in a single model. However, PP cannot claim this role if it fails to accommodate an essential part of cognition—conceptual thought. Recently, Williams argued that PP struggles to address at least two of thought’s core properties—generality and rich compositionality. In this paper, I show that neither necessarily presents a (...) problem for PP. In particular, I argue that because we do not have access to cognitive processes but only to their conscious manifestations, compositionality may be a manifest property of thought, rather than a feature of the thinking process, and result from the interplay of thinking and language. Pace Williams, both of these capacities, constituting parts of a complex and multifarious cognitive system, may be fully based on the architectural principles of PP. Under the assumption that language presents a subsystem separate from conceptual thought, I sketch out one possible way for PP to accommodate both generality and rich compositionality. (shrink)

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

Most discussions frame the Liar Paradox as a formal logical-linguistic puzzle. Attempts to resolve the paradox have focused very little so far on aspects of cognitive psychology and processing, because semantic and cognitive-psychological issues are generally assumed to be disjunct. I provide a motivation and carry out a cognitive-computational treatment of the liar paradox based on a model of language and conceptual knowledge within the Predictive Processing framework. I suggest that the paradox arises as a failure of synchronization between two (...) ways of generating the liar situation in two different PP sub-models, one corresponding to language processing and the other to the processing of meaning and world-knowledge. In this way, I put forward the claim that the liar sentence is meaningless but has an air of meaningfulness. I address the possible objection that the proposal violates the Principle of Unrestricted Compositionality, which purportedly regulates the conceptual competence of thinkers. (shrink)

The debate about the nature of the representational format of concepts seems to have reached an impasse. The debate faces two fundamental problems. Firstly, amodalists (i.e., those who argue that concepts are represented by amodal symbols) and modalists (i.e., those who see concepts as involving crucially representations including sensorimotor information) claim that the same empirical evidence is compatible with their views. Secondly, there is no shared understanding of what a modal or amodal format amounts to. Both camps recognize that the (...) two formats play essential roles in higher cognition, leading to an increasing number of hybrid proposals. In this paper, I argue that the existence of those fundamental problems should make us suspicious about a modal/amodal dichotomy. Also, I suggest that hybrid approaches, as they currently stand, do not provide suitable solutions to the impasse. Instead, we should overcome the dichotomy and treat the modal/amodal distinction as a graded phenomenon. I illustrate this hypothesis with an example of a cognitive-computational model of concepts based on the Predictive Processing framework. (shrink)

Concept contextualism is the view that the information associated with a concept is dependent on the context in which it is tokened. This view is gaining support in recent years. The received and c...

Most discussions frame the Liar Paradox as a formal logical-linguistic puzzle. Attempts to resolve the paradox have focused very little so far on aspects of cognitive psychology and processing, because semantic and cognitive-psychological issues are generally assumed to be disjunct. I provide a motivation and carry out a cognitive-computational treatment of the liar paradox based on a model of language and conceptual knowledge within thePredictive Processing(PP) framework. I suggest that the paradox arises as a failure of synchronization between two ways (...) of generating the liar situation in two different (idealized) PP sub-models, one corresponding to language processing and the other to the processing of meaning and world-knowledge. In this way, I put forward the claim that the liar sentence is meaningless but has an air of meaningfulness. I address the possible objection that the proposal violates thePrinciple of Unrestricted Compositionality, which purportedly regulates the conceptual competence of thinkers. (shrink)

Most discussions frame the Liar Paradox as a formal logical-linguistic puzzle. Attempts to resolve the paradox have focused very little so far on aspects of cognitive psychology and processing, because semantic and cognitive-psychological issues are generally assumed to be disjunct. I provide a motivation and carry out a cognitive-computational treatment of the liar paradox based on a cognitive-computational model of language and conceptual knowledge within the Predictive Processing framework. I suggest that the paradox arises as a failure of synchronization between (...) two ways of generating the liar situation in two different PP sub-models, one corresponding to language processing and the other to the processing of meaning and world-knowledge. In this way, I put forward the claim that the liar sentence is meaningless but has an air of meaningfulness. I address the possible objection that the proposal violates the Principle of Unrestricted Compositionality, which purportedly regulates the conceptual competence of thinkers. (shrink)

Category mistakes are sentences such as ‘Colourless green ideas sleep furiously’ or ‘The theory of relativity is eating breakfast’. Such sentences are highly anomalous, and this has led a large number of linguists and philosophers to conclude that they are meaningless (call this ‘the meaninglessness view’). In this paper I argue that the meaninglessness view is incorrect and category mistakes are meaningful. I provide four arguments against the meaninglessness view: in Sect. 2, an argument concerning compositionality with respect to category (...) mistakes; in Sect. 3 an argument concerning synonymy facts of category mistakes; in Sect. 4 concerning embeddings of category mistakes in propositional attitude ascriptions; and in Sect. 5 concerning the uses of category mistakes in metaphors. Having presented these arguments, in Sect. 6 I briefly discuss some of the positive motivations for accepting the meaninglessness view and argue that they are unconvincing. I conclude that the meaninglessness view ought to be rejected. (shrink)

Can what we know change what we see? Does language affect cognition and perception? The last few years have seen increased attention to these seemingly disparate questions, but with little theoretical advance. We argue that substantial clarity can be gained by considering these questions through the lens of predictive processing, a framework in which mental representations—from the perceptual to the cognitive—reflect an interplay between downward-flowing predictions and upward-flowing sensory signals. This framework provides a parsimonious account of how what we know (...) ought to change what we see and helps us understand how a putatively high-level trait such as language can impact putatively low-level processes such as perception. Within this framework, language begins to take on a surprisingly central role in cognition by providing a uniquely focused and flexible means of constructing predictions against which sensory signals can be evaluated. Predictive processing thus provides a plausible mechanism for many of the reported effects of language on perception, thought, and action, and new insights on how and when speakers of different languages construct the same “reality” in alternate ways. (shrink)

Predictive processing (PP) has been repeatedly presented as a unificatory account of perception, action, and cognition. In this paper, we argue that this is premature: As a unifying theory, PP fails to deliver general, simple, homogeneous, and systematic explanations. By examining its current trajectory of development, we conclude that PP remains only loosely connected both to its computational framework and to its hypothetical biological underpinnings, which makes its fundamentals unclear. Instead of offering explanations that refer to the same set of (...) principles, we observe systematic equivocations in PP‐based models, or outright contradictions with its avowed principles. To make matters worse, PP‐based models are seldom empirically validated, and they are frequently offered as mere just‐so stories. The large number of PP‐based models is thus not evidence of theoretical progress in unifying perception, action, and cognition. On the contrary, we maintain that the gap between theory and its biological and computational bases contributes to the arrested development of PP as a unificatory theory. Thus, we urge the defenders of PP to focus on its critical problems instead of offering mere re‐descriptions of known phenomena, and to validate their models against possible alternative explanations that stem from different theoretical assumptions. Otherwise, PP will ultimately fail as a unified theory of cognition. (shrink)

Predictive processing (PP) is now a prominent theoretical framework in the philosophy of mind and cognitive science. This review focuses on PP research with a relatively philosophical focus, taking stock of the framework and discussing new directions. The review contains an introduction that describes the full PP toolbox; an exploration of areas where PP has advanced understanding of perceptual and cognitive phenomena; a discussion of PP's impact on foundational issues in cognitive science; and a consideration of the philosophy of science (...) of PP. The overall picture is that PP is a fruitful framework, with exciting new directions awaiting exploration. (shrink)

It is often claimed that the greatest value of the Bayesian framework in cognitive science consists in its unifying power. Several Bayesian cognitive scientists assume that unification is obviously linked to explanatory power. But this link is not obvious, as unification in science is a heterogeneous notion, which may have little to do with explanation. While a crucial feature of most adequate explanations in cognitive science is that they reveal aspects of the causal mechanism that produces the phenomenon to be (...) explained, the kind of unification afforded by the Bayesian framework to cognitive science does not necessarily reveal aspects of a mechanism. Bayesian unification, nonetheless, can place fruitful constraints on causal–mechanical explanation. 1 Introduction2 What a Great Many Phenomena Bayesian Decision Theory Can Model3 The Case of Information Integration4 How Do Bayesian Models Unify?5 Bayesian Unification: What Constraints Are There on Mechanistic Explanation?5.1 Unification constrains mechanism discovery5.2 Unification constrains the identification of relevant mechanistic factors5.3 Unification constrains confirmation of competitive mechanistic models6 ConclusionAppendix. (shrink)

This paper explores the difference between Connectionist proposals for cognitive a r c h i t e c t u r e a n d t h e s o r t s o f m o d e l s t hat have traditionally been assum e d i n c o g n i t i v e s c i e n c e . W e c l a i m t h a t t h (...) e m a j o r d i s t i n c t i o n i s t h a t , w h i l e b o t h Connectionist and Classical architectures postulate representational mental states, the latter but not the former are committed to a symbol-level of representation, or to a ‘language of thought’: i.e., to representational states that have combinatorial syntactic and semantic structure. Several arguments for combinatorial structure in mental representations are then reviewed. These include arguments based on the ‘systematicity’ of mental representation: i.e., on the fact that cognitive capacities always exhibit certain symmetries, so that the ability to entertain a given thought implies the ability to entertain thoughts with semantically related contents. We claim that such arguments make a powerful case that mind/brain architecture is not Connectionist at the cognitive level. We then consider the possibility that Connectionism may provide an account of the neural (or ‘abstract neurological’) structures in which Classical cognitive architecture is implemented. We survey a n u m b e r o f t h e s t a n d a r d a r g u m e n t s t h a t h a v e b e e n o f f e r e d i n f a v o r o f Connectionism, and conclude that they are coherent only on this interpretation. (shrink)