Each of our theories of mental representation provides some insight into how the mind works. However, these insights often seem incompatible, as the debates between symbolic, dynamical, emergentist, sub-symbolic, and grounded approaches to cognition attest. Mental representations—whatever they are—must share many features with each of our theories of representation, and yet there are few hypotheses about how a synthesis could be possible. Here, I develop a theory of the underpinnings of symbolic cognition that shows how sub-symbolic dynamics may give rise (...) to higher-level cognitive representations of structures, systems of knowledge, and algorithmic processes. This theory implements a version of conceptual role semantics by positing an internal universal representation language in which learners may create mental models to capture dynamics they observe in the world. The theory formalizes one account of how truly novel conceptual content may arise, allowing us to explain how even elementary logical and computational operations may be learned from a more primitive basis. I provide an implementation that learns to represent a variety of structures, including logic, number, kinship trees, regular languages, context-free languages, domains of theories like magnetism, dominance hierarchies, list structures, quantification, and computational primitives like repetition, reversal, and recursion. This account is based on simple discrete dynamical processes that could be implemented in a variety of different physical or biological systems. In particular, I describe how the required dynamics can be directly implemented in a connectionist framework. The resulting theory provides an “assembly language” for cognition, where high-level theories of symbolic computation can be implemented in simple dynamics that themselves could be encoded in biologically plausible systems. (shrink)

An ongoing philosophical discussion concerns how various types of mental states fall within broad representational genera—for example, whether perceptual states are “iconic” or “sentential,” “analog” or “digital,” and so on. Here, I examine the grounds for making much more specific claims about how mental states are structured from constituent parts. For example, the state I am in when I perceive the shape of a mountain ridge may have as constituent parts my representations of the shapes of each peak and saddle (...) of the ridge. More specific structural claims of this sort are a guide to how mental states fall within broader representational kinds. Moreover, these claims have significant implications of their own about semantic, functional, and epistemic features of our mental lives. But what are the conditions on a mental state's having one type of constituent structure rather than another? Drawing on explanatory strategies in vision science, I argue that, other things being equal, the constituent structure of a mental state determines what I call its distributional properties—namely, how mental states of that type can, cannot, or must co‐occur with other mental states in a given system. Distributional properties depend critically on and are informative about the underlying structures of mental states, they abstract in important ways from aspects of how mental states are processed, and they can yield significant insights into the variegation of psychological capacities. (shrink)

SUMMARY Major theories of philosophical psychology and philosophy of mind are examined on the basis of the fundamental questions of ontology, metaphysics, epistemology, semantics and logic. The result is the choice between language of eliminative reductionism and dualism, neither of which answers properly the relation between mind and body. In the search for a non–dualistic and non–reductive language, Wittgenstein’s notion of language–games as the representative links between language and the world is considered together with Peirce’s semeiosis of cognition. The result (...) is a redefined notion of cognition as the goal–oriented ability to instantiate strategies from the rules of the language–games. Cognition is considered within the four-dimensional languagegames: rules/strategies, primitive/complete language-games, family-resemblances/forms of life, and non-temporal continuum as the language-games’ modality. Cognition is seen as a continuum process of non–individualized elements that unites perception, volition, emotion, will and thought against the commonly accepted understandings of cognition in exclusive terms of perception and thinking. The alternative to the mind/body problem is the continuity of cognition where rules and strategies, syntax and semantics, are considered inseparable within language–games. This continuity of cognition is explained in terms of virtual (univocal) identity, replacing the old philosophical paradigm of the mind/body problem. -/- SOMMARIO Le teorie maggiori della psicologia filosofica e filosofia della mente sono esaminate a partire dalle questioni fondamentali di ontologia, metafisica, epistemologia, semantica e logica. Il risultato è la scelta tra un linguaggio riduzionista eliminativo e un dualismo che però non confronta in modo adeguato la relazione tra mente e corpo. Nella ricerca per un linguaggio non-dualistico e non-riduttivo, viene considerata la nozione del gioco linguistico di Wittgenstein come un legame rappresentativo tra il linguaggio e il mondo insieme con la semiosi cognitiva di Peirce. Il risultato è la nozione ridefinita della cognizione come abilità goal-orientata di creare le strategie dalle regole dei giochi linguistici. La cognizione è considerata entro le quattro dimensioni dei giochi linguistici: regole/strategie, giochi linguistici primitivi/completi, somiglianze di famiglia/forme di vita, e la continuità atemporale come la modalità dei giochi linguistici. La cognizione diventa un processo continuo degli elementi non-individualizzati che tende ad unificare la percezione, volizione, emozione, la volontà e il pensiero contro un concetto generalmente accettato di vedere la cognizione nei termini esclusivamente di percezione e di pensiero. L’alternativa al problema della mente/corpo è la continuità della cognizione, dove le regole e le strategie, la sintassi e la semantica, sono considerate inseparabili nei giochi linguistici. Questa continuità della cognizione è spiegata nei termini dell’identità virtuale (univoca) sostituendo un paradigma filosofico previo del problema della mente/corpo. (shrink)

Traditionally, computational theory (CT) and dynamical systems theory (DST) have presented themselves as opposed and incompatible paradigms in cognitive science. There have been some efforts to reconcile these paradigms, mainly, by assimilating DST to CT at the expenses of its anti-representationalist commitments. In this paper, building on Piccinini’s mechanistic account of computation and the notion of functional closure, we explore an alternative conciliatory strategy. We try to assimilate CT to DST by dropping its representationalist commitments, and by inviting CT to (...) recognize the functionally closed nature of some computational systems. (shrink)

Philosophy and Memory Traces defends two theories of autobiographical memory. One is a bewildering historical view of memories as dynamic patterns in fleeting animal spirits, nervous fluids which rummaged through the pores of brain and body. The other is new connectionism, in which memories are 'stored' only superpositionally, and reconstructed rather than reproduced. Both models, argues John Sutton, depart from static archival metaphors by employing distributed representation, which brings interference and confusion between memory traces. Both raise urgent issues about control (...) of the personal past, and about relations between self and body. Sutton demonstrates the role of bizarre body fluids in moral physiology, as philosophers from Descartes and Locke to Coleridge struggled to control their own innards and impose cognitive discipline on 'the phantasmal chaos of association'. Going on to defend connectionism against Fodor and critics of passive mental representations, he shows how problems of the self are implicated in cognitive science. (shrink)

Which notion of computation (if any) is essential for explaining cognition? Five answers to this question are discussed in the paper. (1) The classicist answer: symbolic (digital) computation is required for explaining cognition; (2) The broad digital computationalist answer: digital computation broadly construed is required for explaining cognition; (3) The connectionist answer: sub-symbolic computation is required for explaining cognition; (4) The computational neuroscientist answer: neural computation (that, strictly, is neither digital nor analogue) is required for explaining cognition; (5) The extreme (...) dynamicist answer: computation is not required for explaining cognition. The first four answers are only accurate to a first approximation. But the “devil” is in the details. The last answer cashes in on the parenthetical “if any” in the question above. The classicist argues that cognition is symbolic computation. But digital computationalism need not be equated with classicism. Indeed, computationalism can, in principle, range from digital (and analogue) computationalism through (the weaker thesis of) generic computationalism to (the even weaker thesis of) digital (or analogue) pancomputationalism. Connectionism, which has traditionally been criticised by classicists for being non-computational, can be plausibly construed as being either analogue or digital computationalism (depending on the type of connectionist networks used). Computational neuroscience invokes the notion of neural computation that may (possibly) be interpreted as a sui generis type of computation. The extreme dynamicist argues that the time has come for a post-computational cognitive science. This paper is an attempt to shed some light on this debate by examining various conceptions and misconceptions of (particularly digital) computation. (shrink)

O'Brien & Opie's (O&O's) theory demands a view of unconscious processing that is incompatible with virtually all current PDP models of neural activity. Relative to the alternatives, the theory is closer to an AI than a parallel distributed processing (PDP) perspective, and its treatment of phenomenology is ad hoc. It raises at least one important question: Could features of network relaxation be the “switch” that turns an unconscious into a conscious network?

When cognitive scientists apply computational theory to the problem of phenomenal consciousness, as many of them have been doing recently, there are two fundamentally distinct approaches available. Either consciousness is to be explained in terms of the nature of the representational vehicles the brain deploys; or it is to be explained in terms of the computational processes defined over these vehicles. We call versions of these two approaches _vehicle_ and _process_ theories of consciousness, respectively. However, while there may be space (...) for vehicle theories of consciousness in cognitive science, they are relatively rare. This is because of the influence exerted, on the one hand, by a large body of research which purports to show that the explicit representation of information in the brain and conscious experience are _dissociable_, and on the other, by the _classical_ computational theory of mind – the theory that takes human cognition to be a species of symbol manipulation. But two recent developments in cognitive science combine to suggest that a reappraisal of this situation is in order. First, a number of theorists have recently been highly critical of the experimental methodologies employed in the dissociation studies – so critical, in fact, it’s no longer reasonable to assume that the dissociability of conscious experience and explicit representation has been adequately demonstrated. Second, classicism, as a theory of human cognition, is no longer as dominant in cognitive science as it once was. It now has a lively competitor in the form of _connectionism; _and connectionism, unlike classicism, does have the computational resources to support a robust vehicle theory of consciousness. In this paper we develop and defend this connectionist vehicle theory of consciousness. It takes the form of the following simple empirical hypothesis: _phenomenal experience consists in the explicit_ _representation of information in neurally realized PDP networks_.. (shrink)

A set of hypotheses is formulated for a connectionist approach to cognitive modeling. These hypotheses are shown to be incompatible with the hypotheses underlying traditional cognitive models. The connectionist models considered are massively parallel numerical computational systems that are a kind of continuous dynamical system. The numerical variables in the system correspond semantically to fine-grained features below the level of the concepts consciously used to describe the task domain. The level of analysis is intermediate between those of symbolic cognitive models (...) and neural models. The explanations of behavior provided are like those traditional in the physical sciences, unlike the explanations provided by symbolic models. (shrink)

This paper offers both a theoretical and an experimental perspective on the relationship between connectionist and Classical (symbol-processing) models. Firstly, a serious flaw in Fodor and Pylyshyn’s argument against connectionism is pointed out: if, in fact, a part of their argument is valid, then it establishes a conclusion quite different from that which they intend, a conclusion which is demonstrably false. The source of this flaw is traced to an underestimation of the differences between localist and distributed representation. It has (...) been claimed that distributed representations cannot support systematic operations, or that if they can, then they will be mere implementations of traditional ideas. This paper presents experimental evidence against this conclusion: distributed representations can be used to support direct structure-sensitive operations, in a man- ner quite unlike the Classical approach. Finally, it is argued that even if Fodor and Pylyshyn’s argument that connectionist models of compositionality must be mere implementations were correct, then this would still not be a serious argument against connectionism as a theory of mind. (shrink)

This paper investigates connectionism's potential to solve the frame problem. The frame problem arises in the context of modelling the human ability to see the relevant consequences of events in a situation. It has been claimed to be unsolvable for classical cognitive science, but easily manageable for connectionism. We will focus on a representational approach to the frame problem which advocates the use of intrinsic representations. We argue that although connectionism's distributed representations may look promising from this perspective, doubts can (...) be raised about the potential of distributed representations to allow large amounts of complexly structured information to be adequately encoded and processed. It is questionable whether connectionist models that are claimed to effectively represent structured information can be scaled up to a realistic extent. We conclude that the frame problem provides a difficulty to connectionism that is no less serious than the obstacle it constitutes for classical cognitive science. (shrink)

The topic of this dissertation is the nature of linguistic competence, the capacity to understand and produce sentences of natural language. I defend the empiricist account of linguistic competence embedded in the connectionist cognitive science. This strand of cognitive science has been opposed to the traditional symbolic cognitive science, coupled with transformational-generative grammar, which was committed to nativism due to the view that human cognition, including language capacity, should be construed in terms of symbolic representations and hardwired rules. Similarly, linguistic (...) competence in this framework was regarded as being innate, rule-governed, domain-specific, and fundamentally different from performance, i.e., idiosyncrasies and factors governing linguistic behavior. I analyze state-of-the-art connectionist, deep learning models of natural language processing, most notably large language models, to see what they can tell us about linguistic competence. Deep learning is a statistical technique for the classification of patterns through which artificial intelligence researchers train artificial neural networks containing multiple layers that crunch a gargantuan amount of textual and/or visual data. I argue that these models suggest that linguistic competence should be construed as stochastic, pattern-based, and stemming from domain-general mechanisms. Moreover, I distinguish syntactic from semantic competence, and I show for each the ramifications of the endorsement of a connectionist research program as opposed to the traditional symbolic cognitive science and transformational-generative grammar. I provide a unifying front, consisting of usage-based theories, a construction grammar approach, and an embodied approach to cognition to show that the more multimodal and diverse models are in terms of architectural features and training data, the stronger the case is for the connectionist linguistic competence. I also propose to discard the competence vs. performance distinction as theoretically inferior so that a novel and integrative account of linguistic competence originating in connectionism and empiricism that I propose and defend in the dissertation could be put forward in scientific and philosophical literature. (shrink)

Classicists and connectionists alike claim to be able to explain systematicity. The proposed classicist explanation, I argue, is little more than a promissory note, one that classicists have no idea how to redeem. Smolensky's (1995) proposed connectionist explanation fares little better: it is not vulnerable to recent classicist objections, but it nonetheless fails, particularly if one requires, as some classicists do, that explanations of systematicity take the form of a‘functional analysis’. Nonetheless, there are, I argue, reasons for cautious optimism about (...) the prospects of a connectionist explanation. (shrink)

Plant and animal species are information-processing entities of such complexity, integration, and adaptive competence that it may be scientifically fruitful to consider them intelligent. The possibility arises from the analogy between learning and evolution, and from recent developments in evolutionary science, psychology and cognitive science. Species are now described as spatiotemporally localized individuals in an expanded hierarchy of biological entities. Intentional and cognitive abilities are now ascribed to animal, human, and artificial intelligence systems that process information adaptively, and that manifest (...) problem-solving abilities. The structural and functional similarities between such systems and species are extensive, although they “are usually obscured by population-genetic metaphors that have nonetheless contributed much to our understanding of evolution.In this target article, I use Sewall Wright's notion of the “adaptive landscape” to compare the performances of evolving species to those of intelligent organisms. With regard to their adaptive achievements and the kinds of processes by which they are achieved, biological species compare very favorably to intelligent animals by virtue of interactions between populations and their environments, between ontogeny and phylogeny, and between natural, interdemic, organic, and species selection. Addressing the question of whether species are intelligent could help to refine our ideas about species, evolution, and intelligence, and could open new lines of empirical and theoretical inquiry in many disciplines. (shrink)

A set of hypotheses is formulated for a connectionist approach to cognitive modeling. These hypotheses are shown to be incompatible with the hypotheses underlying traditional cognitive models. The connectionist models considered are massively parallel numerical computational systems that are a kind of continuous dynamical system. The numerical variables in the system correspond semantically to fine-grained features below the level of the concepts consciously used to describe the task domain. The level of analysis is intermediate between those of symbolic cognitive models (...) and neural models. The explanations of behavior provided are like those traditional in the physical sciences, unlike the explanations provided by symbolic models.Higher-level analyses of these connectionist models reveal subtle relations to symbolic models. Parallel connectionist memory and linguistic processes are hypothesized to give rise to processes that are describable at a higher level as sequential rule application. At the lower level, computation has the character of massively parallel satisfaction of soft numerical constraints; at the higher level, this can lead to competence characterizable by hard rules. Performance will typically deviate from this competence since behavior is achieved not by interpreting hard rules but by satisfying soft constraints. The result is a picture in which traditional and connectionist theoretical constructs collaborate intimately to provide an understanding of cognition. (shrink)

This article presents counter evidence against Smolensky's theory that human intuitive/nonconscious congnitive processes can only be accurately explained in terms of subsymbolic computations carried out in artificial neural networks. We presentsymboliclearning models of two well‐studied, complicated cognitive tasks involving nonconscious acquisition of information: learning production rules and artificial finite state grammars. Our results demonstrate that intuitive learning does not imply subsymbolic computation, and that the already well‐established, perceived correlation between “conscious” and “symbolic” on the one hand, and between “nonconscious” and (...) “subsymbolic” on the other, does not exist. (shrink)

A set of hypotheses is formulated for a connectionist approach to cognitive modeling. These hypotheses are shown to be incompatible with the hypotheses underlying traditional cognitive models. The connectionist models considered are massively parallel numerical computational systems that are a kind of continuous dynamical system. The numerical variables in the system correspond semantically to fine-grained features below the level of the concepts consciously used to describe the task domain. The level of analysis is intermediate between those of symbolic cognitive models (...) and neural models. The explanations of behavior provided are like those traditional in the physical sciences, unlike the explanations provided by symbolic models. Higher-level analyses of these connectionist models reveal subtle relations to symbolic models. Parallel connectionist memory and linguistic processes are hypothesized to give rise to processes that are describable at a higher level as sequential rule application. At the lower level, computation has the character of massively parallel satisfaction of soft numerical constraints; at the higher level, this can lead to competence characterizable by hard rules. Performance will typically deviate from this competence since behavior is achieved not by interpreting hard rules but by satisfying soft constraints. The result is a picture in which traditional and connectionist theoretical constructs collaborate intimately to provide an understanding of cognition. (shrink)

Andy Clark argues that the reality and causal efficacy of the folk psychological attitudes do not require in‐the‐head correlates of the that‐clauses by which they are attributed. The facts for which Fodor invokes a language of thought as empirical explanation—systemati‐city, for example—are, Clark argues, an a priori conceptual demand upon propositional attitude ascription, and hence not in need of empirical explanation. However, no such strategy can work. A priori demands imposed by our practices do not eliminate the need for empirical (...) explanation of how these demands are satisfied by particular beings. And given the vast number of potential beliefs, and the interrelationships they exhibit, no one has the slightest idea how they might be explained except by in‐the‐head syntax. (shrink)