Distributed Cognition and Integrational Linguistics have much in common. Both approaches see communicative activity and intelligent behaviour in general as strongly con- text-dependent and action-oriented, and brains as permeated by history. But there is some ten- sion between the two frameworks on three important issues. The majority of theorists of distributed cognition want to maintain some notions of mental representation and computa- tion, and to seek generalizations and patterns in the various ways in which creatures like us couple with technologies, (...) media, and other agents; many also want to offer explanations at subpersonal levels which may undercut the autonomy of personal-level accounts. In contrast, dominant views in integrational linguistics reject all invocation of representation, resist the explanatory search for similarity across contexts and moments, and see linguistics as a lay dis- cipline which should not offer explanations in terms alien to ordinary agents. On each of these issues, I argue that integrationists could move closer to the distributed cognition frame- work without losing the most important aspects of their view: integrationist criticisms of mainstream or classical theories can be respected while alliances with revised cognitivist views about representation, context, and explanation are developed. Ó 2004 Elsevier Ltd. All rights reserved. (shrink)

A case study in historical cognitive science, this paper addresses two claims made by radical proponents of new dynamical approaches. It queries their historical narrative, which sees embodied, situated cognition as correcting an individualist, atemporal framework originating in Descartes. In fact, new Descartes scholarship shows that 17th-century animal spirits neurophysiology realized a recognizably distributed model of memory; explicit representations are patterns of spirit flow, and memory traces are changes left by experience in connections between brain pores. This historical sketch supports (...) the second dynamicist claim, that connectionists' stress on the cognitive importance of pattern-recreation needs supplementing by dynamicists' real-time focus and attention to the active roles of body and environment. Animal spirits theory exhibits just the 'continuous reciprocal causation' between brain, body, and environment which Andy Clark sees as dynamicism's central contribution, and allows for the embedding of brains in culture as well as the physical world. (shrink)

In "Representations without Rules, Connectionism and the Syntactic Argument'', Kenneth Aizawa argues against the view that connectionist nets can be understood as processing representations without the use of representation-level rules, and he provides a positive characterization of how to interpret connectionist nets as following representation-level rules. He takes Terry Horgan and John Tienson to be the targets of his critique. The present paper marshals functional and methodological considerations, gleaned from the practice of cognitive modelling, to argue against Aizawa's characterization of (...) how connectionist nets may be understood as making use of representation-level rules. (shrink)

In “Connectionism and the fats of folk psychology”, Forster and Saidel argue that the central claim of Ramsey, Stich and Garon (1991)—that distributed connectionist models are incompatible with the causal discreteness of folk psychology—is mistaken. To establish their claim, they offer an intriguing model which allegedly shows how distributed representations can function in a causally discrete manner. They also challenge our position regarding projectibility of folk psychology. In this essay, I offer a response to their account and show how their (...) model fails to demonstrate that our original argument was mistaken. While I will discuss several difficulties with their model, my primary criticism will be that the features of their model that are causally discrete are not truly distributed, while the features that are distributed are not really discrete. Concerning the issue of projectibility, I am more inclined to agree with Forster and Saidel and I offer a revised account of what we should have said originally. (shrink)

The rapid development of connectionist models in computer science and of powerful computational tools in neuroscience has encouraged eliminativist materialist philosophers to propose specific alternatives to traditional mentalistic theories of mind. One of the problems associated with such a move is that elimination of the mental would seem to remove access to ideas like truth as the foundations of normative epistemology. Thus, a successful elimination of propositional or sentential theories of mind must not only replace them for purposes of our (...) psychology, it must also replace them for purposes of the evaluation of our theories and explanations, psychological and otherwise. This paper briefly reviews eliminativist arguments for doubting the correctness of sentential accounts of explanation, understanding, and normative evaluation. It then considers Paul Churchland's (1989) proposed alternative norms, which are framed neurocomputationally. The alternative is found wanting in several specific ways. The arguments for eliminating propositionally-based norms are then re-examined and it is suggested that the need for wholesale elimination is overstated. A clear gap in the traditional epistemological story is identified, however, and a more modest set of norms is proposed as a way of filling this gap, rather than as a way of entirely replacing the traditional framework. (shrink)

Many philosophers claim that the neurocomputational framework of predictive processing entails a globally inferentialist and representationalist view of cognition. Here, I contend that this is not correct. I argue that, given the theoretical commitments these philosophers endorse, no structure within predictive processing systems can be rightfully identified as a representational vehicle. To do so, I first examine some of the theoretical commitments these philosophers share, and show that these commitments provide a set of necessary conditions the satisfaction of which allows (...) us to identify representational vehicles. Having done so, I introduce a predictive processing system capable of active inference, in the form of a simple robotic “brain”. I examine it thoroughly, and show that, given the necessary conditions highlighted above, none of its components qualifies as a representational vehicle. I then consider and allay some worries my claim could raise. I consider whether the anti-representationalist verdict thus obtained could be generalized, and provide some reasons favoring a positive answer. I further consider whether my arguments here could be blocked by allowing the same representational vehicle to possess multiple contents, and whether my arguments entail some extreme form of revisionism, answering in the negative in both cases. A quick conclusion follows. (shrink)

Models of memory in cognitive science and philosophy have traditionally explained human remembering in terms of storage and retrieval. This tendency has been entrenched by reliance on computationalist explanations over the course of the twentieth century; even research programs that eschew computationalism in name, or attempt the revision of traditional models, demonstrate tacit commitment to computationalist assumptions. It is assumed that memory must be stored by means of an isomorphic trace, that memory processes must divide into conceptually distinct systems and (...) phases, and that human remembering consists in inner, cognitive processes that are implemented by distinct neural processes. This dissertation draws on recent empirical work, and on philosophical arguments from Ludwig Wittgenstein and others, to demonstrate that this latent computationalism in the study of memory is problematic, and that it can and should be eliminated. Cognitive psychologists studying memory have encountered numerous data in recent decades that belie archival models. In cognitive neuroscience, establishing the neural basis of storage and retrieval processes has proven elusive. A number of revised models on offer in memory science, that have taken these issues into account, fail to sufficiently extricate the archival framework. Several impasses in memory science are products of these underlying computationalist assumptions. Wittgenstein and other philosophers offer a number of arguments against the need for, and the efficacy of, the storage and retrieval of traces in human remembering. A study of these arguments clarifies the ways that these computationalist assumptions are presently impeding the science of memory, and provides ways forward in removing them. We can and should characterize and model human memory without invoking the storage and retrieval of traces. A range of work in connectionism, dynamical systems theory, and recent philosophical accounts of memory demonstrate how the science of memory can proceed without these assumptions, toward non-archival models of remembering. (shrink)

Does connectionism spell doom for folk psychology? I examine the proposal that cognitive representational states such as beliefs can play no role if connectionist models - - interpreted as radical new cognitive theories -- take hold and replace other cognitive theories. Though I accept that connectionist theories are radical theories that shed light on cognition, I reject the conclusion that neural networks do not represent. Indeed, I argue that neural networks may actually give us a better working notion of cognitive (...) representational states such as beliefs, and in so doing give us a better understanding of how these states might be instantiated in neural wetware. (shrink)

Connectionism and phenomenology can mutually inform and mutually constrain each other. In this manifesto I outline an approach to consciousness based on distinctions developed by connectionists. Two core identities are central to a connectionist theory of consciouness: conscious states of mind are identical to occurrent activation patterns of processing units; and the variable dispositional strengths on connections between units store latent and unconscious information. Within this broad framework, a connectionist model of consciousness succeeds according to the degree of correspondence between (...) the content of human consciousness (the world as it is experienced) and the interpreted content of the network. Constitutive self-awareness and reflective self-awareness can be captured in a model through its ability to respond to self-reflexive information, identify self-referential categories, and process information in the absence of simultaneous input. The qualitative feel of sensation appears in a model as states of activation that are not fully discriminated by later processing. Connectionism also uniquely explains several specific features of experience. The most important of these is the superposition of information in consciousness — our ability to perceive more than meets the eye, and to apprehend complex categorical and temporal information in a single highly-cognized glance. This superposition in experience matches a superposition of representational content in distributed representations. (shrink)

It has recently been argued that the success of the connectionist program in cognitive science would threaten folk psychology. I articulate and defend a "minimalist" construal of folk psychology that comports well with empirical evidence on the folk understanding of belief and is compatible with even the most radical developments in cognitive science.

When the various disciplines participating in cognitive science are listed, philosophy almost always gets a guernsey. Yet, a couple of years ago at the conference of the Cognitive Science Society in Boulder (USA), there was no philosophy or philosopher with any prominence on the program. When queried on this point, the organizer (one of the "superstars" of the field) claimed it was partly an accident, but partly also due to an impression among members of the committee that philosophy is basically (...) a waste of time. Philosophy, they thought, is mostly obscure bullshit that does little to help, and much to hinder, real progress in cognitive science. (shrink)

The past decade has witnessed the emergence of a novel stance on semantic representation, and its relationship to context sensitivity. Connectionist-minded philosophers, including Clark and van Gelder, have espoused the merits of viewing hidden-layer, context-sensitive representations as possessing semantic content, where this content is partially revealed via the representations'' position in vector space. In recent work, Bodén and Niklasson have incorporated a variant of this view of semantics within their conception of semantic systematicity. Moreover, Bodén and Niklasson contend that they (...) have produced experimental results which not only satisfy a kind of context-based, semantic systematicity, but which, to the degree that reality permits, effectively deals with challenges posed by Fodor and Pylyshyn (1988), and Hadley (1994a). The latter challenge involved well-defined criteria for strong semantic systematicity. This paper examines the relevant claims and experiments of Bodén and Niklasson. It is argued that their case fatally involves two fallacies of equivocation; one concerning ''semantic content'' and the other concerning ''novel test sentences''. In addition, it is argued that their ultimate construal of context sensitive semantics contains serious confusions. These confusions are also found in certain publications dealing with "latent semantic analysis". Thus, criticisms presented here have relevance beyond the work of Bodén and Niklasson. (shrink)

Starting from Marr's ideas about levels of explanation, a theory of the data structures and access processes in human memory is demonstrated on 10 tasks. Functional characteristics of human memory are captured implementation-independently. Our theory generates a multidimensional task classification subsuming existing classifications such as the distinction between tasks that are implicit versus explicit, data driven versus conceptually driven, and simple associative (two-way bindings) versus higher order (threeway bindings), providing a broad basis for new experiments. The formal language clarifies the (...) binding problem in episodic memory, the role of input pathways in both episodic and semantic (lexical) memory, the importance of the input set in episodic memory, and the ubiquitous calculation of an intersection in theories of episodic and lexical access. (shrink)

Various systems that learn are examined to show how content is carried in connections installed by a learning history. Agents do not explicitly use the content of such states in practical reasoning, yet the content plays an important role in explaining behavior, and the physical state carrying that content plays a role in causing behavior, given other occurrent beliefs and desires. This leads to an understanding of the environmental reasons which are the determinate content of these states, and leads to (...) a better grasp of how representational content can be carried by systems without an explicit representation. (shrink)

This work represents an attempt to stake out the landscape for dynamicism based on a radical dismissal of the information-processing paradigm that dominates the philosophy of cognitive science. In Section 2, after setting up the basic toolkit of a theory of minimal representationalism, I introduce the central tenets of dynamic systems theory (DST) by discussing recent research in the dynamics of embodiment (Thelen et al. [2001]) in the perseverative-reaching literature. A recent proposal on the dynamics of representation--the dynamic field approach (...) (Spencer and Schöner [2003])-- according to which the alleged representational gap between DST and representational theories of cognition needs to be bridged in order to explain higher-order cognitive activity will then be reviewed. In Section 3 I shall argue that Spencer and Schöner's attempt to bridge the representational gap may jeopardize the whole (antirepresentationalist) spirit of the DST project. In order to show why, I shall introduce the key concepts of "reliability of environment" and "primagenesis", and argue that DST can account for de-coupled, offline cognitive activity with no need of positing representational resources. Conclusions and directions for future research will follow. (shrink)

I propose a semi-eliminative reduction of Fodors concept of module to the concept of attractor basin which is used in Cognitive Dynamic Systems Theory (DST). I show how attractor basins perform the same explanatory function as modules in several DST based research program. Attractor basins in some organic dynamic systems have even been able to perform cognitive functions which are equivalent to the If/Then/Else loop in the computer language LISP. I suggest directions for future research programs which could find similar (...) equivalencies between organic dynamic systems and other cognitive functions. This type of research could help us discover how (and/or if) it is possible to use Dynamic Systems Theory to more accurately model the cognitive functions that are now being modeled by subroutines in Symbolic AI computer models. If such a reduction of subroutines to basins of attraction is possible, it could free AI from the limitations that prompted Fodor to say that it was impossible to model certain higher level cognitive functions. (shrink)

How might artificial neural networks (ANNs) inform cognitive science? Often cognitive scientists use ANNs but do not examine their internal structures. In this paper, we use ANNs to explore how cognition might represent musical properties. We train ANNs to classify musical chords, and we interpret network structure to determine what representations ANNs discover and use. We find connection weights between input units and hidden units can be described using Fourier phase spaces, a representation studied in musical set theory. We find (...) the total signal coming through these weighted connection weights is a measure of the similarity between two Fourier structures: the structure of the hidden unit's weights and the structure of the stimulus. This is surprising because neither of these Fourier structures is computed by the hidden unit. We then show how output units use such similarity measures to classify chords. However, we also find different types of units—units that use different activation functions—use this similarity measure very differently. This result, combined with other findings, indicates that while our networks are related to the Fourier analysis of musical sets, they do not perform Fourier analyses of the kind usually described in musical set theory. Our results show Fourier representations of music are not limited to musical set theory. Our results also suggest how cognitive psychologists might explore Fourier representations in musical cognition. Critically, such theoretical and empirical implications require researchers to understand how network structure converts stimuli into responses. (shrink)

Accounting for phenomenal structure—the forms, aspects, and features of conscious experience—poses a deep challenge for the scientific study of consciousness, but rather than abandon hope I propose a way forward. Connectionism, I argue, offers a bi-directional analogy, with its oft-noted “neural inspiration” on the one hand, and its largely unnoticed capacity to illuminate our phenomenology on the other. Specifically, distributed representations in a recurrent network enable networks to superpose categorical, contextual, and temporal information on a specific input representation, much as (...) our own experience does. Artificial neural networks also suggest analogues of four salient distinctions between sensory and nonsensoty consciousness. The paper concludes with speculative proposals for discharging the connectionist heuristics to leave a robust, detailed empirical theory of consciousness. (shrink)

Marinov''s critique I argue, is vitiated by its failure to recognize the distinctive role of superposition within the distributed connectionist paradigm. The use of so-called subsymbolic distributed encodings alone is not, I agree, enough to justify treating distributed connectionism as a distinctive approach. It has always been clear that microfeatural decomposition is both possible and actual within the confines of recognizably classical approaches. When such approaches also involve statistically-driven learning algorithms — as in the case of ID3 — the fundamental (...) differences become even harder to spot. To see them, it is necessary to consider not just the nature of an acquired input-output function but the nature of the representational scheme underlying it. Differences between such schemes make themselves best felt outside the domain of immediate problem solving. It is in the more extended contexts of performance DURING learning and cognitive change as a result of SUBSEQUENT training on new tasks (or simultaneous training on several tasks) that the effects of superpositional storage techniques come to the fore. I conclude that subsymbols, distribution and statistically driven learning alone are indeed not of the essence. But connectionism is not just about subsymbols and distribution. It is about the generation of whole subsymbol SYSTEMS in which multiple distributed representations are created and superposed. (shrink)

The Epiphenomenal Mind is both a deflationary attack on the powers of the human mind and a defence of human subjectivity. It is deflationary because in the thesis I argue that consciousness is an epiphenomenal consequence of events in the brain. It is a defence of human subjectivity because I argue that the mind is sui generis real, irreducible, and largely an endogenous product (i.e. not dependent on society or its resources). Part I is devoted to arguing that the conscious (...) mind is epiphenomenal. Arguing from, the irreducibility of mental states, the causal closure of the physical domain, and the principle of causal explanatory exclusion, I seek to demonstrate that all theories of mental causation necessarily violate one or more of these premises. Contemporary approaches to mental causation come under two broad categories, those that argue that mental events are supervenient on physical events (such as Davidson, Kim and Horgan) and those (like Haskar) who argue that the mind is an emergent property of the brain. Supervenience based theories, I argue, end up reducing mental states in their search for a theory of mental causation and emergence based theories end up violating the principle of the causal closure of the physical. In part II, I explore some of the consequences of epiphenomenalism for social theory. This exploration comes in the context of a defence of human subjectivity against (i.) those sociological imperialists who view the mind and self as a 'gift of society', and (ii.) social situationalists who have abandoned the concept of action and an interest in 'what's in the head' of the actor, in favour of a concept of social action which views behaviour as action only to the extent that it is socially meaningful. The conclusion is that the social sciences should return to an interpretative style (Weberian) methodology. (shrink)