This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing (PDP), a two-volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary (...) developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes. (shrink)

In this prcis we focus on phenomena central to the reaction against similarity-based theories that arose in the 1980s and that subsequently motivated the approach to semantic knowledge. Specifically, we consider (1) how concepts differentiate in early development, (2) why some groupings of items seem to form or coherent categories while others do not, (3) why different properties seem central or important to different concepts, (4) why children and adults sometimes attest to beliefs that seem to contradict their direct experience, (...) (5) how concepts reorganize between the ages of 4 and 10, and (6) the relationship between causal knowledge and semantic knowledge. The explanations our theory offers for these phenomena are illustrated with reference to a simple feed-forward connectionist model. The relationships between this simple model, the broader theory, and more general issues in cognitive science are discussed. (shrink)

The commentaries reflect three core themes that pertain not just to our theory, but to the enterprise of connectionist modeling more generally. The first concerns the relationship between a cognitive theory and an implemented computer model. Specifically, how does one determine, when a model departs from the theory it exemplifies, whether the departure is a useful simplification or a critical flaw? We argue that the answer to this question depends partially upon the model's intended function, and we suggest that connectionist (...) models have important functions beyond the commonly accepted goals of fitting data and making predictions. The second theme concerns perceived in-principle limitations of the connectionist approach to cognition, and the specific concerns these perceived limitations raise for our theory. We argue that the approach is not in fact limited in the ways our critics suggest. One common misconception, that connectionist models cannot address abstract or relational structure, is corrected through new simulations showing directly that such structure can be captured. The third theme concerns the relationship between parallel distributed processing (PDP) models and structured probabilistic approaches. In this case we argue that there the difference between the approaches is not merely one of levels. Our PDP approach differs from structured statistical approaches at all of Marr's levels, including the characterization of the goals of cognitive computations, and of the representations and algorithms used. (shrink)

Phillips & Silverstein argue that schizophrenia is a result of a deficit of the contextual coordination of neuronal responses. The authors propose that NMDA-receptors control these modulatory effects. However, hallucinations, which are among the principle symptoms of schizophrenia, imply a flaw in the interactions between neurons that is more fundamental than just a general weakness of contextual modulation.

I propose a semi-eliminative reduction of Fodors concept of module to the concept of attractor basin which is used in Cognitive Dynamic Systems Theory (DST). I show how attractor basins perform the same explanatory function as modules in several DST based research program. Attractor basins in some organic dynamic systems have even been able to perform cognitive functions which are equivalent to the If/Then/Else loop in the computer language LISP. I suggest directions for future research programs which could find similar (...) equivalencies between organic dynamic systems and other cognitive functions. This type of research could help us discover how (and/or if) it is possible to use Dynamic Systems Theory to more accurately model the cognitive functions that are now being modeled by subroutines in Symbolic AI computer models. If such a reduction of subroutines to basins of attraction is possible, it could free AI from the limitations that prompted Fodor to say that it was impossible to model certain higher level cognitive functions. (shrink)

We agree with Müller's epigenetic view of evolution and ontogeny and applaud his multilevel perspective. With him, we stress the importance in ontogeny of progressive specialisation rather than prewired structures. However, we argue that he slips from “speech” to “language” and that, in seeking homologies, these two levels need to be kept separate in the analysis of evolution and ontogeny.

This is a reminiscence and short biographical sketch of the late philosopher and cognitive scientist Jerry Fodor. It includes a summary of his main proposals about the mind: his “Language of Thought” hypothesis; his rejection of analyticity and conceptual role semantics; his “mad dog nativism”; his proposal of mental modules and—by contrast—his skepticism about a computational theory of central cognition; his anti‐reductionist, but still physicalist, views about psychology; and, lastly, his attacks on selectionism. I conclude with some discussion of his (...) idiosyncratic style and of his aesthetic and other interests. An appendix provides some memorable quotes. (shrink)

Spelke's book defends two hypotheses about human cognition. First, humans and other species are endowed with core knowledge systems—innate computational structures that use abstract concepts to represent various aspects of the environment. Second, humans, and only humans, acquire natural languages, whose syntax and compositional semantics allow them to construct new concepts by combining the outputs of core systems. We endorse the first hypothesis but doubt that language acquisition alone explains the productivity of human cognition. In particular, we argue against the (...) claim that infants use aspects of language to develop a new conception of other people. (shrink)

Fodor advocates a view of cognitive processes as computations defined over the language of thought (or Mentalese). Even among those who endorse Mentalese, considerable controversy surrounds its representational format. What semantically relevant structure should scientific psychology attribute to Mentalese symbols? Researchers commonly emphasize logical structure, akin to that displayed by predicate calculus sentences. To counteract this tendency, I discuss computational models of navigation drawn from probabilistic robotics. These models involve computations defined over cognitive maps, which have geometric rather than logical (...) structure. They thereby demonstrate the possibility of rational cognitive processes in an exclusively non-logical representational medium. Furthermore, they offer much promise for the empirical study of animal navigation. (shrink)

How can abductive reasoning be physical, feasible, and reliable? This is Fodor’s riddle of abduction, and its apparent intractability is the cause of Fodor’s recent pessimism regarding the prospects for cognitive science. I argue that this riddle can be solved if we augment the computational theory of mind to allow for non-computational mental processes, such as those posited by classical associationists and contemporary connectionists. The resulting hybrid theory appeals to computational mechanisms to explain the semantic coherence of inference and associative (...) mechanisms to explain the efficient retrieval of relevant information from memory. The interaction of these mechanisms explains how abduction can be physical, feasible, and reliable. (shrink)

The principal aim of this essay is to discuss some logical features of the so-called Classical model of cognitive architecture as it is advocated by J. Fodor and Z. Pylyshyn in their much discussed article 'Connectionism and Cognitive Architecture: A Critical Analysis'. It is pointed out that their structural assumptions have consequences of a logical kind which call into question the view that the Classical architecture (in their sense) can be employed to model human cognition. It seems that the consequences (...) have escaped Fodor and Pylyshyn's notice, or else they have failed to appreciate them, since some of their claims evidently conflict with them. It is also investigated whether the human mind can be characterized as being logical in some weaker sense of logic. Furthermore, it is argued that J. H. Fetzer's view that it is a semiotic system is more realistic than the Classical model, but the distinction he suggests between human cognition and other kinds may be problematic. (shrink)

Two different but closely related issues in current cognitive science will be considered in this essay. One is the controversial and extensively discussed question of how connectionist and symbolic representations of knowledge are related to each other. The other concerns the notion of connectionist learning and its relevance for the understanding of the distinction between propositional and nonpropositional knowledge. More specifically, I shall give an overview of a result in Rantala and Vadén (1994) establishing a limiting case correspondence between symbolic (...) and connectionist representations and, on the other hand, study the problem, preliminarily investigated in Rantala (1998), of how propositional knowledge may arise from nonpropositional knowledge. I shall also try to point out that on some more or less plausible assumptions, often made by cognitive scientists, these results may have some significance when we try to comprehend the nature of human knowledge representation. Some of these assumptions are rather hypothethical and debatable for the time being and they will become justified in the future only if there will be more progress in the empirical and theoretical research on the brain and on artificial networks. The assumptions concern, besides some questions of the behavior of neural networks, such things as the relevance of pattern recognition for modelling human cognition, in particular, knowledge acquisition, and the relation between emergence and reduction. (shrink)

In various contexts and for various reasons, writers often define cognitive processes and architectures as those involving representational states and structures. Similarly, cognitive theories are also often delineated as those that invoke representations. In this paper, I present several reasons for rejecting this way of demarcating the cognitive. Some of the reasons against defining cognition in representational terms are that doing so needlessly restricts our theorizing, it undermines the empirical status of the representational theory of mind, and it encourages wildly (...) deflationary and explanatorily vacuous conceptions of representation. After criticizing this outlook, I sketch alternative ways we might try to capture what is distinctive about cognition and cognitive theorizing. (shrink)

In this paper I assess the explanatory role of internal representations in connectionist models of cognition. Focusing on both the internal‘hidden’units and the connection weights between units, I argue that the standard reasons for viewing these components as representations are inadequate to bestow an explanatorily useful notion of representation. Hence, nothing would be lost from connectionist accounts of cognitive processes if we were to stop viewing the weights and hidden units as internal representations.

Considerable debate in philosophy of psychology has recently focussed upon two central themes. One concerns the ontological status of propositional attitudes like beliefs and desires, the other on the proper computational account of cognitive architecture. In the ontological debate, the two most prominent positions are eliminativism, which claims that commonsense psychology is false because there are no such things as beliefs and desires; and versions of intentional realism, which counters that beliefs and desires actually do exist in the mind/brain. In (...) the cognitive architecture debate, there are again two outstanding views: classical cognitivism, which holds that cognition is something closely akin to symbol manipulation; and parallel distributed processing, which roughly maintains that cognition is the distributed activation of several simple, non-symbolic processing units. Furthermore, in spite of their different topics, the two debates have been linked by a number of authors who suggest that where you stand in the cognitive architecture debate should help determine where you stand in the debate over prepositional attitudes. So, for example, writers like Jerry Fodor have used the plausibility of classical cognitivism to defend a realist interpretation of propositional attitudes, while writers like Steve Stich and myself have argued that certain forms of connectionism support eliminativism. (shrink)

This article addresses the ability of Parallel Distributed Processing (PDP) networks to generate stagewise cognitive development in accordance with Piaget's theory of cognitive epigenesis. We carried out a replication study of the simulation experiments by McClelland (1989) and McClelland and Jenkins (1991) in which a PDP network learns to solve balance scale problems. In objective tests motivated from catastrophe theory, a mathematical theory of transitions in epigenetical systems, no evidence for stage transitions in network performance was found. It is concluded (...) that PDP networks lack the ability to recover the positive outcomes of analogous catastrophe analyses of real cognitive developmental data. In an attempt to further characterize the learning behaviour of PDP networks, we carried out a second simulation study using the discrimination‐shift paradigm. The results thus obtained indicate that PDP learning is compatible with the learning of stimulus‐response relationships, not with the acquisition of mediating rules such as conceived in (neo‐)Piagetian theory. In closing, we speculate about the feasibility of simulating stagewise development with alternative network architectures. (shrink)

This article addresses the ability of Parallel Distributed Processing (PDP) networks to generate stagewise cognitive development in accordance with Piaget's theory of cognitive epigenesis. We carried out a replication study of the simulation experiments by McClelland (1989) and McClelland and Jenkins (1991) in which a PDP network learns to solve balance scale problems. In objective tests motivated from catastrophe theory, a mathematical theory of transitions in epigenetical systems, no evidence for stage transitions in network performance was found. It is concluded (...) that PDP networks lack the ability to recover the positive outcomes of analogous catastrophe analyses of real cognitive developmental data. In an attempt to further characterize the learning behaviour of PDP networks, we carried out a second simulation study using the discrimination‐shift paradigm. The results thus obtained indicate that PDP learning is compatible with the learning of stimulus‐response relationships, not with the acquisition of mediating rules such as conceived in (neo‐)Piagetian theory. In closing, we speculate about the feasibility of simulating stagewise development with alternative network architectures. (shrink)

Phillips & Silverstein emphasize the gain-control properties of NMDA synapses in cognitive coordination. We endorse their view and suggest that NMDA synapses play a crucial role in biased attentional competition and (visual) working memory. Our simulations show that NMDA synapses can control the storage rate of visual objects. We discuss specific predictions of our model about cognitive effects of NMDA-antagonists and schizophrenia.

Mental representations remain the central posits of psychology after many decades of scrutiny. However, there is no consensus about the representational format(s) of biological cognition. This paper provides a survey of evidence from computational cognitive psychology, perceptual psychology, developmental psychology, comparative psychology, and social psychology, and concludes that one type of format that routinely crops up is the language-of-thought (LoT). We outline six core properties of LoTs: (i) discrete constituents; (ii) role-filler independence; (iii) predicate–argument structure; (iv) logical operators; (v) inferential (...) promiscuity; and (vi) abstract content. These properties cluster together throughout cognitive science. Bayesian computational modeling, compositional features of object perception, complex infant and animal reasoning, and automatic, intuitive cognition in adults all implicate LoT-like structures. Instead of regarding LoT as a relic of the previous century, researchers in cognitive science and philosophy-of-mind must take seriously the explanatory breadth of LoT-based architectures. We grant that the mind may harbor many formats and architectures, including iconic and associative structures as well as deep-neural-network-like architectures. However, as computational/representational approaches to the mind continue to advance, classical compositional symbolic structures – that is, LoTs – only prove more flexible and well-supported over time. (shrink)

Perceptual systems respond to proximal stimuli by forming mental representations of distal stimuli. A central goal for the philosophy of perception is to characterize the representations delivered by perceptual systems. It may be that all perceptual representations are in some way proprietarily perceptual and differ from the representational format of thought (Dretske 1981; Carey 2009; Burge 2010; Block ms.). Or it may instead be that perception and cognition always trade in the same code (Prinz 2002; Pylyshyn 2003). This paper rejects (...) both approaches in favor of perceptual pluralism, the thesis that perception delivers a multiplicity of representational formats, some proprietary and some shared with cognition. The argument for perceptual pluralism marshals a wide array of empirical evidence in favor of iconic (i.e., image-like, analog) representations in perception as well as discursive (i.e., language-like, digital) perceptual object representations. (shrink)

Most theories of concepts take concepts to be structured bodies of information used in categorization and inference. This paper argues for a version of atomism, on which concepts are unstructured symbols. However, traditional Fodorian atomism is falsified by polysemy and fails to provide an account of how concepts figure in cognition. This paper argues that concepts are generative pointers, that is, unstructured symbols that point to memory locations where cognitively useful bodies of information are stored and can be deployed to (...) resolve polysemy. The notion of generative pointers allows for unresolved ambiguity in thought and provides a basis for conceptual engineering. (shrink)

Philosophical Issues, Volume 30, Issue 1, Page 273-292, October 2020.

It is generally accepted that there is something special about reasoning by using mental images. The question of how it is special, however, has never been satisfactorily spelled out, despite more than thirty years of research in the post-behaviorist tradition. This article considers some of the general motivation for the assumption that entertaining mental images involves inspecting a picture-like object. It sets out a distinction between phenomena attributable to the nature of mind to what is called the cognitive architecture, and (...) ones that are attributable to tacit knowledge used to simulate what would happen in a visual situation. With this distinction in mind, the paper then considers in detail the widely held assumption that in some important sense images are spatially displayed or are depictive, and that examining images uses the same mechanisms that are deployed in visual perception. I argue that the assumption of the spatial or depictive nature of images is only explanatory if taken literally, as a claim about how images are physically instantiated in the brain, and that the literal view fails for a number of empirical reasons – for example, because of the cognitive penetrability of the phenomena cited in its favor. Similarly, while it is arguably the case that imagery and vision involve some of the same mechanisms, this tells us very little about the nature of mental imagery and does not support claims about the pictorial nature of mental images. Finally, I consider whether recent neuroscience evidence clarifies the debate over the nature of mental images. I claim that when such questions as whether images are depictive or spatial are formulated more clearly, the evidence does not provide support for the picture-theory over a symbol-structure theory of mental imagery. Even if all the empirical claims were true, they do not warrant the conclusion that many people have drawn from them: that mental images are depictive or are displayed in some (possibly cortical) space. Such a conclusion is incompatible with what is known about how images function in thought. We are then left with the provisional counterintuitive conclusion that the available evidence does not support rejection of what I call the “null hypothesis”; namely, that reasoning with mental images involves the same form of representation and the same processes as that of reasoning in general, except that the content or subject matter of thoughts experienced as images includes information about how things would look. (shrink)

Müller's target article aims to summarize approaches to the question of how language elements (phonemes, morphemes, etc.) and rules are laid down in the brain. However, it suffers from being too vague about basic assumptions and empirical predictions of neurobiological models, and the empirical evidence available to test the models is not appropriately evaluated. (1) In a neuroscientific model of language, different cortical localizations of words can only be based on biological principles. These need to be made explicit. (2) Evidence (...) for and against word class differences could be evaluated more rigorously. (3) All (and only) humans are able to learn languages with complex syntactic structures; it is, therefore, not appropriate to deny innateness and universality of syntactic principles. The real question appears to be the following: Which neurobiological principles are the linguistic principles based on? (shrink)

The concept of “representation” is used broadly and uncontroversially throughout neuroscience, in contrast to its highly controversial status within the philosophy of mind and cognitive science. In this paper I first discuss the way that the term is used within neuroscience, in particular describing the strategies by which representations are characterized empirically. I then relate the concept of representation within neuroscience to one that has developed within the field of machine learning. I argue that the recent success of artificial neural (...) networks on certain tasks such as visual object recognition reflects the degree to which those systems exhibit inherent inductive biases that reflect the structure of the physical world. I further argue that any system that is going to behave intelligently in the world must contain representations that reflect the structure of the world; otherwise, the system must perform unconstrained function approximation which is destined to fail due to the curse of dimensionality, in which the number of possible states of the world grows exponentially with the number of dimensions in the space of possible inputs. An analysis of these concepts in light of philosophical debates regarding the ontological status of representations suggests that the representations identified within both biological and artificial neural networks qualify as legitimate representations in the philosophical sense. (shrink)

Severity of Test (SoT) is an alternative to Popper's logical falsification that solves a number of problems of the logical view. It was presented by Popper himself in 1963. SoT is a less sophisticated probabilistic model of hypothesis testing than Oaksford & Chater's (O&C's) information gain model, but it has a number of striking similarities. Moreover, it captures the intuition of everyday hypothesis testing.

Is thinking necessarily linguistic? Do we think with words, to use Bermudez’s (2003) phrase? Or does thinking occur in some other, yet to be determined, representational format? Or again do we think in various formats, switching from one to the other as tasks demand? In virtue perhaps of the ambiguous na- ture of first-person introspective data on the matter, philosophers have tradition- ally disagreed on this question, some thinking that thought had to be pictorial, other insisting that it could not (...) be but linguistic. When any problem divides a community of otherwise intelligent rational thinkers, one suspects some deep conceptual confusion is at play. Indeed, we believe that the conceptual cate- gories used to frame these and related questions are so hopelessly muddled that one could honestly answer “both simultaneously”, or “neither”, depending one what is meant by the alternatives. But let’s get our priorities straight. This paper first and foremost aims at defending what we believe to be a step in that direc- tion of the proper view of thinking, a view we call the spatial-motor view. In order to do so, however, we have found it essential to start by addressing the conceptual confusion just alluded to. Accordingly, the paper proceeds in two steps. First a conceptual step, in which we reconsider some of the traditional categories brought into play when thinking about thinking. Then an empirical step, in which we offer empirical evidence for one of the views conceptually isolated during the first part of the work. Future version of this collaborative work will include a speculative step in which we spin out an evolutionary and developmental scenario whose function it is justify the spatial-motor view by showing how it fits into current evolutionary and developmental theories. (shrink)

Neurobiological models of language need a level of analysis that can account for the typical range of language phenomena. Because linguistically motivated models have been successful in explaining numerous language properties, it is premature to dismiss them as biologically irrelevant. Models attempting to unify neurobiology and linguistics need to be sensitive to both sources of evidence.