Fodor and Pylyshyn's critique of connectionism has posed a challenge to connectionists: Adequately explain such nomological regularities as systematicity and productivity without postulating a "language of thought" (LOT). Some connectionists like Smolensky took the challenge very seriously, and attempted to meet it by developing models that were supposed to be non-classical. At the core of these attempts lies the claim that connectionist models can provide a representational system with a combinatorial syntax and processes sensitive to syntactic structure. They are not (...) implementation models because, it is claimed, the way they obtain syntax and structure sensitivity is not "concatenative," hence "radically different" from the way classicists handle them. In this paper, I offer an analysis of what it is to physically satisfy/realize a formal system. In this context, I examine the minimal truth-conditions of LOT Hypothesis. From my analysis it will follow that concatenative realization of formal systems is irrelevant to LOTH since the very notion of LOT is indifferent to such an implementation level issue as concatenation. I will conclude that to the extent to which they can explain the law-like cognitive regularities, a certain class of connectionist models proposed as radical alternatives to the classical LOT paradigm will in fact turn out to be LOT models, even though new and potentially very exciting ones. (shrink)

A comprehensive introduction to the Language of Though Hypothesis (LOTH) accessible to general audiences. LOTH is an empirical thesis about thought and thinking. For their explication, it postulates a physically realized system of representations that have a combinatorial syntax (and semantics) such that operations on representations are causally sensitive only to the syntactic properties of representations. According to LOTH, thought is, roughly, the tokening of a representation that has a syntactic (constituent) structure with an appropriate semantics. Thinking thus consists in (...) syntactic operations defined over representations. Most of the arguments for LOTH derive their strength from their ability to explain certain empirical phenomena like productivity, systematicity of thought and thinking. (shrink)

We argue that Quilty-Dunn et al.'s commitment to representational pluralism undermines their case for the language-of-thought hypothesis as the evidence they present is consistent with the operation of the other representational formats that they are willing to accept.

Language has long been a problem‐case for subsymbolic theories of mind. The reason for this is obvious: Language seems essentially symbolic. However, recent work has developed a potential solution to this problem, arguing that linguistic symbols are public objects which augment a fundamentally subsymbolic mind, rather than components of cognitive symbol‐processing. I shall argue that this strategy cannot work, on the grounds that human language acquisition consists in projecting linguistic structure onto environmental entities, rather than extracting this structure from them.

By pointing to deep philosophical confusions endemic to cognitive science, Wittgenstein might seem an enemy of computational approaches. We agree that while Wittgenstein would reject the classicist’s symbols and rules approach, his observations align well with connectionist or neural network approaches. While many connectionisms that dominated the later twentieth century could fall prey to criticisms of biological, pedagogical, and linguistic implausibility, current connectionist approaches can resolve those problems in a Wittgenstein-friendly manner. We present the basics of a Vector Symbolic Architecture (...) formalism, inspired by Smolensky, and indicate how high-dimensional vectors can operate in a context-sensitive and object-independent manner in biologically plausible time scales, reflecting Wittgenstein’s notions of language-games and family resemblance; we show how “soft” symbols for such a formalism can be formed with plausible learning cycles using Sparse Distributed Memory, resolving disputes surrounding Wittgenstein’s private language argument; and show how connectionist networks can extrapolate meaningful patterns to solve problems, providing “ways to go on” without explicit rules, which indicates linguistic plausibility. Connectionism thus provides a systematicity and productivity that is more than a mere implementation of a classical approach, and provides Wittgenstein-friendly and Wittgenstein-illuminating models of mind and language for cognitive science. (shrink)

ABSTRACTWhile over the last few decades AI research has largely focused on building tools and applications, recent technological developments have prompted a resurgence of interest in building a genuinely intelligent artificial agent – one that has a mind in the same sense that humans and animals do. In this paper, I offer a theoretical and methodological framework for this project of investigating “artificial minded intelligence” that can help to unify existing approaches and provide new avenues for research. I first outline (...) three desiderata that a framework for AMI research should satisfy. In Section 1, I further motivate the desiderata as well as the need for a new framework. Section 2 develops a general methodological approach, the “generative methodology,” and Section 3 develops a version of this methodology, the “Competence Framework for AI research”. (shrink)

The question, ‘Is cognition linguistic?' divides recent cognitive theories into two antagonistic groups. Sententialists claim that we think in some language, while advocates of non linguistic views of cognition deny this claim. The Introspective Argument for Sententialism is one of the most appealing arguments for sententialism. In substance, it claims that the introspective fact of inner speech provides strong evidence that our thoughts are linguistic. This article challenges this argument. I claim that the Introspective Argument for Sententialism confuses the content (...) of our thoughts with their vehicles: while sententialism is a thesis about the vehicles of our thoughts, inner speech sentences are the content of auditory or articulatory images. The rebuttal of the introspective argument for sententialism is shown to have a general significance in cognitive science: Introspection does not tell us how we think. (shrink)

This chapter describes the conceptual foundations of cognitive science during its establishment as a science in the 20th century. It is organized around the core ideas of individual agency as its basic explanans and information-processing as its basic explanandum. The latter consists of a package of ideas that provide a mathematico-engineering framework for the philosophical theory of materialism.

The systematicity argument only challenges connectionism if systematicity is a general property of cognition. I examine this thesis in terms of properties of concepts. First, I propose that Evans's Generality Constraint only applies to attributions of belief. Then I defend a variety of conceptual pluralism, arguing that concepts share two fundamental properties related to centrality and belief-attribution, and contending that there are two kinds of concepts that differ in their compositional properties. Finally, I rely on Dual Systems Theory and on (...) differences between animal and human cognition to suggest a scenario of two processing systems that work on different kinds of concepts, with only one of them supporting full systematicity. I sketch a non-classical systematicity argument that rules out classicism as the basis of one of those systems given that it would wrongly entail that both systems are fully systematic. (shrink)

The computational paradigm, which has dominated psychology and artificial intelligence since the cognitive revolution, has been a source of intense debate. Recently, several cognitive scientists have argued against this paradigm, not by objecting to computation, but rather by objecting to the notion of representation. Our analysis of these objections reveals that it is not the notion of representation per se that is causing the problem, but rather specific properties of representations as they are used in various psychological theories. Our analysis (...) suggests that all theorists accept the idea that cognitive processing involves internal information-carrying states that mediate cognitive processing. These mediating states are a superordinate category of representations. We discuss five properties that can be added to mediating states and examine their importance in various cognitive models. Finally, three methodological lessons are drawn from our analysis and discussion. (shrink)

This paper attempts to clarify and critically examine Fodor's language of thought (LOT) hypothesis, focusing on his contention that the systematicity of language use provides a solid ground for the LOT hypothesis. (edited).

This volume is a collection of some of the most important philosophical papers by Peter Gärdenfors. Spanning a period of more than 20 years of his research, they cover a wide ground of topics, from early works on decision theory, belief revision and nonmonotonic logic to more recent work on conceptual spaces, inductive reasoning, semantics and the evolutions of thinking. Many of the papers have only been published in places that are difficult to access. The common theme of all the (...) papers is the dynamics of thought. Several of the papers have become minor classics and the volume bears witness of the wide scope of Gärdenfors’ research and of his crisp and often witty style of writing. The volume will be of interest to researchers in philosophy and other cognitive sciences. (shrink)

The paper develops an account of minimal traces devoid of representational content and exploits an analogy to a predictive processing framework of perception. As perception can be regarded as a prediction of the present on the basis of sparse sensory inputs without any representational content, episodic memory can be conceived of as a “prediction of the past” on the basis of a minimal trace, i.e., an informationally sparse, merely causal link to a previous experience. The resulting notion of episodic memory (...) will be validated as a natural kind distinct from imagination. This trace minimalist view contrasts with two theory camps dominating the philosophical debate on memory. On one side, we face versions of the Causal Theory that hold on to the idea that episodic remembering requires a memory trace that causally links the event of remembering to the event of experience and carries over representational content from the content of experience to the content of remembering. The Causal Theory, however, fails to account for the epistemic generativity of episodic memory and is psychologically and information-theoretically implausible. On the other side, a new camp of simulationists is currently forming up. Motivated by empirical and conceptual deficits of the Causal Theory, they reject not only the necessity of preserving representational content, but also the necessity of a causal link between experience and memory. They argue that remembering is nothing but a peculiar form of imagination, peculiar only in that it has been reliably produced and is directed towards an episode of one’s personal past. Albeit sharing their criticism of the Causal Theory and, in particular, rejecting its demand for an intermediary carrier of representational content, the paper argues that a causal connection to experience is still necessary to fulfill even the minimal requirements of past-directedness and reliability. (shrink)

There is a vast literature within philosophy of mind that focuses on artificial intelligence, but hardly mentions methodological questions. There is also a growing body of work in philosophy of science about modeling methodology that hardly mentions examples from cognitive science. Here these discussions are connected. Insights developed in the philosophy of science literature about the importance of idealization provide a way of understanding the neural implausibility of connectionist networks. Insights from neurocognitive science illuminate how relevant similarities between models and (...) targets are picked out, how modeling inferences are justified, and the metaphysical status of models. (shrink)

According to the Causal Theory of Memory, remembering a particular past event requires a causal connection between that event and its subsequent representation in memory, specifically, a connection sustained by a memory trace. The CTM is the default view of memory in contemporary philosophy, but debates persist over what the involved memory traces must be like. Martin and Deutscher argued that the CTM required memory traces to be structural analogues of past events. Bernecker and Michaelian, contemporary CTM proponents, reject structural (...) analogues in favor of memory traces as distributed patterns of event features. The proposals are understood as distinct accounts of how memory traces represent past events. But there are two distinct questions one could ask about a trace’s representational features. One might ask how memory traces, qua mental representations, have their semantic properties. Or, what makes memory traces, qua mental representations of memories, distinct from other mental representations. Proponents of the CTM, both past and present, have failed to keep these two questions distinct. The result is a serious but unnoticed problem for the CTM in its current form. Distributed memory traces are incompatible with the CTM. Such traces do not provide a way to track the causal history of individual memories, as the CTM requires. If memory traces are distributed patterns of event features, as Bernecker and Michaelian each claim, then the CTM cannot be right. (shrink)

Over the past thirty years, it is been common to hear the mind likened to a digital computer. This essay is concerned with a particular philosophical view that holds that the mind literally is a digital computer (in a specific sense of “computer” to be developed), and that thought literally is a kind of computation. This view—which will be called the “Computational Theory of Mind” (CTM)—is thus to be distinguished from other and broader attempts to connect the mind with computation, (...) including (a) various enterprises at modeling features of the mind using computational modeling techniques, and (b) employing some feature or features of production-model computers (such as the stored program concept, or the distinction between hardware and software) merely as a guiding metaphor for understanding some feature of the mind. This entry is therefore concerned solely with the Computational Theory of Mind (CTM) proposed by Hilary Putnam [1961] and developed most notably for philosophers by Jerry Fodor [1975, 1980, 1987, 1993]. The senses of ‘computer’ and ‘computation’ employed here are technical; the main tasks of this entry will therefore be to elucidate: (a) the technical sense of ‘computation’ that is at issue, (b) the ways in which it is claimed to be applicable to the mind, (c) the philosophical problems this understanding of the mind is claimed to solve, and (d) the major criticisms that have accrued to this view. (shrink)

Recently, connectionist models have been developed that seem to exhibit structuresensitive cognitive capacities without executing a program. This paper examines one such model and argues that it does execute a program. The argument proceeds by showing that what is essential to running a program is preserving the functional structure of the program. It has generally been assumed that this can only be done by systems possessing a certain temporalcausal organization. However, counterfactualpreserving functional architecture can be instantiated in other ways, for (...) example geometrically, which are realizable by connectionist networks. (shrink)

This paper addresses the question of whether mental representations are compositional. Several researchers have claimed recently that there are empirical data that show mental representations to be context-sensitive in a way that threatens compositionality. Some have then gone on to claim that connectionist encoding schemes are well suited to accommodate such noncom-positionality. I argue here that the data do not show that mental representations are noncompositional, and that there are significant problems with the suggested interpretations of connectionist encoding schemes.

The representations of deep convolutional neural networks (CNNs) are formed from generalizing similarities and abstracting from differences in the manner of the empiricist theory of abstraction (Buckner, Synthese 195:5339–5372, 2018). The empiricist theory of abstraction is well understood to entail infinite regress and circularity in content constitution (Husserl, Logical Investigations. Routledge, 2001). This paper argues these entailments hold a fortiori for deep CNNs. Two theses result: deep CNNs require supplementation by Quine’s “apparatus of identity and quantification” in order to (1) (...) achieve concepts, and (2) represent objects, as opposed to “half-entities” corresponding to similarity amalgams (Quine, Quintessence, Cambridge, 2004, p. 107). Similarity amalgams are also called “approximate meaning[s]” (Marcus & Davis, Rebooting AI, Pantheon, 2019, p. 132). Although Husserl inferred the “complete abandonment of the empiricist theory of abstraction” (a fortiori deep CNNs) due to the infinite regress and circularity arguments examined in this paper, I argue that the statistical learning of deep CNNs may be incorporated into a Fodorian hybrid account that supports Quine’s “sortal predicates, negation, plurals, identity, pronouns, and quantifiers” which are representationally necessary to overcome the regress/circularity in content constitution and achieve objective (as opposed to similarity-subjective) representation (Burge, Origins of Objectivity. Oxford, 2010, p. 238). I base myself initially on Yoshimi’s (New Frontiers in Psychology, 2011) attempt to explain Husserlian phenomenology with neural networks but depart from him due to the arguments and consequently propose a two-system view which converges with Weiskopf’s proposal (“Observational Concepts.” The Conceptual Mind. MIT, 2015. 223–248). (shrink)

The standard approach to model how human beings understand natural languages is the symbolic, compositional approach according to which the meaning of a complex expression is a function of the meanings of its constituents. In other words, meaning plays a fundamental role in the model. In this work, because of the polysemous, flexible, dynamic, and contextual structure of natural languages, this approach is rejected. Instead, a connectionist model which eliminates the concept of meaning is proposed.

This paper is informed by Charles Sanders Peirce’s philosophy as semiotics or the doctrine of signs. The paper’s purpose is to explore Peirce’s category of abduction as not being limited to the inference to the best explanation. In the context of the logic of discovery, abduction is posited as a necessary although not sufficient condition for the production of meanings. The structure of a genuine sign is triadic and represents a synthesis between precognitive ideas and conceptual representations. The novel model (...) of reasoning is offered, based on the mathematical formalism borrowed from Gauss’ interpretation of the complex number. It is suggested that this model in a form of a diagram not only represents a semiotic process-structure but also overcomes the long-standing paradox of new knowledge. For Peirce, it is a diagram as a visual representation that may yield solutions to the otherwise unsolvable logical problems. What appears to us as a paradox is the very presence of abductive, or hypothetical, inference, as Peircean generic category of Firstness within the Thirdness of the total thought-process. Firstness , Secondness , and Thirdness together constitute a dynamic structure of experience. (shrink)

Philosophers have often argued that ascriptions of content are appropriate only to the personal level states of folk psychology. Against this, this paper defends the view that the familiar propositional attitudes and states defined over them are part of a larger set of cognitive proceses that do not make constitutive reference to concept possession. It does this by showing that states with nonconceptual content exist both in perceptual experience and in subpersonal information-processing systems. What makes these states content-involving is their (...) satisfaction of certain basic conditions deriving from a general account of representation-driven behaviour that is neutral on the question of concept possession. It is also argued that creatures can be in states with nonconceptual content even though they possess no conceptual abilities at all. (shrink)

The article provides an analysis of Paul and Patricia Churchland’s eliminative materialism. I will distinguish two lines of argument in their eliminativism: one seeking to eliminate folk psychology and the second criticising Jerry Fodor’s language of thought hypothesis. Then I will closely examine the second line of argument, and show that it represents the main motive of Churchland’s work since the end of 1980s and demonstrate why the success of the argument against the language of thought hypothesis does not constitute (...) a reason for the elimination of folk psychology. Finally, I will examine the consequences of this approach for the role of folk psychology in the study of mind and show that the weakened eliminativist position still fulfils the original aim of Churchland’s program. (shrink)

Between the later views of Wittgenstein and those of connectionism on the subject of the mastery of language there is an impressively large number of similarities. The task of establishing this claim is carried out in the second section of this paper.

Classicists and connectionists alike claim to be able to explain systematicity. The proposed classicist explanation, I argue, is little more than a promissory note, one that classicists have no idea how to redeem. Smolensky's (1995) proposed connectionist explanation fares little better: it is not vulnerable to recent classicist objections, but it nonetheless fails, particularly if one requires, as some classicists do, that explanations of systematicity take the form of a‘functional analysis’. Nonetheless, there are, I argue, reasons for cautious optimism about (...) the prospects of a connectionist explanation. (shrink)

The paper argues that cognitive states of biological systems are inherently temporal. Three adequacy conditions for neuronal models of representation are vindicated: the compositionality of meaning, the compositionality of content, and the co-variation with content. Classicist and connectionist approaches are discussed and rejected. Based on recent neurobiological data, oscillatory networks are introduced as a third alternative. A mathematical description in a Hilbert space framework is developed. The states of this structure can be regarded as conceptual representations satisfying the three conditions.

Between the later views of Wittgenstein and those of connectionism 1 on the subject of the mastery of language there is an impressively large number of similarities. The task of establishing this claim is carried out in the second section of this paper.

Naturalistically minded philosophers hope to identify a privileged nonsemantic relation that holds between a mental representation m and that which m represents, a relation whose privileged status underwrites the assignment of reference to m. The naturalist can accomplish this task only if she has in hand a nonsemantic criterion for individuating mental representations: it would be question-begging for the naturalist to characterize m, for the purpose of assigning content, as 'the representation with such and such content'. If we individuate mental (...) representations using the tools of dynamical systems theory, we find that a given mental representation, characterized nonsemantically, emerges in the cognitive system as the result of causal interactions between the subject and her environment. At least for the most basic of our mental representations, I argue that the dynamical systems-based approach to individuation increases the plausibility of a theory that assigns reference as a function of the subject's causal history. (shrink)

The paper critically reviews Jerry Fodor's book In Critical Condition: Polemic Essays on Cognitive Science and the Philosophy of Mind. It focuses on Fodor's compositionality arguments and their relevance to the following questions: How should concepts be individuated? What has semantics to do with epistemology? Who is right in the debate over classical and connectionist theories of cognition? How can the semantic properties of a mental state be inherited from the semantic properties of the state's constituents? The paper finally argues (...) that Fodor's opposition to functional role semantics might jeopardize his view that semantic compositionality requires appropriate constituent relations between complex and less complex concepts. (shrink)

Given (1) Wittgensteins externalist analysis of the distinction between following a rule and behaving in accordance with a rule, (2) prima facie connections between rule-following and psychological capacities, and (3) pragmatic issues about training, it follows that most, even all, future artificially intelligent computers and robots will not use language, possess concepts, or reason. This argument suggests that AIs traditional aim of building machines with minds, exemplified in current work on cognitive robotics, is in need of substantial revision.

In this reply we claim that, contra Dreyfus, the kinds of skillful performances Dreyfus discusses _are_ representational. We explain this proposal, and then defend it against an objection to the effect that the representational notion we invoke is a weak one countenancing only some global state of an organism as a representation. According to this objection, such a representation is not a robust, projectible property of an organism, and hence will gain no explana- tory leverage in cognitive scientific explanations. We (...) argue on conceptual and empirical grounds that the representations we have identified are not weak unprojectible global states of organisms, but instead genuinely explanatory representational parts of persons. (shrink)

I sketch an explanatory framework that fits a variety of contemporary research programs in cognitive science. I then investigate the scope and the implications of this framework. The framework emphasizes (a) the explanatory role played by the semantic content of cognitive representations, and (b) the important mechanistic, non-intentional dimension of cognitive explanations. I show how both of these features are present simultaneously in certain varieties of cognitive explanation. I also consider the explanatory role played by grounded representational content, that is, (...) content evaluated by appeal to its truth, falsity, accuracy, inaccuracy and other relational properties. (shrink)

The traditional understanding of analyticity in terms of concept containment is revisited, but with a concept explicitly understood as a certain kind of mental representation and containment being read correspondingly literally. The resulting conception of analyticity avoids much of the vagueness associated with attempts to explicate analyticity in terms of synonymy by moving the locus of discussion from the philosophy of language to the philosophy of mind. The account provided here illustrates some interesting features of representations and explains, at least (...) in part, the special epistemic status of analytic judgments. (shrink)

Martin Davies' criterion for the knowledge of implicit rules, viz. the causal systematicity of cognitive processes, is first exposed. Then the inference from causal systematicity of a process to syntactic properties of the input states is examined. It is argued that Davies' notion of a syntactic property is too weak to bear the conclusion that causal systematicity implies a language of thought as far as the input states are concerned. Next, it is shown that Davies' criterion leads to a counterintuitive (...) consequence: it groups together distributed connectionist systems with look-up tables. To avoid this consequence, a modified construal of causal systematicity is proposed and Davies' argument for the causal systematicity of thought is shown to be question-begging. It is briefly sketched how the modified construal links up with multiple dispositions of the same categorical base. Finally, the question of the causal efficacy of single rules is distinguished from the question of their psychological reality: implicit rules might be psychologically real without being causally efficacious. (shrink)

This paper responds to criticisms levelled by Fodor, Pylyshyn, and McLaughlin against connectionism. Specifically, I will rebut the charge that connectionists cannot account for representational systematicity without implementing a classical architecture. This will be accomplished by drawing on Paul Smolensky's Tensor Product model of representation and on his insights about split-level architectures.