Some contemporary philosophers suggest that we know just by introspection that folk psychological states exist. However, such an "armchair refutation" of eliminativism seems too easy. I first attack two strategems, inspired by Descartes, on how such a refutation might proceed. However, I concede that the Cartesian intuition that we have direct knowledge of representational states is very powerful. The rest of this paper then offers an error theory of how that intuition might really be mistaken. The idea is that introspection (...) does not detect any folk psychological states, but rather detects neural states that dispose us to certain sorts of linguistic behavior. Briefly, rather than detecting a mental appearance of the state-of-affairs that I am sitting near the fire, introspection detects a state disposing me to assert "It appears to me that I am sitting by the fire." The nature of this linguistic-dispositional state is then given a connectionist underpinning, where inputs from introspection lead to such assertive behavior. The Cartesian certainty we feel in self-ascribing such appearances is also explained. Even though I do not endorse such an error theory outright, I suggest that its tenability is enough to undercut introspection arguments against eliminativism. (shrink)

This paper offers both a theoretical and an experimental perspective on the relationship between connectionist and Classical (symbol-processing) models. Firstly, a serious flaw in Fodor and Pylyshyn’s argument against connectionism is pointed out: if, in fact, a part of their argument is valid, then it establishes a conclusion quite different from that which they intend, a conclusion which is demonstrably false. The source of this flaw is traced to an underestimation of the differences between localist and distributed representation. It (...) has been claimed that distributed representations cannot support systematic operations, or that if they can, then they will be mere implementations of traditional ideas. This paper presents experimental evidence against this conclusion: distributed representations can be used to support direct structure-sensitive operations, in a man- ner quite unlike the Classical approach. Finally, it is argued that even if Fodor and Pylyshyn’s argument that connectionist models of compositionality must be mere implementations were correct, then this would still not be a serious argument against connectionism as a theory of mind. (shrink)

Connectionism seems to avoid many of the problems of classical artificial intelligence, but has it avoided all of them? In this thesis I examine the problem that Intentionality, the directedness of thought to an object, raises for connectionism. As a preliminary approach, I consider the role of Intentionality in classical artificial intelligence from the programmer’s point of view. In this investigation, one problem I identify with classical artificial intelligence is that the Intentionality of the programmer seems to be (...) projected onto the system, rather than the programmer creating a system whereby Intentionality arises intrinsically within the system. -/- In considering the current practice of connectionism, the same problem with Intentionality reappears. The assignment of Intentional content to input or output nodes in a neural network likewise projects the Intentionality of the programmer onto the system, and that projection is often reinforced by the training process of the neural network. However, connectionism seems to have an advantage over classical artificial intelligence in this respect, in that there is a form of neural network in which the network itself organizes the output nodes. The challenge is to utilize these self-organizing networks without having the programmer project Intentionality onto the system in an act of interpretation. -/- I suggest that the way to overcome these problems in connectionism is to embody the neural network within a world, whether physical or virtual, and to allow the system to develop concepts purely empirically. In this manner, connectionism can make scientific observations concerning the nature of cognition without the risk of contamination from the programmer’s own Intentionality. (shrink)

Is PDP Connectionism compatible with Cognitive Linguistics? It is unfortunate that this question has not received the attention it deserves, since at stake is the very possibility of a unified "West Coast Cognitive Science" approach to language. Part I of this paper argues that a systematic approach to the question of compatibility must involve an enumeration and analysis of the general principles used by each research program in their linguistic explanations. This approach is carried out in Parts II and (...) III, and the conclusion is that the explanatory principles of PDP Connectionism are fundamentally data-driven, whereas those of Cognitive Linguistics rely essentially on structure that the mind contributes to language use. Part IV presents several computational models of metaphor and analogy as case studies of the practical difficulties involved in reconciling these two frameworks. Finally, Part V examines the philosophical foundations of their respective explanatory strategies in order to get a clearer view of the theoretical obstacles to a unified account. (shrink)

Terry Horgan and John Tienson have suggested that connectionism might provide a framework within which to articulate a theory of cognition according to which there are mental representations without rules (RWR) (Horgan and Tienson 1988, 1989, 1991, 1992). In essence, RWR states that cognition involves representations in a language of thought, but that these representations are not manipulated by the sort of rules that have traditionally been posited. In the development of RWR, Horgan and Tienson attempt to forestall a (...) particular line of criticism, theSyntactic Argument, which would show RWR to be inconsistent with connectionism. In essence, the argument claims that the node-level rules of connectionist networks, along with the semantic interpretations assigned to patterns of activation, serve to determine a set of representation-level rules incompatible with the RWR conception of cognition. The present paper argues that the Syntactic Argument can be made to show that RWR is inconsistent with connectionism. (shrink)

Critics of the computational connectionism of the last decade suggest that it shares undesirable features with earlier empiricist or associationist approaches, and with behaviourist theories of learning. To assess the accuracy of this charge the works of earlier writers are examined for the presence of such features, and brief accounts of those found are given for Herbert Spencer, William James and the learning theorists Thorndike, Pavlov and Hull. The idea that cognition depends on associative connections among large networks of (...) neurons is indeed one with precedents, although the implications of this for psychological issues have been interpreted variously — not all versions of connectionism are alike. (shrink)

Philosophy and Memory Traces defends two theories of autobiographical memory. One is a bewildering historical view of memories as dynamic patterns in fleeting animal spirits, nervous fluids which rummaged through the pores of brain and body. The other is new connectionism, in which memories are 'stored' only superpositionally, and reconstructed rather than reproduced. Both models, argues John Sutton, depart from static archival metaphors by employing distributed representation, which brings interference and confusion between memory traces. Both raise urgent issues about (...) control of the personal past, and about relations between self and body. Sutton demonstrates the role of bizarre body fluids in moral physiology, as philosophers from Descartes and Locke to Coleridge struggled to control their own innards and impose cognitive discipline on 'the phantasmal chaos of association'. Going on to defend connectionism against Fodor and critics of passive mental representations, he shows how problems of the self are implicated in cognitive science. (shrink)

[Edited from Conclusion section:] We have looked at various challenging issues to do with getting connectionism to cope with high-level cognitive activities such a reasoning and natural language understanding. The issues are to do with various facets of generalization that are not commonly noted. We have been concerned in particular with the special forms these issues take in the arena of propositional attitude processing. The main problems we have looked at are: (1) The need to construct explicit representations of (...) generalizations, not just generalize correctly to individual cases; (2) The need to be able to match two or more complex short-term information structures, to enable rapid generalization from recent examples rather than from long-term memories; (3) The need to represent and reason with anomalous combinations of concepts; (4) The need to perform embedded reasoning. This presents special problems for systems using non-concatenative representations (as in mainstream connectionist approaches). We also touched on vague quantification in attitude report complements. Neither this topic nor that of analogies between short-term structures (point 2) has been adequately addressed in the symbolic framework, let alone in connectionism. -/- The opportunities and problems covered are put forward as things worth being optimistic about or pessimistic about, respectively. They are not put forward as decisive arguments for or against connectionism. The hope is that this chapter contributes to a greater understanding of the connectionist/symbolist gap by presenting some unusual issues and by throwing new light on some well known ones. (shrink)

This paper is devoted to some generalizations of explanatory potential of connectionist approaches to theoretical problems of the philosophy of mind. Are considered both strong, and weaknesses of neural network models. Connectionism has close methodological ties with modern neurosciences and neurophilosophy. And this fact strengthens its positions, in terms of empirical naturalistic approaches. However, at the same time this direction inherits weaknesses of computational approach, and in this case all system of anticomputational critical arguments becomes applicable to the connectionst (...) models of mind. The last developments in the field of deep learning gave rich empirical material for cognitive sciences. Multilayered networks, mathematical models of associative dynamics of learning, self-organizing neuronets and all that allow to explain the principles of human conceptual organizing and after this to emulate these processes in computer systems. At all engineering achievements of this technology there is a traditional criticism from representatives of cognitive psychology who cannot accept a thesis about learning ability of a neuronet on the basis of redistribution of scales. Process of learning of natural intelligence, according to cognitive models, happens due to attraction of knowledge broadcast in a symbolical form (mental representations, concepts) at the expense of the systems of output knowledge expressed in the propositional contents. Some philosophical aspects of «neural metaphor» in modern cognitive sciences create the problem field which demands comprehensive understanding, the first step towards which is taken in this work. (shrink)

Recent work in the methodology of connectionist explanation has I'ocrrsccl on the notion of levels of explanation. Specific issucs in conncctionisrn hcrc intersect with rvider areas of debate in the philosophy of psychology and thc philosophy of science generally. The issues I raise in this chapter, then, are not unique to cognitive science; but they arise in new and important contexts when connectionism is taken seriously as a model of cognition. The general questions are the relation between levels and (...) the status of levels which have no obvious relation to others. In speaking of levels, what is the connection, if there is one, between explanation and ontology? Which, if any, conccpt of reduction is applicable to connectionist systems? What kind of legitinrtcy can the constructs of common sense psychology, or of that vclsion ol intentional realism represented by classical symbol-systems n I, hirvc irr ir full-scale connectionist theory of mind? (shrink)

Three decades ago, William Ramsey, Steven Stich & Joseph Garon put forward an argument in favor of the following conditional: if connectionist models that implement parallelly distributed processing represent faithfully human cognitive processing, eliminativism about propositional attitudes is true. The corollary of their argument (if it proves to be sound) is that there is no place for folk psychology in contemporary cognitive science. This understanding of connectionism as a hypothesis about cognitive architecture compatible with eliminativism is also endorsed by (...) Paul Churchland, a radical opponent of folk psychology and a prominent supporter of eliminative materialism. I aim to examine whether current connectionist models based on long-short term memory (LSTM) neural networks can back up these arguments in favor of eliminativism. Nonetheless, I will rather put my faith in the eliminativism of the limited domain. This position amounts to the claim that even though connectionist cognitive science has no need whatsoever for folk psychology qua theory, this does not entail the illegitimacy of folk psychology per se in other scientific domains, most notably in humanities, but only on condition that one regards folk psychology as mere heuristics. (shrink)

Cognitive scientists used to deem reasoning either as a higher cognitive process based on the manipulation of abstract rules or as a higher cognitive process that is stochastic rather than involving abstract rules. I maintain that these different perspectives are closely intertwined with a theoretical and methodological endorsement of either cognitivism or connectionism. Cognitivism and connectionism represent two prevailing and opposed paradigms in cognitive science. I aim to extoll the virtues of connectionist models of enthymematic reasoning by following (...) means: via the phenomenon of creative enthymeme, viz. the inference where one cannot even articulate the missing premise, I introduce a connectionist mechanism of pattern recognition as underlying expertise; via Gestalt switch or Gestalt click, I demonstrate how differences in pattern recognition of an expert and a novice can be construed as qualitatively different, and not merely a matter of faster reasoning. (shrink)

The paper is a commentary on the target article by Christine A. Skarda & Walter J. Freeman, “How brains make chaos in order to make sense of the world”, in the same issue of the journal, pp.161–195. -/- I confine my comments largely to some philosophical claims that Skarda & Freeman make and to the relationship of their model to connectionism. Some of the comments hinge on what symbols are and how they might sit in neural systems.

Fodor and Pylyshyn's critique of connectionism has posed a challenge to connectionists: Adequately explain such nomological regularities as systematicity and productivity without postulating a "language of thought" (LOT). Some connectionists like Smolensky took the challenge very seriously, and attempted to meet it by developing models that were supposed to be non-classical. At the core of these attempts lies the claim that connectionist models can provide a representational system with a combinatorial syntax and processes sensitive to syntactic structure. They are (...) not implementation models because, it is claimed, the way they obtain syntax and structure sensitivity is not "concatenative," hence "radically different" from the way classicists handle them. In this paper, I offer an analysis of what it is to physically satisfy/realize a formal system. In this context, I examine the minimal truth-conditions of LOT Hypothesis. From my analysis it will follow that concatenative realization of formal systems is irrelevant to LOTH since the very notion of LOT is indifferent to such an implementation level issue as concatenation. I will conclude that to the extent to which they can explain the law-like cognitive regularities, a certain class of connectionist models proposed as radical alternatives to the classical LOT paradigm will in fact turn out to be LOT models, even though new and potentially very exciting ones. (shrink)

In Book I, part iv, section 2 of the Treatise, "Of scepticism with regard to the senses," Hume presents two different answers to the question of how we come to believe in the continued existence of unperceived objects. He rejects his first answer shortly after its formulation, and the remainder of the section articulates an alternative account of the development of the belief. The account that Hume adopts, however, is susceptible to a number of insurmountable objections, which motivates a reassessment (...) of his original proposal. This paper defends a version of Hume's initial explanation of the belief in continued existence and examines some of its philosophical implications. (shrink)

In his book The Sensory Order, Hayek anticipates many of the central ideas behind what we now call the connectionist paradigm, and develops on this basis a theory of the workings of the human mind that extends the thinking of Hume and Mach. He shows that the idea of neural networks is can be applied not only in psychology and neurology but also in the sphere of economics. For the mind, from the perspective of The Sensory Order, is a dynamic, (...) relational affair that is in many respects analogous to a market process. The mind, as Hayek puts it, is a 'continuous stream of impulses, the significance of each and every contribution of which is determined by the place in the pattern of channels through which they flow' , so that the flow of representative neural impulses can be compared 'to a stock of capital being nourished by inputs and giving a continuous stream of outputs'. (shrink)

Philosophers have argued that on the prevailing theory of mind, functionalism, the fact that mental states are multiply realizable or can be instantiated in a variety of different physical forms, at least in principle, shows that materialism or physical is probably false. A similar argument rejects the relevance to psychology of connectionism, which holds that mental states are embodied and and constituted by connectionist neural networks. These arguments, I argue, fall before reductios ad absurdam, proving too much -- they (...) apply as well to genes, which are multiply realizable, but the reduction of which to DNA is one the core cases of scientific reductive explanation, a reduction if anything is. -/- I suggest that psychology, like biology, be what I call "provincialized," abandon claims to universal validity, except as an idealization, and treat different classes of cognizers differently from an an explanatory perspective. This would permit specifies specific, or more precisely, provincial reductions of different psychologies that might be multiply realized if such reductions were available. Connectionism may be the foundation of a reduction of human psychology, and thus biology and connectionism retain their relevance to psychology, and physicalism or materialism is consistent with functionalism. (shrink)

This paper is a commentary on the target article by Dana H. Ballard, “Cortical connections and parallel processing: Structure and function”, in the same issue of the journal, pp. 67–120. -/- I raise some issues about the connectionist or neural-network implementation of information and information processing. Issues include the sharing of information by different parts of a connectionist/neural network, the copying of complex information from one place to another in a network, the possibility of connection weights not being synaptic weights, (...) and the possibility of fast communication within single neurons as complex systems in their own right. (shrink)

In cognitive science, there are many computational theories regarding the function of the mind; connectionism is one of them. Connectionist networks are intricate systems of simple units related to their environment. Some have thousands of units, but those with only a few units can also behave with surprising complexity and subtlety. This is because processing occurs in parallel as also interactively, in marked contrast with the serial processing to which this is accustomed. In the first section of this paper, (...) I intend to describe a simple network that illustrates several features of connectionist processing. Secondly, I would like to examine its relation with other areas in realm of cognitive science. Thirdly, I shall make an attempt to find out whether this theory contributes to the replacement of folk psychology. Lastly, I find that connectionist thus fails to account for the real nature of the mental states because of its not too clear attempt to reduce mental states to the machine states. The mechanistic theory of mind in all its hues faces the question as to how we can account for the qualitative content of our consciousness. It cannot ultimately tell us how the subjective experience is possible and how consciousness to be real feature of universe. (shrink)

The topic of this dissertation is the nature of linguistic competence, the capacity to understand and produce sentences of natural language. I defend the empiricist account of linguistic competence embedded in the connectionist cognitive science. This strand of cognitive science has been opposed to the traditional symbolic cognitive science, coupled with transformational-generative grammar, which was committed to nativism due to the view that human cognition, including language capacity, should be construed in terms of symbolic representations and hardwired rules. Similarly, linguistic (...) competence in this framework was regarded as being innate, rule-governed, domain-specific, and fundamentally different from performance, i.e., idiosyncrasies and factors governing linguistic behavior. I analyze state-of-the-art connectionist, deep learning models of natural language processing, most notably large language models, to see what they can tell us about linguistic competence. Deep learning is a statistical technique for the classification of patterns through which artificial intelligence researchers train artificial neural networks containing multiple layers that crunch a gargantuan amount of textual and/or visual data. I argue that these models suggest that linguistic competence should be construed as stochastic, pattern-based, and stemming from domain-general mechanisms. Moreover, I distinguish syntactic from semantic competence, and I show for each the ramifications of the endorsement of a connectionist research program as opposed to the traditional symbolic cognitive science and transformational-generative grammar. I provide a unifying front, consisting of usage-based theories, a construction grammar approach, and an embodied approach to cognition to show that the more multimodal and diverse models are in terms of architectural features and training data, the stronger the case is for the connectionist linguistic competence. I also propose to discard the competence vs. performance distinction as theoretically inferior so that a novel and integrative account of linguistic competence originating in connectionism and empiricism that I propose and defend in the dissertation could be put forward in scientific and philosophical literature. (shrink)

This study explores the interface between conscious and nonconscious mental processes using phenomenological analysis, information processing cognitive psychology, connectionism and traditional aesthetic theories. It attempts to explain how global, evaluative information--especially the primitive feeling of 'rightness' or 'making sense'--is represented in consciousness. ;Many lines of evidence confirm and extend William James' nucleus/fringe model of consciousness: surrounding clear experience in focal attention is a fringe of vague experience. Context information in general, and the feeling of rightness in particular, occupy the (...) fringe. The fringe is vague because it works to finesse consciousness' limited capacity to articulate experience, and the fringe is elusive or 'ungraspable' because it helps to call new information into consciousness. The phenomenology of the fringe is thus a consequence of its cognitive functions. ;Meaningfulness is proposed to be a summary index of cognitive integration, signalling consciousness about the degree of global compatibility or 'fit' between a given content in the focus of attention and its nonconscious context. Though very similar to goodness-of-fit in a connectionist network, Meaningfulness is proposed to play an active feedback role in cognition, while goodness-of-fit, as currently used, is a passive measure of network integration. ;This analysis predicts that an intense feeling of Meaningfulness will have a characteristic 'profile,' and this profile is evident in many accounts of aesthetic experience: a feeling of unity and coherence that cannot be captured adequately in words, but which nevertheless seems to be a source of profound, and often "spiritual," knowledge. ;Many philosophical theories try to explain the unistic, ineffable, noetic, and transcendent aspects of the aesthetic. Platonic and Aristotelian traditions are considered, but the primary focus is on Kant. The Critique of Judgment created modern aesthetics, and in many ways it is remarkably compatible with current cognitive analysis. ;Beyond clarifying the cognitive foundation of aesthetic experience, this study offers new arguments against epiphenomenalism, provides further reason to doubt rule-based accounts of nonconscious processing, explains the isomorphism in aesthetic and mystical phenomenology, and develops a method to investigate consciousness called convergent phenomenology. (shrink)

Abstract: Research on the nature and varieties of the format of cognitive representations in philosophy and cognitive science have been partly shaped by analogies to external, public representations. In this paper, we argue that relying on such analogies contributes to framing the question of cognitive formats in problematic, potentially counterproductive ways. We show that cognitive and public representations differ in many of their central features, making analogies to public representations ill-suited to improving our understanding of cognitive formats. We illustrate these (...) points by examining two case studies in which analogies to public representations may have had a negative impact on research: the 80’s-90’s debate about compositionality and cognitive architecture between symbolicists and connectionists; and contemporary discussions about the nature of visual demonstratives. Finally, we outline an alternative, computational account of formats that does not share the shortcomings of appeal to public representations. (shrink)

Abstract: Research on the nature and varieties of the format of cognitive representations in philosophy and cognitive science have been partly shaped by analogies to external, public representations. In this paper, we argue that relying on such analogies contributes to framing the question of cognitive formats in problematic, potentially counterproductive ways. We show that cognitive and public representations differ in many of their central features, making analogies to public representations ill-suited to improving our understanding of cognitive formats. We illustrate these (...) points by examining two case studies in which analogies to public representations may have had a negative impact on research: the 80’s-90’s debate about compositionality and cognitive architecture between symbolicists and connectionists; and contemporary discussions about the nature of visual demonstratives. Finally, we outline an alternative, computational account of formats that does not share the shortcomings of appeal to public representations. (shrink)

The systematicity argument only challenges connectionism if systematicity is a general property of cognition. I examine this thesis in terms of properties of concepts. First, I propose that Evans's Generality Constraint only applies to attributions of belief. Then I defend a variety of conceptual pluralism, arguing that concepts share two fundamental properties related to centrality and belief-attribution, and contending that there are two kinds of concepts that differ in their compositional properties. Finally, I rely on Dual Systems Theory and (...) on differences between animal and human cognition to suggest a scenario of two processing systems that work on different kinds of concepts, with only one of them supporting full systematicity. I sketch a non-classical systematicity argument that rules out classicism as the basis of one of those systems given that it would wrongly entail that both systems are fully systematic. (shrink)

There are two versions of the language-of-thought hypothesis (LOT): Representational LOT (roughly, structured representation), introduced by Ockham, and computational LOT (roughly, symbolic computation) introduced by Fodor. Like many others, I oppose the latter but not the former. Quilty-Dunn et al. defend representational LOT, but they do not defend the strong computational LOT thesis central to the classical-connectionist debate.

The paper is dedicated to particular cases of interaction and mutual impact of philosophy and cognitive science. Thus, philosophical preconditions in the middle of the 20th century shaped the newly born cognitive science as mainly based on conceptual and propositional representations and syntactical inference. Further developments towards neural networks and statistical representations did not change the prejudice much: many still believe that network models must be complemented with some extra tools that would account for proper human cognitive traits. I address (...) some real implemented connectionist models that show how ‘new associationism ’ of the neural network approach may not only surpass Humean limitations, but, as well, realistically explain abstraction, inference and prediction. Then I stay on Predictive Processing theories in a little more detail to demonstrate that sophisticated statistical tools applied to a biologically realist ontology may not only provide solutions to scientific problems or integrate different cognitive paradigms but propose some philosophical insights either. To conclude, I touch on a certain parallelism of Predictive Processing and philosophical inferentialism as presented by Robert Brandom. (shrink)

This paper is a commentary on the target article by Lokendra Shastri & Venkat Ajjanagadde [S&A]: “From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony” in same issue of the journal, pp.417–451. -/- It puts S&A's temporal-synchrony binding method in a broader context, comments on notions of pointing and other ways of associating information - in both computers and connectionist systems - and mentions types of reasoning that are a challenge to (...) S&A's system (amongst many other connectionist systems, recognizing that S&A's is much more capable as regards reasoning than most other contemporary systems). (shrink)

1. Do models formulated in programming languages use explicit rules where connectionist models do not? 2. Are rules as found in programming languages hard, precise, and exceptionless, where connectionist rules are not? 3. Do connectionist models use rules operating on distributed representations where models formulated in programming languages do not? 4. Do connectionist models fail to use structure sensitive rules of the sort found in "classical" computer architectures? In this chapter we argue that the answer to each of these questions (...) is negative. (shrink)

Tae Wan Kim, John Hooker, and Thomas Donaldson make an attempt, in recent articles, to solve the alignment problem. As they define the alignment problem, it is the issue of how to give AI systems moral intelligence. They contend that one might program machines with a version of Kantian ethics cast in deontic modal logic. On their view, machines can be aligned with human values if such machines obey principles of universalization and autonomy, as well as a deontic utilitarian principle. (...) Programming machines to do so might be useful, in their view, for applications such as future autonomous vehicles. Their proposal draws both on traditional logic-based and contemporary connectionist approaches, to fuse factual information with normative principles. I will argue that this approach makes demands of machines that go beyond what is currently feasible, and may extend past the limits of the possible for AI. I also argue that a deontological ethics for machines should place greater stress on the formula of humanity of the Kantian categorical imperative. On this principle, one ought never treat a person as a mere means. Recognition of what makes a person a person requires ethical insight. Similar insight is needed to tell treatment as a means from treatment as a mere means. The resources in Kim, Hooker, and Donaldson’s approach is insufficient for this reason. Hesitation regarding deployment of autonomous machines is warranted in light of these alignment concerns. (shrink)

Ask most any cognitive scientist working today if a digital computational system could develop aesthetic sensibility and you will likely receive the optimistic reply that this remains an open empirical question. However, I attempt to show, while drawing upon the later Wittgenstein, that the correct answer is in fact available. And it is a negative a priori. It would seem, for example, that recent computational successes in generative AI and textual attribution, most notably those of Donald Foster (famed finder of (...) Ted Kazinski a.k.a. “the Unibomber”) speak favorably of the connectionist model's capacity to overcome the “aspect blindness” handicap in this domain. I argue however that such results are only achievable when rigid input‐to‐output parameters are given, and that this element is precisely what is absent in standard examples of aesthetic judgment. I thus conclude that while the connectionist model anticipated by Turing may provide the best approach for the AI project, its capacity for meeting its own sufficiency requirements is necessarily crippled by its inability to share in what can be generally referred to as the collective engagements of human solidarity. (shrink)

Since the second half of the XXth century, researchers in cybernetics and AI, neural nets and connectionism, Artificial Life and new robotics have endeavoured to build different machines that could simulate functions of living organisms, such as adaptation and development, problem solving and learning. In this book these research programs are discussed, particularly as regard the epistemological issues of the behaviour modelling. One of the main novelty of this book consists of the fact that certain projects involving the building (...) of simulative machine models before the advent of cybernetics are been investigated for the first time, on the basis of little known, and sometimes completely forgotten or unpublished, texts and figures. These pre-cybernetics projects can be considered as steps toward the “discovery” of a modelling methodology that has been fully developed by those more recent research programs, and that shares some of their central goals and key methodological proposals. -/- More info in Springer link: http://www.springer.com/new+%26+forthcoming+titles+%28default%29/book/978-1-4020-0606-7 -/- This book is the English translation of La scoperta dell'artificiale, Dunod/Masson, Milan, 1998. (shrink)

Although Paul Churchland and Jerry Fodor both subscribe to the so-called theory-theory– the theory that folk psychology (FP) is an empirical theory of behavior – they disagree strongly about FP’s fate. Churchland contends that FP is a fundamentally flawed view analogous to folk biology, and he argues that recent advances in computational neuroscience and connectionist AI point toward development of a scientifically respectable replacement theory that will give rise to a new common-sense psychology. Fodor, however, wagers that FP will be (...) largely preserved and vindicated by scientific investigations of behavior. Recent findings by developmental psychologists, I argue, will push both Churchlandians and Fodorians toward the pessimistic view that FP is a misguided theory that will never be displaced, because it is, so to speak, built into our cognitive systems. I explore the possibility of preserving optimism by rejecting the theory-theory and adopting the simulation theory, a competing view developed by Robert Gordon, Alvin Goldman, and Jane Heal. According to simulationists, common-sense interpretation of behavior is accomplished by means of pretense-like operations that deploy the cognitive system’s own reasoning capabilities in a disengaged manner. Since on this view no theory-like set of principles would be needed, the simulation theory seems to enjoy a simplicity advantage over the theory-theory. Steven Stich and Shawn Nichols, however, contend that as the cognitive system would require special mechanisms for disengaged operation, the simplicity question cannot be resolved until suitable computational models are developed. I describe a set of models I have constructed to meet this need, and I discuss the contribution such models can make to determining FP’s fate. (shrink)

This work addresses a broad range of questions which belong to four fields: computation theory, general philosophy of science, philosophy of cognitive science, and philosophy of mind. Dynamical system theory provides the framework for a unified treatment of these questions. ;The main goal of this dissertation is to propose a new view of the aims and methods of cognitive science--the dynamical approach . According to this view, the object of cognitive science is a particular set of dynamical systems, which I (...) call "cognitive systems". The goal of a cognitive study is to specify a dynamical model of a cognitive system, and then use this model to produce a detailed account of the specific cognitive abilities of that system. The dynamical approach does not limit a-priori the form of the dynamical models which cognitive science may consider. In particular, this approach is compatible with both computational and connectionist modeling, for both computational systems and connectionist networks are special types of dynamical systems. ;To substantiate these methodological claims about cognitive science, I deal first with two questions in two different fields: What is a computational system? What is a dynamical explanation of a deterministic process? ;Intuitively, a computational system is a deterministic system which evolves in discrete time steps, and which can be described in an effective way. In chapter 1, I give a formal definition of this concept which employs the notions of isomorphism between dynamical systems, and of Turing computable function. In chapter 2, I propose a more comprehensive analysis which is based on a natural generalization of the concept of Turing machine. ;The goal of chapter 3 is to develop a theory of the dynamical explanation of a deterministic process. By a "dynamical explanation" I mean the specification of a dynamical model of the system or process which we want to explain. I start from the analysis of a specific type of explanandum--dynamical phenomena--and I then use this analysis to shed light on the general form of a dynamical explanation. Finally, I analyze the structure of those theories which generate explanations of this form, namely dynamical theories. (shrink)

The emerging contemporary natural philosophy provides a common ground for the integrative view of the natural, the artificial, and the human-social knowledge and practices. Learning process is central for acquiring, maintaining, and managing knowledge, both theoretical and practical. This paper explores the relationships between the present advances in understanding of learning in the sciences of the artificial, natural sciences, and philosophy. The question is, what at this stage of the development the inspiration from nature, specifically its computational models such as (...) info-computation through morphological computing, can contribute to machine learning and artificial intelligence, and how much on the other hand models and experiments in machine learning and robotics can motivate, justify, and inform research in computational cognitive science, neurosciences, and computing nature. We propose that one contribution can be understanding of the mechanisms of ‘learning to learn’, as a step towards deep learning with symbolic layer of computation/information processing in a framework linking connectionism with symbolism. As all natural systems possessing intelligence are cognitive systems, we describe the evolutionary arguments for the necessity of learning to learn for a system to reach humanlevel intelligence through evolution and development. The paper thus presents a contribution to the epistemology of the contemporary philosophy of nature. (shrink)

A case study in historical cognitive science, this paper addresses two claims made by radical proponents of new dynamical approaches. It queries their historical narrative, which sees embodied, situated cognition as correcting an individualist, atemporal framework originating in Descartes. In fact, new Descartes scholarship shows that 17th-century animal spirits neurophysiology realized a recognizably distributed model of memory; explicit representations are patterns of spirit flow, and memory traces are changes left by experience in connections between brain pores. This historical sketch supports (...) the second dynamicist claim, that connectionists' stress on the cognitive importance of pattern-recreation needs supplementing by dynamicists' real-time focus and attention to the active roles of body and environment. Animal spirits theory exhibits just the 'continuous reciprocal causation' between brain, body, and environment which Andy Clark sees as dynamicism's central contribution, and allows for the embedding of brains in culture as well as the physical world. (shrink)

We describe and try to motivate our project to build systems using both a knowledge based and a neural network approach. These two approaches are used at different stages in the solution of a problem, instead of using knowledge bases exclusively on some problems, and neural nets exclusively on others. The knowledge base (KB) is defined first in a declarative, symbolic language that is easy to use. It is then compiled into an efficient neural network (NN) representation, run, and the (...) results from run time and (eventually) from learning are decompiled to a symbolic description of the knowledge contained in the network. After inspecting this recovered knowledge, a designer would be able to modify the KB and go through the whole cycle of compiling, running, and decompiling again. The central question with which this project is concerned is, therefore, How do we go from a KB to an NN, and back again? We are investigating this question by building tools consisting of a repertoire of language/translation/network types, and trying them on problems in a variety of domains. (shrink)

Historical Cognitive Science I am lucky to strike three reviewers who extract so clearly my book's spirit as well as its substance. They all both accept and act on my central methodological assumption; that detailed historical research, and consideration of difficult contemporary questions about cognition and culture, can be mutually illuminating. It's gratifying to find many themes which recur in different contexts throughout _Philosophy and Memory_ _Traces_ so well articulated here. The reviews catch my desires to interweave discussion of cognitive (...) theories of memory with moral questions of psychological control and self-mastery, to evoke the virtues and the pleasures of strange, baroque beliefs about fickle 'animal spirits' coursing through the nerves and the brain, to demonstrate that mechanistic explanation (even in its blunt old Cartesian form) can acknowledge complexity, and to develop scientific conceptions of dynamic memory traces and representations which can survive uncharitable philosophical criticism. The book's insistent interdisciplinarity is just an inchoate quest to acknowledge the daunting variety of the phenomena: remembering is both natural and cultural, and is studied by narrative theorists as well as neurobiologists, by physicists as well as psychologists. By fusing the rangy detail of a history of early modern neurophysiology with the committed, even gullible fervor of a defence of 'new connectionist' cognitive science, I wanted to pull out the carpet from all those who are happy to let 'scientific' and 'cultural' approaches to the mind run along independently. Once this general project is given space, as it is by all three reviewers, we can get down to specifics. (shrink)

During the last decades, many cognitive architectures (CAs) have been realized adopting different assumptions about the organization and the representation of their knowledge level. Some of them (e.g. SOAR [35]) adopt a classical symbolic approach, some (e.g. LEABRA[ 48]) are based on a purely connectionist model, while others (e.g. CLARION [59]) adopt a hybrid approach combining connectionist and symbolic representational levels. Additionally, some attempts (e.g. biSOAR) trying to extend the representational capacities of CAs by integrating diagrammatical representations and reasoning are (...) also available [34]. In this paper we propose a reflection on the role that Conceptual Spaces, a framework developed by Peter G¨ardenfors [24] more than fifteen years ago, can play in the current development of the Knowledge Level in Cognitive Systems and Architectures. In particular, we claim that Conceptual Spaces offer a lingua franca that allows to unify and generalize many aspects of the symbolic, sub-symbolic and diagrammatic approaches (by overcoming some of their typical problems) and to integrate them on a common ground. In doing so we extend and detail some of the arguments explored by G¨ardenfors [23] for defending the need of a conceptual, intermediate, representation level between the symbolic and the sub-symbolic one. In particular we focus on the advantages offered by Conceptual Spaces (w.r.t. symbolic and sub-symbolic approaches) in dealing with the problem of compositionality of representations based on typicality traits. Additionally, we argue that Conceptual Spaces could offer a unifying framework for interpreting many kinds of diagrammatic and analogical representations. As a consequence, their adoption could also favor the integration of diagrammatical representation and reasoning in CAs. (shrink)

Many philosophers and psychologists have attempted to elucidate the nature of mental representation by appealing to notions like isomorphism or abstract structural resemblance. The ‘structural representations’ that these theorists champion are said to count as representations by virtue of functioning as internal models of distal systems. In his 2007 book, Representation Reconsidered, William Ramsey endorses the structural conception of mental representation, but uses it to develop a novel argument against representationalism, the widespread view that cognition essentially involves the manipulation of (...) mental representations. Ramsey argues that although theories within the ‘classical’ tradition of cognitive science once posited structural representations, these theories are being superseded by newer theories, within the tradition of connectionism and cognitive neuroscience, which rarely if ever appeal to structural representations. Instead, these theories seem to be explaining cognition by invoking so-called ‘receptor representations’, which, Ramsey claims, aren’t genuine representations at all—despite being called representations, these mechanisms function more as triggers or causal relays than as genuine stand-ins for distal systems. I argue that when the notions of structural and receptor representation are properly explicated, there turns out to be no distinction between them. There only appears to be a distinction between receptor and structural representations because the latter are tacitly conflated with the ‘mental models’ ostensibly involved in offline cognitive processes such as episodic memory and mental imagery. While structural representations might count as genuine representations, they aren’t distinctively mental representations, for they can be found in all sorts of non-intentional systems such as plants. Thus to explain the kinds of offline cognitive capacities that have motivated talk of mental models, we must develop richer conceptions of mental representation than those provided by the notions of structural and receptor representation. (shrink)

Writing within and against the set critical practices of psychoanalytic-deconstructive-Foucauldian-feminist cultural theory, Elizabeth Wilson demonstrates, in this provocative and original book, the productivity and the pleasure of direct, complicitous engagement with the contemporary cognitive sciences. Wilson forges an eclectic method in reaction to the 'zealous but disavowed moralism' of those high cultural Theorists whose 'disciplining compulsion' concocts a monolithic picture of science in order to keep their 'sanitizing critical practice' untainted by its sinister reductionism. Her unsettling accounts of texts by, (...) for example, Karl Popper, Judith Butler, Derrida, Turing, Ebbinghaus and Freud will send many readers back to the sources. It is no surprise that such a broad and ambitious project leaves many threads loose, and no criticism at all that it succeeds more in hinting at the promise of a new connectionist politics than in offering up such a hybrid fully-formed. (shrink)

Abstract Scientific discoveries must have more impact on philosophy (Bechtel, 2001. Part. I.I.). That is the thesis of the American professor of philosophy William Bechtel. Applications of the insights from the neurosciences could perhaps lead to a breakthrough in solving metaphysical and religious questions. Philosophers must assume the task of building bridges between the exact (and cognitive) sciences and contemporary philosophy (Bechtel, 2002. 49). This paper is a critical analysis of the promises of a relatively new discipline: Neurophilosophy.

In artificial intelligence, recent research has demonstrated the remarkable potential of Deep Convolutional Neural Networks (DCNNs), which seem to exceed state-of-the-art performance in new domains weekly, especially on the sorts of very difficult perceptual discrimination tasks that skeptics thought would remain beyond the reach of artificial intelligence. However, it has proven difficult to explain why DCNNs perform so well. In philosophy of mind, empiricists have long suggested that complex cognition is based on information derived from sensory experience, often appealing to (...) a faculty of abstraction. Rationalists have frequently complained, however, that empiricists never adequately explained how this faculty of abstraction actually works. In this paper, I tie these two questions together, to the mutual benefit of both disciplines. I argue that the architectural features that distinguish DCNNs from earlier neural networks allow them to implement a form of hierarchical processing that I call “transformational abstraction”. Transformational abstraction iteratively converts sensory-based representations of category exemplars into new formats that are increasingly tolerant to “nuisance variation” in input. Reflecting upon the way that DCNNs leverage a combination of linear and non-linear processing to efficiently accomplish this feat allows us to understand how the brain is capable of bi-directional travel between exemplars and abstractions, addressing longstanding problems in empiricist philosophy of mind. I end by considering the prospects for future research on DCNNs, arguing that rather than simply implementing 80s connectionism with more brute-force computation, transformational abstraction counts as a qualitatively distinct form of processing ripe with philosophical and psychological significance, because it is significantly better suited to depict the generic mechanism responsible for this important kind of psychological processing in the brain. (shrink)

The Emergic Cognitive Model (ECM) is a unified computational model of visual filling-in based on the Emergic Network architecture. The Emergic Network was designed to help realize systems undergoing continuous change. In this thesis, eight different filling-in phenomena are demonstrated under a regime of continuous eye movement (and under static eye conditions as well). -/- ECM indirectly demonstrates the power of unification inherent with Emergic Networks when cognition is decomposed according to finer-grained functions supporting change. These can interact to raise (...) additional emergent behaviours via cognitive re-use, hence the Emergic prefix throughout. Nevertheless, the model is robust and parameter free. Differential re-use occurs in the nature of model interaction with a particular testing paradigm. -/- ECM has a novel decomposition due to the requirements of handling motion and of supporting unified modelling via finer functional grains. The breadth of phenomenal behaviour covered is largely to lend credence to our novel decomposition. -/- The Emergic Network architecture is a hybrid between classical connectionism and classical computationalism that facilitates the construction of unified cognitive models. It helps cutting up of functionalism into finer-grains distributed over space (by harnessing massive recurrence) and over time (by harnessing continuous change), yet simplifies by using standard computer code to focus on the interaction of information flows. Thus while the structure of the network looks neurocentric, the dynamics are best understood in flowcentric terms. Surprisingly, dynamic system analysis (as usually understood) is not involved. An Emergic Network is engineered much like straightforward software or hardware systems that deal with continuously varying inputs. Ultimately, this thesis addresses the problem of reduction and induction over complex systems, and the Emergic Network architecture is merely a tool to assist in this epistemic endeavour. -/- ECM is strictly a sensory model and apart from perception, yet it is informed by phenomenology. It addresses the attribution problem of how much of a phenomenon is best explained at a sensory level of analysis, rather than at a perceptual one. As the causal information flows are stable under eye movement, we hypothesize that they are the locus of consciousness, howsoever it is ultimately realized. (shrink)

This paper aims to offer a new view of the role of connectionist models in the study of human cognition through the conceptualization of the history of connectionism – from the simplest perceptrons to convolutional neural nets based on deep learning techniques, as well as through the interpretation of criticism coming from symbolic cognitive science. Namely, the connectionist approach in cognitive science was the target of sharp criticism from the symbolists, which on several occasions caused its marginalization and almost (...) complete abandonment of its assumptions in the study of cognition. Criticisms have mostly pointed to its explanatory inadequacy as a theory of cognition or to its biological implausibility as a theory of implementation, and critics often focused on specific shortcomings of some connectionist models and argued that they apply to connectionism in general. In this paper, we want to show that both types of critique are based on the assumption that the only valid explanations in cognitive science are instances of homuncular functionalism and that by removing this assumption and by adopting an alternative methodology – exploratory mechanistic strategy, we can reject most objections to connectionism as irrelevant, explain the progress of connectionist models despite their shortcomings and sketch the trajectory of their future development. By adopting mechanistic explanations and by criticizing functionalism, we will reject the objections of explanatory inadequacy, by characterizing connectionist models as generic rather than concrete mechanisms, we will reject the objections of biological implausibility, and by attributing the exploratory character to connectionist models we will show that practice of generalizing current to general failures of connectionism is unjustified. (shrink)

Paul Cilliers has developed a novel post-structural approach to complexity that has influenced several writers contributing to the current complexity literature. Concomitantly however, Cilliers advocates for modelling complex systems using connectionist neural networks (rather than analytic, rule-based models). In this paper, I argue that it is dilemmic to simultaneously hold these two positions. Cilliers’ post-structural interpretation of complexity states that models of complex systems are always contextual and provisional; there is no exclusive model of complex systems. This sentiment however appears (...) at odds with Cilliers’ promotion of connectionist neural networks as the best way to model complex systems. The lesson is that those who currently follow Cilliers’ post-structural approach to complexity cannot also develop a preferred model of complex systems, and those who currently advocate for some preferred model of complex systems cannot adopt the post-structural approach to complexity without giving up the purported objectivity and/or superiority of their preferred model. (shrink)

The rapid advancements in artificial intelligence, particularly in natural language processing, have brought to light a critical challenge, i.e., the semantic grounding problem. This article explores the root causes of this issue, focusing on the limitations of connectionist models that dominate current AI research. By examining Noam Chomsky's theory of Universal Grammar and his critiques of connectionism, I highlight the fundamental differences between human language understanding and AI language generation. Introducing the concept of semantic grounding, I emphasise the need (...) for AI to connect language with real-world experiences and context to achieve true understanding. While multi-modal models represent a step forward, they fall short of addressing the core issue. The article concludes with a call for a course correction in AI development, advocating for the integration of embodied cognition, dynamic learning, hybrid models, and ethical practices. This shift is essential for creating AI systems that can meaningfully interact with the world, reducing the incidence of hallucinations and enhancing their reliability and utility. (shrink)

This paper is a commentary on the target article by Michael Arbib, “Levels of modeling of mechanisms of visually guided behavior”, in the same issue of the journal, pp. 407–465. -/- I focus on the importance of the inclusion of an ability of a system to entertain, at a given time, multiple instantiations of a given schema (situation template, frame, script, action plan, etc.), and complications introduced into neural/connectionist network systems by such inclusion.

In this Master's dissertation, I try to show that the causal theory of memory, which is the only theory developed so far that at first view seems more plausible and that could be integrated with psychological explanations and investigations of memory, shows some conceptual and ontological problems that go beyond the internal inconsistencies that each version can present. On one hand, the memory phenomenon analyzed is very limited: in general it is reduced to the conscious act of remembering expressed in (...) a propositional format: the idea of an agent who can control his memory reports, in contrast to a passive subject who merely retrieve his encoded memories, is not even considered. Furthermore, the representational function of memory is the only function taken into account; and all the diachronic changes that could entail a dynamic conception of memory are ignored, as is the consideration of context in a broad sense of the term. On the other hand, causal theories make some implicit assumptions that are obviously questionable (e.g., the difference between facts and events) and leave some of their key concepts unexplained, like the nature of the causality, the isomorphism between the memory trace and the memory event, etc. Nonetheless, the principal point that we criticized is the idea of a correspondence between a past event or representation of it, the correspondent memory trace and the memory representation of it. Psychological models of memory, with the exception of the spatial analogy, question some of these assumptions and suggest that memory information is organized in a way other than that implied by the causal theory. But it is distributed connectionism that actually challenges the causal theory of memory, not only through some of its basic postulates, like the superpositional conception of memory traces, their mutual influence and constant state of change, but also because it is compatible with a more situated approach to memory phenomena as well as with the idea that memory in reality accomplishes a variety of functions that go beyond the representational one. The explicit and implicit ideas provided by distributed connectionism, together with the previous criticisms that we made to of causal theory, clearly suggest the possibility of developing another kind of philosophical theory of memory, different from existing theories. This task, nonetheless, implies: (a) A much deeper study of connectionism principles and memory models, as well as of the rival candidate, symbolism, plus the evaluation of these models in the light of psychological and neurophysiological empirical research, which unfortunately I have not dealt with in this work. (b) An analysis of the metaphysical nature of events and facts, in order to see if we should decide in favor of a realist or a non-realist account. It is also clear that this decision can’t be taken without an examination of perception studies (and not exclusively philosophical ones) which would be crucial for determining what is encoded in memory, and studies devoted to language, which, I suspect, plays an important role in the segmentation of reality. (c) A clarification of the notion of causality, because we wouldn’t like to deny any kind entail the complete disappearance of boundaries between memory and imagination. And even if I suspect that my future work will question the existence of absolute boundaries between these two capacities, the notion of causality can’t be completely erase from the theory of memory without erasing the memory phenomenon itself. But this causality, as we’ve already showed, can’t consist in the naïve conception adopted by the causal accounts of memory, nor can it be explained in counterfactual terms. If we think of the reconsolidation concept, of the interdependence between all the memory system, and of the deciding influence of context, it’s almost sure that more than one notion of causality will need to be invoked in order to explain memory. (d) Because I do not want to reduce the study of memory exclusively to cases of remembering, it’s essential to analyze how memory intervenes not only in imagination, but also in perception, reasoning and future projection, for example. In this respect, we could quote the interesting articles of Atance & O’Neill (2001) and Bucker & Carroll (2006), the first concerning the relationship between episodic memory and episodic future thinking, the second concerning the relationship between episodic memory and all kinds of self-projection, such as navigation and theory of mind, relations that would also have to be explored from a philosophical perspective, in particular to overcome the tendency to suppose that representation is the only function of memory. I will also mention the necessity of combining the notion of metamemory with that of memory to some extent; as I have already remarked, it is implausible to suppose that a subject who consciously remembers something is unable to exert any kind of control over his memory reports. (e) Finally, in order to integrate a situated conception of memory into a philosophical account, it will also be indispensable to take into consideration what is known as “everyday memory research” as well as studies in social and collective memory. (shrink)