Connectionism and classicism, it generally appears, have at least this much in common: both place some notion of internal representation at the heart of a scientific study of mind. In recent years, however, a much more radical view has gained increasing popularity. This view calls into question the commitment to internal representation itself. More strikingly still, this new wave of anti-representationalism is rooted not in armchair theorizing but in practical attempts to model and understand intelligent, adaptive behavior. In this paper (...) we first present, and then critically assess, a variety of recent anti-representationalist treatments. We suggest that so far, at least, the sceptical rhetoric outpaces both evidence and argument. Some probable causes of this premature scepticism are isolated. Nonetheless, the anti-representationalist challenge is shown to be both important and progressive insofar as it forces us to see beyond the bare representational/non-representational dichotomy and to recognize instead a rich continuum of degrees and types of representationality. (shrink)

This paper offers both a theoretical and an experimental perspective on the relationship between connectionist and Classical (symbol-processing) models. Firstly, a serious flaw in Fodor and Pylyshyn’s argument against connectionism is pointed out: if, in fact, a part of their argument is valid, then it establishes a conclusion quite different from that which they intend, a conclusion which is demonstrably false. The source of this flaw is traced to an underestimation of the differences between localist and distributed representation. It has (...) been claimed that distributed representations cannot support systematic operations, or that if they can, then they will be mere implementations of traditional ideas. This paper presents experimental evidence against this conclusion: distributed representations can be used to support direct structure-sensitive operations, in a man- ner quite unlike the Classical approach. Finally, it is argued that even if Fodor and Pylyshyn’s argument that connectionist models of compositionality must be mere implementations were correct, then this would still not be a serious argument against connectionism as a theory of mind. (shrink)

The term “Contemplative sciences” refers to an interdisciplinary approach to mind that aims at a better understanding of alternative states of consciousness, like those obtained trough deep concentration and meditation, mindfulness and other “superior” or “spiritual” mental states. There is, however, a key discipline missing: artificial intelligence. AI has forgotten its original aims to create intelligent machines that could help us to understand better what intelligence is and is more worried about pragmatical stuff, so almost nobody in the field seems (...) to be interested to join this new effort of contemplative science. In this paper, I would like to accomplish the following: (1) To give a brief description of the field of “contemplative sciences;” (2) To argue why AI should actively join this new paradigm on the study of the mind; and (3) To set up a research program on artificial wisdom: that is to design computational systems that can model at least some relevant aspects of human wisdom. (shrink)

The paper is an examination of the ways and extent to which neuroscience places constraints on cognitive science. In Part I, I clarify the issue, as well as the notion of levels in cognitive inquiry. I then present and address, in Part II, two arguments designed to show that facts from neuroscience are at a level too low to constrain cognitive theory in any important sense. I argue, to the contrary, that there are several respects in which facts from neurophysiology (...) will constrain cognitive theory. Part III then turns to an examination of Connectionism and Classical Cognitivism to determine which, if either, is in a better position to accomodate neural constraints in the ways suggested in Part II. (shrink)

This paper addresses the question of whether mental representations are compositional. Several researchers have claimed recently that there are empirical data that show mental representations to be context-sensitive in a way that threatens compositionality. Some have then gone on to claim that connectionist encoding schemes are well suited to accommodate such noncom-positionality. I argue here that the data do not show that mental representations are noncompositional, and that there are significant problems with the suggested interpretations of connectionist encoding schemes.

Connectionist research first emerged in the 1940s. The first phase of connectionism attracted a certain amount of media attention, but scant philosophical interest. The phase came to an abrupt halt, due to the efforts of Minsky and Papert (1969), when they argued for the intrinsic limitations of the approach. In the mid-1980s connectionism saw a resurgence. This marked the beginning of the second phase of connectionist research. This phase did attract considerable philosophical attention. It was of philosophical interest, as it (...) offered a way of counteracting the conceptual ties to the philosophical traditions of atomism, rationalism, logic, nativism, rule realism and a concern with the role symbols play in human cognitive functioning, which was prevalent as a consequence of artificial intelligence research. The surge in philosophical interest waned, possibly in part due to the efforts of some traditionalists and the so-called black box problem. Most recently, what may be thought of as a third phase of connectionist research, based on so-called deep learning methods, is beginning to show some signs of again exciting philosophical interest. (shrink)

Advocates of dynamical systems theory (DST) sometimes employ revolutionary rhetoric. In an attempt to clarify how DST models differ from others in cognitive science, I focus on two issues raised by DST: the role for representations in mental models and the conception of explanation invoked. Two features of representations are their role in standing-in for features external to the system and their format. DST advocates sometimes claim to have repudiated the need for stand-ins in DST models, but I argue that (...) they are mistaken. Nonetheless, DST does offer new ideas as to the format of representations employed in cognitive systems. With respect to explanation, I argue that some DST models are better seen as conforming to the covering-law conception of explanation than to the mechanistic conception of explanation implicit in most cognitive science research. But even here, I argue, DST models are a valuable complement to more mechanistic cognitive explanations. (shrink)

The relation between logic and thought has long been controversial, but has recently influenced theorizing about the nature of mental processes in cognitive science. One prominent tradition argues that to explain the systematicity of thought we must posit syntactically structured representations inside the cognitive system which can be operated upon by structure sensitive rules similar to those employed in systems of natural deduction. I have argued elsewhere that the systematicity of human thought might better be explained as resulting from the (...) fact that we have learned natural languages which are themselves syntactically structured. According to this view, symbols of natural language are external to the cognitive processing system and what the cognitive system must learn to do is produce and comprehend such symbols. In this paper I pursue that idea by arguing that ability in natural deduction itself may rely on pattern recognition abilities that enable us to operate on external symbols rather than encodings of rules that might be applied to internal representations. To support this suggestion, I present a series of experiments with connectionist networks that have been trained to construct simple natural deductions in sentential logic. These networks not only succeed in reconstructing the derivations on which they have been trained, but in constructing new derivations that are only similar to the ones on which they have been trained. (shrink)

This paper reviews four significant advances on the feedforward architecture that has dominated discussions of connectionism. The first involves introducing modularity into networks by employing procedures whereby different networks learn to perform different components of a task, and a Gating Network determines which network is best equiped to respond to a given input. The second consists in the use of recurrent inputs whereby information from a previous cycle of processing is made available on later cycles. The third development involves developing (...) compressed representations of strings in which there is no longer an explicit encoding of the components but where information about the structure of the original string can be recovered and so is present functionally. The final advance entails using connectionist learning procedures not just to change weights in networks but to change the patterns used as inputs to the network. These advances significantly increase the usefulness of connectionist networks for modeling human cognitive performance by, among other things, providing tools for explaining the productivity and systematicity of some mental activities, and developing representations that are sensitive to the content they are to represent. (shrink)

This paper is a commentary on the target article by Lokendra Shastri & Venkat Ajjanagadde [S&A]: “From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony” in same issue of the journal, pp.417–451. -/- It puts S&A's temporal-synchrony binding method in a broader context, comments on notions of pointing and other ways of associating information - in both computers and connectionist systems - and mentions types of reasoning that are a challenge to (...) S&A's system (amongst many other connectionist systems, recognizing that S&A's is much more capable as regards reasoning than most other contemporary systems). (shrink)

Various defenses of amodal symbol systems are addressed, including amodal symbols in sensory-motor areas, the causal theory of concepts, supramodal concepts, latent semantic analysis, and abstracted amodal symbols. Various aspects of perceptual symbol systems are clarified and developed, including perception, features, simulators, category structure, frames, analogy, introspection, situated action, and development. Particular attention is given to abstract concepts, language, and computational mechanisms.

Fodor and Pylyshyn's critique of connectionism has posed a challenge to connectionists: Adequately explain such nomological regularities as systematicity and productivity without postulating a "language of thought" (LOT). Some connectionists like Smolensky took the challenge very seriously, and attempted to meet it by developing models that were supposed to be non-classical. At the core of these attempts lies the claim that connectionist models can provide a representational system with a combinatorial syntax and processes sensitive to syntactic structure. They are not (...) implementation models because, it is claimed, the way they obtain syntax and structure sensitivity is not "concatenative," hence "radically different" from the way classicists handle them. In this paper, I offer an analysis of what it is to physically satisfy/realize a formal system. In this context, I examine the minimal truth-conditions of LOT Hypothesis. From my analysis it will follow that concatenative realization of formal systems is irrelevant to LOTH since the very notion of LOT is indifferent to such an implementation level issue as concatenation. I will conclude that to the extent to which they can explain the law-like cognitive regularities, a certain class of connectionist models proposed as radical alternatives to the classical LOT paradigm will in fact turn out to be LOT models, even though new and potentially very exciting ones. (shrink)

Arguably no concept is more fundamental to science than that of causality, for investigations into cases of existence, persistence, and change in the natural world are largely investigations into the causes of these phenomena. Yet the metaphysics and epistemology of causality remain unclear. For example, the ontological categories of the causal relata have been taken to be objects (Hume 1739), events (Davidson 1967), properties (Armstrong 1978), processes (Salmon 1984), variables (Hitchcock 1993), and facts (Mellor 1995). (For convenience, causes and effects (...) will usually be understood as events in what follows.) Complicating matters, causal relations may be singular (Socrates’s drinking hemlock caused Socrates’s death) or general (Drinking hemlock causes death); hence the relata might be tokens (e.g., instances of properties) or types (e.g., types of events) of the category in question. Other questions up for grabs are: Are singular causes metaphysically and/or epistemologically prior to general causes or vice versa (or neither)? What grounds the intuitive asymmetry of the causal relation? Are macro-causal relations reducible to micro-causal relations? And perhaps most importantly: Are causal facts (e.g., the holding of causal relations) reducible to non-causal facts (e.g., the holding of certain spatiotemporal relations)? (shrink)

Philosophy and Literature is an internationally renowned refereed journal founded by Denis Dutton at the University of Canterbury, Christchurch. It is now published by the Johns Hopkins University Press. Since its inception in 1976, Philosophy and Literature has been concerned with the relation between literary and philosophical studies, publishing articles on the philosophical interpretation of literature as well as the literary treatment of philosophy. Philosophy and Literature has sometimes been regarded as iconoclastic, in the sense that it repudiates academic pretensions, (...) insidious jargon and institutional vogue. Dutton, who remains the editor, still writes a regular column. A distinctive feature of Philosophy and Literature was the annual Bad Writing Contest, held from 1995–98, which sought to identify (and publish) the ‘most stylistically lamentable passages’ of academic prose, often to great amusement. (shrink)

Comparatively easy questions we might ask about creativity are distinguished from the hard question of explaining transformative creativity. Many have focused on the easy questions, offering no reason to think that the imagining relied upon in creative cognition cannot be reduced to more basic folk psychological states. The relevance of associative thought processes to songwriting is then explored as a means for understanding the nature of transformative creativity. Productive artificial neural networks—known as generative antagonistic networks (GANs)—are a recent example of (...) how a system’s ability to generate novel products can both be finely tuned by prior experience and grounded in strategies that cannot be articulated by the system itself. Further, the kinds of processes exploited by GANs need not be seen as incorporating something akin to sui generis imaginative states. The chapter concludes with reflection on the added relevance of personal character to explanations of creativity. [This is Chapter 12 of the book Explaining Imagination.]. (shrink)

Currie’s (2010) argument that “i-desires” must be posited to explain our responses to fiction is critically discussed. It is argued that beliefs and desires featuring ‘in the fiction’ operators—and not sui generis imaginings (or "i-beliefs" or "i-desires")—are the crucial states involved in generating fiction-directed affect. A defense of the “Operator Claim” is mounted, according to which ‘in the fiction’ operators would be also be required within fiction-directed sui generis imaginings (or "i-beliefs" and "i-desires"), were there such. Once we appreciate that (...) even fiction-directed sui generis imaginings would need to incorporate ‘in the fiction’ operators, the main appeal of the idea that sui generis imaginings (or "i-beliefs" or "i-desires") are at work in fiction-appreciation dissipates. [This is Chapter 10 of Explaining Imagination (OUP, 2020)]. (shrink)

​Imagination will remain a mystery—we will not be able to explain imagination—until we can break it into parts we already understand. Explaining Imagination is a guidebook for doing just that, where the parts are other ordinary mental states like beliefs, desires, judgments, and decisions. In different combinations and contexts, these states constitute cases of imagining. This reductive approach to imagination is at direct odds with the current orthodoxy, according to which imagination is a sui generis mental state or process—one with (...) its own inscrutable principles of operation. Explaining Imagination upends that view, showing how, on closer inspection, the imaginings at work in hypothetical reasoning, pretense, the enjoyment of fiction, and creativity are reducible to other familiar mental states—judgments, beliefs, desires, and decisions among them. Crisscrossing contemporary philosophy of mind, cognitive science, and aesthetics, Explaining Imagination argues that a clearer understanding of imagination is already well within reach. (shrink)

[Edited from Conclusion section:] We have looked at various challenging issues to do with getting connectionism to cope with high-level cognitive activities such a reasoning and natural language understanding. The issues are to do with various facets of generalization that are not commonly noted. We have been concerned in particular with the special forms these issues take in the arena of propositional attitude processing. The main problems we have looked at are: (1) The need to construct explicit representations of generalizations, (...) not just generalize correctly to individual cases; (2) The need to be able to match two or more complex short-term information structures, to enable rapid generalization from recent examples rather than from long-term memories; (3) The need to represent and reason with anomalous combinations of concepts; (4) The need to perform embedded reasoning. This presents special problems for systems using non-concatenative representations (as in mainstream connectionist approaches). We also touched on vague quantification in attitude report complements. Neither this topic nor that of analogies between short-term structures (point 2) has been adequately addressed in the symbolic framework, let alone in connectionism. -/- The opportunities and problems covered are put forward as things worth being optimistic about or pessimistic about, respectively. They are not put forward as decisive arguments for or against connectionism. The hope is that this chapter contributes to a greater understanding of the connectionist/symbolist gap by presenting some unusual issues and by throwing new light on some well known ones. (shrink)

Over the past thirty years, it is been common to hear the mind likened to a digital computer. This essay is concerned with a particular philosophical view that holds that the mind literally is a digital computer (in a specific sense of “computer” to be developed), and that thought literally is a kind of computation. This view—which will be called the “Computational Theory of Mind” (CTM)—is thus to be distinguished from other and broader attempts to connect the mind with computation, (...) including (a) various enterprises at modeling features of the mind using computational modeling techniques, and (b) employing some feature or features of production-model computers (such as the stored program concept, or the distinction between hardware and software) merely as a guiding metaphor for understanding some feature of the mind. This entry is therefore concerned solely with the Computational Theory of Mind (CTM) proposed by Hilary Putnam [1961] and developed most notably for philosophers by Jerry Fodor [1975, 1980, 1987, 1993]. The senses of ‘computer’ and ‘computation’ employed here are technical; the main tasks of this entry will therefore be to elucidate: (a) the technical sense of ‘computation’ that is at issue, (b) the ways in which it is claimed to be applicable to the mind, (c) the philosophical problems this understanding of the mind is claimed to solve, and (d) the major criticisms that have accrued to this view. (shrink)

There has been much interest in the possibility of connectionist models whose representations can be endowed with compositional structure, and a variety of such models have been proposed. These models typically use distributed representations that arise from the functional composition of constituent parts. Functional composition and decomposition alone, however, yield only an implementation of classical symbolic theories. This paper explores the possibility of moving beyond implementation by exploiting holistic structure-sensitive operations on distributed representations. An experiment is performed using Pollack’s Recursive (...) Auto-Associative Memory. RAAM is used to construct distributed representations of syntactically structured sentences. A feed-forward network is then trained to operate directly on these representations, modeling syn- tactic transformations of the represented sentences. Successful training and generalization is obtained, demonstrating that the implicit structure present in these representations can be used for a kind of structure-sensitive processing unique to the connectionist domain. (shrink)

Complete URL to this document: http://srsc.ulb.ac.be/axcWWW/93-Principles.html.

This chapter presents a new semantics for inductive empirical knowledge. The epistemic agent is represented concretely as a learner who processes new inputs through time and who forms new beliefs from those inputs by means of a concrete, computable learning program. The agent’s belief state is represented hyper-intensionally as a set of time-indexed sentences. Knowledge is interpreted as avoidance of error in the limit and as having converged to true belief from the present time onward. Familiar topics are re-examined within (...) the semantics, such as inductive skepticism, the logic of discovery, Duhem’s problem, the articulation of theories by auxiliary hypotheses, the role of serendipity in scientific knowledge, Fitch’s paradox, deductive closure of knowability, whether one can know inductively that one knows inductively, whether one can know inductively that one does not know inductively, and whether expert instruction can spread common inductive knowledge—as opposed to mere, true belief—through a community of gullible pupils. (shrink)

Many studies of language, whether in philosophy, linguistics, or psychology, have focused on highly developed human languages. In their highly developed forms, such as are employed in scientific discourse, languages have a unique set of properties that have been the focus of much attention. For example, descriptive sentences in a language have the property of being "true" or "false," and words of a language have senses and referents. Sentences in a language are structured in accord with complex syntactic rules. Theorists (...) focusing on language are naturally led to ask questions such as what constitutes the meanings of words and sentences and how are the principles of syntax encoded in the heads of language users. While there is an important function for inquiries into the highly developed forms of these cultural products (Abrahamsen, 1987), such a focus can be quite misleading when we want to explain how these products have arisen or the human capacity to use language. The problem is that focusing on its most developed forms makes linguistic ability seem to be a _sui generis_ phenomenon, not related to, and hence not explicable in terms of other cognitive capacities. Chomsky's (1980) postulation of a specific language module equipped with specialized resources needed to process language and possessed only by hum ans is not a surprising result. (shrink)

I present experimental and computational research, inspired by the perspective of Embodied Embedded Cognition, concerning various aspects of language as supporting Everett’s interactionist view of language. Based on earlier and ongo- ing work, I briefly illustrate the contribution of the environment to the syste- maticity displayed in linguistic performance, the importance of joint attention for the development of a shared vocabulary, the role of (limited) traveling for language diversification, the function of perspective taking in social communica- tion, and the bodily (...) nature of understanding of meaning. (shrink)

has to do with the acquisition of encyclopedic knowledge.