The computational paradigm, which has dominated psychology and artificial intelligence since the cognitive revolution, has been a source of intense debate. Recently, several cognitive scientists have argued against this paradigm, not by objecting to computation, but rather by objecting to the notion of representation. Our analysis of these objections reveals that it is not the notion of representation per se that is causing the problem, but rather specific properties of representations as they are used in various psychological theories. Our analysis (...) suggests that all theorists accept the idea that cognitive processing involves internal information-carrying states that mediate cognitive processing. These mediating states are a superordinate category of representations. We discuss five properties that can be added to mediating states and examine their importance in various cognitive models. Finally, three methodological lessons are drawn from our analysis and discussion. (shrink)

[Edited from Conclusion section:] We have looked at various challenging issues to do with getting connectionism to cope with high-level cognitive activities such a reasoning and natural language understanding. The issues are to do with various facets of generalization that are not commonly noted. We have been concerned in particular with the special forms these issues take in the arena of propositional attitude processing. The main problems we have looked at are: (1) The need to construct explicit representations of generalizations, (...) not just generalize correctly to individual cases; (2) The need to be able to match two or more complex short-term information structures, to enable rapid generalization from recent examples rather than from long-term memories; (3) The need to represent and reason with anomalous combinations of concepts; (4) The need to perform embedded reasoning. This presents special problems for systems using non-concatenative representations (as in mainstream connectionist approaches). We also touched on vague quantification in attitude report complements. Neither this topic nor that of analogies between short-term structures (point 2) has been adequately addressed in the symbolic framework, let alone in connectionism. -/- The opportunities and problems covered are put forward as things worth being optimistic about or pessimistic about, respectively. They are not put forward as decisive arguments for or against connectionism. The hope is that this chapter contributes to a greater understanding of the connectionist/symbolist gap by presenting some unusual issues and by throwing new light on some well known ones. (shrink)

Recent work in the methodology of connectionist explanation has I'ocrrsccl on the notion of levels of explanation. Specific issucs in conncctionisrn hcrc intersect with rvider areas of debate in the philosophy of psychology and thc philosophy of science generally. The issues I raise in this chapter, then, are not unique to cognitive science; but they arise in new and important contexts when connectionism is taken seriously as a model of cognition. The general questions are the relation between levels and the (...) status of levels which have no obvious relation to others. In speaking of levels, what is the connection, if there is one, between explanation and ontology? Which, if any, conccpt of reduction is applicable to connectionist systems? What kind of legitinrtcy can the constructs of common sense psychology, or of that vclsion ol intentional realism represented by classical symbol-systems n I, hirvc irr ir full-scale connectionist theory of mind? (shrink)

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

Converging data from different disciplines are showing the role of classical conditioning processes in the elaboration of human and animal behavior to be larger than previously supposed. Restricted views of classically conditioned responses as merely secretory, reflexive, or emotional are giving way to a broader conception that includes problem-solving, and other rule-governed behavior thought to be the exclusive province of either operant conditiońing or cognitive psychology. These new views have been accompanied by changes in the way conditioning is conducted and (...) evaluated. Data from a number of seemingly unrelated phenomena such as relapse to drug abuse by postaddicts, the placebo effect, and the immune response appear to involve classical conditioning processes. Classical conditioning, moreover, has been found to occur in simpler and simpler organisms and recently even demonstrated in brain slices and in utero. This target article will integrate the several research areas that have used the classical conditioning process as an explanatory model; it will challenge teleological interpretations of the classically conditioned CR and offer some basic principles for testing conditioning in diverse areas. (shrink)

An essential aspect of knowing language is knowing the words of that language. This knowledge is usually thought to reside in the mental lexicon, a kind of dictionary that contains information regarding a word’s meaning, pronunciation, syntactic characteristics, and so on. In this article, a very different view is presented. In this view, words are understood as stimuli that operate directly on mental states. The phonological, syntactic and semantic properties of a word are revealed by the effects it has on (...) those states. (shrink)

The poverty of stimulus argument is one of the most controversial arguments in the study of language acquisition. Here we follow previous approaches challenging the assumption of impoverished primary linguistic data, focusing on the specific problem of auxiliary (AUX) fronting in complex polar interrogatives. We develop a series of corpus analyses of child-directed speech showing that there is indirect statistical information useful for correct auxiliary fronting in polar interrogatives and that such information is sufficient for distinguishing between grammatical and ungrammatical (...) generalizations, even in the absence of direct evidence. We further show that there are simple learning devices, such as neural networks, capable of exploiting such statistical cues, producing a bias toward correct AUX questions when compared to their ungrammatical counterparts. The results suggest that the basic assumptions of the poverty of stimulus argument may need to be reappraised. (shrink)

The species-specific organizational property of speech is a continual mouth open-close alternation, the two phases of which are subject to continual articulatory modulation. The cycle constitutes the syllable, and the open and closed phases are segments framescontent displays that are prominent in many nonhuman primates. The new role of Broca's area and its surround in human vocal communication may have derived from its evolutionary history as the main cortical center for the control of ingestive processes. The frame and content components (...) of speech may have subsequently evolved separate realizations within two general purpose primate motor control systems: (1) a motivation-related medial system, including anterior cingulate cortex and the supplementary motor area, for self-generated behavior, formerly responsible for ancestral vocalization control and now also responsible for frames, and (2) a lateral system, including Broca's area and surround, and Wernicke's area, specialized for response to external input (and therefore the emergent vocal learning capacity) and more responsible for content. (shrink)

O'Brien & Opie's (O&O's) theory demands a view of unconscious processing that is incompatible with virtually all current PDP models of neural activity. Relative to the alternatives, the theory is closer to an AI than a parallel distributed processing (PDP) perspective, and its treatment of phenomenology is ad hoc. It raises at least one important question: Could features of network relaxation be the “switch” that turns an unconscious into a conscious network?

Multiple explanatory frameworks may be required to provide an adequate account of human cognition. This paper embeds the classical account within a neural network framework, exploring the encoding of syntacticallystructured objects over the synchronicdiachronic characteristics of networks. Synchronic structure is defined in terms of temporal binding and the superposition of states. To accommodate asymmetric relations, synchronic structure is subject to the type uniqueness constraint. The nature of synchronic structure is shown to underlie Xbar theory that characterizes the phrasal structure of (...) human languages. The derivation differentiates core Xbar properties from languagespecific properties. (shrink)

Arguments for the autonomy of psychology or other higher-level sciences have often taken the form of denying the possibility of reduction. The form of reduction most proponents and critics of the autonomy of psychology have in mind is theory reduction. Mechanistic explanations provide a different perspective. Mechanistic explanations are reductionist insofar as they appeal to lower-level entities—the component parts of a mechanism and their operations— to explain a phenomenon. However, unlike theory reductions, mechanistic explanations also recognize the fundamental role of (...) organization in enabling mechanisms to engage their environments as units (as well as the role of yet higher-level structures in constraining such engagement). Especially when organization is non-linear, it can enable mechanisms to generate phenomena that are quite surprising given the operations of the components taken in isolation. Such organization must be discovered—it cannot simply be derived from knowledge of lower-level parts and their operations. Moreover, the organized environments in which mechanisms operate must also be discovered. It is typically the higher-level disciplines that have the tools for discovering the organization within and between mechanisms. Although these inquiries are constrained by the knowledge of the parts and operations constituting the mechanism, they make their own autonomous contribution to understanding how a mechanism actually behaves. Thus, mechanistic explanations provide a strong sense of autonomy for higher levels of organization and the inquiries addressing them even while recognizing the distinctive contributions of reductionistic research investigating the operations of the lower level components. (shrink)

Scholars studying the origins and evolution of language are also interested in the general issue of the evolution of cognition. Language is not an isolated capability of the individual, but has intrinsic relationships with many other behavioral, cognitive, and social abilities. By understanding the mechanisms underlying the evolution of linguistic abilities, it is possible to understand the evolution of cognitive abilities. Cognitivism, one of the current approaches in psychology and cognitive science, proposes that symbol systems capture mental phenomena, and attributes (...) cognitive validity to them. Therefore, in the same way that language is considered the prototype of cognitive abilities, a symbol system has become the prototype for studying language and cognitive systems. Symbol systems are advantageous as they are easily studied through computer simulation (a computer program is a symbol system itself), and this is why language is often studied using computational models. (shrink)

Eliminative materialism is a popular view of the mind which holds that propositional attitudes, the typical units of our traditional understanding, are unsupported by modern connectionist psychology and neuroscience, and consequently that propositional attitudes are a poor scientific postulate, and do not exist. Since our traditional folk psychology employs propositional attitudes, the usual argument runs, it too represents a poor theory, and may in the future be replaced by a more successful neurologically grounded theory, resulting in a drastic improvement in (...) our interpersonal relationships. I contend that these eliminativist arguments typically run together two distinct capacities: the folk psychological mechanisms which we use to understand one another, and scientific and philosophical guesses about the structure of those understandings. Both capacities are ontologically committed and therefore empirical. However, the commitments whose prospects look so dismal to the eliminativist, in particular the causal and logical image of propositional attitudes, belong to the guesses, and not necessarily to the underlying mechanisms. It is the commitments of traditional philosophical perspectives about the operation of our folk psychology which are contradicted by␣new evidence and modeling methods in connectionist psychology. Our actual folk psychology was not clearly committed to causal, sentential propositional attitudes, and thus is not directly threatened by connectionist psychology. (shrink)

According to the dominant computational approach in cognitive science, cognitive agents are digital computers; according to the alternative approach, they are dynamical systems. This target article attempts to articulate and support the dynamical hypothesis. The dynamical hypothesis has two major components: the nature hypothesis (cognitive agents are dynamical systems) and the knowledge hypothesis (cognitive agents can be understood dynamically). A wide range of objections to this hypothesis can be rebutted. The conclusion is that cognitive systems may well be dynamical systems, (...) and only sustained empirical research in cognitive science will determine the extent to which that is true. (shrink)

High-level perception--”the process of making sense of complex data at an abstract, conceptual level--”is fundamental to human cognition. Through high-level perception, chaotic environmen- tal stimuli are organized into the mental representations that are used throughout cognitive pro- cessing. Much work in traditional artificial intelligence has ignored the process of high-level perception, by starting with hand-coded representations. In this paper, we argue that this dis- missal of perceptual processes leads to distorted models of human cognition. We examine some existing artificial-intelligence models--”notably (...) BACON, a model of scientific discovery, and the Structure-Mapping Engine, a model of analogical thought--”and argue that these are flawed pre- cisely because they downplay the role of high-level perception. Further, we argue that perceptu- al processes cannot be separated from other cognitive processes even in principle, and therefore that traditional artificial-intelligence models cannot be defended by supposing the existence of a --œrepresentation module--� that supplies representations ready-made. Finally, we describe a model of high-level perception and analogical thought in which perceptual processing is integrated with analogical mapping, leading to the flexible build-up of representations appropriate to a given context. (shrink)

Along with the increasing popularity of connectionist language models has come a number of provocative suggestions about the challenge these models present to Chomsky's arguments for nativism. The aim of this paper is to assess these claims. We begin by reconstructing Chomsky's argument from the poverty of the stimulus and arguing that it is best understood as three related arguments, with increasingly strong conclusions. Next, we provide a brief introduction to connectionism and give a quick survey of recent efforts to (...) develop networks that model various aspects of human linguistic behavior. Finally, we explore the implications of this research for Chomsky's arguments. Our claim is that the relation between connectionism and Chomsky's views on innate knowledge is more complicated than many have assumed, and that even if these models enjoy considerable success the threat they pose for linguistic nativism is small. (shrink)

The topic of this dissertation is the nature of linguistic competence, the capacity to understand and produce sentences of natural language. I defend the empiricist account of linguistic competence embedded in the connectionist cognitive science. This strand of cognitive science has been opposed to the traditional symbolic cognitive science, coupled with transformational-generative grammar, which was committed to nativism due to the view that human cognition, including language capacity, should be construed in terms of symbolic representations and hardwired rules. Similarly, linguistic (...) competence in this framework was regarded as being innate, rule-governed, domain-specific, and fundamentally different from performance, i.e., idiosyncrasies and factors governing linguistic behavior. I analyze state-of-the-art connectionist, deep learning models of natural language processing, most notably large language models, to see what they can tell us about linguistic competence. Deep learning is a statistical technique for the classification of patterns through which artificial intelligence researchers train artificial neural networks containing multiple layers that crunch a gargantuan amount of textual and/or visual data. I argue that these models suggest that linguistic competence should be construed as stochastic, pattern-based, and stemming from domain-general mechanisms. Moreover, I distinguish syntactic from semantic competence, and I show for each the ramifications of the endorsement of a connectionist research program as opposed to the traditional symbolic cognitive science and transformational-generative grammar. I provide a unifying front, consisting of usage-based theories, a construction grammar approach, and an embodied approach to cognition to show that the more multimodal and diverse models are in terms of architectural features and training data, the stronger the case is for the connectionist linguistic competence. I also propose to discard the competence vs. performance distinction as theoretically inferior so that a novel and integrative account of linguistic competence originating in connectionism and empiricism that I propose and defend in the dissertation could be put forward in scientific and philosophical literature. (shrink)

The standard approach to model how human beings understand natural languages is the symbolic, compositional approach according to which the meaning of a complex expression is a function of the meanings of its constituents. In other words, meaning plays a fundamental role in the model. In this work, because of the polysemous, flexible, dynamic, and contextual structure of natural languages, this approach is rejected. Instead, a connectionist model which eliminates the concept of meaning is proposed.

The present paper intends to draw the conception of language implied in the technique of word embeddings that supported the recent development of deep neural network models in computational linguistics. After a preliminary presentation of the basic functioning of elementary artificial neural networks, we introduce the motivations and capabilities of word embeddings through one of its pioneering models, word2vec. To assess the remarkable results of the latter, we inspect the nature of its underlying mechanisms, which have been characterized as the (...) implicit factorization of a word-context matrix. We then discuss the ordinary association of the “distributional hypothesis” with a “use theory of meaning,” often justifying the theoretical basis of word embeddings, and contrast them to the theory of meaning stemming from those mechanisms through the lens of matrix models (such as vector space models and distributional semantic models). Finally, we trace back the principles of their possible consistency through Harris’s original distributionalism up to the structuralist conception of language of Saussure and Hjelmslev. Other than giving access to the technical literature and state of the art in the field of natural language processing to non-specialist readers, the paper seeks to reveal the conceptual and philosophical stakes involved in the recent application of new neural network techniques to the computational treatment of language. (shrink)

One of the great successes of the application of generalized quantifiers to natural language has been the ability to formulate robust semantic universals. When such a universal is attested, the question arises as to the source of the universal. In this paper, we explore the hypothesis that many semantic universals arise because expressions satisfying the universal are easier to learn than those that do not. While the idea that learnability explains universals is not new, explicit accounts of learning that can (...) make good on this hypothesis are few and far between. We propose a model of learning — back-propagation through a recurrent neural network — which can make good on this promise. In particular, we discuss the universals of monotonicity, quantity, and conservativity and perform computational experiments of training such a network to learn to verify quantifiers. Our results are able to explain monotonicity and quantity quite well. We suggest that conservativity may have a different source than the other universals. (shrink)

Neural networks have long been used to study linguistic phenomena spanning the domains of phonology, morphology, syntax, and semantics. Of these domains, semantics is somewhat unique in that there is little clarity concerning what a model needs to be able to do in order to provide an account of how the meanings of complex linguistic expressions, such as sentences, are understood. We argue that one thing such models need to be able to do is generate predictions about which further sentences (...) are likely to follow from a given sentence; these define the sentence's “inferential role.” We then show that it is possible to train a tree-structured neural network model to generate very simple examples of such inferential roles using the recently released Stanford Natural Language Inference (SNLI) dataset. On an empirical front, we evaluate the performance of this model by reporting entailment prediction accuracies on a set of test sentences not present in the training data. We also report the results of a simple study that compares human plausibility ratings for both human-generated and model-generated entailments for a random selection of sentences in this test set. On a more theoretical front, we argue in favor of a revision to some common assumptions about semantics: understanding a linguistic expression is not only a matter of mapping it onto a representation that somehow constitutes its meaning; rather, understanding a linguistic expression is mainly a matter of being able to draw certain inferences. Inference should accordingly be at the core of any model of semantic cognition. (shrink)

Complex systems are to be seen as typically having multiple levels of organization. For instance, in the behavioural and cognitive sciences, there has been a long lasting trend, promoted by the seminal work of David Marr, putting focus on three distinct levels of analysis: the computational level, accounting for the What and Why issues, the algorithmic and the implementational levels specifying the How problem. However, the tremendous developments in neuroscience knowledge about processes at different scales of organization together with the (...) complexity of today cognitive theories suggest that there will hardly be only three levels of explanation. Instead, there will be many different degrees of commitments corresponding to the different granularities—from high-level (behavioural) models to low-level (neural and molecular) models of the cognitive research program. For instance, Bayesian approaches, that are usually advocated for formalizing Marr’s computational level and rational behaviour, have even been adopted to model synaptic plasticity and axon guidance by molecular gradients. As a result, we can consider the behavioural scientist as dealing with models at a multiplicity of levels. The purpose of this Research Topic in Frontiers in Theoretical and Philosophical Psychology is to promote an approach to the role of the levels and explanation and models which is of interest for cognitive scientists, neuroscientists, psychologists, behavioural scientists, and philosophers of science. (shrink)

In this paper, I review the objections against the claim that brains are computers, or, to be precise, information-processing mechanisms. By showing that practically all the popular objections are either based on uncharitable interpretation of the claim, or simply wrong, I argue that the claim is likely to be true, relevant to contemporary cognitive (neuro)science, and non-trivial.

Neurological syndromes in which consciousness seems to malfunction, such as temporal lobe epilepsy, visual scotomas, Charles Bonnet syndrome, and synesthesia offer valuable clues about the normal functions of consciousness and ‘qualia’. An investigation into these syndromes reveals, we argue, that qualia are different from other brain states in that they possess three functional characteristics, which we state in the form of ‘three laws of qualia’. First, they are irrevocable: I cannot simply decide to start seeing the sunset as green, or (...) feel pain as if it were an itch; second, qualia do not always produce the same behaviour: given a set of qualia, we can choose from a potentially infinite set of possible behaviours to execute; and third, qualia endure in short-term memory, as opposed to non-conscious brain states involved in the on-line guidance of behaviour in real time. We suggest that qualia have evolved these and other attributes because of their role in facilitating non-automatic, decision-based action. We also suggest that the apparent epistemic barrier to knowing what qualia another person is experiencing can be overcome by using a ‘bridge’ of neurons; and we offer a hypothesis about the relation between qualia and one's sense of self. (shrink)

This project provides a detailed examination and critique of current philosophical, linguistic, and cognitive accounts of first language acquisition. In particular, I focus on the concept of "innate" and how it is embraced, marginally utilized, or abandoned altogether in efforts to describe the way that a child comes to be a competent user of a language. A central question that naturally falls out of this general inquiry is therefore what exactly is supposed to be "innate," according to various theories? Philosophically, (...) the theory of innate ideas put forth to explain human learning has existed for centuries and hence, this thesis as it relates to language is discussed. The revival of nativism by linguists like Chomsky is thus a central theme of the first chapter. Universal Grammar and the various arguments for it are closely scrutinized, and I close this chapter with what I take to be the commitments of linguistic nativism, how its proponents conceive of "innate," and several possible objections to the arguments they put forth. Just as the theory of innate ideas has had its contesters throughout the history of philosophy, so too have linguists and cognitive scientists rejected Universal Grammar and other forms of linguistic nativism. Thus, the second chapter presents several of these alternative explanations of language acquisition. Namely, I divide the chapter into three sections, Usage-Based Linguistics, Emergentism, and Sociolinguistic Acquisition, as it is my suggestion that most of the anti-UG attacks are levied from one of these three fields. In discussing the details of each, two distinctions become of particular concern: first, a large part of the differing conceptions of "innate" seem to hinge on what is meant by "learning" and "acquiring," and therefore second, a fine line between UBL and Emergentism can be drawn, a relationship that is otherwise conflated in the literature. Because chapter two involves a brief account of the way in which connectionist simulations are often utilized to model or represent language acquisition, particularly from an Emergentist perspective, chapter three begins by examining this feature of Emergentism in more detail. Due to its explanatory power, ability to be effectively modeled, and the evidentiary support found in neuroscience, Emergentism would appear to be the most tenable position to maintain regarding language acquisition. This possibility seems further strengthened when we take into account the neuroscientific data often used to bolster anti-nativist claims. Nevertheless, reflecting on the overarching concern of the project, regarding what is really meant by "innate," it is shown that this attack on nativism might stand on shakier ground than was originally assumed. Finally, based on these considerations, a case is made for an intermediary position, a theory of "Minimally Innate Ideas.". (shrink)