The synthetic position adopted by Müller is weakened by a large number of overinterpretations and misrepresentations, together with a caricatured view of innateness and modularity.

I present experimental and computational research, inspired by the perspective of Embodied Embedded Cognition, concerning various aspects of language as supporting Everett's interactionist view of language. Based on earlier and ongoing work, I briefly illustrate the contribution of the environment to the systematicity displayed in linguistic performance, the importance of joint attention for the development of a shared vocabulary, the role of (limited) traveling for language diversification, the function of perspective taking in social communication, and the bodily nature of understanding (...) of meaning. (shrink)

This paper investigates connectionism's potential to solve the frame problem. The frame problem arises in the context of modelling the human ability to see the relevant consequences of events in a situation. It has been claimed to be unsolvable for classical cognitive science, but easily manageable for connectionism. We will focus on a representational approach to the frame problem which advocates the use of intrinsic representations. We argue that although connectionism's distributed representations may look promising from this perspective, doubts can (...) be raised about the potential of distributed representations to allow large amounts of complexly structured information to be adequately encoded and processed. It is questionable whether connectionist models that are claimed to effectively represent structured information can be scaled up to a realistic extent. We conclude that the frame problem provides a difficulty to connectionism that is no less serious than the obstacle it constitutes for classical cognitive science. (shrink)

In trying to characterize the relationship between psychology and neuroscience, the trend has been to argue that reductionism does not work without suggesting a suitable substitute. I offer explanatory extension as a good model for elucidating the complex relationship among disciplines which are obviously connected but which do not share pragmatic explanatory features. Explanatory extension rests on the idea that one field can "illuminate" issues that were incompletely treated in another. In this paper, I explain how this "illumination" would work (...) between psychology and neuroscience. (shrink)

Performative Utterances: Seven Puzzles It was John Austin who introduced the word "performative" into the philosophy of language and linguistics. His original idea was that there are utterances which are more correctly characterized as doing something rather than stating something. Austin wrote: "when I say ‘I do’, I am not reporting on a marriage, I am indulging in it." As is well known, Austin went on to work out this notion of a performative utterance in a number of directions, but (...) in the end the attempt to isolate performatives from constatives failed dramatically, and the idea of viewing language use in terms of the performative-constative dichotomy gave way to the study of speech acts: "The total speech act in the total speech situation is the only actual phenomena which, in the last resort, we are engaged in elucidating." But giving up the performative-constative distinction does not mean giving up theorizing about performatives, and there is a cottage industry in the theory of language devoted to them. We identify seven puzzles for theorizing about performatives. We consider how Austin might have dealt with some of them. Finding his answers problematic, we then survey recent theories of performatives and zoom in on the major contenders, identifying one theory in particular for scrutiny and seeing how it fares with the seven puzzles. The upshot is that there is still work to be done understanding performatives. (shrink)

Computation is interpretable symbol manipulation. Symbols are objects that are manipulated on the basis of rules operating only on theirshapes, which are arbitrary in relation to what they can be interpreted as meaning. Even if one accepts the Church/Turing Thesis that computation is unique, universal and very near omnipotent, not everything is a computer, because not everything can be given a systematic interpretation; and certainly everything can''t be givenevery systematic interpretation. But even after computers and computation have been successfully distinguished (...) from other kinds of things, mental states will not just be the implementations of the right symbol systems, because of the symbol grounding problem: The interpretation of a symbol system is not intrinsic to the system; it is projected onto it by the interpreter. This is not true of our thoughts. We must accordingly be more than just computers. My guess is that the meanings of our symbols are grounded in the substrate of our robotic capacity to interact with that real world of objects, events and states of affairs that our symbols are systematically interpretable as being about. (shrink)

Working memory limits are best defined in terms of the complexity of the relations that can be processed in parallel. Complexity is defined as the number of related dimensions or sources of variation. A unary relation has one argument and one source of variation; its argument can be instantiated in only one way at a time. A binary relation has two arguments, two sources of variation, and two instantiations, and so on. Dimensionality is related to the number of chunks, because (...) both attributes on dimensions and chunks are independent units of information of arbitrary size. Studies of working memory limits suggest that there is a soft limit corresponding to the parallel processing of one quaternary relation. More complex concepts are processed by or In segmentation, tasks are broken into components that do not exceed processing capacity and can be processed serially. In conceptual chunking, representations are to reduce their dimensionality and hence their processing load, but at the cost of making some relational information inaccessible. Neural net models of relational representations show that relations with more arguments have a higher computational cost that coincides with experimental findings on higher processing loads in humans. Relational complexity is related to processing load in reasoning and sentence comprehension and can distinguish between the capacities of higher species. The complexity of relations processed by children increases with age. Implications for neural net models and theories of cognition and cognitive development are discussed. (shrink)

I discuss the philosophical implications that the rising new science of quantum computing may have on the philosophy of computer science. While quantum algorithms leave the notion of Turing-Computability intact, they may re-describe the abstract space of computational complexity theory hence militate against the autonomous character of some of the concepts and categories of computer science.

Fodor's and Pylyshyn's stand on systematicity in thought and language has been debated and criticized. Van Gelder and Niklasson, among others, have argued that Fodor and Pylyshyn offer no precise definition of systematicity. However, our concern here is with a learning based formulation of that concept. In particular, Hadley has proposed that a network exhibits strong semantic systematicity when, as a result of training, it can assign appropriate meaning representations to novel sentences (both simple and embedded) which contain words in (...) syntactic positions they did not occupy during training. The experience of researchers indicates that strong systematicity in any form is difficult to achieve in connectionist systems.Herein we describe a network which displays strong semantic systematicity in response to Hebbian, connectionist training. During training, two-thirds of all nouns are presented only in a single syntactic position (either as grammatical subject or object). Yet, during testing, the network correctly interprets thousands of sentences containing those nouns in novel positions. In addition, the network generalizes to novel levels of embedding. Successful training requires a, corpus of about 1000 sentences, and network training is quite rapid. The architecture and learning algorithms are purely connectionist, but classical insights are discernible in one respect, viz, that complex semantic representations spatially contain their semantic constituents. However, in other important respects, the architecture is distinctly non-classical. (shrink)

Fodor's and Pylyshyn's stand on systematicity in thought and language has been debated and criticized. Van Gelder and Niklasson, among others, have argued that Fodor and Pylyshyn offer no precise definition of systematicity. However, our concern here is with a learning based formulation of that concept. In particular, Hadley has proposed that a network exhibits strong semantic systematicity when, as a result of training, it can assign appropriate meaning representations to novel sentences (both simple and embedded) which contain words in (...) syntactic positions they did not occupy during training. The experience of researchers indicates that strong systematicity in any form is difficult to achieve in connectionist systems.Herein we describe a network which displays strong semantic systematicity in response to Hebbian, connectionist training. During training, two-thirds of all nouns are presented only in a single syntactic position (either as grammatical subject or object). Yet, during testing, the network correctly interprets thousands of sentences containing those nouns in novel positions. In addition, the network generalizes to novel levels of embedding. Successful training requires a, corpus of about 1000 sentences, and network training is quite rapid. The architecture and learning algorithms are purely connectionist, but ‘classical’ insights are discernible in one respect, viz, that complex semantic representations spatially contain their semantic constituents. However, in other important respects, the architecture is distinctly non-classical. (shrink)

The past decade has witnessed the emergence of a novel stance on semantic representation, and its relationship to context sensitivity. Connectionist-minded philosophers, including Clark and van Gelder, have espoused the merits of viewing hidden-layer, context-sensitive representations as possessing semantic content, where this content is partially revealed via the representations'' position in vector space. In recent work, Bodén and Niklasson have incorporated a variant of this view of semantics within their conception of semantic systematicity. Moreover, Bodén and Niklasson contend that they (...) have produced experimental results which not only satisfy a kind of context-based, semantic systematicity, but which, to the degree that reality permits, effectively deals with challenges posed by Fodor and Pylyshyn (1988), and Hadley (1994a). The latter challenge involved well-defined criteria for strong semantic systematicity. This paper examines the relevant claims and experiments of Bodén and Niklasson. It is argued that their case fatally involves two fallacies of equivocation; one concerning ''semantic content'' and the other concerning ''novel test sentences''. In addition, it is argued that their ultimate construal of context sensitive semantics contains serious confusions. These confusions are also found in certain publications dealing with "latent semantic analysis". Thus, criticisms presented here have relevance beyond the work of Bodén and Niklasson. (shrink)

In his discussion of results which I (with Michael Hayward) recently reported in this journal, Kenneth Aizawa takes issue with two of our conclusions, which are: (a) that our connectionist model provides a basis for explaining systematicity “within the realm of sentence comprehension, and subject to a limited range of syntax” (b) that the model does not employ structure-sensitive processing, and that this is clearly true in the early stages of the network's training. Ultimately, Aizawa rejects both (a) and (b) (...) for reasons which I think are ill-founded. In what follows, I offer a defense of our position. In particular, I argue (1) that Aizawa adopts a standard of explanation that many accepted scientific explanations could not meet, and (2) that Aizawa misconstrues the relevant meaning of ‘structure-sensitive process’. (shrink)

In their provocative 1988 paper, Fodor and Pylyshyn issued a formidable challenge to connectionists, i.e. to provide a non‐classical explanation of the empirical phenomenon of systematicity in cognitive agents. Since the appearance of F&P's challenge, a number of connectionist systems have emerged which prima facie meet this challenge. However, Fodor and McLaughlin (1990) advance an argument, based upon a general principle of nomological necessity, to show that one of these systems (Smolensky's) could not satisfy the Fodor‐Pylyshyn challenge. Yet, if Fodor (...) and McLaughlin's analysis is correct, it is doubtful whether any existing connectionist system would fare better than Smolensky's. In the view of Fodor and McLaughlin, humans and classical architectures display systematicity as a matter of nomological necessity (necessity by virtue of natural law), but connectionist architectures do not. However, I argue that the Fodor‐Pylyshyn‐McLaughlin appeal to nomological necessity is untenable. There is a sense in which neither classical nor connectionist architectures possess nomological (or‘nomic’) necessity. However, the sense in which classical architectures do possess nomic necessity applies equally well to at least some connectionist architectures. Representational constituents can have causal efficacy within both classical and connectionist architectures. (shrink)

In their provocative 1988 paper, Fodor and Pylyshyn issued a formidable challenge to connectionists, i.e. to provide a non‐classical explanation of the empirical phenomenon of systematicity in cognitive agents. Since the appearance of F&P's challenge, a number of connectionist systems have emerged which prima facie meet this challenge. However, Fodor and McLaughlin (1990) advance an argument, based upon a general principle of nomological necessity, to show that one of these systems (Smolensky's) could not satisfy the Fodor‐Pylyshyn challenge. Yet, if Fodor (...) and McLaughlin's analysis is correct, it is doubtful whether any existing connectionist system would fare better than Smolensky's. In the view of Fodor and McLaughlin, humans and classical architectures display systematicity as a matter of nomological necessity (necessity by virtue of natural law), but connectionist architectures do not. However, I argue that the Fodor‐Pylyshyn‐McLaughlin appeal to nomological necessity is untenable. There is a sense in which neither classical nor connectionist architectures possess nomological (or‘nomic’) necessity. However, the sense in which classical architectures do possess nomic necessity applies equally well to at least some connectionist architectures. Representational constituents can have causal efficacy within both classical and connectionist architectures. (shrink)

In the late 1980s, there were many who heralded the emergence of connectionism as a new paradigm – one which would eventually displace the classically symbolic methods then dominant in AI and Cognitive Science. At present, there remain influential connectionists who continue to defend connectionism as a more realistic paradigm for modeling cognition, at all levels of abstraction, than the classical methods of AI. Not infrequently, one encounters arguments along these lines: given what we know about neurophysiology, it is just (...) not plausible to suppose that our brains are digital computers. Thus, they could not support a classical architecture. I argue here for a middle ground between connectionism and classicism. I assume, for argument's sake, that some form(s) of connectionism can provide reasonably approximate models – at least for lower-level cognitive processes. Given this assumption, I argue on theoretical and empirical grounds that most human mental skills must reside in separate connectionist modules or sub-networks. Ultimately, it is argued that the basic tenets of connectionism, in conjunction with the fact that humans often employ novel combinations of skill modules in rule following and problem solving, lead to the plausible conclusion that, in certain domains, high level cognition requires some form of classical architecture. During the course of argument, it emerges that only an architecture with classical structure could support the novel patterns of information flow and interaction that would exist among the relevant set of modules. Such a classical architecture might very well reside in the abstract levels of a hybrid system whose lower-level modules are purely connectionist. (shrink)

At present, the prevailing Connectionist methodology forrepresenting rules is toimplicitly embody rules in neurally-wired networks. That is, the methodology adopts the stance that rules must either be hard-wired or trained into neural structures, rather than represented via explicit symbolic structures. Even recent attempts to implementproduction systems within connectionist networks have assumed that condition-action rules (or rule schema) are to be embodied in thestructure of individual networks. Such networks must be grown or trained over a significant span of time. However, arguments (...) are presented herein that humanssometimes follow rules which arevery rapidly assignedexplicit internal representations, and that humans possessgeneral mechanisms capable of interpreting and following such rules. In particular, arguments are presented that thespeed with which humans are able to follow rules ofnovel structure demonstrates the existence of general-purpose rule following mechanisms. It is further argued that the existence of general-purpose rule following mechanisms strongly indicates that explicit rule following is not anisolated phenomenon, but may well be a common and important aspect of cognition. The relationship of the foregoing conclusions to Smolensky''s view of explicit rule following is also explored. The arguments presented here are pragmatic in nature, and are contrasted with thekind of arguments developed by Fodor and Pylyshyn in their recent, influential paper. (shrink)

Representations seem to play a major role in many neuroscientific explanations. Philosophers have long attempted to properly define what it means for a neural state to be a representation of a specific content. Teleosemantic theories of content which characterize representations, in part, by appealing to a historical notion of function, are often regarded as our best path towards an account of neural representations. This paper points to the anti-representationalist consequences of these accounts. I argue that assuming such teleosemantic views will (...) deprive representations of their explanatory role in computational explanations. My argument rests on the claim that many explanations in cognitive neuroscience are entirely independent of any historical considerations. In making this claim, I will also offer an adapted version of the famous Swampperson thought experiment, which is better suited to discussions of subpersonal neural representations. (shrink)

This paper responds to criticisms levelled by Fodor, Pylyshyn, and McLaughlin against connectionism. Specifically, I will rebut the charge that connectionists cannot account for representational systematicity without implementing a classical architecture. This will be accomplished by drawing on Paul Smolensky's Tensor Product model of representation and on his insights about split-level architectures.

This chapter contains sections titled: Introduction Historical Background: Behaviorism and the Cognitive Revolution Current Topics Future Directions.

The conclusion that language is not really innate or modular is based on several fallacies. I show that the target article confuses communicative skills with linguistic abilities, and that its discussion of brain/language relations is replete with factual errors. I also criticize its attempt to contrast biological and linguistic principles. Finally, I argue that no case is made for the “alternative” approach proposed here.

To understand schizophrenia, a linking hypothesis is needed that shows how brain mechanisms lead to behavioral functions in normals, and also how breakdowns in these mechanisms lead to behavioral symptoms of schizophrenia. Such a linking hypothesis is now available that complements the discussion offered by Phillips & Silverstein (P&S).

The target article demonstrates how neurocognitive modellers should not be intimidated by challenges such as Jackendoff's and should explore neurally plausible implementations of linguistic constructs. The next step is to take seriously insights offlered by neuroscience, including the robustness allowed by analogue computation with distributed representations and the power of attractor dynamics in turning analogue into nearly discrete operations.

The problem of epistemic opacity in Artificial Intelligence is often characterised as a problem of intransparent algorithms that give rise to intransparent models. However, the degrees of transparency of an AI model should not be taken as an absolute measure of the properties of its algorithms but of the model’s degree of intelligibility to human users. Its epistemically relevant elements are to be specified on various levels above and beyond the computational one. In order to elucidate this claim, I first (...) contrast computer models and their claims to algorithm-based universality with cybernetics-style analogue models and their claims to structural isomorphism between elements of model and target system. While analogue models aim at perceptually or conceptually accessible model-target relations, computer models give rise to a specific kind of underdetermination in these relations that needs to be addressed in specific ways. I then undertake a comparison between two contemporary AI approaches that, although related, distinctly align with the above modelling paradigms and represent distinct strategies towards model intelligibility: Deep Neural Networks and Predictive Processing. I conclude that their respective degrees of epistemic transparency primarily depend on the underlying purposes of modelling, not on their computational properties. (shrink)

In this paper it is argued that we would not be logically obliged or rationally inclined to reject the ontology of contentful psychological states postulated by folk psychology even if the explanations advanced by folk psychology turned out to be generally inaccurate or inadequate. Moreover, it is argued that eliminativists such as Paul Churchland do not establish that folk psychological explanations are, or are likely to prove, generally inaccurate or inadequate. Most of Churchland's arguments—based upon developments within connectionist neuroscience—only cast (...) doubt upon the adequacy of 'sentential' theories of cognitive processing, not upon scientifically developed forms of folk psychological explanation of behavior, such as those offered by contemporary social psychology. Finally, it is noted that Churchland's brand of eliminativism rests upon a crude reductive criterion of theoretical adequacy that has little to recommend it, and suggested that the recognized theoretical limitations of contemporary social psychology may be precisely due to its historical commitment to this reductive criterion. (shrink)

Müller attempts to downplay cases of dissociation between language and cognition as evidence against the modularity of language. We review cases of associations between verbal and nonverbal abilities as further evidence against the notion of language as an autonomous subsystem. We also point out a discrepancy between his proposal of homologies between nonhuman primates' communication and human language and recent proposals on the evolution of language.

A model is presented that addresses both the distribution and comprehension of different forms of referring expressions in language. This model is expressed in a formalism (Kamp & Reyle, 1993) that uses interpretive rules to map syntactic representations onto representations of discourse. Basic interpretive rules are developed for names, pronouns, definite descriptions, and quantified descriptions. These rules are triggered by syntactic input and interact dynamically with representations of discourse to establish reference and coreference. This interaction determines the ease with which (...) coreference can be established for different linguistic forms given the existing discourse context. The performance of the model approximates that observed in studies of intuitive judgments of grammaticality and studies using online measures of language comprehension. The model uses the same basic interpretive mechanisms for coreference within and between sentences, thereby linking the domain traditionally studied by generative linguists to domains that have been of concern primarily to psychologists and computational linguists. (shrink)

Müller argues that general cognitive skills and linguistic skills are not necessarily independent. However, cross-linguistic evidence from an inherited specific language disorder affecting productive rules suggests significant degrees of modularity, innateness, and universality of language. Confident claims about the overall nature of such a complex system still await more interdisciplinary research.

The Phillips & Silverstein model of NMDA-mediated coordination deficits provides a useful heuristic for the study of schizophrenic cognition. However, the model does not specifically account for the development of schizophrenia-spectrum disorders. The P&S model is compared to Meehl's seminal model of schizotaxia, schizotypy, and schizophrenia, as well as the model of schizophrenic cognitive dysfunction posited by McCarley and colleagues.

We develop an analysis of the notion of mental representation, in the domain of visual perception, from a Cognitive Science perspective. Emphasis is given on a Connectionist view, according to which mental representations are emergent properties of the interaction between brain-like systems and structured light in the environment. We suggest that such a notion of mental representation indicates a way out of an ancient dispute between Representationalism and Eliminativism regarding the existence of mental representation in the human perceptual system.We develop (...) an analysis of the notion of mental representation, in the domain of visual perception, from a Cognitive Science perspective. Emphasis is given on a Connectionist view, according to which mental representations are emergent properties of the interaction between brain-like systems and structured light in the environment. We suggest that such a notion of mental representation indicates a way out of an ancient dispute between Representationalism and Eliminativism regarding the existence of mental representation in the human perceptual system.Investigaremos, a partir da perspectiva da Ciência Cognitiva, a noção de representação mental, no domínio da percepção visual humana. Ênfase é dada ao paradigma Conexionista, ou de Redes Neurais, de acordo com o qual tais representações mentais são descritas como estruturas emergentes da interação entre sistemas de processamento de informação que se auto-organizam - tais como o cérebro - e a luz estruturada no meio ambiente. Sugerimos que essa noção de representação mental indica uma solução para uma antiga polêmica, entre Representacionalistas e Eliminativistas, acerca da existência de representações mentais no sistema perceptual humano. (shrink)

The “systematicity argument” has been used to argue for a classical cognitive architecture (Fodor in The Language of Thought. Harvester Press, London, 1975, Why there still has to be a language of thought? In Psychosemantics, appendix. MIT Press, Cambridge, pp 135–154, 1987; Fodor and Pylyshyn in Cognition 28:3–71, 1988; Aizawa in The systematicity arguments. Kluwer Academic Press, Dordrecht, 2003). From the premises that cognition is systematic and that the best/only explanation of systematicity is compositional structure, it concludes that cognition is (...) to be explained in terms of symbols (in a language of thought) and formal rules. The debate, with connectionism, has mostly centered on the second premise-whether an explanation of systematicity requires compositional structure, which neural networks do not to exhibit (for example, Hadley and Hayward, in Minds and Machines, 7:1–37). In this paper, I will take issue with the first premise. Several arguments will be deployed that show that cognition is not systematic in general; that, in fact, systematicity seems to be related to language. I will argue that it is just verbal minds that are systematic, and they are so because of the structuring role of language in cognition. A dual-process theory of cognition will be defended as the best explanation of the facts. (shrink)