Purely parallel neural networks can model object recognition in brief displays – the same conditions under which illusory conjunctions have been demonstrated empirically. Correcting errors of illusory conjunction is the “tag-assignment” problem for a purely parallel processor: the problem of assigning a spatial tag to nonspatial features, feature combinations, and objects. This problem must be solved to model human object recognition over a longer time scale. Our model simulates both the parallel processes that may underlie illusory conjunctions and the serial (...) processes that may solve the tag-assignment problem in normal perception. One component of the model extracts pooled features and another provides attentional tags that correct illusory conjunctions. Our approach addresses two questions: How can objects be identified from simultaneously attended features in a parallel, distributed representation? How can the spatial selectional requirements of such an attentional process be met by a separation of pathways for spatial and nonspatial processing? Our analysis of these questions yields a neurally plausible simulation of tag assignment based on synchronizing feature processing activity in a spatial focus of attention. (shrink)

There is a vast literature within philosophy of mind that focuses on artificial intelligence, but hardly mentions methodological questions. There is also a growing body of work in philosophy of science about modeling methodology that hardly mentions examples from cognitive science. Here these discussions are connected. Insights developed in the philosophy of science literature about the importance of idealization provide a way of understanding the neural implausibility of connectionist networks. Insights from neurocognitive science illuminate how relevant similarities between models and (...) targets are picked out, how modeling inferences are justified, and the metaphysical status of models. (shrink)

The semantic automata framework, developed originally in the 1980s, provides computational interpretations of generalized quantifiers. While recent experimental results have associated structural features of these automata with neuroanatomical demands in processing sentences with quantifiers, the theoretical framework has remained largely unexplored. In this paper, after presenting some classic results on semantic automata in a modern style, we present the first application of semantic automata to polyadic quantification, exhibiting automata for iterated quantifiers. We also discuss the role of semantic automata in (...) linguistic theory and offer new empirical predictions for sentence processing with embedded quantifiers. (shrink)

The semantic automata framework, developed originally in the 1980s, provides computational interpretations of generalized quantifiers. While recent experimental results have associated structural features of these automata with neuroanatomical demands in processing sentences with quantifiers, the theoretical framework has remained largely unexplored. In this paper, after presenting some classic results on semantic automata in a modern style, we present the first application of semantic automata to polyadic quantification, exhibiting automata for iterated quantifiers. We also discuss the role of semantic automata in (...) linguistic theory and offer new empirical predictions for sentence processing with embedded quantifiers. (shrink)

Current artificial neural network or connectionist models of music cognition embody feature-extraction and feature-weighting principles. This paper reports two experiments which seek evidence for similar processes mediating recognition of short musical compositions by musically trained and untrained listeners. The experiments are cast within a pattern recognition framework based on the vision-audition analogue wherein music is considered an auditory pattern consisting of local and global features. Local features such as inter-note interval, and global features such as melodic contour, are derived from (...) a two-dimensional matrix in which music is represented as a series of frequencies plotted over time.Manipulation of inter-note interval affected accuracy and reaction time measures in a discrimination task, whereas the same variables were affected by manipulation of melodic contour in a classification task. Musical training is thought of as a form of practice in musical pattern recognition and, as predicted, accuracy and reaction time measures of musically trained subjects were significantly better than those of untrained subjects. Given the evidence for feature-extraction and weighting processes in music recognition tasks, two connectionist models are discussed. The first is a single-layer perceptron which has been trained to discriminate between compositions according to inter-note interval. A second network, using the back-propagation algorithm and sequential input of patterns, is also discussed. (shrink)

Gestalt theory is discussed as one main precursor of synergetics, one of the most elaborated theories of self-organization. It is a precursor for two reasons: the Gestalt theoretical view of cognitive order-formation comes dose to the central ideas of self-organization. Furthermore both approaches have stressed the significance of non-linear perceptual processes (such as multistability) for the solution of the mind-brain problem. The question of whether Gestalt theory preferred a dualistic or a monistic view of the mind-body relation is answered in (...) that there was a preference for dualism in epistemological questions and for monism in the mind-brain relation. The latter was attained by the concept of psychophysical isomorphism. This concept, although widely misunderstood in many respects, was criticized on the basis of neurobiological findings. One main objection was the neglect of the importance of the elementary neurophysiological processes. A distinction between macroscopic and microscopic brain processes seemed to be required. This idea was taken up in synergetics which postulates a bottom-up and top-down interaction between these two levels. Macroscopic order emerges from elementary brain processes and, at the same time, has a backward slaving effect to the microscopic level In the light of such holistic emergentism, the question whether macroscopic order states might be attractors for psychological meanings is discussed. (shrink)

In this article, I survey the integrated connectionist/symbolic (ICS) cognitive architecture in which higher cognition must be formally characterized on two levels of description. At the microlevel, parallel distributed processing (PDP) characterizes mental processing; this PDP system has special organization in virtue of which it can be characterized at the macrolevel as a kind of symbolic computational system. The symbolic system inherits certain properties from its PDP substrate; the symbolic functions computed constitute optimization of a well-formedness measure called Harmony. The (...) most important outgrowth of the ICS research program is optimality theory (Prince & Smolensky, 1993/2004), an optimization based grammatical theory that provides a formal theory of cross-linguistic typology. Linguistically, Harmony maximization corresponds to minimization of markedness or structural ill-formedness. Cognitive explanation in ICS requires the collaboration of symbolic and connectionist principles. ICS is developed in detail in Smolensky and Legendre (2006a); this article is a précis of and guide to those volumes. (shrink)

A number of theoretical positions in psychology—including variants of case‐based reasoning, instance‐based analogy, and connectionist models—maintain that abstract rules are not involved in human reasoning, or at best play a minor role. Other views hold that the use of abstract rules is a core aspect of human reasoning. We propose eight criteria for determining whether or not people use abstract rules in reasoning, and examine evidence relevant to each criterion for several rule systems. We argue that there is substantial evidence (...) that several different inferential rules, including modus ponens, contractual rules, causal rules, and the law of large numbers, are used in solving everyday problems. We discuss the implications for various theoretical positions and consider hybrid mechanisms that combine aspects of instance and rule models. (shrink)

Evidence is presented from a polyglot savant to suggest that double dissociations between linguistic and nonverbal abilities are more important than Müller's target article implies. It is also argued that the special nature of syntax makes its assimilation to other aspects of language or to nonhuman communication systems radically implausible.

Multiple explanatory frameworks may be required to provide an adequate account of human cognition. This paper embeds the classical account within a neural network framework, exploring the encoding of syntacticallystructured objects over the synchronicdiachronic characteristics of networks. Synchronic structure is defined in terms of temporal binding and the superposition of states. To accommodate asymmetric relations, synchronic structure is subject to the type uniqueness constraint. The nature of synchronic structure is shown to underlie Xbar theory that characterizes the phrasal structure of (...) human languages. The derivation differentiates core Xbar properties from languagespecific properties. (shrink)

Does connectionism spell doom for folk psychology? I examine the proposal that cognitive representational states such as beliefs can play no role if connectionist models - - interpreted as radical new cognitive theories -- take hold and replace other cognitive theories. Though I accept that connectionist theories are radical theories that shed light on cognition, I reject the conclusion that neural networks do not represent. Indeed, I argue that neural networks may actually give us a better working notion of cognitive (...) representational states such as beliefs, and in so doing give us a better understanding of how these states might be instantiated in neural wetware. (shrink)

Does connectionism spell doom for folk psychology? I examine the proposal that cognitive representational states such as beliefs can play no role if connectionist models—interpreted as radical new cognitive theories—take hold and replace other cognitive theories. Though I accept that connectionist theories are radical theories that shed light on cognition, I reject the conclusion that neural networks do not represent. Indeed, I argue that neural networks may actually give us a better working notion of cognitive representational states such as beliefs, (...) and in so doing give us a better understanding of how these states might be instantiated in neural wetware. (shrink)

Müller's review of the neuroscientific evidence undermines nativist claims for autonomous syntax and the argument from the poverty of the stimulus. Generativists will appeal to data from language acquisition, but here too there is growing evidence against the nativist position. Epigenetic naturalism, the developmental alternative to nativism, can be extended to epigenetic socionaturalism, acknowledging the importance of sociocultural processes in language and cognitive development.

A basic deep neural network (DNN) is trained to exhibit a large set of input–output dispositions. While being a good model of the way humans perform some tasks automatically, without deliberative reasoning, more is needed to approach human‐like artificial intelligence. Analysing recent additions brings to light a distinction between two fundamentally different styles of computation: content‐specific and non‐content‐specific computation (as first defined here). For example, deep episodic RL networks draw on both. So does human conceptual reasoning. Combining the two takes (...) advantage of the complementary costs and benefits of each. It also offers a better model of human cognitive competence. (shrink)

This paper advocates explicitness about the type of entity to be considered as content- bearing in connectionist systems; it makes a positive proposal about how vehicles of content should be individuated; and it deploys that proposal to argue in favour of representation in connectionist systems. The proposal is that the vehicles of content in some connectionist systems are clusters in the state space of a hidden layer. Attributing content to such vehicles is required to vindicate the standard explanation for some (...) classificatory networks’ ability to generalise to novel samples their correct classification of the samples on which they were trained. (shrink)

The view that the brain is a sort of computer has functioned as a theoretical guideline both in cognitive science and, more recently, in neuroscience. But since we can view every physical system as a computer, it has been less than clear what this view amounts to. By considering in some detail a seminal study in computational neuroscience, I first suggest that neuroscientists invoke the computational outlook to explain regularities that are formulated in terms of the information content of electrical (...) signals. I then indicate why computational theories have explanatory force with respect to these regularities:in a nutshell, they underscore correspondence relations between formal/mathematical properties of the electrical signals and formal/mathematical properties of the represented objects. I finally link my proposal to the philosophical thesis that content plays an essential role in computational taxonomy. (shrink)

Lange & Dyer misunderstand what is meant by an “entity” and confuse a medium of representation with the content being represented. This leads them to the erroneous conclusion that SHRUTI will run out of phases and that its representation of bindings lacks semantic content. It is argued that the limit on the number of phases suffices, and SHRUTI can be interpreted as using “dynamic signatures” that offer significant advantages over fixed preexisting signatures. Bonatti refers to three levels of commitment to (...) a representational theory of the mind and states that SHRUTI is committed to RTM at levels 1 and 2. He acknowledges that SHRUTI is not committed at level 3, but argues that an extended SHRUTI would have to make such a commitment. We agree that SHRUTI is committed to RTM at level 1 and, in a sense, also at level 2. SHRUTI, however, is not committed to RTM at level 3 and, even though it has been extended in several ways, it has retained its original representational character. (shrink)

Abstract A survey of different senses of the term ?representation? is presented. The presentation is guided by the appraisal that this key term is employed in the cognitive literature in different senses and that the distinction between these is not always explicitly stated or appreciated. Furthermore, the different senses seem to be associated with different rationales for the postulation of representation. Given that there may be a lack of convergence between the various senses of the construct in question and the (...) rationales for its postulation, a clear differentiation of these may be crucial for any evaluation of the role of representations in cognition and in cognitive theory. (shrink)

Human agents draw a variety of inferences effortlessly, spontaneously, and with remarkable efficiency – as though these inferences were a reflexive response of their cognitive apparatus. Furthermore, these inferences are drawn with reference to a large body of background knowledge. This remarkable human ability seems paradoxical given the complexity of reasoning reported by researchers in artificial intelligence. It also poses a challenge for cognitive science and computational neuroscience: How can a system of simple and slow neuronlike elements represent a large (...) body of systemic knowledge and perform a range of inferences with such speed? We describe a computational model that takes a step toward addressing the cognitive science challenge and resolving the artificial intelligence paradox. We show how a connectionist network can encode millions of facts and rules involving n-ary predicates and variables and perform a class of inferences in a few hundred milliseconds. Efficient reasoning requires the rapid representation and propagation of dynamic bindings. Our model (which we refer to as SHRUTI) achieves this by representing (1) dynamic bindings as the synchronous firing of appropriate nodes, (2) rules as interconnection patterns that direct the propagation of rhythmic activity, and (3) long-term facts as temporal pattern-matching subnetworks. The model is consistent with recent neurophysiological evidence that synchronous activity occurs in the brain and may play a representational role in neural information processing. The model also makes specific psychologically significant predictions about the nature of reflexive reasoning. It identifies constraints on the form of rules that may participate in such reasoning and relates the capacity of the working memory underlying reflexive reasoning to biological parameters such as the lowest frequency at which nodes can sustain synchronous oscillations and the coarseness of synchronization. (shrink)

In their critique of connectionist models Fodor and Pylyshyn (1988) dismiss such models as not being cognitive or psychological. Evaluating Fodor and Pylyshyn's critique requires examining what is required in characterizating models as 'cognitive'. The present discussion examines the various senses of this term. It argues the answer to the title question seems to vary with these different senses. Indeed, by one sense of the term, neither representa-tionalism nor connectionism is cognitive. General ramifications of such an appraisal are discussed and (...) alternative avenues for cognitive research are suggested. (shrink)