Recent progress in artificial intelligence has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video games, and board games, achieving performance that equals or even beats that of humans in some respects. Despite their biological inspiration and performance achievements, these systems differ from human intelligence in crucial ways. We review progress in cognitive science suggesting that truly human-like learning and thinking (...) machines will have to reach beyond current engineering trends in both what they learn and how they learn it. Specifically, we argue that these machines should build causal models of the world that support explanation and understanding, rather than merely solving pattern recognition problems; ground learning in intuitive theories of physics and psychology to support and enrich the knowledge that is learned; and harness compositionality and learning-to-learn to rapidly acquire and generalize knowledge to new tasks and situations. We suggest concrete challenges and promising routes toward these goals that can combine the strengths of recent neural network advances with more structured cognitive models. (shrink)

We were encouraged by the broad enthusiasm for building machines that learn and think in more human-like ways. Many commentators saw our set of key ingredients as helpful, but there was disagreement regarding the origin and structure of those ingredients. Our response covers three main dimensions of this disagreement: nature versus nurture, coherent theories versus theory fragments, and symbolic versus sub-symbolic representations. These dimensions align with classic debates in artificial intelligence and cognitive science, although, rather than embracing these debates, we (...) emphasize ways of moving beyond them. Several commentators saw our set of key ingredients as incomplete and offered a wide range of additions. We agree that these additional ingredients are important in the long run and discuss prospects for incorporating them. Finally, we consider some of the ethical questions raised regarding the research program as a whole. (shrink)

Weisberg (2006) and Godfrey-Smith (2006, 2009) distinguish between two forms of theorising: data-driven ‘abstract direct representation’ and modeling. The key difference is that when using a data-driven approach, theories are intended to represent specific phenomena, so directly represent them, while models may not be intended to represent anything, so represent targets indirectly, if at all. The aim here is to compare and analyse these practices, in order to outline an account of model-based theorising that involves direct representational relationships. This is (...) based on the way that computational templates Humphreys (2002, 2004) are now used in cognitive neuroscience, and draws on the dynamic and tentative process of any kind of theory construction, and the idea of partial, purpose-relative representation. (shrink)

Productivity—the hallmark of linguistic competence—is typically attributed to algebraic rules that support broad generalizations. Past research on spoken language has documented such generalizations in both adults and infants. But whether algebraic rules form part of the linguistic competence of signers remains unknown. To address this question, here we gauge the generalization afforded by American Sign Language (ASL). As a case study, we examine reduplication (X→XX)—a rule that, inter alia, generates ASL nouns from verbs. If signers encode this rule, then they (...) should freely extend it to novel syllables, including ones with features that are unattested in ASL. And since reduplicated disyllables are preferred in ASL, such rule should favor novel reduplicated signs. Novel reduplicated signs should thus be preferred to nonreduplicative controls (in rating), and consequently, such stimuli should also be harder to classify as nonsigns (in the lexical decision task). The results of four experiments support this prediction. These findings suggest that the phonological knowledge of signers includes powerful algebraic rules. The convergence between these conclusions and previous evidence for phonological rules in spoken language suggests that the architecture of the phonological mind is partly amodal. (shrink)

Neural plasticity has been invoked as a powerful argument against nativism. However, there is a line of argument, which is well exemplified by Pinker and more recently by Laurence and Margolis The conceptual mind: new directions in the study of concepts, MIT, Cambridge, 2015) with respect to concept nativism, according to which even extreme cases of plasticity show important innate constraints, so that one should rather speak of “constrained plasticity”. According to this view, cortical areas are not really equipotential, they (...) perform instead different kinds of computation, follow essentially different learning rules, or have a fixed internal structure acting as a filter for specific categories of inputs. We intend to analyze this argument, in the light of a review of current neuroscientific literature on plasticity. Our conclusion is that Laurence and Margolis are right in their appeal to innate constraints on connectivity—a thesis that is nowadays welcome to both nativists and non-nativists —but there is little support for their claim of further innate differentiation between and within cortical areas. As we will show, there is instead strong evidence that the cortex is characterized by the indefinite repetition of substantially identical computational units, giving rise in any of its portions to Hebbian, input-dependent plasticity. Although this is entirely compatible with the existence of innate constraints on the brain’s connectivity, the cerebral cortex architecture based on a multiplicity of maps correlating with one another has important computational consequences, a point that has been underestimated by traditional connectionist approaches. (shrink)

This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing (PDP), a two-volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary (...) developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes. (shrink)

Utility maximization is a key element of a number of theoretical approaches to explaining human behavior. Among these approaches are rational analysis, ideal observer theory, and signal detection theory. While some examples of these approaches define the utility maximization problem with little reference to the bounds imposed by the organism, others start with, and emphasize approaches in which bounds imposed by the information processing architecture are considered as an explicit part of the utility maximization problem. These latter approaches are the (...) topic of this issue of the journal. (shrink)

Brains, it has recently been argued, are essentially prediction machines. They are bundles of cells that support perception and action by constantly attempting to match incoming sensory inputs with top-down expectations or predictions. This is achieved using a hierarchical generative model that aims to minimize prediction error within a bidirectional cascade of cortical processing. Such accounts offer a unifying model of perception and action, illuminate the functional role of attention, and may neatly capture the special contribution of cortical processing to (...) adaptive success. This target article critically examines this approach, concluding that it offers the best clue yet to the shape of a unified science of mind and action. Sections 1 and 2 lay out the key elements and implications of the approach. Section 3 explores a variety of pitfalls and challenges, spanning the evidential, the methodological, and the more properly conceptual. The paper ends (sections 4 and 5) by asking how such approaches might impact our more general vision of mind, experience, and agency. (shrink)

Human participants and recurrent (“connectionist”) neural networks were both trained on a categorization system abstractly similar to natural language systems involving irregular (“strong”) classes and a default class. Both the humans and the networks exhibited staged learning and a generalization pattern reminiscent of the Elsewhere Condition (Kiparsky, 1973). Previous connectionist accounts of related phenomena have often been vague about the nature of the networks’ encoding systems. We analyzed our network using dynamical systems theory, revealing topological and geometric properties that can (...) be directly compared with the mechanisms of non-connectionist, rule-based accounts. The results reveal that the networks “contain” structures related to mechanisms posited by rule-based models, partly vindicating the insights of these models. On the other hand, they support the one mechanism (OM), as opposed to the more than one mechanism (MOM), view of symbolic abstraction by showing how the appearance of MOM behavior can arise emergently from one underlying set of principles. The key new contribution of this study is to show that dynamical systems theory can allow us to explicitly characterize the relationship between the two perspectives in implemented models. (shrink)

Cognitive science depends on abstractions made from the complex reality of human behaviour. Cognitive scientists typically wish the abstractions in their theories to be universals, but seldom attend to the ontology of universals. Two sorts of universal, resulting from Galilean abstraction and materialist abstraction respectively, are available in the philosophical literature: the abstract universal—the one-over-many universal—is the universal conventionally employed by cognitive scientists; in contrast, a concrete universal is a material entity that can appear within the set of entities it (...) describes, of which it represents the essential, paradigmatic case. The potential role of concrete universals in cognitive science is discussed. (shrink)

A U-shaped curve in a cognitive-developmental trajectory refers to a three-step process: good performance followed by bad performance followed by good performance once again. U-shaped curves have been observed in a wide variety of cognitive-developmental and learning contexts. U-shaped learning seems to contradict the idea that learning is a monotonic, cumulative process and thus constitutes a challenge for competing theories of cognitive development and learning. U-shaped behavior in language learning (in particular in learning English past tense) has become a central (...) topic in the Cognitive Science debate about learning models. Antagonist models (e.g., connectionism versus nativism) are often judged on their ability of modeling or accounting for U-shaped behavior. The prior literature is mostly occupied with explaining how U-shaped behavior occurs. Instead, we are interested in the necessity of this kind of apparently inefficient strategy. We present and discuss a body of results in the abstract mathematical setting of (extensions of) Gold-style computational learning theory addressing a mathematically precise version of the following question: Are there learning tasks that require U-shaped behavior? All notions considered are learning in the limit from positive data. We present results about the necessity of U-shaped learning in classical models of learning as well as in models with bounds on the memory of the learner. The pattern emerges that, for parameterized, cognitively relevant learning criteria, beyond very few initial parameter values, U-shapes are necessary for full learning power! We discuss the possible relevance of the above results for the Cognitive Science debate about learning models as well as directions for future research. (shrink)

In this paper we discuss the new Tweety puzzle. The original Tweety puzzle was addressed by approaches in non-monotonic logic, which aim to adequately represent the Tweety case, namely that Tweety is a penguin and, thus, an exceptional bird, which cannot fly, although in general birds can fly. The new Tweety puzzle is intended as a challenge for probabilistic theories of epistemic states. In the first part of the paper we argue against monistic Bayesians, who assume that epistemic states can (...) at any given time be adequately described by a single subjective probability function. We show that monistic Bayesians cannot provide an adequate solution to the new Tweety puzzle, because this requires one to refer to a frequency-based probability function. We conclude that monistic Bayesianism cannot be a fully adequate theory of epistemic states. In the second part we describe an empirical study, which provides support for the thesis that monistic Bayesianism is also inadequate as a descriptive theory of cognitive states. In the final part of the paper we criticize Bayesian approaches in cognitive science, insofar as their monistic tendency cannot adequately address the new Tweety puzzle. We, further, argue against monistic Bayesianism in cognitive science by means of a case study. In this case study we show that Oaksford and Chater’s (2007, 2008) model of conditional inference—contrary to the authors’ theoretical position—has to refer also to a frequency-based probability function. (shrink)

This paper argues that the cognitive neuroscientific use of ordinary mental terms to report research results and draw implications can contribute to public confusion and misunderstanding regarding neuroscience results. This concern is raised at a time when cognitive neuroscientists are increasingly required by funding agencies to link their research to specific results of public benefit, and when neuroethicists have called for greater attention to public communication of neuroscience. The paper identifies an ethical dimension to the problem and presses for greater (...) sensitivity and responsibility among neuroscientists regarding their use of such terms. (shrink)

This article explores some of the philosophical implications of the Bayesian modeling paradigm. In particular, it focuses on the ramifications of the fact that Bayesian models pre‐specify an inbuilt hypothesis space. To what extent does this pre‐specification correspond to simply ‘‘building the solution in''? I argue that any learner must have a built‐in hypothesis space in precisely the same sense that Bayesian models have one. This has implications for the nature of learning, Fodor's puzzle of concept acquisition, and the role (...) of modeling in cognitive science. (shrink)

In some areas of cognitive science we are confronted with ultrafast cognition, exquisite context sensitivity, and scale-free variation in measured cognitive activities. To move forward, we suggest a need to embrace this complexity, equipping cognitive science with tools and concepts used in the study of complex dynamical systems. The science of movement coordination has benefited already from this change, successfully circumventing analogous paradoxes by treating human activities as phenomena of self-organization. Therein, action and cognition are seen to be emergent in (...) ultrafast symmetry breaking across the brain and body; exquisitely constituted of the otherwise trivial details of history, context, and environment; and exhibiting the characteristic scale-free signature of self-organization. (shrink)

The question whether cognition is subserved by internal processes in the brain (internalism) or extends in to the world (active externalism) has been vigorously debated in recent years. I show how internalist and externalist ideas can be pursued in a common framework, using (1) open dynamical systems, which allow for separate analysis of an agent's intrinsic and embodied dynamics, and (2) supervenience functions, which can be used to study how low-level dynamical systems give rise to higher-level dynamical structures.

The study of human intelligence was once dominated by symbolic approaches, but over the last 30 years an alternative approach has arisen. Symbols and processes that operate on them are often seen today as approximate characterizations of the emergent consequences of sub- or nonsymbolic processes, and a wide range of constructs in cognitive science can be understood as emergents. These include representational constructs (units, structures, rules), architectural constructs (central executive, declarative memory), and developmental processes and outcomes (stages, sensitive periods, neurocognitive (...) modules, developmental disorders). The greatest achievements of human cognition may be largely emergent phenomena. It remains a challenge for the future to learn more about how these greatest achievements arise and to emulate them in artificial systems. (shrink)

The notion of domain specificity plays a central role in some of the most important debates in cognitive science. Yet, despite the widespread reliance on domain specificity in recent theorizing in cognitive science, this notion remains elusive. Critics have claimed that the notion of domain specificity can't bear the theoretical weight that has been put on it and that it should be abandoned. Even its most steadfast proponents have highlighted puzzles and tensions that arise once one tries to go beyond (...) an initial intuitive sketch of what domain specificity involves. In this paper, we address these concerns head on by developing an account of what it means for a cognitive mechanism to be domain specific that overcomes the obstacles that have made domain specificity seem so problematic. We then apply this understanding of domain specificity to one of the key debates that it has figured prominently in—the rationalism-empiricism debate concerning the origins of cognitive traits—and introduce several related theoretical notions that work alongside domain specificity in helping to clarify what makes a view more (or less) rationalist. This example illustrates how the notion of domain specificity can, and should, continue to play a central role in ongoing debates in cognitive science. (shrink)

Cognitive Science, Volume 46, Issue 8, August 2022.

Cognitive Science, Volume 46, Issue 3, March 2022.

How does the human brain link relational concepts to perceptual experience? For example, a speaker may say “the cup to the left of the computer” to direct the listener's attention to one of two cups on a desk. We provide a neural dynamic account for both perceptual grounding, in which relational concepts enable the attentional selection of objects in the visual array, and for the generation of descriptions of the visual array using relational concepts. In the model, activation in neural (...) populations evolves dynamically under the influence of both inputs and strong interaction as formalized in dynamic field theory. Relational concepts are modeled as patterns of connectivity to perceptual representations. These generalize across the visual array through active coordinate transforms that center the representation of target objects in potential reference objects. How the model perceptually grounds or generates relational descriptions is probed in 104 simulations that systematically vary the spatial and movement relations employed, the number of feature dimensions used, and the number of matching and nonmatching objects. We explain how sequences of decisions emerge from the time‐ and state‐continuous neural dynamics, how relational hypotheses are generated and either accepted or rejected, followed by the selection of new objects or the generation of new relational hypotheses. Its neural realism distinguishes the model from information processing accounts, its capacity to autonomously generate sequences of processing steps distinguishes it from deep neural network accounts. The model points toward a neural dynamic theory of higher cognition. (shrink)

Each of our theories of mental representation provides some insight into how the mind works. However, these insights often seem incompatible, as the debates between symbolic, dynamical, emergentist, sub-symbolic, and grounded approaches to cognition attest. Mental representations—whatever they are—must share many features with each of our theories of representation, and yet there are few hypotheses about how a synthesis could be possible. Here, I develop a theory of the underpinnings of symbolic cognition that shows how sub-symbolic dynamics may give rise (...) to higher-level cognitive representations of structures, systems of knowledge, and algorithmic processes. This theory implements a version of conceptual role semantics by positing an internal universal representation language in which learners may create mental models to capture dynamics they observe in the world. The theory formalizes one account of how truly novel conceptual content may arise, allowing us to explain how even elementary logical and computational operations may be learned from a more primitive basis. I provide an implementation that learns to represent a variety of structures, including logic, number, kinship trees, regular languages, context-free languages, domains of theories like magnetism, dominance hierarchies, list structures, quantification, and computational primitives like repetition, reversal, and recursion. This account is based on simple discrete dynamical processes that could be implemented in a variety of different physical or biological systems. In particular, I describe how the required dynamics can be directly implemented in a connectionist framework. The resulting theory provides an “assembly language” for cognition, where high-level theories of symbolic computation can be implemented in simple dynamics that themselves could be encoded in biologically plausible systems. (shrink)

By pointing to deep philosophical confusions endemic to cognitive science, Wittgenstein might seem an enemy of computational approaches. We agree that while Wittgenstein would reject the classicist’s symbols and rules approach, his observations align well with connectionist or neural network approaches. While many connectionisms that dominated the later twentieth century could fall prey to criticisms of biological, pedagogical, and linguistic implausibility, current connectionist approaches can resolve those problems in a Wittgenstein-friendly manner. We present the basics of a Vector Symbolic Architecture (...) formalism, inspired by Smolensky, and indicate how high-dimensional vectors can operate in a context-sensitive and object-independent manner in biologically plausible time scales, reflecting Wittgenstein’s notions of language-games and family resemblance; we show how “soft” symbols for such a formalism can be formed with plausible learning cycles using Sparse Distributed Memory, resolving disputes surrounding Wittgenstein’s private language argument; and show how connectionist networks can extrapolate meaningful patterns to solve problems, providing “ways to go on” without explicit rules, which indicates linguistic plausibility. Connectionism thus provides a systematicity and productivity that is more than a mere implementation of a classical approach, and provides Wittgenstein-friendly and Wittgenstein-illuminating models of mind and language for cognitive science. (shrink)

The dynamics of neural populations capture the laws of the mindThis paper focuses on the level of neural networks. Examining the case of recurrent neural networks, the paper argues that the dynamics of neural populations form a privileged level of explanation in cognitive science. According to Schöner, this level is privileged, because it enables cognitive scientists to discover the laws governing organisms’ cognition and behaviour.

In recent years, scientists have increasingly taken to investigate the predictive nature of cognition. We argue that prediction relies on abstraction, and thus theories of predictive cognition need an explicit theory of abstract representation. We propose such a theory of the abstract representational capacities that allow humans to transcend the “here-and-now.” Consistent with the predictive cognition literature, we suggest that the representational substrates of the mind are built as ahierarchy, ranging from the concrete to the abstract; however, we argue that (...) there are qualitative differences between elements along this hierarchy, generating meaningful, often unacknowledged,diversity.Echoing views from philosophy, we suggest that the representational hierarchy can be parsed into:modality-specificrepresentations, instantiated on perceptual similarity;multimodalrepresentations, instantiated primarily on the discovery of spatiotemporal contiguity; andcategoricalrepresentations, instantiated primarily on social interaction. These elements serve as the building blocks ofcomplex structures discussed in cognitive psychology (e.g., episodes, scripts) and are the inputs for mental representations that behave like functions, typically discussed in linguistics (i.e.,predicators). We support our argument for representational diversity by explaining how the elements in our ontology are all required to account for humans’ predictive cognition (e.g., in subserving logic-based prediction; in optimizing the trade-off between accurate and detailed predictions) and by examining how the neuroscientific evidence coheres with our account. In doing so, we provide a testable model of the neural bases of conceptual cognition and highlight several important implications to research on self-projection, reinforcement learning, and predictive-processing models of psychopathology. (shrink)

The rise of Bayesianism in cognitive science promises to shape the debate between nativists and empiricists into more productive forms—or so have claimed several philosophers and cognitive scientists. The present paper explicates this claim, distinguishing different ways of understanding it. After clarifying what is at stake in the controversy between nativists and empiricists, and what is involved in current Bayesian cognitive science, the paper argues that Bayesianism offers not a vindication of either nativism or empiricism, but one way to talk (...) precisely and transparently about the kinds of mechanisms and representations underlying the acquisition of psychological traits without a commitment to an innate language of thought. (shrink)

Theories of emotion have often maintained artificial boundaries: for instance, that cognition and emotion are separable, and that an emotion concept is separable from the emotional events that comprise its category (e.g. “fear” is distinct from instances of fear). Over the past several years, research has dissolved these artificial boundaries, suggesting instead that conceptual construction is a domain-general process—a process by which the brain makes meaning of the world. The brain constructs emotion concepts, but also cognitions and perceptions, all in (...) the service of guiding action. In this view, concepts are multimodal constructions, dynamically prepared from a set of highly variable instances. This approach obviates old questions (e.g. how does cognition regulate emotion?) but generates new ones (e.g. how does a brain learn emotion concepts?). In this paper, we review this constructionist, predictive coding account of emotion, considering its implications for health and well-being, culture and development. (shrink)

The contents and structure of semantic memory have been the focus of much recent research, with major advances in the development of distributional models, which use word co‐occurrence information as a window into the semantics of language. In parallel, connectionist modeling has extended our knowledge of the processes engaged in semantic activation. However, these two lines of investigation have rarely been brought together. Here, we describe a processing model based on distributional semantics in which activation spreads throughout a semantic network, (...) as dictated by the patterns of semantic similarity between words. We show that the activation profile of the network, measured at various time points, can successfully account for response times in lexical and semantic decision tasks, as well as for subjective concreteness and imageability ratings. We also show that the dynamics of the network is predictive of performance in relational semantic tasks, such as similarity/relatedness rating. Our results indicate that bringing together distributional semantic networks and spreading of activation provides a good fit to both automatic lexical processing (as indexed by lexical and semantic decisions) as well as more deliberate processing (as indexed by ratings), above and beyond what has been reported for previous models that take into account only similarity resulting from network structure. (shrink)

The rise of Bayesianism in cognitive science promises to shape the debate between nativists and empiricists into more productive forms—or so have claimed several philosophers and cognitive scientists. The present paper explicates this claim, distinguishing different ways of understanding it. After clarifying what is at stake in the controversy between nativists and empiricists, and what is involved in current Bayesian cognitive science, the paper argues that Bayesianism offers not a vindication of either nativism or empiricism, but one way to talk (...) precisely and transparently about the kinds of mechanisms and representations underlying the acquisition of psychological traits without a commitment to an innate language of thought. (shrink)

The aim of this paper is to demonstrate that the postulation of irreducible, distributed cognitive systems is necessary for the successful explanatory practice of cognitive science and sociology. Towards this end, and with an eye specifically on the phenomenon of distributed cognition, the debate over reductionism versus emergence is examined from the perspective of Dynamical Systems Theory. The motivation for this novel approach is threefold. Firstly, DST is particularly popular amongst cognitive scientists who work on modelling collective behaviors. Secondly, DST (...) can deliver two distinct arguments in support of the claim that the presence of mutual interactions between group members necessitates the postulation of the corresponding group entity. Thirdly, DST can also provide a succinct understanding of the way group entities exert downward causation on their individual members. The outcome is a naturalist account of the emergent, and thereby irreducible, nature of distributed cognitive systems that avoids the reductionists’ threat of epiphenomenalism, while being well in line with materialism. (shrink)

Two aspects of dynamic systems approaches that are pertinent to developmental models of reading are the emergence of a system with self-organizing characteristics, and its evolution over time to a stable state that is not easily modified or perturbed. The effects of dynamic stability may be seen in the differences obtained in the processing of print by beginner readers taught by different approaches to reading (phonics and text-centered), and more long-term effects on adults, consistent with these differences. However, there is (...) little direct evidence collected over time for the same participants. In this study, lexicalized (implicit) phonological processing, and explicit phonological and letter-sound skills are further examined in a precocious reader whose early development at 3 and 5 years has been extensively described (Cognition, 2000, 2004). At ages 10 and 14 years, comparisons were made with these earlier reports and skilled adult readers, using the same tasks for evidence of changes in reading processes. The results showed that along with an increase of reading accuracy and speed, her pattern of lexicalized phonological responses for reading did not change over time. Neither did her pattern of explicit phonological and letter-sound skills, aspects of which were inferior to her lexicalized phonological processing, and word reading. These results suggest dynamic stability of the word reading system. The early emergence of this system with minimal explicit skill development calls into question developmental reading theories that require such skills for learning to read. Currently, only the Knowledge Sources theory of reading acquisition can account for such findings. Consideration of these aspects of dynamic systems raise theoretical issues that could result in a paradigm shift with regard to best practice and intervention. (shrink)

This article introduces the Special Issue and its focus on research in language evolution with emphasis on theory as well as computational and robotic modeling. A key theme is based on the growth of evolutionary developmental biology or evo-devo. The Special Issue consists of 13 articles organized in two sections: A) Theoretical foundations and B) Modeling and simulation studies. All the papers are interdisciplinary in nature, encompassing work in biological and linguistic foundations for the study of language evolution as well (...) as a variety of computational and robotic modeling efforts shedding light on how language may be developed and may have evolved. (shrink)

In this paper I critically discuss and, in the end, reject Morgan’s Canon, a popular principle in comparative psychology. According to this principle we should always prefer explanations of animal behavior in terms of lower psychological processes over explanations in terms of higher psychological processes, when alternative explanations are possible. The validity of the principle depends on two things, a clear understanding of what it means for psychological processes to be higher or lower relative to each other and a justification (...) of a general preference for explanations that refer to lower psychological abilities. However, I argue that we cannot spell out the idea of a psychological scale in a way that claim is satisfied. I start with the discussion of different interpretations of the notion of a psychological scale. In Sect. 3, I discuss different possible strategies to justify any of those interpretations and argue that all of them fail. Finally, in Sect. 4, I generalize the argument for all possible interpretations of Morgan’s Canon and propose an alternative strategy: We should base our interpretations of animal behavior on more general principles such as evidential support and explanatory power, as followed in other scientific domains. (shrink)

Learning the structure of event sequences is a ubiquitous problem in cognition and particularly in language. One possible solution is to learn a probabilistic generative model of sequences that allows making predictions about upcoming events. Though appealing from a neurobiological standpoint, this approach is typically not pursued in connectionist modeling. Here, we investigated a sequential version of the restricted Boltzmann machine, a stochastic recurrent neural network that extracts high-order structure from sensory data through unsupervised generative learning and can encode contextual (...) information in the form of internal, distributed representations. We assessed whether this type of network can extract the orthographic structure of English monosyllables by learning a generative model of the letter sequences forming a word training corpus. We show that the network learned an accurate probabilistic model of English graphotactics, which can be used to make predictions about the letter following a given context as well as to autonomously generate high-quality pseudowords. The model was compared to an extended version of simple recurrent networks, augmented with a stochastic process that allows autonomous generation of sequences, and to non-connectionist probabilistic models. We conclude that sequential RBMs and stochastic simple recurrent networks are promising candidates for modeling cognition in the temporal domain. (shrink)

Marr's levels of analysis—computational, algorithmic, and implementation—have served cognitive science well over the last 30 years. But the recent increase in the popularity of the computational level raises a new challenge: How do we begin to relate models at different levels of analysis? We propose that it is possible to define levels of analysis that lie between the computational and the algorithmic, providing a way to build a bridge between computational- and algorithmic-level models. The key idea is to push the (...) notion of rationality, often used in defining computational-level models, deeper toward the algorithmic level. We offer a simple recipe for reverse-engineering the mind's cognitive strategies by deriving optimal algorithms for a series of increasingly more realistic abstract computational architectures, which we call “resource-rational analysis.”. (shrink)

Marr's seminal work laid out a program of research by specifying key questions for cognitive science at different levels of analysis. Because dynamic systems theory focuses on time and interdependence of components, DST research programs come to very different conclusions regarding the nature of cognitive change. We review a specific DST approach to cognitive-level processes: dynamic field theory. We review research applying DFT to several cognitive-level processes: object permanence, naming hierarchical categories, and inferring intent, that demonstrate the difference in understanding (...) of behavior and cognition that results from a DST perspective. These point to a central challenge for cognitive science research as defined by Marr—emergence. We argue that appreciating emergence raises questions about the utility of computational-level analyses and opens the door to insights concerning the origin of novel forms of behavior and thought. We contend this is one of the most fundamental questions about cognition and behavior. (shrink)

Rumelhart and McClelland's chapter about learning the past tense created a degree of controversy extraordinary even in the adversarial culture of modern science. It also stimulated a vast amount of research that advanced the understanding of the past tense, inflectional morphology in English and other languages, the nature of linguistic representations, relations between language and other phenomena such as reading and object recognition, the properties of artificial neural networks, and other topics. We examine the impact of the Rumelhart and McClelland (...) model with the benefit of 25 years of hindsight. It is not clear who “won” the debate. It is clear, however, that the core ideas that the model instantiated have been assimilated into many areas in the study of language, changing the focus of research from abstract characterizations of linguistic competence to an emphasis on the role of the statistical structure of language in acquisition and processing. (shrink)

Cognitive control has long been one of the most active areas of computational modeling work in cognitive science. The focus on computational models as a medium for specifying and developing theory predates the PDP books, and cognitive control was not one of the areas on which they focused. However, the framework they provided has injected work on cognitive control with new energy and new ideas. On the occasion of the books' anniversary, we review computational modeling in the study of cognitive (...) control, with a focus on the influence that the PDP approach has brought to bear in this area. Rather than providing a comprehensive review, we offer a framework for thinking about past and future modeling efforts in this domain. We define control in terms of the optimal parameterization of task processing. From this vantage point, the development of control systems in the brain can be seen as responding to the structure of naturalistic tasks, through the filter of the brain systems with which control directly interfaces. This perspective lays open a set of fascinating but difficult research questions, which together define an important frontier for future computational research. (shrink)