How can we think about things in the outside world? There is still no widely accepted theory of how mental representations get their meaning. In light of pioneering research, Nicholas Shea develops a naturalistic account of the nature of mental representation with a firm focus on the subpersonal representations that pervade the cognitive sciences.

Bayesian reverse-engineering is a research strategy for developing three-level explanations of behavior and cognition. Starting from a computational-level analysis of behavior and cognition as optimal probabilistic inference, Bayesian reverse-engineers apply numerous tweaks and heuristics to formulate testable hypotheses at the algorithmic and implementational levels. In so doing, they exploit recent technological advances in Bayesian artificial intelligence, machine learning, and statistics, but also consider established principles from cognitive psychology and neuroscience. Although these tweaks and heuristics are highly pragmatic in character and (...) are often deployed unsystematically, Bayesian reverse-engineering avoids several important worries that have been raised about the explanatory credentials of Bayesian cognitive science: the worry that the lower levels of analysis are being ignored altogether; the challenge that the mathematical models being developed are unfalsifiable; and the charge that the terms ‘optimal’ and ‘rational’ have lost their customary normative force. But while Bayesian reverse-engineering is therefore a viable and productive research strategy, it is also no fool-proof recipe for explanatory success. (shrink)

Mechanistic explanation has an impressive track record of advancing our understanding of complex, hierarchically organized physical systems, particularly biological and neural systems. But not every complex system can be understood mechanistically. Psychological capacities are often understood by providing cognitive models of the systems that underlie them. I argue that these models, while superficially similar to mechanistic models, in fact have a substantially more complex relation to the real underlying system. They are typically constructed using a range of techniques for abstracting (...) the functional properties of the system, which may not coincide with its mechanistic organization. I describe these techniques and show that despite being non-mechanistic, these cognitive models can satisfy the normative constraints on good explanations. (shrink)

Cognitive architectures are unified theories of cognition that take the form of computational formalisms. They support computational models that collectively account for large numbers of empirical regularities using small numbers of computational mechanisms. Empirical coverage and parsimony are the most prominent criteria by which architectures are designed and evaluated, but they are not the only ones. This paper considers three additional criteria that have been comparatively undertheorized. (a) Successful architectures possess subjective and intersubjective meaning, making cognition comprehensible to individual cognitive (...) scientists and organizing groups of like-minded cognitive scientists into genuine communities. (b) Successful architectures provide idioms that structure the design and interpretation of computational models. (c) Successful architectures are strange: They make provocative, often disturbing, and ultimately compelling claims about human information processing that demand evaluation. (shrink)

Human participants and recurrent (“connectionist”) neural networks were both trained on a categorization system abstractly similar to natural language systems involving irregular (“strong”) classes and a default class. Both the humans and the networks exhibited staged learning and a generalization pattern reminiscent of the Elsewhere Condition (Kiparsky, 1973). Previous connectionist accounts of related phenomena have often been vague about the nature of the networks’ encoding systems. We analyzed our network using dynamical systems theory, revealing topological and geometric properties that can (...) be directly compared with the mechanisms of non-connectionist, rule-based accounts. The results reveal that the networks “contain” structures related to mechanisms posited by rule-based models, partly vindicating the insights of these models. On the other hand, they support the one mechanism (OM), as opposed to the more than one mechanism (MOM), view of symbolic abstraction by showing how the appearance of MOM behavior can arise emergently from one underlying set of principles. The key new contribution of this study is to show that dynamical systems theory can allow us to explicitly characterize the relationship between the two perspectives in implemented models. (shrink)

Learning depends on attention. The processes that cue attention in the moment dynamically integrate learned regularities and immediate contextual cues. This paper reviews the extensive literature on cued attention and attentional learning in the adult literature and proposes that these fundamental processes are likely significant mechanisms of change in cognitive development. The value of this idea is illustrated using phenomena in children's novel word learning.

People are remarkably smart: They use language, possess complex motor skills, make nontrivial inferences, develop and use scientific theories, make laws, and adapt to complex dynamic environments. Much of this knowledge requires concepts and this study focuses on how people acquire concepts. It is argued that conceptual development progresses from simple perceptual grouping to highly abstract scientific concepts. This proposal of conceptual development has four parts. First, it is argued that categories in the world have different structure. Second, there might (...) be different learning systems that evolved to learn categories of differing structures. Third, these systems exhibit differential maturational course, which affects how categories of different structures are learned in the course of development. And finally, an interaction of these components may result in the developmental transition from perceptual groupings to more abstract concepts. This study reviews a large body of empirical evidence supporting this proposal. (shrink)

Words refer to objects in the world, but this correspondence is not one-to-one: Each word has a range of referents that share features on some dimensions but differ on others. This property of language is called underspecification. Parts of the lexicon have characteristic patterns of underspecification; for example, artifact nouns tend to specify shape, but not color, whereas substance nouns specify material but not shape. These regularities in the lexicon enable learners to generalize new words appropriately. How does the lexicon (...) come to have these helpful regularities? We test the hypothesis that systematic backgrounding of some dimensions during learning and use causes language to gradually change, over repeated episodes of transmission, to produce a lexicon with strong patterns of underspecification across these less salient dimensions. This offers a cultural evolutionary mechanism linking individual word learning and generalization to the origin of regularities in the lexicon that help learners generalize words appropriately. (shrink)

In this prcis we focus on phenomena central to the reaction against similarity-based theories that arose in the 1980s and that subsequently motivated the approach to semantic knowledge. Specifically, we consider (1) how concepts differentiate in early development, (2) why some groupings of items seem to form or coherent categories while others do not, (3) why different properties seem central or important to different concepts, (4) why children and adults sometimes attest to beliefs that seem to contradict their direct experience, (...) (5) how concepts reorganize between the ages of 4 and 10, and (6) the relationship between causal knowledge and semantic knowledge. The explanations our theory offers for these phenomena are illustrated with reference to a simple feed-forward connectionist model. The relationships between this simple model, the broader theory, and more general issues in cognitive science are discussed. (shrink)

Children improve at word learning during the 2nd year of life—sometimes dramatically. This fact has suggested a change in mechanism, from associative learning to a more referential form of learning. This article presents an associative exemplar-based model that accounts for the improvement without a change in mechanism. It provides a unified account of children's growing abilities to (a) learn a new word given only 1 or a few training trials (“fast mapping”); (b) acquire words that differ only slightly in phonological (...) form; (c) generalize word meanings preferentially along particular dimensions, such as object shape (the “shape bias”); and (d) learn 2nd labels for already-named objects, despite a persisting resistance to doing so (“mutual exclusivity”). The model explains these improvements in terms of increased attention to relevant aspects of form and meaning, which reduces memory interference. The interaction of associations and reference in word learning is discussed. (shrink)

This article addresses the ability of Parallel Distributed Processing (PDP) networks to generate stagewise cognitive development in accordance with Piaget's theory of cognitive epigenesis. We carried out a replication study of the simulation experiments by McClelland (1989) and McClelland and Jenkins (1991) in which a PDP network learns to solve balance scale problems. In objective tests motivated from catastrophe theory, a mathematical theory of transitions in epigenetical systems, no evidence for stage transitions in network performance was found. It is concluded (...) that PDP networks lack the ability to recover the positive outcomes of analogous catastrophe analyses of real cognitive developmental data. In an attempt to further characterize the learning behaviour of PDP networks, we carried out a second simulation study using the discrimination‐shift paradigm. The results thus obtained indicate that PDP learning is compatible with the learning of stimulus‐response relationships, not with the acquisition of mediating rules such as conceived in (neo‐)Piagetian theory. In closing, we speculate about the feasibility of simulating stagewise development with alternative network architectures. (shrink)

The distinction between rules and similarity is central to our understanding of much of cognitive psychology. Two aspects of existing research have motivated the present work. First, in different cognitive psychology areas we typically see different conceptions of rules and similarity; for example, rules in language appear to be of a different kind compared to rules in categorization. Second, rules processes are typically modeled as separate from similarity ones; for example, in a learning experiment, rules and similarity influences would be (...) described on the basis of separate models. In the present article, I assume that the rules versus similarity distinction can be understood in the same way in learning, reasoning, categorization, and language, and that a unified model for rules and similarity is appropriate. A rules process is considered to be a similarity one where only a single or a small subset of an object's properties are involved. Hence, rules and overall similarity operations are extremes in a single continuum of similarity operations. It is argued that this viewpoint allows adequate coverage of theory and empirical findings in learning, reasoning, categorization, and language, and also a reassessment of the objectives in research on rules versus similarity. Key Words: categorization; cognitive explanation; language; learning; reasoning; rules; similarity. (shrink)

Page's proposal to stipulate representations in which individual units correspond to meaningful entities is too unconstrained to support effective theorizing. An approach combining general computational principles with domain-specific assumptions, in which learning is used to discover representations that are effective in solving tasks, provides more insight into why cognitive and neural systems are organized the way they are.

Decades of psychological research have been aimed at modeling how people learn features and categories. The empirical validation of these theories is often based on artificial stimuli with simple representations. Recently, deep neural networks have reached or surpassed human accuracy on tasks such as identifying objects in natural images. These networks learn representations of real‐world stimuli that can potentially be leveraged to capture psychological representations. We find that state‐of‐the‐art object classification networks provide surprisingly accurate predictions of human similarity judgments for (...) natural images, but they fail to capture some of the structure represented by people. We show that a simple transformation that corrects these discrepancies can be obtained through convex optimization. We use the resulting representations to predict the difficulty of learning novel categories of natural images. Our results extend the scope of psychological experiments and computational modeling by enabling tractable use of large natural stimulus sets. (shrink)

Inductive generalization, where people go beyond the data provided, is a basic cognitive capability, and it underpins theoretical accounts of learning, categorization, and decision making. To complete the inductive leap needed for generalization, people must make a key ‘‘sampling’’ assumption about how the available data were generated. Previous models have considered two extreme possibilities, known as strong and weak sampling. In strong sampling, data are assumed to have been deliberately generated as positive examples of a concept, whereas in weak sampling, (...) data are assumed to have been generated without any restrictions. We develop a more general account of sampling that allows for an intermediate mixture of these two extremes, and we test its usefulness. In two experiments, we show that most people complete simple one-dimensional generalization tasks in a way that is consistent with their believing in some mixture of strong and weak sampling, but that there are large individual differences in the relative emphasis different people give to each type of sampling. We also show experimentally that the relative emphasis of the mixture is influenced by the structure of the available information. We discuss the psychological meaning of mixing strong and weak sampling, and possible extensions of our modeling approach to richer problems of inductive generalization. (shrink)

This article presents a process account of some typicality effects and related similarity-dependent accuracy and response time phenomena that arise in the context of supervised concept acquisition. We describe Symbolic Concept Acquisition (SCA), a computational system that acquires and activates category prediction rules. In contrast to gradient representations, SCA performs by probing for prediction rules in a series of discrete steps. For learning new rules, it acquires general rules but then incrementally learns more specific ones. In describing SCA, we emphasize (...) its functionality in terms of accuracy and efficiency and motivate its design within the set of symbolic mechanisms and memory structures defined by the Soar architecture (Laird, Newell & Rosenbloom, 1987). For replicating human behavior, we first show how SCA exhibits some typicality effects in the course of learning responding faster and more accurately to more typical test examples. Then, using data from human experiments, we evaluate SCA's qualitative predictions on accuracy and response time on individual dataset instances. We show how SCA's predictions correlate with human data across three experimental conditions concerning the effect of instruction on learning strategy. (shrink)

This paper presents a skill learning model CLARION. Different from existing models of mostly high-level skill learning that use a top-down approach (that is, turning declarative knowledge into procedural knowledge through practice), we adopt a bottom-up approach toward low-level skill learning, where procedural knowledge develops first and declarative knowledge develops later. Our model is formed by integrating connectionist, reinforcement, and symbolic learning methods to perform on-line reactive learning. It adopts a two-level dual-representation framework (Sun, 1995), with a combination of localist (...) and distributed representation. We compare the model with human data in a minefield navigation task, demonstrating some match between the model and human data in several respects. (shrink)

Three experiments with 88 college-aged participants explored how unlabeled experiences—learning episodes in which people encounter objects without information about their category membership—influence beliefs about category structure. Participants performed a simple one-dimensional categorization task in a brief supervised learning phase, then made a large number of unsupervised categorization decisions about new items. In all three experiments, the unsupervised experience altered participants’ implicit and explicit mental category boundaries, their explicit beliefs about the most representative members of each category, and even their memory (...) for the items encountered during the supervised learning phase. These changes were influenced by both the range and frequency distribution of the unlabeled stimuli: mental category boundaries shifted toward the middle of the range and toward the trough of the bimodal distribution of unlabeled items, whereas beliefs about the most representative category members shifted toward the modes of the unlabeled distribution. One consequence of this shift in representations is a false-consensus effect (Experiment 3) where participants, despite receiving very disparate training experiences, show strong agreement in judgments about representativeness and boundary location following unsupervised category judgments. (shrink)

PROBEX (PROBabilities from EXemplars), a model of probabilistic inference and probability judgment based on generic knowledge is presented. Its properties are that: (a) it provides an exemplar model satisfying bounded rationality; (b) it is a “lazy” algorithm that presumes no pre‐computed abstractions; (c) it implements a hybrid‐representation, similarity‐graded probability. We investigate the ecological rationality of PROBEX and find that it compares favorably with Take‐The‐Best and multiple regression (Gigerenzer, Todd, & the ABC Research Group, 1999). PROBEX is fitted to the point (...) estimates, decisions, and probability assessments by human participants. The best fit is obtained for a version that weights frequency heavily and retrieves only two exemplars. It is proposed that PROBEX implements speed and frugality in a psychologically plausible way. (shrink)

Theories of relational concept acquisition based on structured intersection discovery predict that relational concepts with a probabilistic structure ought to be extremely difficult to learn. We report four experiments testing this prediction by investigating conditions hypothesized to facilitate the learning of such categories. Experiment 1 showed that changing the task from a category-learning task to choosing the “winning” object in each stimulus greatly facilitated participants' ability to learn probabilistic relational categories. Experiments 2 and 3 further investigated the mechanisms underlying this (...) “who's winning” effect. Experiment 4 replicated and generalized the “who's winning” effect with more natural stimuli. Together, our findings suggest that people learn relational concepts by a process of intersection discovery akin to schema induction, and that any task that encourages people to discover a higher order relation that remains invariant over members of a category will facilitate the learning of putatively probabilistic relational concepts. (shrink)

Humans and many other species selectively attend to stimuli or stimulus dimensions—but why should an animal constrain information input in this way? To investigate the adaptive functions of attention, we used a genetic algorithm to evolve simple connectionist networks that had to make categorization decisions in a variety of environmental structures. The results of these simulations show that while learned attention is not universally adaptive, its benefit is not restricted to the reduction of input complexity in order to keep it (...) within an organism's processing capacity limitations. Instead, being able to shift attention provides adaptive benefit by allowing faster learning with fewer errors in a range of ecologically plausible environments. (shrink)

Languages are transmitted from person to person and generation to generation via a process of iterated learning: people learn a language from other people who once learned that language themselves. We analyze the consequences of iterated learning for learning algorithms based on the principles of Bayesian inference, assuming that learners compute a posterior distribution over languages by combining a prior (representing their inductive biases) with the evidence provided by linguistic data. We show that when learners sample languages from this posterior (...) distribution, iterated learning converges to a distribution over languages that is determined entirely by the prior. Under these conditions, iterated learning is a form of Gibbs sampling, a widely-used Markov chain Monte Carlo algorithm. The consequences of iterated learning are more complicated when learners choose the language with maximum posterior probability, being affected by both the prior of the learners and the amount of information transmitted between generations. We show that in this case, iterated learning corresponds to another statistical inference algorithm, a variant of the expectation-maximization (EM) algorithm. These results clarify the role of iterated learning in explanations of linguistic universals and provide a formal connection between constraints on language acquisition and the languages that come to be spoken, suggesting that information transmitted via iterated learning will ultimately come to mirror the minds of the learners. (shrink)

Most empirical work in human categorization has studied learning in either fully supervised or fully unsupervised scenarios. Most real-world learning scenarios, however, are semi-supervised: Learners receive a great deal of unlabeled information from the world, coupled with occasional experiences in which items are directly labeled by a knowledgeable source. A large body of work in machine learning has investigated how learning can exploit both labeled and unlabeled data provided to a learner. Using equivalences between models found in human categorization and (...) machine learning research, we explain how these semi-supervised techniques can be applied to human learning. A series of experiments are described which show that semi-supervised learning models prove useful for explaining human behavior when exposed to both labeled and unlabeled data. We then discuss some machine learning models that do not have familiar human categorization counterparts. Finally, we discuss some challenges yet to be addressed in the use of semi-supervised models for modeling human categorization. (shrink)

This paper deals with the problem of understanding semiosis and meaning in cognitive systems. To this aim we argue for a unified two-factor account according to which both external and internal information are non-independent aspects of meaning, thus contributing as a whole in determining its nature. To overcome the difficulties stemming from this approach we put forward a theoretical scheme based on the definition of a suitable representation space endowed with a set of transformations, and we show how it can (...) be implemented, in the case of a single agent, by a neural network architecture. Numerical experiments conducted on different instances of the latter show that similar representations are developed as a consequence of the fact that these instances are facing a similar semantic task. This allows to model social and environmental influences through a system of interacting agents, each described by a specific implementation of this model architecture. (shrink)

We apply the “wisdom of the crowd” idea to human category learning, using a simple approach that combines people's categorization decisions by taking the majority decision. We first show that the aggregated crowd category learning behavior found by this method performs well, learning categories more quickly than most or all individuals for 28 previously collected datasets. We then extend the approach so that it does not require people to categorize every stimulus. We do this using a model‐based method that predicts (...) the categorization behavior people would produce for new stimuli, based on their behavior with observed stimuli, and uses the majority of these predicted decisions. We demonstrate and evaluate the model‐based approach in two case studies. In the first, we use the general recognition theory decision‐bound model of categorization (Ashby & Townsend, ) to infer each person's decision boundary for two categories of perceptual stimuli, and we use these inferences to make aggregated predictions about new stimuli. In the second, we use the generalized context model exemplar model of categorization (Nosofsky, ) to infer each person's selective attention for face stimuli, and we use these inferences to make aggregated predictions about withheld stimuli. In both case studies, we show that our method successfully predicts the category of unobserved stimuli, and we emphasize that the aggregated crowd decisions arise from psychologically interpretable processes and parameters. We conclude by discussing extensions and potential real‐world applications of the approach. (shrink)

In Book I, Part I, Section VII of the Treatise, Hume sets out to settle, once and for all, the early modern controversy over abstract ideas. In order to do so, he tries to accomplish two tasks: (1) he attempts to defend an exemplar-based theory of general language and thought, and (2) he sets out to refute the rival abstraction-based account. This paper examines the successes and failures of these two projects. I argue that Hume manages to articulate a plausible (...) theory of general ideas; indeed, a version of his account has defenders in contemporary cognitive science. But Hume fails to refute the abstraction-based account, and as a result, the early modern controversy ends in a stalemate, with both sides able to explain how we manage to speak and think in general terms. Although Hume fails to settle the controversy, he nevertheless advances it to a point from which we have yet to progress: the contemporary debate over abstract ideas in cognitive science has stalled on precisely this point. (shrink)

Causal reasoning is one of our most central cognitive competencies, enabling us to adapt to our world. Causal knowledge allows us to predict future events, or diagnose the causes of observed facts. We plan actions and solve problems using knowledge about cause-effect relations. Without our ability to discover and empirically test causal theories, we would not have made progress in various empirical sciences. In the past decades, the important role of causal knowledge has been discovered in many areas of cognitive (...) psychology. Despite the ubiquity of causal reasoning, textbooks of cognitive psychology have neglected this growing field. The goal of The Oxford Handbook of Causal Reasoning is to fill this gap. The handbook brings together the leading researchers in the field of causal reasoning and offers state-of-the-art presentations of theories and research. It provides introductions of competing theories of causal reasoning, and discusses its role in various cognitive functions and domains. The final section presents research from neighboring fields. 1. Causal Reasoning: An Introduction Michael R. Waldmann Part I: Theories of Causal Cognition 2. Associative Accounts of Causal Cognition Mike E. Le Pelley, Oren Griffiths, and Tom Beesley 3. Rules of Causal Judgment: Mapping Statistical Information Onto Causal Beliefs José C. Perales, Andrés Catena, Antonio Cándido, and Antonio Maldonado 4. The Inferential Reasoning Theory of Causal Learning: Toward a Multi- Process Propositional Account Yannick Boddez, Jan De Houwer, and Tom Beckers 5. Causal Invariance as an Essential Constraint for Creating a Causal Representation of the World: Generalizing the Invariance of Causal Power Patricia W. Cheng and Hongjing Lu 6. The Acquisition and Use of Causal Structure Knowledge Benjamin Margolin Rottman 7. Formalizing Prior Knowledge in Causal Induction Thomas L. Griffiths 8. Causal Mechanisms Samuel G. B. Johnson and Woo-kyoung Ahn 9. Force Dynamics and Causation Phillip Wolff and Robert Thorstad 10. Mental Models and Causation P. N. Johnson- Laird and Sangeet S. Khemlani 11. Pseudocontingencies Klaus Fiedler and Florian Kutzner 12. Singular Causation David Danks 13. Cognitive Neuroscience of Causal Reasoning Joachim T. Operskalski and Aron K. Barbey Part II: Basic Cognitive Functions 14. Visual Impressions of Causality Peter White 15. Goal-Directed Actions Bernhard Hommel 16. Planning and Control Magda Osman 17. Reinforcement Learning and Causal Models Samuel J. Gershman 18. Causation and the Probability of Causal Conditionals David E. Over 19. Causal Models and Conditional Reasoning Mike Oaksford and Nick Chater 20. Concepts as Causal Models: Categorization Bob Rehder 21. Concepts as Causal Models: Induction Bob Rehder 22. Causal Explanation Tania Lombrozo and Nadya Vasilyeva 23. Diagnostic Reasoning Björn Meder and Ralf Mayrhofer 24. Inferring Causal Relations by Analogy Keith J. Holyoak and Hee-Seung Lee 25. Causal Argument Ulrike Hahn, Roland Bluhm, and Frank Zenker 26. Causality in Decision- Making York Hagmayer and Philip M. Fernbach Part III: Domains of Causal Reasoning 27. Intuitive Theories Tobias Gerstenberg and Joshua B. Tenenbaum 28. Space, Time, and Causality Marc J. Buehner 29. Causation in Legal and Moral Reasoning David A. Lagnado and Tobias Gerstenberg 30. The Role of Causal Knowledge in Reasoning About Mental Disorders Woo-kyoung Ahn, Nancy S. Kim, and Matthew S. Lebowitz 31. Causality and Causal Reasoning in Natural Language Torgrim Solstad and Oliver Bott 32. Social Attribution and Explanation Denis Hilton Part IV: Development, Phylogeny, and Culture 33. The Development of Causal Reasoning Paul Muentener and Elizabeth Bonawitz 34. Causal Reasoning in Non-Human Animals Christian Schloegl and Julia Fischer 35. Causal Cognition and Culture Andrea Bender, Sieghard Beller, and Douglas L. Medin. (shrink)