To function well in an unpredictable environment using unreliable components, a system must have a high degree of robustness. Robustness is fundamental to biological systems and is an objective in the design of engineered systems such as airplane engines and buildings. Cognitive systems, like biological and engineered systems, exist within variable environments. This raises the question, how do cognitive systems achieve similarly high degrees of robustness? The aim of this study was to identify a set of mechanisms that enhance robustness (...) in cognitive systems. We identify three mechanisms that enhance robustness in biological and engineered systems: system control, redundancy, and adaptability. After surveying the psychological literature for evidence of these mechanisms, we provide simulations illustrating how each contributes to robust cognition in a different psychological domain: psychomotor vigilance, semantic memory, and strategy selection. These simulations highlight features of a mathematical approach for quantifying robustness, and they provide concrete examples of mechanisms for robust cognition. (shrink)

Mental representations have continuous as well as discrete, combinatorial properties. For example, while predominantly discrete, phonological representations also vary continuously; this is reflected by gradient effects in instrumental studies of speech production. Can an integrated theoretical framework address both aspects of structure? The framework we introduce here, Gradient Symbol Processing, characterizes the emergence of grammatical macrostructure from the Parallel Distributed Processing microstructure (McClelland, Rumelhart, & The PDP Research Group, 1986) of language processing. The mental representations that emerge, Distributed Symbol Systems, (...) have both combinatorial and gradient structure. They are processed through Subsymbolic Optimization–Quantization, in which an optimization process favoring representations that satisfy well-formedness constraints operates in parallel with a distributed quantization process favoring discrete symbolic structures. We apply a particular instantiation of this framework, λ-Diffusion Theory, to phonological production. Simulations of the resulting model suggest that Gradient Symbol Processing offers a way to unify accounts of grammatical competence with both discrete and continuous patterns in language performance. (shrink)

Jaegwon Kim has developed an argument that interactionist dualists cannot account for the causal relations between minds and brains. This paper develops a closely related argument that focuses instead on the causal relations between minds and neurons. While there are several promising responses to Kim’s argument, their plausibility relies on a relatively simple understanding of mind–brain relations. Once we shift our focus to neurons, these responses lose their appeal. The problem is that even if mind–brain causal pairing can be explained (...) at no great theoretical cost, the complex interactions non-physical minds would need to have with neurons cannot. (shrink)

One of the central debates in cognitive science is the dispute over the role of representation in cognition: on computational/representational accounts, representations are theoretically central; on dynamic systems approaches in which cognition is investigated as a particular sort of physical process, representations play either no role, or, at best, a derivative one. But these two perspectives lead to a deeply unsatisfying theoretical divide: accounts situated in the representational camp are plagued by the inscrutable problem of intentionality, while those hedging towards (...) anti-representationalism seem incapable of saying anything theoretically interesting about high-level cognition. This unhelpful polarization is due in part, at least, to a muddy debate; while some take representationalism to be a commitment to the necessity of conceptual representations for cognition, representations the having of which require certain conceptual capacities, others do not. Recently, there has been a surge of work on non-conceptual representation. This article aims to add to this movement by suggesting a particular cognitive mechanism for non-conceptual representations, one that plays a pivotal role in making conceptual representations possible. One of the central consequences of this new view of representation is the possibility of a non-question-begging naturalistic account of intentionality. (shrink)

The debate between the amodal and the grounded views of cognition seems to be stuck. Their only substantial disagreement is about the vehicle or format of concepts. Amodal theorists reject the grounded claim that concepts are couched in the same modality-specific format as representations in sensory systems. The problem is that there is no clear characterization of format or its neural correlate. In order to make the disagreement empirically meaningful and move forward in the discussion we need a neurocognitive criterion (...) for representational format. I argue that efficient coding models in computational neuroscience can be used to characterize modal codes: These are codes which satisfy special informational demands imposed by sensory tasks. Additionally, I examine recent studies on neural coding and argue that although they do not provide conclusive evidence for either the grounded or the amodal views, they can be used to determine what predictions these approaches can make and what experimental and theoretical developments would be required to settle the debate. (shrink)

In a seminal 1977 article, Rumelhart argued that perception required the simultaneous use of multiple sources of information, allowing perceivers to optimally interpret sensory information at many levels of representation in real time as information arrives. Building on Rumelhart's arguments, we present the Interactive Activation hypothesis—the idea that the mechanism used in perception and comprehension to achieve these feats exploits an interactive activation process implemented through the bidirectional propagation of activation among simple processing units. We then examine the interactive activation (...) model of letter and word perception and the TRACE model of speech perception, as early attempts to explore this hypothesis, and review the experimental evidence relevant to their assumptions and predictions. We consider how well these models address the computational challenge posed by the problem of perception, and we consider how consistent they are with evidence from behavioral experiments. We examine empirical and theoretical controversies surrounding the idea of interactive processing, including a controversy that swirls around the relationship between interactive computation and optimal Bayesian inference. Some of the implementation details of early versions of interactive activation models caused deviation from optimality and from aspects of human performance data. More recent versions of these models, however, overcome these deficiencies. Among these is a model called the multinomial interactive activation model, which explicitly links interactive activation and Bayesian computations. We also review evidence from neurophysiological and neuroimaging studies supporting the view that interactive processing is a characteristic of the perceptual processing machinery in the brain. In sum, we argue that a computational analysis, as well as behavioral and neuroscience evidence, all support the Interactive Activation hypothesis. The evidence suggests that contemporary versions of models based on the idea of interactive activation continue to provide a basis for efforts to achieve a fuller understanding of the process of perception. (shrink)

The study of human intelligence was once dominated by symbolic approaches, but over the last 30 years an alternative approach has arisen. Symbols and processes that operate on them are often seen today as approximate characterizations of the emergent consequences of sub- or nonsymbolic processes, and a wide range of constructs in cognitive science can be understood as emergents. These include representational constructs (units, structures, rules), architectural constructs (central executive, declarative memory), and developmental processes and outcomes (stages, sensitive periods, neurocognitive (...) modules, developmental disorders). The greatest achievements of human cognition may be largely emergent phenomena. It remains a challenge for the future to learn more about how these greatest achievements arise and to emulate them in artificial systems. (shrink)

Localist models of spreading activation (SA) and models assuming distributed representations offer very different takes on semantic priming, a widely investigated paradigm in word recognition and semantic memory research. In this study, we implemented SA in an attractor neural network model with distributed representations and created a unified framework for the two approaches. Our models assume a synaptic depression mechanism leading to autonomous transitions between encoded memory patterns (latching dynamics), which account for the major characteristics of automatic semantic priming in (...) humans. Using computer simulations, we demonstrated how findings that challenged attractor‐based networks in the past, such as mediated and asymmetric priming, are a natural consequence of our present model’s dynamics. Puzzling results regarding backward priming were also given a straightforward explanation. In addition, the current model addresses some of the differences between semantic and associative relatedness and explains how these differences interact with stimulus onset asynchrony in priming experiments. (shrink)

Associative theories of cognitive representation begin with an ontology of two kinds of entities: concepts and associations. According to most social cognitive theories of attitudes, attitudes are object-evaluation associations of varying strength, where strength is defined in terms of accessibility. This paper proposes a cognitive account of belief such that beliefs are object-attribute associations of varying strength: thus, insofar as evaluative concepts are examples of attribute concepts, attitudes are a species of belief. This cognitive account of belief also denies that (...) additional processes of endorsement—explicit or otherwise—are strictly required for an object-attribute association to count as a belief. (shrink)

It has been recently argued that some machine learning techniques known as Kernel methods could be relevant for capturing cognitive and neural mechanisms (Jäkel, Schölkopf, & Wichmann, 2009). We point out that ‘‘String kernels,’’ initially designed for protein function prediction and spam detection, are virtually identical to one contending proposal for how the brain encodes orthographic information during reading. We suggest some reasons for this connection and we derive new ideas for visual word recognition that are successfully put to the (...) test. We argue that the versatility and performance of String kernels makes a compelling case for their implementation in the brain. (shrink)

In this article, we apply a special case of holographic representations to letter position coding. We translate different well-known schemes into this format, which uses distributed representations and supports constituent structure. We show that in addition to these brain-like characteristics, performances on a standard benchmark of behavioral effects are improved in the holographic format relative to the standard localist one. This notably occurs because of emerging properties in holographic codes, like transposition and edge effects, for which we give formal demonstrations. (...) Finally, we outline the limits of the approach as well as its possible future extensions. (shrink)

In recent years, scientists have increasingly taken to investigate the predictive nature of cognition. We argue that prediction relies on abstraction, and thus theories of predictive cognition need an explicit theory of abstract representation. We propose such a theory of the abstract representational capacities that allow humans to transcend the “here-and-now.” Consistent with the predictive cognition literature, we suggest that the representational substrates of the mind are built as ahierarchy, ranging from the concrete to the abstract; however, we argue that (...) there are qualitative differences between elements along this hierarchy, generating meaningful, often unacknowledged,diversity.Echoing views from philosophy, we suggest that the representational hierarchy can be parsed into:modality-specificrepresentations, instantiated on perceptual similarity;multimodalrepresentations, instantiated primarily on the discovery of spatiotemporal contiguity; andcategoricalrepresentations, instantiated primarily on social interaction. These elements serve as the building blocks ofcomplex structures discussed in cognitive psychology (e.g., episodes, scripts) and are the inputs for mental representations that behave like functions, typically discussed in linguistics (i.e.,predicators). We support our argument for representational diversity by explaining how the elements in our ontology are all required to account for humans’ predictive cognition (e.g., in subserving logic-based prediction; in optimizing the trade-off between accurate and detailed predictions) and by examining how the neuroscientific evidence coheres with our account. In doing so, we provide a testable model of the neural bases of conceptual cognition and highlight several important implications to research on self-projection, reinforcement learning, and predictive-processing models of psychopathology. (shrink)

There is widespread agreement in neuroscience and psychology that the visual system identifies objects and faces based on a pattern of activation over many neurons, each neuron being involved in representing many different categories. The hypothesis that the visual system includes finely tuned neurons for specific objects or faces for the sake of identification, so‐called “grandmother cells”, is widely rejected. Here it is argued that the rejection of grandmother cells is premature. Grandmother cells constitute a hypothesis of how familiar visual (...) categories are identified, but the primary evidence against this hypothesis comes from studies that have failed to observe neurons that selectively respond to unfamiliar stimuli. These findings are reviewed and it is shown that they are irrelevant. Neuroscientists need to better understand existing models of face and object identification that include grandmother cells and then compare the selectivity of these units with single neurons responding to stimuli that can be identified. (shrink)

Howson famously argues that the no-miracles argument, stating that the success of science indicates the approximate truth of scientific theories, is a base rate fallacy: it neglects the possibility of an overall low rate of true scientific theories. Recently a number of authors has suggested that the corresponding probabilistic reconstruction is unjust, as it concerns only the success of one isolated theory. Dawid and Hartmann, in particular, suggest to use the frequency of success in some field of research \ to (...) infer a probability of truth for a new theory from \. I here shed doubts on the justification of this and similar moves and suggest a way to directly bound the probability of truth. As I will demonstrate, my bound can become incompatible with the assumption specific testing and Dawid and Hartmann’s estimate for success. (shrink)

I propose a new approach to the constitutive problem of psychology ‘what is mind?’ The first section introduces modifications of the received scope, methodology, and evaluation criteria of unified theories of cognition in accordance with the requirements of evolutionary compatibility and of a mature science. The second section outlines the proposed theory. Its first part provides empirically verifiable conditions delineating the class of meaningful neural formations and modifies accordingly the traditional conceptions of meaning, concept and thinking. This analysis is part (...) of a theory of communication in terms of inter-level systems of primitives that proposes the communication-understanding principle as a psychological invariance. It unifies a substantial amount of research by systematizing the notions of meaning, thinking, concept, belief, communication, and understanding and leads to a minimum vocabulary for this core system of mental phenomena. Its second part argues that written human language is the key characteristic of the artificially natural human mind. Overall, the theory both supports Darwin’s continuity hypothesis and proposes that the mental gap is within our own species. (shrink)