This article addresses an open problem in the area of cognitive systems and architectures: namely the problem of handling (in terms of processing and reasoning capabilities) complex knowledge structures that can be at least plausibly comparable, both in terms of size and of typology of the encoded information, to the knowledge that humans process daily for executing everyday activities. Handling a huge amount of knowledge, and selectively retrieve it according to the needs emerging in different situational scenarios, is an important (...) aspect of human intelligence. For this task, in fact, humans adopt a wide range of heuristics (Gigerenzer & Todd) due to their “bounded rationality” (Simon, 1957). In this perspective, one of the requirements that should be considered for the design, the realization and the evaluation of intelligent cognitively-inspired systems should be rep- resented by their ability of heuristically identify and retrieve, from the general knowledge stored in their artificial Long Term Memory (LTM), that one which is synthetically and contextually relevant. This requirement, however, is often neglected. Currently, artificial cognitive systems and architectures are not able, de facto, to deal with complex knowledge structures that can be even slightly comparable to the knowledge heuris- tically managed by humans. In this paper I will argue that this is not only a technological problem but also an epistemological one and I will briefly sketch a proposal for a possible solution. (shrink)

What type of artificial systems will claim to be conscious and will claim to experience qualia? The ability to comment upon physical states of a brain-like dynamical system coupled with its environment seems to be sufficient to make claims. The flow of internal states in such systems, guided and limited by associative memory, is similar to the stream of consciousness. A specific architecture of an artificial system, termed articon, is introduced that by its very design has to claim being conscious. (...) Non-verbal discrimination of the working memory states of the articon gives it the ability to experience different qualities of internal states. Analysis of the flow of inner states of such a system during typical behavioral process shows that qualia are inseparable from perception and action. The role of consciousness in learning of skills — when conscious information processing is replaced by subconscious — is elucidated. Arguments confirming that phenomenal experience is a result of cognitive processes are presented. Possible philosophical objections based on the Chinese room and other arguments are discussed, but they are insufficient to refute articon’s claims that it is conscious. Conditions for genuine understanding that go beyond the Turing test are presented. Articons may fulfill such conditions and in principle the structure of their experiences may be arbitrarily close to human. (shrink)

This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing (PDP), a two-volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary (...) developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes. (shrink)

Consciousness remains a mystery—“a phenomenon that people do not know how to think about—yet” (Dennett, , p. 21). Here, I consider how the connectionist perspective on information processing may help us progress toward the goal of understanding the computational principles through which conscious and unconscious processing differ. I begin by delineating the conceptual challenges associated with classical approaches to cognition insofar as understanding unconscious information processing is concerned, and to highlight several contrasting computational principles that are constitutive of the connectionist (...) approach. This leads me to suggest that conscious and unconscious processing are fundamentally connected, that is, rooted in the very same computational principles. I further develop a perspective according to which the brain continuously and unconsciously learns to redescribe its own activity itself based on constant interaction with itself, with the world, and with other minds. The outcome of such interactions is the emergence of internal models that are metacognitive in nature and that function so as to make it possible for an agent to develop a (limited, implicit, practical) understanding of itself. In this light, plasticity and learning are constitutive of what makes us conscious, for it is in virtue of our own experiences with ourselves and with other people that our mental life acquires its subjective character. The connectionist framework continues to be uniquely positioned in the Cognitive Sciences to address the challenge of identifying what one could call the “computational correlates of consciousness” (Mathis & Mozer, ) because it makes it possible to focus on the mechanisms through which information processing takes place. (shrink)

Several recent criticisms of the somatic marker hypothesis (SMH) identify multiple ambiguities in the way it has been formulated by its chief proponents. Here we provide evidence that this hypothesis has also been interpreted in various different ways by the scientific community. Our diagnosis of this problem is that SMH lacks an adequate computational-level account of practical decision making. Such an account is necessary for drawing meaningful links between neurological- and psychological-level data. The paper concludes by providing a simple, five-step (...) model of practical decision making. Recasting SMH in terms of this model generates more precise and empirically tractable computational-level hypotheses about the various ways that somatic markers might influence practical decisions. (shrink)

The computational paradigm, which has dominated psychology and artificial intelligence since the cognitive revolution, has been a source of intense debate. Recently, several cognitive scientists have argued against this paradigm, not by objecting to computation, but rather by objecting to the notion of representation. Our analysis of these objections reveals that it is not the notion of representation per se that is causing the problem, but rather specific properties of representations as they are used in various psychological theories. Our analysis (...) suggests that all theorists accept the idea that cognitive processing involves internal information-carrying states that mediate cognitive processing. These mediating states are a superordinate category of representations. We discuss five properties that can be added to mediating states and examine their importance in various cognitive models. Finally, three methodological lessons are drawn from our analysis and discussion. (shrink)

How do people make deductions? The orthodox view in psychology is that they use formal rules of inference like those of a “natural deduction” system.Deductionargues that their logical competence depends, not on formal rules, but on mental models. They construct models of the situation described by the premises, using their linguistic knowledge and their general knowledge. They try to formulate a conclusion based on these models that maintains semantic information, that expresses it parsimoniously, and that makes explicit something not directly (...) stated by any premise. They then test the validity of the conclusion by searching for alternative models that might refute the conclusion. The theory also resolves long-standing puzzles about reasoning, including how nonmonotonic reasoning occurs in daily life. The book reports experiments on all the main domains of deduction, including inferences based on prepositional connectives such as “if” and “or,” inferences based on relations such as “in the same place as,” inferences based on quantifiers such as “none,” “any,” and “only,” and metalogical inferences based on assertions about the true and the false. Where the two theories make opposite predictions, the results confirm the model theory and run counter to the formal rule theories. Without exception, all of the experiments corroborate the two main predictions of the model theory: inferences requiring only one model are easier than those requiring multiple models, and erroneous conclusions are usually the result of constructing only one of the possible models of the premises. (shrink)

This paper is a commentary on the target article by Lokendra Shastri & Venkat Ajjanagadde [S&A]: “From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony” in same issue of the journal, pp.417–451. -/- It puts S&A's temporal-synchrony binding method in a broader context, comments on notions of pointing and other ways of associating information - in both computers and connectionist systems - and mentions types of reasoning that are a challenge to (...) S&A's system (amongst many other connectionist systems, recognizing that S&A's is much more capable as regards reasoning than most other contemporary systems). (shrink)

Classical (Bayesian) probability (CP) theory has led to an influential research tradition for modeling cognitive processes. Cognitive scientists have been trained to work with CP principles for so long that it is hard even to imagine alternative ways to formalize probabilities. However, in physics, quantum probability (QP) theory has been the dominant probabilistic approach for nearly 100 years. Could QP theory provide us with any advantages in cognitive modeling as well? Note first that both CP and QP theory share the (...) fundamental assumption that it is possible to model cognition on the basis of formal, probabilistic principles. But why consider a QP approach? The answers are that (1) there are many well-established empirical findings (e.g., from the influential Tversky, Kahneman research tradition) that are hard to reconcile with CP principles; and (2) these same findings have natural and straightforward explanations with quantum principles. In QP theory, probabilistic assessment is often strongly context- and order-dependent, individual states can be superposition states (that are impossible to associate with specific values), and composite systems can be entangled (they cannot be decomposed into their subsystems). All these characteristics appear perplexing from a classical perspective. However, our thesis is that they provide a more accurate and powerful account of certain cognitive processes. We first introduce QP theory and illustrate its application with psychological examples. We then review empirical findings that motivate the use of quantum theory in cognitive theory, but also discuss ways in which QP and CP theories converge. Finally, we consider the implications of a QP theory approach to cognition for human rationality. (shrink)

In this article, I survey the integrated connectionist/symbolic (ICS) cognitive architecture in which higher cognition must be formally characterized on two levels of description. At the microlevel, parallel distributed processing (PDP) characterizes mental processing; this PDP system has special organization in virtue of which it can be characterized at the macrolevel as a kind of symbolic computational system. The symbolic system inherits certain properties from its PDP substrate; the symbolic functions computed constitute optimization of a well-formedness measure called Harmony. The (...) most important outgrowth of the ICS research program is optimality theory (Prince & Smolensky, 1993/2004), an optimization based grammatical theory that provides a formal theory of cross-linguistic typology. Linguistically, Harmony maximization corresponds to minimization of markedness or structural ill-formedness. Cognitive explanation in ICS requires the collaboration of symbolic and connectionist principles. ICS is developed in detail in Smolensky and Legendre (2006a); this article is a précis of and guide to those volumes. (shrink)

This paper provides an overview of developments in a dual processing theory of automatic and controlled processing that began with the empirical and theoretical work described by Schneider and Shiffrin (1977) and Shiffrin and Schneider (1977) over a quarter century ago. A review of relevant empirical findings suggests that there is a set of core behavioral phenomena reflecting differences between controlled and automatic processing that must be addressed by a successful theory. These phenomena relate to: consistency in training, serial versus (...) parallel processing, level of effort, robustness to stressors, degree of control, effects on long‐term memory, and priority encoding. We detail a computational model of controlled processing, CAP2, that accounts for these phenomena as emergent properties of an underlying hybrid computational architecture. The model employs a large network of distributed data modules that can categorize, buffer, associate, and prioritize information. Each module is a connectionist network with input and output layers, and each module communicates with a central Control System by outputting priority and activity report signals, and by receiving control signals. The Control System is composed of five processors including a Goal Processor, an Attention Controller, an Activity Monitor, an Episodic Store, and a Gating & Report Relay. The transition from controlled to automatic processing occurs in this model as the data modules become capable of transmitting their output without mediation by the Control System. We describe recent progress in mapping the components of this model onto specific neuroanatomical substrates, briefly discuss the potential for applying functional neuroimaging techniques to test the model's predictions, and its relation to other models. (shrink)

I show how a conversational process that takes simple, intuitively meaningful steps may be understood as a sophisticated computation that derives the richly detailed, complex representations implicit in our knowledge of language. To develop the account, I argue that natural language is structured in a way that lets us formalize grammatical knowledge precisely in terms of rich primitives of interpretation. Primitives of interpretation can be correctly viewed intentionally, as explanations of our choices of linguistic actions; the model therefore fits our (...) intuitions about meaning in conversation. Nevertheless, interpretations for complex utterances can be built from these primitives by simple operations of grammatical derivation. In bridging analyses of meaning at semantic and symbol‐processing levels, this account underscores the fundamental place for computation in the cognitive science of language use. (shrink)

In multicausal abductive tasks a person must explain some findings by assembling a composite hypothesis that consists of one or more elementary hypotheses. If there are n elementary hypotheses, there can be up to 2n composite hypotheses. To constrain the search for hypotheses to explain a new observation, people sometimes use their current explanation—the previous evidence and their present composite hypothesis of that evidence; however, it is unclear when and how the current explanation is used. In addition, although a person's (...) current explanation can narrow the search for a hypothesis, it can also blind the problem solver to alternative, possibly better, explanations. This paper describes a model of multicausal abductive reasoning that makes two predictions regarding the use of the current explanation. The first prediction is that the current explanation is not used to explain new evidence if there is a simple (i.e., nondisjunctive, concrete) hypothesis to account for that evidence. The second prediction is that the current explanation is used when attempting to discriminate among several alternative hypotheses for new evidence. These hypotheses were tested in three experiments. The results are consistent with the second prediction: the current explanation is used when discriminating among alternative hypotheses. However, the first prediction—that the current explanation is not used when a simple hypothesis can account for new data—received only limited support. Participants used the current explanation to constrain their interpretation of new data in 46.5% of all trials. This suggests that context‐independent strategies compete with context‐dependent ones—an interpretation that is consistent with recent work on strategy selection during problem solving. (shrink)

Within the field of human‐computer interaction, the study of the interaction between people and computers has revealed many phenomena. For example, highly interactive devices, such as the Apple Macintosh, are often easier to learn and use than keyboard‐based devices such as Unix. Similarly, consistent interfaces are easier to learn and use than inconsistent ones. This article describes an integrated cognitive model designed to exhibit a range of these phenomena while learning task‐action mappings: action sequences for achieving simple goals, such as (...) opening a file in a word processor. The model, called TAL, is of a user who is familiar with the basic operations of a keyboard and mouse, but unfamiliar with the particular menu structures, words, and actions required to use the device. The model is constructed in Soar and employs a single set of architectural mechanisms. It exhibits behavior that captures human preference for consistent, interactive, and meaningful task‐action mappings. (shrink)

The sciences use a wide range of visual devices, practices, and imaging technologies. This diversity points to an important repertoire of visual methods that scientists use to adapt representations to meet the varied demands that their work places on cognitive processes. This paper identifies key features of the use of visualization in a range of scientific domains and considers the implications of this repertoire for understanding scientists as cognitive agents.

Psychological constructivist models of emotion propose that emotions arise from the combinations of multiple processes, many of which are not emotion specific. These models attempt to describe both the homogeneity of instances of an emotional “kind” (why are fears similar?) and the heterogeneity of instances (why are different fears quite different?). In this article, we review the iterative reprocessing model of affect, and suggest that emotions, at least in part, arise from the processing of dynamical unfolding representations of valence across (...) time. Critical to this model is the hypothesis that affective trajectories—over time—provide important information that helps build emotional states. (shrink)

This article proposes a theoretical framework for external representation based problem solving. The Tic‐Tac‐Toe and its isomorphs are used to illustrate the procedures of the framework as a methodology and test the predictions of the framework as a functional model. Experimental results show that the behavior in the Tic‐Tac‐Toe is determined by the directly available information in external and internal representations in terms of perceptual and cognitive biases, regardless of whether the biases are consistent with, inconsistent with, or irrelevant to (...) the task. It is shown that external representations are not merely inputs and stimuli to the internal mind and that they have much more important functions than mere memory aids. A representational determinism is suggested—the form of a representation determines what information can be perceived, what processes can be activated, and what structures can be discovered from the specific representation. (shrink)

We begin by distinguishing computationalism from a number of other theses that are sometimes conflated with it. We also distinguish between several important kinds of computation: computation in a generic sense, digital computation, and analog computation. Then, we defend a weak version of computationalism—neural processes are computations in the generic sense. After that, we reject on empirical grounds the common assimilation of neural computation to either analog or digital computation, concluding that neural computation is sui generis. Analog computation requires continuous (...) signals; digital computation requires strings of digits. But current neuroscientific evidence indicates that typical neural signals, such as spike trains, are graded like continuous signals but are constituted by discrete functional elements (spikes); thus, typical neural signals are neither continuous signals nor strings of digits. It follows that neural computation is sui generis. Finally, we highlight three important consequences of a proper understanding of neural computation for the theory of cognition. First, understanding neural computation requires a specially designed mathematical theory (or theories) rather than the mathematical theories of analog or digital computation. Second, several popular views about neural computation turn out to be incorrect. Third, computational theories of cognition that rely on non-neural notions of computation ought to be replaced or reinterpreted in terms of neural computation. (shrink)

In grappling with the micro-macro problem in sociology, philosophers of the field are finding it increasingly useful to associate micro-sociology with theory reduction. In this article I argue that the association is ungrounded and undesirable. Although of a reductive "disposition," micro-sociological theories instantiate something more like "reductive explanation," whereby the causal roles of social wholes are explained in terms of their psychological parts. In this form, micro-sociological theories may actually have a better shot at closing the sociology–psychology explanatory gap, and (...) resist many antireductionist arguments, including the well-known argument from "multiple realization.". (shrink)

Although activity aimed at the construction of artificial intelligence started about 60 years ago however, contemporary intelligent systems are effective in very narrow domains only. One of the reasons for this situation appears to be serious problems in the theory of intelligence. Intelligence is a characteristic of goal-directed systems and two classes of goal-directed systems can be derived from observations on animals and humans, one class is systems with innately and jointly determined goals and means. The other class contains systems (...) that are able to construct arbitrary goals and means. It is suggested that the classes (that implicitly underlie most models of artificial intelligence) are insufficient to explain human goal-directed activity. A broader approach to goal-directed systems is considered. This approach suggests that humans are goal-directed systems that jointly synthesize arbitrary goals and means. Neural and psychological data favoring this hypothesis and its experimental validation are considered. A simple computer model based on the idea of joint synthesis to simulate goal-directed activity is presented. The usage of the idea of joint synthesis for the construction of artificial intelligence is discussed. (shrink)