The target article on cellular mechanisms of long-term depression appears to have been well received by most authors of the relevant commentaries. This may be due to the fact that this review aimed to give a general account of the topic, rather than just describe previous work of the present author. The present response accordingly only raises questions of major interest for future research.

According to the reward-prediction error hypothesis of dopamine, the phasic activity of dopaminergic neurons in the midbrain signals a discrepancy between the predicted and currently experienced reward of a particular event. It can be claimed that this hypothesis is deep, elegant and beautiful, representing one of the largest successes of computational neuroscience. This paper examines this claim, making two contributions to existing literature. First, it draws a comprehensive historical account of the main steps that led to the formulation and subsequent (...) success of the RPEH. Second, in light of this historical account, it explains in which sense the RPEH is explanatory and under which conditions it can be justifiably deemed deeper than the incentive salience hypothesis of dopamine, which is arguably the most prominent contemporary alternative to the RPEH. (shrink)

We must rethink our assessment of Hume’s theory of probabilistic inference. Hume scholars have traditionally dismissed his naturalistic explanation of how we make inferences under conditions of uncertainty; however, psychological experiments and computer models from cognitive science provide substantial support for Hume’s account. Hume’s theory of probabilistic inference is far from obsolete or outdated; on the contrary, it stands at the leading edge of our contemporary science of the mind.

Some regularities enjoy only an attenuated existence in a body of training data. These are regularities whose statistical visibility depends on some systematic recoding of the data. The space of possible recodings is, however, infinitely large – it is the space of applicable Turing machines. As a result, mappings that pivot on such attenuated regularities cannot, in general, be found by brute-force search. The class of problems that present such mappings we call the class of “type-2 problems.” Type-1 problems, by (...) contrast, present tractable problems of search insofar as the relevant regularities can be found by sampling the input data as originally coded. Type-2 problems, we suggest, present neither rare nor pathological cases. They are rife in biologically realistic settings and in domains ranging from simple animat behaviors to language acquisition. Not only are such problems rife – they are standardly solved! This presents a puzzle. How, given the statistical intractability of these type-2 cases, does nature turn the trick? One answer, which we do not pursue, is to suppose that evolution gifts us with exactly the right set of recoding biases so as to reduce specific type-2 problems to type-1 mappings. Such a heavy-duty nativism is no doubt sometimes plausible. But we believe there are other, more general mechanisms also at work. Such mechanisms provide general strategies for managing problems of type-2 complexity. Several such mechanisms are investigated. At the heart of each is a fundamental ploy – namely, the maximal exploitation of states of representation already achieved by prior, simpler learning so as to reduce the amount of subsequent computational search. Such exploitation both characterizes and helps make unitary sense of a diverse range of mechanisms. These include simple incremental learning, modular connectionism, and the developmental hypothesis of “representational redescription”. In addition, the most distinctive features of human cognition – language and culture – may themselves be viewed as adaptations enabling this representation/computation trade-off to be pursued on an even grander scale. (shrink)

The primary assumption made in this series of target articles is that the cerebellum is directly involved in motor control. However, in my opinion, there is ample and growing experimental evidence to question this classical view, whether or not learning is involved. I propose, instead, that the cerebellum is involved in the control of data acquisition for many different sensory systems, [CRÉPEL et al., HOUK et al., SMITH, THACH].

The present commentary considers the question of what must be learned in different types of motor skills, thereby limiting the question of what should be adjusted in the APG model in order to explain successful learning. It is concluded that an open loop model like the APG might well be able to describe the learning pattern of motor skills in a stable, predictable environment. Recent research on saccadic plasticity, however, illustrates that motor skills performed in an unpredictable environment depend heavily (...) on sensory (mostly visual) feedback, [HOUK et al.]. (shrink)

We ask what cerebellum and basal ganglia arguing that cerebellum tunes motor schemas and their coordination. We argue for a synthesis of models addressing the real-time role and error signaling roles of climbing fibers. bridges between regional and neuro-physiological studies, while relates the neurochemis-try of learning to neural and behavioral levels. [CRÉPEL et al.; HOUK et al.; KANO; LINDEN; SIMPSON et al.; SMITH; THACH; VINCENT].

The appropriate methodology for psychological research depends on whether one is studying mental algorithms or their implementation. Mental algorithms are abstract specifications of the steps taken by procedures that run in the mind. Implementational issues concern the speed and reliability of these procedures. The algorithmic level can be explored only by studying across-task variation. This contrasts with psychology's dominant methodology of looking for within-task generalities, which is appropriate only for studying implementational issues.The implementation-algorithm distinction is related to a number of (...) other “levels” considered in cognitive science. Its realization in Anderson's ACT theory of cognition is discussed. Research at the algorithmic level is more promising because it is hard to make further fundamental scientific progress at the implementational level with the methodologies available. Protocol data, which are appropriate only for algorithm-level theories, provide a richer source than data at the implementational level. Research at the algorithmic level will also yield more insight into fundamental properties of human knowledge because it is the level at which significant learning transitions are defined.The best way to study the algorithmic level is to look for differential learning outcomes in pedagogical experiments that manipulate instructional experience. This provides control and prediction in realistically complex learning situations. The intelligent tutoring paradigm provides a particularly fruitful way to implement such experiments.The implications of this analysis for the issue of modularity of mind, the status of language, research on human/computer interaction, and connectionist models are also examined. (shrink)

We present a spatial system called Specialized Egocentrically Coordinated Spaces embedded in an embodied cognitive architecture (ACT-R Embodied). We show how the spatial system works by modeling two different developmental findings: gaze-following and Level 1 perspective taking. The gaze-following model is based on an experiment by Corkum and Moore (1998), whereas the Level 1 visual perspective-taking model is based on an experiment by Moll and Tomasello (2006). The models run on an embodied robotic system.

This chapter describes the conceptual foundations of cognitive science during its establishment as a science in the 20th century. It is organized around the core ideas of individual agency as its basic explanans and information-processing as its basic explanandum. The latter consists of a package of ideas that provide a mathematico-engineering framework for the philosophical theory of materialism.

The medial prefrontal cortex (mPFC) has been the subject of intense interest as a locus of cognitive control. Several computational models have been proposed to account for a range of effects, including error detection, conflict monitoring, error likelihood prediction, and numerous other effects observed with single-unit neurophysiology, fMRI, and lesion studies. Here, we review the state of computational models of cognitive control and offer a new theoretical synthesis of the mPFC as signaling response–outcome predictions. This new synthesis has two interacting (...) components. The first component learns to predict the various possible outcomes of a planned action, and the second component detects discrepancies between the actual and intended responses; the detected discrepancies in turn update the outcome predictions. This single construct is consistent with a wide array of performance monitoring effects in mPFC and suggests a unifying account of the cognitive role of medial PFC in performance monitoring. (shrink)

Studies comparing movement-related cortical potentials, post-excitatory inhibition after transcranial magnetic brain stimulation, and PET findings in normal controls and patients with cerebellar degeneration demonstrate plasticity of cerebro-cerebellar interactions and hereby support Thach's theory that the cerebellum has the ability to play a role in building behavioral context-response linkages and to build up appropriate responses from simpler constitutive elements, [THACH].

Several target articles in this BBS special issue address the topic of cerebellar and olivary functions, especially as they pertain to motor earning. Another important topic is the neural interaction between the limbic system and the cerebellum during associative learning. In this commentary we present some of our data on olivo-cerebellar and limbic-cerebellar interactions during eyeblink conditioning. [HOUK et al.; SIMPSON et al.; THACH].

Critics of the computational connectionism of the last decade suggest that it shares undesirable features with earlier empiricist or associationist approaches, and with behaviourist theories of learning. To assess the accuracy of this charge the works of earlier writers are examined for the presence of such features, and brief accounts of those found are given for Herbert Spencer, William James and the learning theorists Thorndike, Pavlov and Hull. The idea that cognition depends on associative connections among large networks of neurons (...) is indeed one with precedents, although the implications of this for psychological issues have been interpreted variously — not all versions of connectionism are alike. (shrink)

Converging data from different disciplines are showing the role of classical conditioning processes in the elaboration of human and animal behavior to be larger than previously supposed. Restricted views of classically conditioned responses as merely secretory, reflexive, or emotional are giving way to a broader conception that includes problem-solving, and other rule-governed behavior thought to be the exclusive province of either operant conditiońing or cognitive psychology. These new views have been accompanied by changes in the way conditioning is conducted and (...) evaluated. Data from a number of seemingly unrelated phenomena such as relapse to drug abuse by postaddicts, the placebo effect, and the immune response appear to involve classical conditioning processes. Classical conditioning, moreover, has been found to occur in simpler and simpler organisms and recently even demonstrated in brain slices and in utero. This target article will integrate the several research areas that have used the classical conditioning process as an explanatory model; it will challenge teleological interpretations of the classically conditioned CR and offer some basic principles for testing conditioning in diverse areas. (shrink)

The uncertainty associated with paradigmatic families has been shown to correlate with their phonetic characteristics in speech, suggesting that representations of complex sublexical relations between words are part of speaker knowledge. To better understand this, recent studies have used two-layer neural network models to examine the way paradigmatic uncertainty emerges in learning. However, to date this work has largely ignored the way choices about the representation of inflectional and grammatical functions in models strongly influence what they subsequently learn. To explore (...) the consequences of this, we investigate how representations of IFS in the input-output structures of learning models affect the capacity of uncertainty estimates derived from them to account for phonetic variability in speech. Specifically, we examine whether IFS are best represented as outputs to neural networks or as inputs by building models that embody both choices and examining their capacity to account for uncertainty effects in the formant trajectories of word final [ɐ], which in German discriminates around sixty different IFS. Overall, we find that formants are enhanced as the uncertainty associated with IFS decreases. This result dovetails with a growing number of studies of morphological and inflectional families that have shown that enhancement is associated with lower uncertainty in context. Importantly, we also find that in models where IFS serve as inputs—as our theoretical analysis suggests they ought to—its uncertainty measures provide better fits to the empirical variance observed in [ɐ] formants than models where IFS serve as outputs. This supports our suggestion that IFS serve as cognitive cues during speech production, and should be treated as such in modeling. It is also consistent with the idea that when IFS serve as inputs to a learning network. This maintains the distinction between those parts of the network that represent message and those that represent signal. We conclude by describing how maintaining a “signal-message-uncertainty distinction” can allow us to reconcile a range of apparently contradictory findings about the relationship between articulation and uncertainty in context. (shrink)

PET studies using classical conditioning paradigms are reported. It is emphasized that PET studies show and not in learning paradigms. The importance of dissociating motor performance and learning deficits in human lesions studies is demonstrated in two exemplary studies. The different role of the cerebellum in adaptation of postural reflexes and learning of complex voluntary arm movements is discussed, [THACH].