In this chapter, I will present an empirical conjecture to the effect that some bodily actions are categorically perceived. These are bodily actions such as grasping or reaching for something, which I am going to call motor actions. My conjecture builds on one recently put forward about how the categorical perception of facial expressions of some emotions works. I shall motivate my own conjecture on the basis of both theoretical and empirical considerations, describe how it could be operationalised and what (...) explanatory gain could be obtained from it. (shrink)

Jerry Fodor deemed informational encapsulation ‘the essence’ of a system’s modularity and argued that human perceptual processing comprises modular systems, thus construed. Nowadays, his conclusion is widely challenged. Often, this is because experimental work is seen to somehow demonstrate the cognitive penetrability of perceptual processing, where this is assumed to conflict with the informational encapsulation of perceptual systems. Here, I deny the conflict, proposing that cognitive penetration need not have any straightforward bearing on the conjecture that perceptual processing is composed (...) of nothing but informationally encapsulated modules, the conjecture that each and every perceptual computation is performed by an informationally encapsulated module, and the consequences perceptual encapsulation was traditionally expected to have for a perception-cognition border, the epistemology of perception and cognitive science. With these points in view, I propose that particularly plausible cases of cognitive penetration would actually seem to evince the encapsulation of perceptual systems rather than refute/problematize this conjecture. (shrink)

To some it is a shallow platitude that inner speech always has an auditory-phonological component. To others, it is an empirical hypothesis with accumulating support. To yet others it is a false dogma. In this chapter, I defend the claim that inner speech always has an auditory-phonological component, confining the claim to adults with ordinary speech and hearing. It is one thing, I emphasize, to assert that inner speech often, or even typically, has an auditory-phonological component—quite another to propose that (...) it always does. When forced to argue for the stronger point, we stand to make a number of interesting discoveries about inner speech itself, and about our means for discriminating it from other psycholinguistic phenomena. Establishing the stronger conclusion also provides new leverage on debates concerning how we should conceive of, diagnose, and explain auditory verbal hallucinations and “inserted thoughts” in schizophrenia. (shrink)

It is unfashionable to suggest that enactive processes - including some that involve the mirror neuron system - might contribute to the comprehension of sign language. The present essay formulates and defends a version of that unfashionable suggestion, as it applies to certain forms of syntactic processing. There is evidence that has been thought to weigh against any such suggestion, coming from neuroimaging experiments and from the study of Deaf aphasics. In both cases it is shown to be unpersuasive.

Multiple acoustic dimensions signal speech categories. However, dimensions vary in their informativeness; some are more diagnostic of category membership than others. Speech categorization reflects these dimensional regularities such that diagnostic dimensions carry more “perceptual weight” and more effectively signal category membership to native listeners. Yet perceptual weights are malleable. When short-term experience deviates from long-term language norms, such as in a foreign accent, the perceptual weight of acoustic dimensions in signaling speech category membership rapidly adjusts. The present study investigated whether (...) rapid adjustments in listeners’ perceptual weights in response to speech that deviates from the norms also affects listeners’ own speech productions. In a word recognition task, the correlation between two acoustic dimensions signaling consonant categories, fundamental frequency and voice onset time, matched the correlation typical of English, and then shifted to an “artificial accent” that reversed the relationship, and then shifted back. Brief, incidental exposure to the artificial accent caused participants to down-weight perceptual reliance on F0, consistent with previous research. Throughout the task, participants were intermittently prompted with pictures to produce these same words. In the block in which listeners heard the artificial accent with a reversed F0 × VOT correlation, F0 was a less robust cue to voicing in listeners’ own speech productions. The statistical regularities of short-term speech input affect both speech perception and production, as evidenced via shifts in how acoustic dimensions are weighted. (shrink)

This is a book about the metaphysics of perception and discusses touch, audition, and vision. Though primarily concerned with the nature of perception, it draws heavily from the history of philosophy of perception, and connects the concerns of analytical and continental philosophers.

In this chapter, I critically examine two of the main approaches to colour categorization in cognitive science: the perceptual salience theory and linguistic relativism. I then turn to reviewing several decades of psychological research on colour categorical perception (CP). A careful assessment of relevant findings suggests that most of the experimental effects that have been understood in terms of CP actually fall on the cognition side of the perception-cognition divide: they are effects of colour language, for example, on memory or (...) decision-making. (shrink)

In this paper a tentative neurophysiologically framed approach of the Freudian unconscious that would function on the basis of linguistic (phonological) organizing principles, is proposed. A series of arguments, coming from different fields, are taken together. First, clinical reports indicate that in a state of high emotional arousal linguistic fragments are treated in a decontextualized way, and can lead to the isolation of phoneme sequences which, independently of their actual meaning, are able to resort emotional effects. Second, phonological and neurophysiological (...) arguments are given to make the case that language processing – be it producing, receiving or imagining language – is a motor event. A crucial distinction is proposed: while contextualized processing correlates on a neurophysiological level with action understanding, and is psychoanalytically akin to secondary processing, decontextualized language processing has a neurophysiological counterpart in object understanding and is psychoanalytically akin to primary processing. Third, isolated speech fragments are therefore considered as objects which, similarly to non-linguistic objects, undergo emotional conditioning and establish an idiosyncratic linguistically structured emotional memory. Phoneme sequences which in this way come to carry high emotional valences are thought to be more readily subject to threaten the bodily integrity, and therefore more readily inhibited. When this inhibition leads to the prevention of effective realization of the voluntary motor output, this is thought to result in the sustained high levels of neuronal activation which seek for release by attracting substitutes that are phonemically similar to the censored speech fragments though they are cognitively non threatening. As a result, the speech of the subject would be particularly concerned with the verbalizations of these substitutive phoneme sequences. In summary, the Freudian unconscious is conceived as the instantiation of a linguistic action space which would be idiosyncratically organized by particular phonemic “phantoms” operating as attractors for the subject’s (linguistic) actions. (shrink)

Contrary to Müller's claims, and in support of modular theories, genetic factors play a substantial and significant role in language. The finding that some children with specific language impairment (SLI) have nonlinguistic impairments may reflect improper diagnosis of SLI or impairments that are secondary to linguistic impairments. Thus, such findings do not argue against the modularity thesis. The lexical/functional distinction appears to be innate and specifically linguistic and could be instantiated in either symbolic or connectionist systems.

Müller argues that general cognitive skills and linguistic skills are not necessarily independent. However, cross-linguistic evidence from an inherited specific language disorder affecting productive rules suggests significant degrees of modularity, innateness, and universality of language. Confident claims about the overall nature of such a complex system still await more interdisciplinary research.

Müller attempts to downplay cases of dissociation between language and cognition as evidence against the modularity of language. We review cases of associations between verbal and nonverbal abilities as further evidence against the notion of language as an autonomous subsystem. We also point out a discrepancy between his proposal of homologies between nonhuman primates' communication and human language and recent proposals on the evolution of language.

Müller misconstrues autonomy to mean strict locality of brain function, something quite different from the functional autonomy that linguists claim. Similarly, he misperceives the interaction of learned and innate components hypothesized in current generative models. Evidence from sign languages, Creole languages, and neurological studies of rare forms of aphasia also argues against his conclusions.

We examined whether facial expressions of performers influence the emotional connotations of sung materials, and whether attention is implicated in audio-visual integration of affective cues. In Experiment 1, participants judged the emotional valence of audio-visual presentations of sung intervals. Performances were edited such that auditory and visual information conveyed congruent or incongruent affective connotations. In the single-task condition, participants judged the emotional connotation of sung intervals. In the dual-task condition, participants judged the emotional connotation of intervals while performing a secondary (...) task. Judgements were influenced by melodic cues and facial expressions and the effects were undiminished by the secondary task. Experiment 2 involved identical conditions but participants were instructed to base judgements on auditory information alone. Again, facial expressions influenced judgements and the effect was undiminished by the secondary task. The results suggest that visual aspects of music performance are automatically and preattentively registered and integrated with auditory cues. (shrink)

The discovery of so-called ‘mirror neurons’ - found to respond both to own actions and the observation of similar actions performed by others - has been enormously influential in the cognitive sciences and beyond. Given the self-other symmetry these neurons have been hypothesized as underlying a ‘mirror mechanism’ that lets us share representations and thereby ground core social cognitive functions from intention understanding to linguistic abilities and empathy. I argue that mirror neurons are important for very different reasons. Rather than (...) a symmetric ubiquitous or context- independent mechanism, I propose that these neurons are part of broader sensorimotor circuits, which help us navigate and predict the social affordance space that we meet others in. To develop both the critical and positive project I analyze the interpretive choices and the debate surrounding the mirror neuron research and show how the field is marred by highly questionable assumptions about respectively motor and social cognition. The discovery of mirror neurons - and the sensorimotor circuits of which these neurons are a part – actually empirically challenge many of these tacit assumptions. Findings of sensorimotor goal representations at levels of abstraction well beyond actual sensory information and kinetic movements challenge the idea of motor cognition as primarily output production. Additionally, the focus on 3rd person mindreading of hidden mental states is misguiding the field of social cognition. Much ‘mind-reading’ seems rooted in sensorimotor representations and a developmentally primary 2nd person understanding of actions and the mental lives of others, which precisely breaks the assumed dichotomy between mind and behavior. I propose a Social Affordance model where parallel fronto-parietal sensorimotor circuits support representations not just of other people’s actions but of the overall social affordance space. It is a process that monitors concrete goals and teleological possibilities that the environment affords respectively oneself and other present agents. With this model I hypothesize that the complex spectrum of sensorimotor integrations are indeed essential not only to normal action choice calibration but also to social cognitive abilities, as the sensorimotor teleological representations let us relate to others and understand their action choices in a shared pragmatic and intentional context. (shrink)

Is speech special? This paper evaluates the evidence that speech perception is distinctive when compared with non-linguistic auditory perception. It addresses the phenomenology, contents, objects, and mechanisms involved in the perception of spoken language. According to the account it proposes, the capacity to perceive speech in a manner that enables understanding is an acquired perceptual skill. It involves learning to hear language-specific types of ethologically significant sounds. According to this account, the contents of perceptual experience when listening to familiar speech (...) are of a variety that is distinctive to hearing spoken utterances. However, perceiving speech involves neither novel perceptual objects nor a unique perceptual modality. Much of what makes speech special stems from our interest in it. (shrink)

Neuroethological investigations of mammalian and avian auditory systems have documented species-specific specializations for processing complex acoustic signals that could, if viewed in abstract terms, have an intriguing and striking relevance for human speech sound categorization and representation. Each species forms biologically relevant categories based on combinatorial analysis of information-bearing parameters within the complex input signal. This target article uses known neural models from the mustached bat and barn owl to develop, by analogy, a conceptualization of human processing of consonant plus (...) vowel sequences that offers a partial solution to the noninvariance dilemma the locus equations orderly output constraint”) is hypothesized based on the notion of an evolutionarily conserved auditory-processing strategy. High correlation and linearity between critical parameters in the speech signal that help to cue place of articulation categories might have evolved to satisfy a preadaptation by mammalian auditory systems for representing tightly correlated, linearly related components of acoustic signals. (shrink)

Evidence for motion extrapolation at motion offset is scarce. In contrast, there is abundant evidence that subjects mentally extrapolate the future trajectory of weak motion signals at motion offset. Further, pointing movements overshoot at motion offset. We believe that mental and sensorimotor extrapolation is sufficient to solve the problem of perceptual latencies. Both present the advantage of being much more flexible than motion extrapolation.

First, we discuss issues raised with respect to the Theory of Event Coding (TEC)'s scope, that is, its limitations and possible extensions. Then, we address the issue of specificity, that is, the widespread concern that TEC is too unspecified and, therefore, too vague in a number of important respects. Finally, we elaborate on our views about TEC's relations to other important frameworks and approaches in the field like stages models, ecological approaches, and the two-visual-pathways model. Footnotes1 We acknowledge the precedence (...) of both Freud¹s Instincts and Their Vicissitudes (1915) and Neisser¹s Stimulus Information and Its Vicissitudes (a term Neisser borrowed from Freud for his monograph “Cognitive psychology,” 1967). (shrink)

Goldstein reported multiple cases of failure to categorise colours in patients that he termed amnesic or anomic aphasics. These patients have a particular difficulty in producing perceptual categories in the absence of other aphasic impairments. We hold that neuropsychological evidence supports the view that the task of colour categorisation is logically impossible without labels.

We examine the question of which aspects of language are uniquely human and uniquely linguistic in light of recent suggestions by Hauser, Chomsky, and Fitch that the only such aspect is syntactic recursion, the rest of language being either specific to humans but not to language (e.g. words and concepts) or not specific to humans (e.g. speech perception). We find the hypothesis problematic. It ignores the many aspects of grammar that are not recursive, such as phonology, morphology, case, agreement, and (...) many properties of words. It is inconsistent with the anatomy and neural control of the human vocal tract. And it is weakened by experiments suggesting that speech perception cannot be reduced to primate audition, that word learning cannot be reduced to fact learning, and that at least one gene involved in speech and language was evolutionarily selected in the human lineage but is not specific to recursion. The recursion-only claim, we suggest, is motivated by Chomsky’s recent approach to syntax, the Minimalist Program, which de-emphasizes the same aspects of language. The approach, however, is sufficiently problematic that it cannot be used to support claims about evolution. We contest related arguments that language is not an adaptation, namely that it is “perfect,” non-redundant, unusable in any partial form, and badly designed for.. (shrink)

For many years the evolution of language has been seen as a disreputable topic, mired in fanciful “just so stories” about language origins. However, in the last decade a new synthesis of modern linguistics, cognitive neuroscience and neo-Darwinian evolutionary theory has begun to make important contributions to our understanding of the biology and evolution of language. I review some of this recent progress, focusing on the value of the comparative method, which uses data from animal species to draw inferences about (...) language evolution. Discussing speech first, I show how data concerning a wide variety of species, from monkeys to birds, can increase our understanding of the anatomical and neural mechanisms underlying human spoken language, and how bird and whale song provide insights into the ultimate evolutionary function of language. I discuss the “descended larynx” of humans, a peculiar adaptation for speech that has received much attention in the past, which despite earlier claims is not uniquely human. Then I will turn to the neural mechanisms underlying spoken language, pointing out the difficulties animals apparently experience in perceiving hierarchical structure in sounds, and stressing the importance of vocal imitation in the evolution of a spoken language. Turning to ultimate function, I suggest that communication among kin (especially between parents and offspring) played a crucial but neglected role in driving language evolution. Finally, I briefly discuss phylogeny, discussing hypotheses that offer plausible routes to human language from a non-linguistic chimp-like ancestor. I conclude that comparative data from living animals will be key to developing a richer, more interdisciplinary understanding of our most distinctively human trait: language. (shrink)

Many people have argued that the evolution of the human language faculty cannot be explained by Darwinian natural selection. Chomsky and Gould have suggested that language may have evolved as the by-product of selection for other abilities or as a consequence of as-yet unknown laws of growth and form. Others have argued that a biological specialization for grammar is incompatible with every tenet of Darwinian theory – that it shows no genetic variation, could not exist in any intermediate forms, confers (...) no selective advantage, and would require more evolutionary time and genomic space than is available. We examine these arguments and show that they depend on inaccurate assumptions about biology or language or both. Evolutionary theory offers clear criteria for when a trait should be attributed to natural selection: complex design for some function, and the absence of alternative processes capable of explaining such complexity. Human language meets these criteria: Grammar is a complex mechanism tailored to the transmission of propositional structures through a serial interface. Autonomous and arbitrary grammatical phenomena have been offered as counterexamples to the position that language is an adaptation, but this reasoning is unsound: Communication protocols depend on arbitrary conventions that are adaptive as long as they are shared. Consequently, language acquisition in the child should systematically differ from language evolution in the species, and attempts to analogize them are misleading. Reviewing other arguments and data, we conclude that there is every reason to believe that a specialization for grammar evolved by a conventional neo-Darwinian process. (shrink)

Many current neurophysiological, psychophysical, and psychological approaches to vision rest on the idea that when we see, the brain produces an internal representation of the world. The activation of this internal representation is assumed to give rise to the experience of seeing. The problem with this kind of approach is that it leaves unexplained how the existence of such a detailed internal representation might produce visual consciousness. An alternative proposal is made here. We propose that seeing is a way of (...) acting. It is a particular way of exploring the environment. Activity in internal representations does not generate the experience of seeing. The out- side world serves as its own, external, representation. The experience of seeing occurs when the organism masters what we call the gov- erning laws of sensorimotor contingency. The advantage of this approach is that it provides a natural and principled way of accounting for visual consciousness, and for the differences in the perceived quality of sensory experience in the different sensory modalities. Sev- eral lines of empirical evidence are brought forward in support of the theory, in particular: evidence from experiments in sensorimotor adaptation, visual “filling in,” visual stability despite eye movements, change blindness, sensory substitution, and color perception. (shrink)

Imitation and mirroring processes are necessary but not sufficient conditions for children to develop human sociality. Human sociality entails more than the equivalence and connectedness of perceptual experiences. It corresponds to the sense of a shared world made of shared values. It originates from complex ‘open’ systems of reciprocation and negotiation, not just imitation and mirroring processes that are by definition ‘closed’ systems. From this premise, we argue that if imitation and mirror processes are important foundations for sociality, human inter-subjectivity (...) develops primarily in reciprocation, not just imitation. Imitation provides a basic sense of social connectedness and mutual acknowledgment of existing with others that are ‘like me.’ However, it does not allow for the co-construction of meanings with others. For human sociality to develop, imitation and mirroring processes need to be supplemented by an open system of reciprocation. Developmental research shows that from the second month, mirroring, imitative, and other contagious emotional responses are by-passed. Imitation gives way to first signs of reciprocation (primary intersubjectivity), joint attention to objects (secondary intersubjectivity), the emergence of values that are jointly represented and negotiated with others (tertiary intersubjectivity), and eventually the development of an ethical stance accompanying theories of mind by 4 years of age. We review this development and propose that if mirroring processes enable individuals to bridge their subjective experiences, human inter-subjectivity proper develops from reciprocal social exchanges that lead to value negotiation and mutual recognition, both cardinal trademarks of human sociality. (shrink)

According to sensorimotor theory perceiving is a bodily skill involving exercise of an implicit know-how of the systematic ways that sensations change as a result of potential movements, that is, of sensorimotor contingencies. The theory has been most successfully applied to vision and touch, while perceptual modalities that rely less on overt exploration of the environment have not received as much attention. In addition, most research has focused on philosophically grounding the theory and on psychologically elucidating sensorimotor laws, but the (...) theory’s ramifications for neuroscience still remain underexamined. Here we sketch the beginnings of a research program that could address these two outstanding challenges in terms of auditory perception. We review the neuroscience literature on passive listening, which is defined as listening without overt bodily movement, and conclude that sensorimotor theory provides a unique perspective on the consistent finding of motor system activation. In contrast to competing theories, this activation is predicted to be involved not only in the perception of speech- and action-related sounds, but in auditory perception in general. More specifically, we propose that the auditory processing associated with supplementary motor areas forms part of the neural basis of the exercise of sensorimotor know-how: these areas’ recognized role in facilitating spontaneous motor responses to sound and supporting flexible engagement of sensorimotor processes to guide auditory experience and enable auditory imagery, can be understood in terms of two key characteristics of sensorimotor interaction, its “alerting capacity” and “corporality”, respectively. We also highlight that there is more to the inside of the body than the brain: there is an opportunity to develop sensorimotor theory into new directions in terms of the still poorly understood active processes of the peripheral auditory system. (shrink)

Speech is intelligible even when the temporal envelope of speech is distorted. The current study investigates how native and non-native speakers perceptually restore temporally distorted speech. Participants were native English speakers (NS), and native Japanese speakers who spoke English as a second language (NNS). In Experiment 1, participants listened to “locally time-reversed speech” where every x-ms of speech signal was reversed on the temporal axis. Here, the local time reversal shifted the constituents of the speech signal forward or backward from (...) the original position, and the amplitude envelope of speech was altered as a function of reversed segment length. In Experiment 2, participants listened to “modulation-filtered speech” where the modulation frequency components of speech were low-pass filtered at a particular cut-off frequency. Here, the temporal envelope of speech was altered as a function of cut-off frequency. The results suggest that speech becomes gradually unintelligible as the length of reversed segments increases (Experiment 1), and as a lower cut-off frequency is imposed (Experiment 2). Both experiments exhibit the equivalent level of speech intelligibility across six levels of degradation for native and non-native speakers respectively, which poses a question whether the regular occurrence of local time reversal can be discussed in the modulation frequency domain, by simply converting the length of reversed segments (ms) into frequency (Hz). (shrink)

Neurobiological models of language need a level of analysis that can account for the typical range of language phenomena. Because linguistically motivated models have been successful in explaining numerous language properties, it is premature to dismiss them as biologically irrelevant. Models attempting to unify neurobiology and linguistics need to be sensitive to both sources of evidence.

Both autonomy and local specificity are compatible with observed interconnectivity at the cell level when considering two different levels: cell assemblies and brain systems. Early syntactic structuring processes in particular are likely to representan autonomous module in the language/brain system.

Müller argues that double dissociations do not imply underlying modularity of the cognitive system, citing neural networks as examples of fully distributed systems that can give rise to double dissociations. We challenge this claim, noting that suchdouble dissociations typically do not “scale-up,” and that even some singledissociations can be difficult to account for in a distributed system.

The concepts of the innateness, universality, species-specificity, and autonomy of the human language capacity have had an extreme impact on the psycholinguistic debate for over thirty years. These concepts are evaluated from several neurobiological perspectives, with an emphasis on the emergence of language and its decay due to brain lesion and progressive brain disease.Evidence of perceptuomotor homologies and preadaptations for human language in nonhuman primates suggests a gradual emergence of language during hominid evolution. Regarding ontogeny, the innate component of language (...) capacity is likely to be polygenic and shared with other developmental domains. Dissociations between verbal and nonverbal development are probably rooted in the perceptuomotor specializations of neural substrates rather than the autonomy of a grammar module. Aphasiologicaldata often assumed to suggest modular linguistic subsystems can be accounted for in terms of a neurofunctional model incorporating perceptuomotor-based regional specializationsand distributivity of representations. Thus, dissociations between grammatical functors and content words are due to different conditions of acquisition and resulting differences in neural representation. Human brains are characterized by multifactorial interindividual variability, and strict universality of functional organization is biologically unrealistic.A theoretical alternative is proposed according to which (1) linguistic specialization of brain areas is due to epigenetic and probabilistic maturational events, not to genetic ”hard-wiring,” and (2) linguistic knowledge is neurally represented in distributed cell assemblies whose topography reflects the perceptuomotor modalities involved in the acquisition and use of a given item of knowledge. (shrink)

A theory of conceptual development must specify the innate representational primitives, must characterize the ways in which the initial state differs from the adult state, and must characterize the processes through which one is transformed into the other. The Origin of Concepts (henceforth TOOC) defends three theses. With respect to the initial state, the innate stock of primitives is not limited to sensory, perceptual, or sensorimotor representations; rather, there are also innate conceptual representations. With respect to developmental change, conceptual development (...) consists of episodes of qualitative change, resulting in systems of representation that are more powerful than, and sometimes incommensurable with, those from which they are built. With respect to a learning mechanism that achieves conceptual discontinuity, I offer Quinian bootstrapping. TOOC concludes with a discussion of how an understanding of conceptual development constrains a theory of concepts. (shrink)

The lack of consensus on how to characterize humans’ capacity for belief reasoning has been brought into sharp focus by recent research. Children fail critical tests of belief reasoning before 3 to 4 years (Wellman, Cross, & Watson, 2001; Wimmer & Perner, 1983), yet infants apparently pass false belief tasks at 13 or 15 months (Onishi & Baillargeon, 2005; Surian, Caldi, & Sperber, 2007). Non-human animals also fail critical tests of belief reasoning but can show very complex social behaviour (e.g., (...) Call & Tomasello, 2005). Fluent social interaction in adult humans implies efficient processing of beliefs, yet direct tests suggest that belief reasoning is cognitively demanding, even for adults (e.g., Apperly, Samson & Humphreys, 2005). We interpret these findings by drawing an analogy with the domain of number cognition, where similarly contrasting results have been observed. We propose that the success of infants and non-human animals on some belief reasoning tasks may be best explained by a cognitively efficient but inflexible capacity for tracking belief-like states. In humans this capacity persists in parallel with later-developing, more flexible but more cognitively demanding theory of mind abilities. (shrink)