We examine the embodiment of one foundational aspect of human cognition, language, through its bodily association with the gestures that accompany its expression in speech. Gesture is a universal feature of human communication. Gestures are produced by all speakers in every culture . They are tightly timed with speech . Gestures convey important communicative information to the listener, but even blind speakers gesture while talking to blind listeners , so the mutual co-occurrence of speech and gesture reflects a deep association (...) between the two modes that transcends the intentions of the speaker to communicate. Indeed, we believe that this linkage of the vocal expression of language and the arm movements produced with it are a manifestation of the embodiment of thought: that human mental activities arise through bodily interactions with the world and remain linked with them throughout the lifespan. In particular, we propose that speech and gesture have their developmental origins in early hand-mouth linkages, such that as oral activities become gradually used for meaningful speech, these linkages are maintained and strengthened. Both hand and mouth are tightly coupled in the mutual cognitive activity of language. In short, it is the initial sensorimotor linkages of these systems that form the bases for their later cognitive interdependence. (shrink)

While philosophers of mind have been arguing over the status of mental representations in cognitive science, cognitive scientists have been quietly engaged in studying perception, action, and cognition without explaining them in terms of mental representation. In this book, Anthony Chemero describes this nonrepresentational approach, puts it in historical and conceptual context, and applies it to traditional problems in the philosophy of mind. Radical embodied cognitive science is a direct descendant of the American naturalist psychology of William James and John (...) Dewey, and follows them in viewing perception and cognition to be understandable only in terms of action in the environment. Chemero argues that cognition should be described in terms of agent-environment dynamics rather than in terms of computation and representation. After outlining this orientation to cognition, Chemero proposes a methodology: dynamical systems theory, which would explain things dynamically and without reference to representation. He also advances a background theory: Gibsonian ecological psychology, "shored up" and clarified. Chemero then looks at some traditional philosophical problems through the lens of radical embodied cognitive science and concludes that the comparative ease with which it resolves these problems, combined with its empirical promise, makes this approach to cognitive science a rewarding one. "Jerry Fodor is my favorite philosopher," Chemero writes in his preface, adding, "I think that Jerry Fodor is wrong about nearly everything." With this book, Chemero explains nonrepresentational, dynamical, ecological cognitive science as clearly and as rigorously as Jerry Fodor explained computational cognitive science in his classic work The Language of Thought. (shrink)

In spite of the remarkable progress made in the burgeoning field of social neuroscience, the neural mechanisms that underlie social encounters are only beginning to be studied and could —paradoxically— be seen as representing the ‘dark matter’ of social neuroscience. Recent conceptual and empirical developments consistently indicate the need for investigations, which allow the study of real-time social encounters in a truly interactive manner. This suggestion is based on the premise that social cognition is fundamentally different when we are in (...) interaction with others rather than merely observing them. In this article, we outline the theoretical conception of a second-person approach to other minds and review evidence from neuroimaging, psychophysiological studies and related fields to argue for the development of a second-person neuroscience, which will help neuroscience to really go social; this may also be relevant for our understanding of psychiatric disorders construed as disorders of social cognition. (shrink)

Brains, it has recently been argued, are essentially prediction machines. They are bundles of cells that support perception and action by constantly attempting to match incoming sensory inputs with top-down expectations or predictions. This is achieved using a hierarchical generative model that aims to minimize prediction error within a bidirectional cascade of cortical processing. Such accounts offer a unifying model of perception and action, illuminate the functional role of attention, and may neatly capture the special contribution of cortical processing to (...) adaptive success. This target article critically examines this approach, concluding that it offers the best clue yet to the shape of a unified science of mind and action. Sections 1 and 2 lay out the key elements and implications of the approach. Section 3 explores a variety of pitfalls and challenges, spanning the evidential, the methodological, and the more properly conceptual. The paper ends (sections 4 and 5) by asking how such approaches might impact our more general vision of mind, experience, and agency. (shrink)

Two experiments examined the restriction of referential domains during unscripted conversation by analyzing the modification and online interpretation of referring expressions. Experiment 1 demonstrated that from the earliest moments of processing, addressees interpreted referring expressions with respect to referential domains constrained by the conversation. Analysis of eye movements during the conversation showed elimination of standard competition effects seen with scripted language. Results from Experiment 2 pinpointed two pragmatic factors responsible for restriction of the referential domains used by speakers to design (...) referential expressions and demonstrated that the same factors predict whether addressees consider local competitors to be potential referents during online interpretation of the same expressions. These experiments demonstrate, for the first time, that online interpretation of referring expressions in conversation is facilitated by referential domains constrained by pragmatic factors that predict when addressees are likely to encounter temporary ambiguity in language processing. (shrink)

We identify a number of principles with respect to prediction that, we argue, underpin adult language comprehension: (a) comprehension consists in realizing a mapping between the unfolding sentence and the event representation corresponding to the real‐world event being described; (b) the realization of this mapping manifests as the ability to predict both how the language will unfold, and how the real‐world event would unfold if it were being experienced directly; (c) concurrent linguistic and nonlinguistic inputs, and the prior internal states (...) of the system, each drive the predictive process; (d) the representation of prior internal states across a representational substrate common to the linguistic and nonlinguistic domains enables the predictive process to operate over variable time frames and variable levels of representational abstraction. We review empirical data exemplifying the operation of these principles and discuss the relationship between prediction, event structure, thematic role assignment, and incrementality. (shrink)

Time underlies many interesting human behaviors. Thus, the question of how to represent time in connectionist models is very important. One approach is to represent time implicitly by its effects on processing rather than explicitly (as in a spatial representation). The current report develops a proposal along these lines first described by Jordan (1986) which involves the use of recurrent links in order to provide networks with a dynamic memory. In this approach, hidden unit patterns are fed back to themselves: (...) the internal representations which develop thus reflect task demands in the context of prior internal states. A set of simulations is reported which range from relatively simple problems (temporal version of XOR) to discovering syntactic/semantic features for words. The networks are able to learn interesting internal representations which incorporate task demands with memory demands: indeed, in this approach the notion of memory is inextricably bound up with task processing. These representations reveal a rich structure, which allows them to be highly context‐dependent, while also expressing generalizations across classes of items. These representations suggest a method for representing lexical categories and the type/token distinction. (shrink)

Talk of linguistic universals has given cognitive scientists the impression that languages are all built to a common pattern. In fact, there are vanishingly few universals of language in the direct sense that all languages exhibit them. Instead, diversity can be found at almost every level of linguistic organization. This fundamentally changes the object of enquiry from a cognitive science perspective. This target article summarizes decades of cross-linguistic work by typologists and descriptive linguists, showing just how few and unprofound the (...) universal characteristics of language are, once we honestly confront the diversity offered to us by the world's 6,000 to 8,000 languages. After surveying the various uses of “universal,” we illustrate the ways languages vary radically in sound, meaning, and syntactic organization, and then we examine in more detail the core grammatical machinery of recursion, constituency, and grammatical relations. Although there are significant recurrent patterns in organization, these are better explained as stable engineering solutions satisfying multiple design constraints, reflecting both cultural-historical factors and the constraints of human cognition.Linguistic diversity then becomes the crucial datum for cognitive science: we are the only species with a communication system that is fundamentally variable at all levels. Recognizing the true extent of structural diversity in human language opens up exciting new research directions for cognitive scientists, offering thousands of different natural experiments given by different languages, with new opportunities for dialogue with biological paradigms concerned with change and diversity, and confronting us with the extraordinary plasticity of the highest human skills. (shrink)

In this original and provocative account of the evolutionary origins of human communication, Michael Tomasello connects the fundamentally cooperative structure of human communication (initially discovered by Paul Grice) to the especially ...

The Oxford Handbook of Psycholinguistics brings together the views of 75 leading researchers in psycholinguistics to provide a comprehensive and authoritative review of the current state of the art in psycholinguistics. With almost 50 chapters written by experts in the field, the range and depth of coverage is unequalled.

How can an incomplete and uncertain model of the environment be used to perceive, infer, decide and act efficiently? This is the challenge that both living and artificial cognitive systems have to face. Symbolic logic is, by its nature, unable to deal with this question. The subjectivist approach to probability is an extension to logic that is designed specifically to face this challenge. In this paper, we review a number of frequently encountered cognitive issues and cast them into a common (...) Bayesian formalism. The concepts we review are ambiguities, fusion, multimodality, conflicts, modularity, hierarchies and loops. First, each of these concepts is introduced briefly using some examples from the neuroscience, psychophysics or robotics literature. Then, the concept is formalized using a template Bayesian model. The assumptions and common features of these models, as well as their major differences, are outlined and discussed. (shrink)

For this second edition, the editors have returned to Austin's original lecture notes, amending the printed text where it seemed necessary.

We propose that the crucial difference between human cognition and that of other species is the ability to participate with others in collaborative activities with shared goals and intentions: shared intentionality. Participation in such activities requires not only especially powerful forms of intention reading and cultural learning, but also a unique motivation to share psychological states with others and unique forms of cognitive representation for doing so. The result of participating in these activities is species-unique forms of cultural cognition and (...) evolution, enabling everything from the creation and use of linguistic symbols to the construction of social norms and individual beliefs to the establishment of social institutions. In support of this proposal we argue and present evidence that great apes understand the basics of intentional action, but they still do not participate in activities involving joint intentions and attention. Human children's skills of shared intentionality develop gradually during the first 14 months of life as two ontogenetic pathways intertwine: the general ape line of understanding others as animate, goal-directed, and intentional agents; and a species-unique motivation to share emotions, experience, and activities with other persons. The developmental outcome is children's ability to construct dialogic cognitive representations, which enable them to participate in earnest in the collectivity that is human cognition. Key Words: collaboration; cooperation; cultural learning; culture; evolutionary psychology; intentions; shared intentionality; social cognition; social learning; theory of mind; joint attention. (shrink)

Traditional mechanistic accounts of language processing derive almost entirely from the study of monologue. Yet, the most natural and basic form of language use is dialogue. As a result, these accounts may only offer limited theories of the mechanisms that underlie language processing in general. We propose a mechanistic account of dialogue, the interactive alignment account, and use it to derive a number of predictions about basic language processes. The account assumes that, in dialogue, the linguistic representations employed by the (...) interlocutors become aligned at many levels, as a result of a largely automatic process. This process greatly simplifies production and comprehension in dialogue. After considering the evidence for the interactive alignment model, we concentrate on three aspects of processing that follow from it. It makes use of a simple interactive inference mechanism, enables the development of local dialogue routines that greatly simplify language processing, and explains the origins of self-monitoring in production. We consider the need for a grammatical framework that is designed to deal with language in dialogue rather than monologue, and discuss a range of implications of the account. Key Words: common ground; dialogue; dialogue routines; language comprehension; language production; monitoring; perception-behavior link. (shrink)

Preparing words in speech production is normally a fast and accurate process. We generate them two or three per second in fluent conversation; and overtly naming a clear picture of an object can easily be initiated within 600 msec after picture onset. The underlying process, however, is exceedingly complex. The theory reviewed in this target article analyzes this process as staged and feedforward. After a first stage of conceptual preparation, word generation proceeds through lexical selection, morphological and phonological encoding, phonetic (...) encoding, and articulation itself. In addition, the speaker exerts some degree of output control, by monitoring of self-produced internal and overt speech. The core of the theory, ranging from lexical selection to the initiation of phonetic encoding, is captured in a computational model, called WEAVER++. Both the theory and the computational model have been developed in interaction with reaction time experiments, particularly in picture naming or related word production paradigms, with the aim of accounting for the real-time processing in normal word production. A comprehensive review of theory, model, and experiments is presented. The model can handle some of the main observations in the domain of speech errors (the major empirical domain for most other theories of lexical access), and the theory opens new ways of approaching the cerebral organization of speech production by way of high-temporal-resolution imaging. (shrink)

Traditional approaches to human information processing tend to deal with perception and action planning in isolation, so that an adequate account of the perception-action interface is still missing. On the perceptual side, the dominant cognitive view largely underestimates, and thus fails to account for, the impact of action-related processes on both the processing of perceptual information and on perceptual learning. On the action side, most approaches conceive of action planning as a mere continuation of stimulus processing, thus failing to account (...) for the goal-directedness of even the simplest reaction in an experimental task. We propose a new framework for a more adequate theoretical treatment of perception and action planning, in which perceptual contents and action plans are coded in a common representational medium by feature codes with distal reference. Perceived events (perceptions) and to-be-produced events (actions) are equally represented by integrated, task-tuned networks of feature codes – cognitive structures we call event codes. We give an overview of evidence from a wide variety of empirical domains, such as spatial stimulus-response compatibility, sensorimotor synchronization, and ideomotor action, showing that our main assumptions are well supported by the data. Key Words: action planning; binding; common coding; event coding; feature integration; perception; perception-action interface. (shrink)

The nature of cognition is being re-considered. Instead of emphasizing formal operations on abstract symbols, the new approach foregrounds the fact that cognition is, rather, a situated activity, and suggests that thinking beings ought therefore be considered first and foremost as acting beings. The essay reviews recent work in Embodied Cognition, provides a concise guide to its principles, attitudes and goals, and identifies the physical grounding project as its central research focus.

One of the most notable aspects of Fodor's work is that it articulates features not only of speculative cognitive architectures but also of current research in ...

Prior to the twentieth century, theories of knowledge were inherently perceptual. Since then, developments in logic, statis- tics, and programming languages have inspired amodal theories that rest on principles fundamentally different from those underlying perception. In addition, perceptual approaches have become widely viewed as untenable because they are assumed to implement record- ing systems, not conceptual systems. A perceptual theory of knowledge is developed here in the context of current cognitive science and neuroscience. During perceptual experience, association areas in the (...) brain capture bottom-up patterns of activation in sensory-motor areas. Later, in a top-down manner, association areas partially reactivate sensory-motor areas to implement perceptual symbols. The stor- age and reactivation of perceptual symbols operates at the level of perceptual components – not at the level of holistic perceptual expe- riences. Through the use of selective attention, schematic representations of perceptual components are extracted from experience and stored in memory (e.g., individual memories of green, purr, hot). As memories of the same component become organized around a com- mon frame, they implement a simulator that produces limitless simulations of the component (e.g., simulations of purr). Not only do such simulators develop for aspects of sensory experience, they also develop for aspects of proprioception (e.g., lift, run) and introspec- tion (e.g., compare, memory, happy, hungry). Once established, these simulators implement a basic conceptual system that represents types, supports categorization, and produces categorical inferences. These simulators further support productivity, propositions, and ab- stract concepts, thereby implementing a fully functional conceptual system. Productivity results from integrating simulators combinato- rially and recursively to produce complex simulations. Propositions result from binding simulators to perceived individuals to represent type-token relations. Abstract concepts are grounded in complex simulations of combined physical and introspective events. Thus, a per- ceptual theory of knowledge can implement a fully functional conceptual system while avoiding problems associated with amodal sym- bol systems. Implications for cognition, neuroscience, evolution, development, and artificial intelligence are explored. (shrink)

The emulation theory of representation is developed and explored as a framework that can revealingly synthesize a wide variety of representational functions of the brain. The framework is based on constructs from control theory (forward models) and signal processing (Kalman filters). The idea is that in addition to simply engaging with the body and environment, the brain constructs neural circuits that act as models of the body and environment. During overt sensorimotor engagement, these models are driven by efference copies in (...) parallel with the body and environment, in order to provide expectations of the sensory feedback, and to enhance and process sensory information. These models can also be run off-line in order to produce imagery, estimate outcomes of different actions, and evaluate and develop motor plans. The framework is initially developed within the context of motor control, where it has been shown that inner models running in parallel with the body can reduce the effects of feedback delay problems. The same mechanisms can account for motor imagery as the off-line driving of the emulator via efference copies. The framework is extended to account for visual imagery as the off-line driving of an emulator of the motor-visual loop. I also show how such systems can provide for amodal spatial imagery. Perception, including visual perception, results from such models being used to form expectations of, and to interpret, sensory input. I close by briefly outlining other cognitive functions that might also be synthesized within this framework, including reasoning, theory of mind phenomena, and language. Key Words: efference copies; emulation theory of representation; forward models; Kalman filters; motor control; motor imagery; perception; visual imagery. (shrink)

Herbert Clark argues that language use is more than the sum of a speaker speaking and a listener listening. It is the joint action that emerges when speakers and listeners, writers and readers perform their individual actions in coordination, as ensembles. In contrast to work within the cognitive sciences, which has seen language use as an individual process, and to work within the social sciences, which has seen it as a social process, the author argues strongly that language use embodies (...) both individual and social processes. (shrink)

The article is the first Russian translation of the most well-known piece in conversation analysis, written by the founders of CA Harvey Sacks, Emanuel Schegloff and Gail Jefferson. It has become a milestone in the development of the discipline. The authors offer a comprehensive approach to the study of conversational interactions. The approach is based on the analysis of detailed transcripts of the records of natural conversations. The authors show that in the course of the conversation co-conversationalists use a number (...) of techniques to organize the turn-taking. These techniques are combined in four rules: the first option is the transfer of speakership via allocation of the next speaker by the current speaker; if this first option is not realized, turn-taking may happen via the self-selection by one of the participants; if the second option remains unrealized too, the current speaker continues speaking, with all three options being recurrently provided at all next transition relevant places. The result of the operation of these rules is an orderly conversation based on the principle “one speaker at a time.” According to the authors, this model is compatible with obvious observations concerning conversational practices that they make. The authors show that in every conversation there is a turn-taking system in operation, which provides for a flexible adaptation of the every conversation’s structure to any possible topics and any possible speakers’ identities. Such approach considers how the participants in social interactions order their communication with each other, achieving a sense of normally occurring interaction. (shrink)

Embodied cognition often challenges standard cognitive science. In this outstanding introduction, Lawrence Shapiro sets out the central themes and debates surrounding embodied cognition, explaining and assessing the work of many of the key figures in the field, including George Lakoff, Alva Noë, Andy Clark, and Arthur Glenberg. Beginning with an outline of the theoretical and methodological commitments of standard cognitive science, Shapiro then examines philosophical and empirical arguments surrounding the traditional perspective. He introduces topics such as dynamic systems theory, ecological (...) psychology, robotics, and connectionism, before addressing core issues in philosophy of mind such as mental representation and extended cognition. Including helpful chapter summaries and annotated further reading at the end of each chapter, _Embodied Cognition_ is essential reading for all students of philosophy of mind, psychology, and cognitive science. (shrink)

Presenting a landmark in linguistics and cognitive science, Ray Jackendoff proposes a new holistic theory of the relation between the sounds, structure, and meaning of language and their relation to mind and brain. Foundations of Language exhibits the most fundamental new thinking in linguistics since Noam Chomsky's Aspects of the Theory of Syntax in 1965—yet is readable, stylish, and accessible to a wide readership. Along the way it provides new insights on the evolution of language, thought, and communication.

Dialog is a joint action at different levels. At the highest level, the goal of interlocutors is to align their mental representations. This emerges from joint activity at lower levels, both concerned with linguistic decisions (e.g., choice of words) and nonlinguistic processes (e.g., alignment of posture or speech rate). Because of the high‐level goal, the interlocutors are particularly concerned with close coupling at these lower levels. As we illustrate with examples, this means that imitation and entrainment are particularly pronounced during (...) interactive communication. We then argue that the mechanisms underlying such processes involve covert imitation of interlocutors’ communicative behavior, leading to emulation of their expected behavior. In other words, communication provides a very good example of predictive emulation, in a way that leads to successful joint activity. (shrink)