Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

I evaluate the bottlenecks involved in the simulation mechanism underpinning superior predictive abilities for upcoming actions. This perceptual-motor state is characterized by a complex interrelationship designed to make predictions using a highly fine-tuned and constrained motor operation. The extension of such mechanisms to language may occur only in sensorimotor circuits devoted to the action domain.

In his novel Remembrance of Things Past, Marcel Proust argues that conventional descriptions of the phenomenology of consciousness are incomplete because they focus too much on the highly-salient sensory information that dominates each moment of awareness and ignore the network of associations that lies in the background. In this paper, I explicate Proust’s theory of conscious experience and show how it leads him directly to a theory of aesthetic perception. Proust’s division of awareness into two components roughly corresponds to William (...) James’ division of the stream of thought into a “nucleus” and “fringe.” Proust argues that the function of art is to evoke the underlying associative network indirectly in the mind of the observer by using carefully chosen sensory surfaces to control the stream of thought. I propose a possible neural basis for this Proustian/Jamesian phenomenology, and argue that the general principles of Proustian aesthetics can be applied to all forms of art. I conclude that a scientific theory of art should follow in a straightforward manner from a scientific theory of consciousness. (shrink)

Joint actions often require agents to track others’ actions while planning and executing physically incongruent actions of their own. Previous research has indicated that this can lead to visuomotor interference effects when it occurs outside of joint action. How is this avoided or overcome in joint actions? We hypothesized that when joint action partners represent their actions as interrelated components of a plan to bring about a joint action goal, each partner’s movements need not be represented in relation to distinct, (...) incongruent proximal goals. Instead they can be represented in relation to a single proximal goal – especially if the movements are, or appear to be, mechanically linked to a more distal joint action goal. To test this, we implemented a paradigm in which participants produced finger movements that were either congruent or incongruent with those of a virtual partner, and either with or without a joint action goal (the joint flipping of a switch, which turned on two light bulbs). Our findings provide partial support for the hypothesis that visuomotor interference effects can be reduced when two physically incongruent actions are represented as mechanically interdependent contributions to a joint action goal. (shrink)

This book aims to show that recent developments in neuroscience permit a defense of free will. Through language, human beings can escape strict biological determinism.

The idea that intentions make the difference between voluntary and non-voluntary behaviors is simple and intuitive. At the same time, we lack an understanding of how voluntary actions actually come about, and the unquestioned appeal to intentions as discrete causes of actions offers little if anything in the way of an answer. We cite evidence suggesting that the origin of actions varies depending on context and effector, and argue that actions emerge from a causal web in the brain, rather than (...) a central origin of intentional action. We argue that this causal web need not be confined to the central nervous system, and that proprioceptive feedback might play a counterintuitive role in the decision process. Finally we argue that the complex and dynamic origins of voluntary action and their interplay with the brain’s propensity to predict the immediate future are better studied using a dynamical systems approach. (shrink)

Our target article proposed that language production and comprehension are interwoven, with speakers making predictions of their own utterances and comprehenders making predictions of other people's utterances at different linguistic levels. Here, we respond to comments about such issues as cognitive architecture and its neural basis, learning and development, monitoring, the nature of forward models, communicative intentions, and dialogue.

Action understanding of children develops from simple associative learning to mentalizing. With the rise of embodied cognition, the role of interoception in action observation and action understanding has received more attention. From a developmental perspective, this study proposes a novel developmental model that explores how interoception promotes action understanding of children across ages. In early infancy, most actions observed in infants come from interactions with their caregivers. Babies learn about action effects through automatic interoceptive processing and interoceptive feedback. Interoception in (...) early infancy is not fully developed, such as the not fully developed gastrointestinal tract and intestinal nervous system. Therefore, in early infancy, action understanding is based on low-level and original interoceptive information. At this stage, after observing the actions of others, infants can create mental representations or even imitate actions without external visual feedback, which requires interoception to provide internal reference information. By early childhood, children begin to infer action intentions of other people by integrating various types of information to reach the mentalizing level. Interoception processing requires the integration of multiple internal signals, which promotes the information integration ability of children. Interoception also provides inner information for reasoning about action intention. This review also discussed the neural mechanisms of interoception and possible ways by which it could promote action understanding of children. In early infancy, the central autonomic neural network (CAN) automatically processes and responds to the actions of caregivers on infants, providing interoceptive information for action understanding of infants. In infancy, the growth of the somatomotor system provides important internal reference information for observing and imitating the actions of infants. In early childhood, the development of interoception of children facilitates the integration of internal and external information, which promotes the mentalization of action understanding of children. According to the proposed developmental model of action understanding of children promoted by interoception, there are multilevel and stage-dependent characteristics that impact the role of interoception in action understanding of children. (shrink)

Given the discovery of a distributed language and motor functional network, surprisingly few studies have explored whether language processing is related to motor skill training. To address this issue, the present study used functional magnetic resonance imaging to compare whole-brain activation between nonexperts and experts in table tennis, an open skill sport in which players make rapid decisions in response to an ever-changing environment. Whole-brain activation was assessed in 30 expert table tennis players with more than 7 years’ experience and (...) 35 age-matched nonexpert college students while they performed both a size and a semantic judgment task of words presented on a monitor. Compared with nonexperts, expert table tennis players showed greater activation in the left middle occipital gyrus and right precuneus while judging the size of the words versus during baseline fixation. They also showed greater activation in the left lingual gyrus during the semantic judgment task versus during baseline fixation. Our findings indicate that the visual regions engaged in language processing are associated with open motor skill training. (shrink)