The debate about the nature of the representational format of concepts seems to have reached an impasse. The debate faces two fundamental problems. Firstly, amodalists (i.e., those who argue that concepts are represented by amodal symbols) and modalists (i.e., those who see concepts as involving crucially representations including sensorimotor information) claim that the same empirical evidence is compatible with their views. Secondly, there is no shared understanding of what a modal or amodal format amounts to. Both camps recognize that the (...) two formats play essential roles in higher cognition, leading to an increasing number of hybrid proposals. In this paper, I argue that the existence of those fundamental problems should make us suspicious about a modal/amodal dichotomy. Also, I suggest that hybrid approaches, as they currently stand, do not provide suitable solutions to the impasse. Instead, we should overcome the dichotomy and treat the modal/amodal distinction as a graded phenomenon. I illustrate this hypothesis with an example of a cognitive-computational model of concepts based on the Predictive Processing framework. (shrink)

The Phenomenal Concept Strategy offers the physicalist perhaps the most promising means of explaining why the connection between mental facts and physical facts appears to be contingent even though it is not. In this article, we show that the large body of evidence suggesting that our concepts are often embodied and grounded in sensorimotor systems speaks against standard forms of the PCS. We argue, nevertheless, that it is possible to formulate a novel version of the PCS that is thoroughly in (...) keeping with embodied cognition, focuses on features of physical concepts, and succeeds in explaining the appearance of contingency. (shrink)

Traditionally, the “Imagery Debate” has opposed two main camps: depictivism and descriptivism. This debate has essentially focused on the nature of the internal representations thought to be involved in imagery, without addressing at all the question of action. More recently, a third, “embodied” view is moving the debate into a new phase. The embodied approach focuses on the interdependence of perception, cognition and action, and in its more radical line this approach promotes the idea that perception is not a process (...) involving internal world-models. The anti-representationalist version of the embodied paradigm covers, among others that we shall not discuss here, two quite different positions, namely the enactive approach and sensorimotor theory. Up to now these two anti-representationalist accounts have generally been confounded. In this paper we will argue that despite some important commonalities, enactive and sensorimotor accounts come with distinctive theoretical traits with regard to their approach to imagery. These become manifest when critically examining the role they assign to sensorimotor engagements with the world. We shall argue that enactive and sensorimotor approaches are different in their understanding of the role of embodied action, and these different notions of embodiment lead to different explanatory accounts of perception and imagery. We propose that, due to existing ambiguities in enactivism, the sensorimotor theory is a better framework for a skill-based approach to imagery. (shrink)

I evaluate the bottlenecks involved in the simulation mechanism underpinning superior predictive abilities for upcoming actions. This perceptual-motor state is characterized by a complex interrelationship designed to make predictions using a highly fine-tuned and constrained motor operation. The extension of such mechanisms to language may occur only in sensorimotor circuits devoted to the action domain.

In the past, notions of embodiment have been applied to robotics mainly in the realm of very simple robots, and supporting low-level mechanisms such as dynamics and navigation. In contrast, most human-like, interactive, and socially adept robotic systems turn away from embodiment and use amodal, symbolic, and modular approaches to cognition and interaction. At the same time, recent research in Embodied Cognition (EC) is spanning an increasing number of complex cognitive processes, including language, nonverbal communication, learning, and social behavior.This article (...) suggests adopting a modern EC approach for autonomous robots interacting with humans. In particular, we present three core principles from EC that may be applicable to such robots: (a) modal perceptual representation, (b) action/perception and action/cognition integration, and (c) a simulation-based model of top-down perceptual biasing. We describe a computational framework based on these principles, and its implementation on two physical robots. This could provide a new paradigm for embodied human–robot interaction based on recent psychological and neurological findings. (shrink)

Cognition is embodied when it is deeply dependent upon features of the physical body of an agent, that is, when aspects of the agent's body beyond the brain play a significant causal or physically constitutive role in cognitive processing. In general, dominant views in the philosophy of mind and cognitive science have considered the body as peripheral to understanding the nature of mind and cognition. Proponents of embodied cognitive science view this as a serious mistake. Sometimes the nature of the (...) dependence of cognition on the body is quite unexpected, and suggests new ways of conceptualizing and exploring the mechanics of cognitive processing. Embodied cognitive science encompasses a loose-knit family of research programs in the cognitive sciences that often share a commitment to critiquing and even replacing traditional approaches to cognition and cognitive processing. Empirical research on embodied cognition has exploded in the past 10 years. As the bibliography for this article attests, the various bodies of work that will be discussed represent a serious alternative to the investigation of cognitive phenomena. Relatively recent work on the embodiment of cognition provides much food for thought for empirically-informed philosophers of mind. This is in part because of the rich range of phenomena that embodied cognitive science has studied. But it is also in part because those phenomena are often thought to challenge dominant views of the mind, such as the computational and representational theories of mind, at the heart of traditional cognitive science. And they have sometimes been taken to undermine standard positions in the philosophy of mind, such as the idea that the mind is identical to, or even realized in, the brain. (shrink)

The paper outlines a structuralist unification between two existing relational theories of the self, i.e., Beni's Structural Realist theory of the Self and Gallese's Embodied Relational Self. Each one of these theories provides a structuralist account of some aspects of the self but leaves out some other aspects which are indispensable to a comprehensive account of the self. SRS accounts for the reflective aspects of the self, and ERS accounts for the environmental and social aspects of the self. In this (...) paper, I argue that when paired with one another, SRS and ERS could amend one another's shortcomings, without giving way to a non-relational conception of the self. I draw on neurology of the connection between Cortical Midline Structures and the mirror neuron system to inform my unifying proposal. I also show that an informational framework can underlie the union. (shrink)

Sensorimotor representations are essential for building up and maintaining corporeal awareness, i.e. the ability to perceive, know and evaluate one's own body as well as the bodies of others. The notion of embodied cognition implies that abstract forms of conceptual knowledge may be ultimately instantiated in such sensorimotor representations. In this sense, conceptual thinking should evoke, via mental simulation, some underlying sensorimotor events. In this review we discuss studies on the relation between embodiment and corporeal awareness. We approach the question (...) by issuing challenges from both ends. First, we ask whether bodily representations themselves can be disembodied or disconnected from underlying sensorimotor events. Second, we ask whether any concept, no matter how abstract, can actually be embodied in this way. The strong view of embodied cognition requires a negative answer to the first question, and an affirmative answer to the second. We also focus on the surprising range of cognitive processes that can be explained by linking them to corporeal awareness, such as aesthetic appreciation, and object constancy following brain damage. We conclude that (a) somatomotor simulation may help to understand the external world and the society of other individuals, but (b) some non-somatic forms of simulation may be required to explain how abstract knowledge contributes to understanding others' states. In this sense, the classic divide between sensorimotor and conceptual domains must remain in some form. (shrink)

In this paper we discuss an approach called grounded action cognition, which aims to provide a theory of the interdependencies between motor control and action-related cognitive processes, like perceiving an action or thinking about an action. The theory contrasts with traditional views in cognitive science in that it motivates an understanding of cognition as embodied, through application of Barsalou’s general idea of grounded cognition. To guide further research towards an appropriate theory of grounded action cognition we distinguish between grounding qua (...) acquisition and grounding qua constitution. On this basis, we distinguish three possible theoretical conceptions of grounded action cognition. In addition to these methodological and conceptual analyses, we draw on recent empirical evidence to motivate our inclination towards a particular theory. According to this theory certain representations are involved in action cognition and action perception that are not modality-specific as usually proposed by advocates of grounded cognition. Further, the evidence is in favor of our more specific theory stating that for some cognitive abilities, some motor abilites are constitutive. (shrink)

Concept normativity is a prominent subject of inquiry in the philosophical literature on the nature of concepts. Concepts are said to be normative, in that the use of concepts to categorise is associated with an evaluation of the appropriateness of such categorisation measured against some objective external standard. Two broad groups of views have emerged in accounting for the normativity of concepts: a weaker view traces such normativity to the social practice in which the agent using the concept is embedded, (...) while a stronger view traces such normativity to a first-person capacity of reflection. However, both views have drawbacks: the weaker view seems not to do justice to the basic sense of normativity associated with an individual agent using a concept, while the stronger view ties such normativity with the first-person conscious evaluation, which appears to be too strong. Here, we propose a different view of concepts using principles from the Active Inference framework. We reconceive concepts, defining them as Bayesian beliefs—that is, conditional probability distributions—that represent causes and contingencies in the world, their form grounded in the exchange between the agent and its environment. This allows us to present a different view on the source of normativity, with an emphasis on the structure of the agent itself as well as its interaction with the environment. On the Active Inference view, concepts are normative in that they are intrinsically connected to the self-evidencing nature of an agent, whose very structure implies an evaluation of the concepts it employs. (shrink)

My reply to Macpherson begins by addressing whether it is effects of cognition on early vision or perceptual performance that I am interested in. I proceed to address Macpherson’s comments on evidence from cross-modal effects, interpretations of linguistic effects on image detection, evidence from illusions, and the usefulness of predictive coding for understanding cognitive penetration. By stressing the interactive and distributed nature of neural processing, I am committing to a collapse between perception and cognition. Following such a collapse, the very (...) question of whether cognition affects perception becomes ill-posed, but this may be for the best. (shrink)

Many current programs for cognitive science sail under the banner of “embodied cognition.” These programs typically seek to distance themselves from standard cognitive science. The present proposal for a conception of embodied cognition is less radical than most, indeed, quite compatible with many versions of traditional cognitive science. Its rationale is based on two elements, each of which is theoretically plausible and empirically well-founded. The first element invokes the idea of “bodily formats,” i.e., representational codes primarily utilized in forming interoceptive (...) or directive representations of one’s bodily states and activities. The second element appeals to wideranging evidence that the brain reuses or redeploys cognitive processes having different original uses. When the redeployment theme is applied to bodily formats of representation, they jointly provide for the possibility that body-coded cognition is a very pervasive sector of cognition. (shrink)

According to embodied theories of language (ETLs), word meaning relies on sensorimotor brain areas, generally dedicated to acting and perceiving in the real world. More specifically, words denoting actions are postulated to make use of neural motor areas, while words denoting visual properties draw on the resources of visual brain areas. Therefore, there is a direct correspondence between word meaning and the experience a listener has had with a word's referent on the brain level. Behavioral and neuroimaging studies have provided (...) evidence in favor of ETLs; however, recent studies have also shown that sensorimotor information is recruited in a flexible manner during language comprehension (e.g., Raposo et al. ; Van Dam et al., ), leaving open the question as to what level of language processing sensorimotor activations contribute. In this study, we investigated the time course of modality‐specific contributions (i.e., the contribution of action information) as to word processing by manipulating both (a) the linguistic and (b) the action context in which target words were presented. Our results demonstrate that processes reflecting sensorimotor information play a role early in word processing (i.e., within 200 ms of word presentation), but that they are sensitive to the linguistic context in which a word is presented. In other words, when sensorimotor information is activated, it is activated quickly; however, specific words do not reliably activate a consistent sensorimotor pattern. (shrink)

This paper critically examines Jay Garfield’s accounts of the self, consciousness, and phenomenology in his book, Engaging Buddhism: Why It Matters to Philosophy. I argue that Garfield’s views on these topics are shaped, in problematic ways, by views he takes over from Wilfrid Sellars and applies to Buddhist philosophy.

This review discusses recent work on foundational questions about concepts. The first of these questions is whether concepts are context-independent bodies of knowledge, or context-dependent constructs, created on the fly. The second question is whether concepts are abstract, amodal representations, or whether they are embedded within the sensory-motor system. I discuss these two questions in light of empirical data from psychology and neuroscience, as well as theoretical considerations, and examine their implications for theories of concepts.

Euclidean diagrammatic reasoning refers to the diagrammatic inferential practice that originated in the geometrical proofs of Euclid’s Elements. A seminal philosophical analysis of this practice by Manders (‘The Euclidean diagram’, 2008) has revealed that a systematic method of reasoning underlies the use of diagrams in Euclid’s proofs, leading in turn to a logical analysis aiming to capture this method formally via proof systems. The central premise of this paper is that our understanding of Euclidean diagrammatic reasoning can be fruitfully advanced (...) by confronting these logical and philosophical analyses with the field of cognitive science. Surprisingly, central aspects of the philosophical and logical analyses resonate in very natural ways with research topics in mathematical cognition, spatial cognition and the psychology of reasoning. The paper develops these connections, concentrating on four issues: (1) the cognitive origins of Euclidean diagrammatic reasoning, (2) the cognitive representations of spatial relations in Euclidean diagrams, (3) the nature of the cognitive processes and cognitive representations involved in Euclidean diagrammatic reasoning seen as a form of visuospatial relational reasoning and (4) the complexity of Euclidean diagrammatic reasoning for the human cognitive system. For each of these issues, our analysis generates concrete experiment proposals, opening thereby the way for further empirical investigations. The paper is thus a prolegomenon to a research program on Euclidean diagrammatic reasoning at the crossroads of logic, philosophy and cognitive science. (shrink)

Spatial aspects of words are associated with their canonical locations in the real world. Yet little research has tested whether spatial associations denoted in language comprehension generalize to their corresponding images. We directly tested the spatial aspects of mental imagery in picture and word processing (Experiment 1). We also tested whether spatial representations of motion words produce similar perceptual-interference effects as demonstrated by object words (Experiment 2). Findings revealed that words denoting an upward spatial location produced slower responses to targets (...) appearing at the top of the display, whereas words denoting a downward spatial location produced slower responses to targets appearing at the bottom of the display. Perceptual-interference effects did not obtain for pictures or for words lacking a spatial relation. These findings provide greater empirical support for the perceptual-symbols system theory (Barsalou, 1999, 2008). (shrink)

TEST is a novel taxonomy of knowledge representations based on three distinct hierarchically organized representational features: Tropism, Embodiment, and Situatedness. Tropic representational features reflect constraints of the physical world on the agent's ability to form, reactivate, and enrich embodied (i.e., resulting from the agent's bodily constraints) conceptual representations embedded in situated contexts. The proposed hierarchy entails that representations can, in principle, have tropic features without necessarily having situated and/or embodied features. On the other hand, representations that are situated and/or embodied (...) are likely to be simultaneously tropic. Hence, although we propose tropism as the most general term, the hierarchical relationship between embodiment and situatedness is more on a par, such that the dominance of one component over the other relies on the distinction between offline storage versus online generation as well as on representation-specific properties. (shrink)

Thirty years ago, grounded cognition had roots in philosophy, perception, cognitive linguistics, psycholinguistics, cognitive psychology, and cognitive neuropsychology. During the next 20 years, grounded cognition continued developing in these areas, and it also took new forms in robotics, cognitive ecology, cognitive neuroscience, and developmental psychology. In the past 10 years, research on grounded cognition has grown rapidly, especially in cognitive neuroscience, social neuroscience, cognitive psychology, social psychology, and developmental psychology. Currently, grounded cognition appears to be achieving increased acceptance throughout cognitive (...) science, shifting from relatively minor status to increasing importance. Nevertheless, researchers wonder whether grounded mechanisms lie at the heart of the cognitive system or are peripheral to classic symbolic mechanisms. Although grounded cognition is currently dominated by demonstration experiments in the absence of well-developed theories, the area is likely to become increasingly theory driven over the next 30 years. Another likely development is the increased incorporation of grounding mechanisms into cognitive architectures and into accounts of classic cognitive phenomena. As this incorporation occurs, much functionality of these architectures and phenomena is likely to remain, along with many original mechanisms. Future theories of grounded cognition are likely to be heavily influenced by both cognitive neuroscience and social neuroscience, and also by developmental science and robotics. Aspects from the three major perspectives in cognitive science—classic symbolic architectures, statistical/dynamical systems, and grounded cognition—will probably be integrated increasingly in future theories, each capturing indispensable aspects of intelligence. (shrink)

According to sensorimotor theory perceiving is a bodily skill involving exercise of an implicit know-how of the systematic ways that sensations change as a result of potential movements, that is, of sensorimotor contingencies. The theory has been most successfully applied to vision and touch, while perceptual modalities that rely less on overt exploration of the environment have not received as much attention. In addition, most research has focused on philosophically grounding the theory and on psychologically elucidating sensorimotor laws, but the (...) theory’s ramifications for neuroscience still remain underexamined. Here we sketch the beginnings of a research program that could address these two outstanding challenges in terms of auditory perception. We review the neuroscience literature on passive listening, which is defined as listening without overt bodily movement, and conclude that sensorimotor theory provides a unique perspective on the consistent finding of motor system activation. In contrast to competing theories, this activation is predicted to be involved not only in the perception of speech- and action-related sounds, but in auditory perception in general. More specifically, we propose that the auditory processing associated with supplementary motor areas forms part of the neural basis of the exercise of sensorimotor know-how: these areas’ recognized role in facilitating spontaneous motor responses to sound and supporting flexible engagement of sensorimotor processes to guide auditory experience and enable auditory imagery, can be understood in terms of two key characteristics of sensorimotor interaction, its “alerting capacity” and “corporality”, respectively. We also highlight that there is more to the inside of the body than the brain: there is an opportunity to develop sensorimotor theory into new directions in terms of the still poorly understood active processes of the peripheral auditory system. (shrink)

Grammatical categories represent implicit knowledge, and it is not known if such abstract linguistic knowledge can be continuously grounded in real-life experiences, nor is it known what types of mental states can be simulated. A former study showed that attention bias in peripersonal space affects reaction times in grammatical congruency judgments of nominal classifiers, suggesting that simulated semantics may include reenactment of attention. In this study, we contrasted a Chinese nominal classifier used with nouns denoting pinch grip objects with a (...) classifier for nouns with big object referents in a pupil dilation experiment. Twenty Chinese native speakers read grammatical and ungrammatical classifier-noun combinations and made grammaticality judgment while their pupillary responses were measured. It was found that their pupils dilated significantly more to the pinch grip classifier than to the big object classifier, indicating attention simulation in PPS. Pupil dilations were also significantly larger with congruent trials on the whole than in incongruent trials, but crucially, congruency and classifier semantics were independent of each other. No such effects were found in controls. (shrink)

The phenomenal character of conscious experience has long been regarded as the major problem for physicalist accounts of consciousness. In recent years, defenders of physicalism have typically been relying on the so-called Phenomenal Concept Strategy to avoid dualism. In this paper, we argue with PCS that cognitive-physicalistic explanations can account for the peculiarities of phenomenal character. However, we think that the conceptual features PCS investigates are not the genuine causes of the special characteristics of phenomenal consciousness but only symptoms, which (...) can themselves be explained in terms of the features of the sensory-perceptual representations underlying conscious experiences, namely that some, but not all, of these states are representationally unstructured. (shrink)

The topic is characterized by a highly interdisciplinary approach to the issue of action and language integration. Such an approach, combining computational models and cognitive robotics experiments with neuroscience, psychology, philosophy, and linguistic approaches, can be a powerful means that can help researchers disentangle ambiguous issues, provide better and clearer definitions, and formulate clearer predictions on the links between action and language. In the introduction we briefly describe the papers and discuss the challenges they pose to future research. We identify (...) four important phenomena the papers address and discuss in light of empirical and computational evidence: (a) the role played not only by sensorimotor and emotional information but also of natural language in conceptual representation; (b) the contextual dependency and high flexibility of the interaction between action, concepts, and language; (c) the involvement of the mirror neuron system in action and language processing; (d) the way in which the integration between action and language can be addressed by developmental robotics and Human-Robot Interaction. (shrink)

As embodied theories of cognition are increasingly formalized and tested, care must be taken to make informed assumptions regarding the nature of concepts and representations. In this study, we outline three reasons why one cannot, in effect, represent the same concept twice. First, online perception affects offline representation: Current representational content depends on how ongoing demands direct attention to modality-specific systems. Second, language is a fundamental facilitator of offline representation: Bootstrapping and shortcuts within the computationally cheaper linguistic system continuously modify (...) representational content. Third, time itself is a source of representational change: As the content of underlying concepts shifts with the accumulation of direct and vicarious experience, so too does the content of representations that draw upon these concepts. We discuss the ramifications of these principles for research into both human and synthetic cognitive systems. (shrink)

The Internet is an important focus of attention for the philosophy of mind and cognitive science communities. This is partly because the Internet serves as an important part of the material environment in which a broad array of human cognitive and epistemic activities are situated. The Internet can thus be seen as an important part of the ‘cognitive ecology’ that helps to shape, support and realize aspects of human cognizing. Much of the previous philosophical work in this area has sought (...) to analyze the cognitive significance of the Internet from the perspective of human cognition. There has, as such, been little effort to assess the cognitive significance of the Internet from the perspective of ‘machine cognition’. This is unfortunate, because the Internet is likely to exert a significant influence on the shape of machine intelligence. The present paper attempts to evaluate the extent to which the Internet serves as a form of cognitive ecology for synthetic forms of intelligence. In particular, the phenomenon of Internet-situated machine intelligence is analyzed from the perspective of a number of approaches that are typically subsumed under the heading of situated cognition. These include extended, embedded, scaffolded and embodied approaches to cognition. For each of these approaches, the Internet is shown to be of potential relevance to the development and operation of machine-based cognitive capabilities. Such insights help us to appreciate the role of the Internet in advancing the current state-of-the-art in machine intelligence. (shrink)

We discuss two problems for a general scientific understanding of language, sequences and synergies: how language is an intricately sequenced behavior and how language is manifested as a multidimensionally structured behavior. Though both are central in our understanding, we observe that the former tends to be studied more than the latter. We consider very general conditions that hold in human brain evolution and its computational implications, and identify multimodal and multiscale organization as two key characteristics of emerging cognitive function in (...) our species. This suggests that human brains, and cognitive function specifically, became more adept at integrating diverse information sources and operating at multiple levels for linguistic performance. We argue that framing language evolution, learning, and use in terms of synergies suggests new research questions, and it may be a fruitful direction for new developments in theory and modeling of language as an integrated system. (shrink)

The recent trend in cognitive robotics experiments on language learning, symbol grounding, and related issues necessarily entails a reduction of sensorimotor aspects from those provided by a human body to those that can be realized in machines, limiting robotic models of symbol grounding in this respect. Here, we argue that there is a need for modeling work in this domain to explicitly take into account the richer human embodiment even for concrete concepts that prima facie relate merely to simple actions, (...) and illustrate this using distributional methods from computational linguistics which allow us to investigate grounding of concepts based on their actual usage. We also argue that these techniques have applications in theories and models of grounding, particularly in machine implementations thereof. Similarly, considering the grounding of concepts in human terms may be of benefit to future work in computational linguistics, in particular in going beyond “grounding” concepts in the textual modality alone. Overall, we highlight the overall potential for a mutually beneficial relationship between the two fields. (shrink)

Interactional expertise is said to be a form of knowledge achieved in a linguistic community and, therefore, obtained entirely outside practice. Supposedly, it is not or only minimally sustained by the so-called embodied knowledge. Here, drawing upon studies in contemporary neuroscience and cognitive psychology, I propose that ‘derived’ embodiment is deeply involved in competent language use and, therefore, also in interactional expertise. My argument consists of two parts. First, I argue for a strong relationship among language acquisition, language use and (...) the real world (i.e. the world accessible to the senses). Biological constraints in very early childhood anchor language to the body. These constraints are by-products of our evolutionary peculiarity that we gain because of our physical and psychological immaturity at birth. Thus, infancy is predominantly concerned with the bodily needs and experiences of the concrete while language acquisition takes place. Particular interest in the concrete furnishes our linguistic world and installs ‘concrete’ language as the principal constituent of competent language use. Second, I argue that well-established concrete language implicitly and explicitly elicits mental representations, namely partial reactivations of sensorimotor states that occur during experience. These are stepping stones by which we subsequently make sense of expressions in new linguistic areas. Like any competent language user, the interactional expert, therefore, prompts multimodal imagination and re-enacts concrete experiences when acquiring linguistic knowledge pertaining to a specialist field. Finally, I outline the characteristics of those imaginative powers to identify mechanisms that improve interactional expertise and discuss the obvious relation between interactional expertise and ordinary knowledge acquisition after the concrete language stage. (shrink)

This paper takes an embodied and extended cognition perspective to ER integration – a cognitive process through which a learner integrates external representations (ERs) in a domain, with her internal (mental) model, as she interacts with, uses, understands and transforms between those ERs. In the paper, I argue for a theoretical as well as empirical shift in future investigations of ER integration, by proposing a model of cognitive mechanisms underlying the process, based on recent advances in extended and embodied cognition. (...) I present this new model in contrast to the still dominant classical cognitivist (information processing) approaches to ER integration, and the educational technology intervention designs such approaches inspire. I then exemplify this distinction between the information processing model and the new model through a case of arithmetic problem solving. Corroborative neuroscience evidence presented in relation to this case provides empirical support for the new model by showing how bodily actions (sensorimotor mechanisms) are critical to ER integration and learning. Finally, as educational implications of the new model, I demonstrate the need for: (i) re-viewing the development of ER integration and expertise as fine-tuning of the learner's action or sensorimotor system, and (ii) a shift of focus in new-media intervention design principles based on this newer understanding of ER integration in science, technology, engineering and mathematics. (shrink)

Describing actions entails that relations between objects are discovered. A pervasively neural account of this process requires that fundamental problems are solved: the neural pointer problem, the binding problem, and the problem of generating discrete processing steps from time-continuous neural processes. We present a prototypical solution to these problems in a neural dynamic model that comprises dynamic neural fields holding representations close to sensorimotor surfaces as well as dynamic neural nodes holding discrete, language-like representations. Making the connection between these two (...) types of representations enables the model to describe actions as well as to perceptually ground movement phrases—all based on real visual input. We demonstrate how the dynamic neural processes autonomously generate the processing steps required to describe or ground object-oriented actions. By solving the fundamental problems of neural pointing, binding, and emergent discrete processing, the model may be a first but critical step toward a systematic neural processing account of higher cognition. (shrink)

Over the past 15 years, there have been two increasingly popular approaches to the study of meaning in cognitive science. One, based on theories of embodied cognition, treats meaning as a simulation of perceptual and motor states. An alternative approach treats meaning as a consequence of the statistical distribution of words across spoken and written language. On the surface, these appear to be opposing scientific paradigms. In this review, we aim to show how recent cross-disciplinary developments have done much to (...) reconcile these two approaches. The foundation to these developments has been the recognition that intralinguistic distributional and sensory-motor data are interdependent. We describe recent work in philosophy, psychology, cognitive neuroscience, and computational modeling that are all based on or consistent with this conclusion. We conclude by considering some possible directions for future research that arise as a consequence of these developments. (shrink)

Recent metaphor research has revealed that metaphor comprehension involves both categorization and comparison processes. This finding has triggered the following central question: Which property determines the choice between these two processes for metaphor comprehension? Three competing views have been proposed to answer this question: the conventionality view (Bowdle & Gentner, 2005), aptness view (Glucksberg & Haught, 2006b), and interpretive diversity view (Utsumi, 2007); these views, respectively, argue that vehicle conventionality, metaphor aptness, and interpretive diversity determine the choice between the categorization (...) and comparison processes. This article attempts to answer the question regarding which views are plausible by using cognitive modeling and computer simulation based on a semantic space model. In the simulation experiment, categorization and comparison processes are modeled in a semantic space constructed by latent semantic analysis. These two models receive word vectors for the constituent words of a metaphor and compute a vector for the metaphorical meaning. The resulting vectors can be evaluated according to the degree to which they mimic the human interpretation of the same metaphor; the maximum likelihood estimation determines which of the two models better explains the human interpretation. The result of the model selection is then predicted by three metaphor properties (i.e., vehicle conventionality, aptness, and interpretive diversity) to test the three views. The simulation experiment for Japanese metaphors demonstrates that both interpretive diversity and vehicle conventionality affect the choice between the two processes. On the other hand, it is found that metaphor aptness does not affect this choice. This result can be treated as computational evidence supporting the interpretive diversity and conventionality views. (shrink)

In this study, we examined the effects of emotional experience, a relatively new dimension of emotional knowledge that gauges the ease with which words evoke emotional experience, on abstract word processing in the Stroop task. In order to test the context-dependency of these effects, we accentuated the saliency of this dimension in Experiment 1A by blocking the stimuli such that one block consisted of the stimuli with the highest emotional experience ratings and the other block consisted of the stimuli with (...) the lowest emotional experience ratings. We attenuated the saliency of this dimension in Experiment 1B by intermixing the stimuli. We observed slower color naming performance for words with higher emotional experience ratings only in Experiment 1A, suggesting that the dimension of emotional experience is an aspect of semantic representation for abstract words but that its influence can be modulated by context. We interpret these results more generally using Vigliocco, Meteyard, Andrews, and Kousta's framework of semantic representation, and more specifically using Cohen, Dunbar, and McClelland's model of Stroop task performance. (shrink)

Recently, there has been a great deal of interest in the idea that natural language enhances and extends our cognitive capabilities. Supporters of embodied cognition have been particularly interested in the way in which language may provide a solution to the problem of abstract concepts. Toward this end, some have emphasized the way in which language may act as form of cognitive scaffolding and others have emphasized the potential importance of language-based distributional information. This essay defends a version of the (...) cognitive enhancement thesis that integrates and builds on both of these proposals. I argue that the embodied representations associated with language processing serve as a supplementary medium for conceptual processing. The acquisition of a natural language provides a means of extending our cognitive reach by giving us access to an internalized combinatorial symbol system that augments and supports the context-sensitive embodied representational systems that exist independently of language. (shrink)

Experientialist semantics has contributed to a broader notion of linguistic meaning by emphasizing notions such as construal, perspective, metaphor, and embodiment, but has suffered from an individualist concept of meaning and has conflated experiential motivations with conventional semantics. We argue that these problems can be redressed by methods and concepts from phenomenology, on the basis of a case study of sentences of non-actual motion such as “The mountain range goes all the way from Mexico to Canada.” Through a phenomenological reanalysis (...) of proposals of Talmy, Langacker, and Matlock, we show that non-actual motion is both experientially and linguistically non-unitary. At least three different features of human consciousness—enactive perception, visual scanning, and imagination—constitute experiential motivations for non-actual motion sentences, and each of these could be related to phenomenological analyses of human intentionality. The second problem is addressed by proposing that the experiential motivations of non-actual motion sentences can be viewed as sedimented through “passive” processes of acquisition and social transmission and that this implies an interactive loop between experience and language, yielding losses in terms of original experience, but gains in terms of communal signification. Something that is underestimated by phenomenology is that what is sedimented are not only intentional objects such as states of affairs, but aspects of how they are given, i.e., the original, temporal, bodily experiences themselves. Since cognitive semantics has emphasized such aspects of meaning, we suggest that phenomenology can itself benefit from experientialist semantics, especially when it turns its focus from prepredicative to predicative, linguistic intentionality. (shrink)

Contemporary research on mindreading or theory of mind has resulted in three major findings: There is a difference in the age of passing of the elicited-response false belief task and its spontaneous–response version; 15-month-olds pass the latter while the former is passed only by 4-year-olds. Linguistic and social factors influence the development of the ability to mindread in many ways. There are cultures with folk psychologies significantly different from the Western one, and children from such cultures tend to show different (...) timetables of mindreading development. The traditional accounts of the data are nativism, rational constructivism, and two-systems theory. In this paper, we offer criticism of these traditional cognitivist accounts and explore an alternative, action-based framework. We argue that even though they all seem to explain the above empirical data, there are other, theoretical reasons why their explanations are untenable. Specifically, we discuss the problem of foundationalism and the related problem of innateness. Finally, we explore an alternative, action-based framework that avoids these theoretical limitations and offer an interpretation of the empirical data from that perspective. (shrink)

This article notes the convergence of recent thinking in neuroscience and grounded cognition regarding the way we understand mental representation and recollection: ideas are dynamic and multi-modal, actively created at the point of recall. Also, neurophysiologically, re-entrant signalling among cortical circuits allows non-conscious processing to support our deliberative thoughts and actions. The qualitative research we describe examines the exchanges occurring during semi-structured interviews with 360 children age 3–13, including 294 from New Zealand and 66 from China concerning their understanding of (...) the shape and motion of the Earth, Sun and Moon. We look closely at the relationships between what is revealed as children manipulate their own play-dough models and their apparent understandings of ESM concepts. In particular, we focus on the switching taking place between what is said, what is drawn and what is modelled. The evidence is supportive of Edelman’s view that memory is non-representational and that concepts are the outcome of perceptual mappings, a view which is also in accord with Barsalou’s notion that concepts are simulators or skills which operate consistently across several modalities. Quantitative data indicate that the dynamic structure of memory/concept creation is similar in both genders and common to the cultures/ethnicities compared and that repeated interviews in this longitudinal research lead to more advanced modelling skills and/or more advanced shape and motion concepts, the results supporting hypotheses. (shrink)

A growing body of evidence in cognitive psychology and neuroscience suggests a deep interconnection between sensory-motor and language systems in the brain. Based on recent neurophysiological findings on the anatomo-functional organization of the fronto-parietal network, we present a computational model showing that language processing may have reused or co-developed organizing principles, functionality, and learning mechanisms typical of premotor circuit. The proposed model combines principles of Hebbian topological self-organization and prediction learning. Trained on sequences of either motor or linguistic units, the (...) network develops independent neuronal chains, formed by dedicated nodes encoding only context-specific stimuli. Moreover, neurons responding to the same stimulus or class of stimuli tend to cluster together to form topologically connected areas similar to those observed in the brain cortex. Simulations support a unitary explanatory framework reconciling neurophysiological motor data with established behavioral evidence on lexical acquisition, access, and recall. (shrink)

Designing, building, and experimenting with physical simulation models are central problem‐solving practices in the engineering sciences. Model‐based simulation is an epistemic activity that includes exploration, generation and testing of hypotheses, explanation, and inference. This paper argues that to interpret and understand how these simulation models function in creating knowledge and technologies requires construing problem solving as accomplished by a researcher–artifact system. It draws on and further develops the framework of “distributed cognition” to interpret data collected in ethnographic and cognitive‐historical studies (...) of two biomedical engineering research laboratories, and articulates the notion of distributed model‐based cognition to answer the question posed in the title. (shrink)

The literature contains a disconnect between accounts of how humans learn lexical semantic representations for words. Theories generally propose that lexical semantics are learned either through perceptual experience or through exposure to regularities in language. We propose here a model to integrate these two information sources. Specifically, the model uses the global structure of memory to exploit the redundancy between language and perception in order to generate inferred perceptual representations for words with which the model has no perceptual experience. We (...) test the model on a variety of different datasets from grounded cognition experiments and demonstrate that this diverse set of results can be explained as perceptual simulation (cf. Barsalou, Simmons, Barbey, & Wilson, 2003) within a global memory model. (shrink)

Metaphor has a double life. It can be described as a directional process in which a stable, familiar base domain provides inferential structure to a less clearly specified target. But metaphor is also described as a process of finding commonalities, an inherently symmetric process. In this second view, both concepts may be altered by the metaphorical comparison. Whereas most theories of metaphor capture one of these aspects, we offer a model based on structure-mapping that captures both sides of metaphor processing. (...) This predicts (a) an initial processing stage of symmetric alignment; and (b) a later directional phase in which inferences are projected to the target. To test these claims, we collected comprehensibility judgments for forward (e.g., “A rumor is a virus”) and reversed (“A virus is a rumor”) metaphors at early and late stages of processing, using a deadline procedure. We found an advantage for the forward direction late in processing, but no directional preference early in processing. Implications for metaphor theory are discussed. (shrink)

This article addresses the semiotic problem of how meaning is agentially grounded: how actual meaning is possible and is justifiably supported by agents’ capabilities and purposes. This article is particularly focused on human agential grounding; however, to a great degree, insights presented here can be extended to other living beings. Specifically, agential meaning is examined here inside the framework of agentive semiotics and embodied, situated and enactive cognition theories, in line with the mind-life continuity general thesis. To offer clarity and (...) methodological precision about agential grounding, three explanation categories are proposed: phylogenetic recurrence, the evolutionary basis for corporal/embodied grounding; ontogenetic recurrence, the developmental basis for individual meaning grounding; and collective recurrence, the basis for meaning recognized, attributed and assigned inside social contexts. These recurrences are conceived as three types of general processes that constantly enclose possibilities for purpose and meaning emergence in humans. As a result of these types of recurrences, two categories of human agendas or purposes are also proposed: individual and collective. Finally, remarks about how these categories can be useful for semiotic analysis and further research are suggested. (shrink)

Although philosophy has been only a minor contributor to cognitive science to date, this paper describes two projects in naturalistic philosophy of mind and one in naturalistic philosophy of science that have been pursued during the past 30 years and that can make theoretical and methodological contributions to cognitive science. First, stances on the mind–body problem (identity theory, functionalism, and heuristic identity theory) are relevant to cognitive science as it negotiates its relation to neuroscience and cognitive neuroscience. Second, analyses of (...) mental representations address both their vehicles and their contents; new approaches to characterizing how representations have content are particularly relevant to understanding the relation of cognitive agents to their environments. Third, the recently formulated accounts of mechanistic explanation in philosophy of science both provide perspective on the explanatory project of cognitive science and may offer normative guidance to cognitive science (e.g., by providing perspective on how multiple disciplinary perspectives can be integrated in understanding a given mechanism). (shrink)

Recent developments in the psychological and social sciences have seen a surge of attention to concepts of embodiment. The burgeoning field of embodied cognition, as well as the long-standing tradition of phenomenological philosophy, offer valuable insights for theorising how people come to understand the world around them. However, the implications of human embodiment have been largely neglected by one of the key frameworks for conceptualising the development of social knowledge: Social Representations Theory. This article seeks to spark a dialogue between (...) Social Representations Theory and embodiment research. It outlines the position the body occupies in the existing theoretical and empirical social representations literature, and argues that incorporating concepts gleaned from embodiment research may facilitate a more comprehensive account of the aetiology of social representations. The value of analytic attention to embodiment is illustrated with reference to a recent study of social representations of neuroscience, which suggested that embodied experience can shape the extent to which people engage with certain topics, the conditions under which they do so, and the conceptual and affective content of the ensuing representations. The article argues that expanding Social Representations Theory's methodological and conceptual toolkit, in order to illuminate the interplay between embodied experience and social communication in the development of common-sense knowledge, promises productive directions for empirical and theoretical advancement. (shrink)

This study examines the spontaneous use of embodied egocentric transformation in understanding false beliefs in the minds of others. EET involves the participants mentally transforming or rotating themselves into the orientation of an agent when trying to adopt his or her visuospatial perspective. We argue that psychological perspective taking such as false belief reasoning may also involve EET because of what has been widely reported in the embodied cognition literature, showing that our processing of abstract, propositional information is often grounded (...) in concrete bodily sensations which are not apparently linked to higher cognition. In Experiment 1, an agent placed a ball into one of two boxes and left. The ball then rolled out and moved either into the other box or back into the original one. The participants were to decide from which box they themselves or the agent would try to recover the ball. Results showed that false belief performance was affected by increased orientation disparity between the participants and the agent, suggesting involvement of embodied transformation. In Experiment 2, false belief was similarly induced and the participants were to decide if the agent would try to recover the ball in one specific box. Orientation disparity was again found to affect false belief performance. The present results extend previous findings on EET in visuospatial perspective taking and suggest that false belief reasoning, which is a kind of psychological perspective taking, can also involve embodied rotation, consistent with the embodied cognition view. (shrink)

Embodied cognitive science holds that cognitive processes are deeply and inescapably rooted in our bodily interactions with the world. Our finite, contingent, and mortal embodiment may be not only supportive, but in some cases even constitutive of emotions, thoughts, and experiences. My discussion here will work outward from the neuroanatomy and neurophysiology of the brain to a nervous system which extends to the boundaries of the body. It will extend to nonneural aspects of embodiment and even beyond the boundaries of (...) the body to prosthetics of various kinds, including symbioses with a broad array of cultural artifacts, our symbolic niche, and our relationships with other embodied human beings. While cognition may not always be situated, its origins are embedded in temporally and spatially limited activities. Cognitive work also can be off-loaded to the body and to the environment in service of action, tool use, group cognition, and social coordination. This can blur the boundaries between brain areas, brain and body, and body and environment, transforming our understanding of mind and personhood to provide a different grounding for faith traditions in general, and of the historically dualist Christian tradition in particular. (shrink)

Psychologists are increasingly interested in embodiment based on the assumption that thoughts, feelings, and behaviors are grounded in bodily interaction with the environment. We examine how embodiment is used in social psychology, and we explore the ways in which embodied approaches enrich traditional theories. Although research in this area is burgeoning, much of it has been more descriptive than explanatory. We provide a critical discussion of the trajectory of embodiment research in social psychology. We contend that future researchers should engage (...) in a phenomenon-based approach, highlight the theoretical boundary conditions and mediators involved, explore novel action-relevant outcome measures, and address the role of individual differences broadly defined. Such research will likely provide a more explanatory account of the role of embodiment in general terms as well as how it expands the knowledge base in social psychology. (shrink)

Expertise depends on hours and hours of practice within a field before a state of proficiency is achieved. Normally, expert skills involve bodily knowledge associated to the practices of a field. Interactional expertise, i.e. the ability to talk competently about the field, however, is not causally dependent on bodily proficiency. Instead, interactional experts are verbally skilled to an extent that makes them impossible to distinguish from so-called contributory experts, the experienced practitioners. The concept of interactional expertise defines linguistic skills as (...) contingent on bodily knowledge. However, recent neuropsychological findings make it plausible that “first-person”-related neural activations would be relevant with respect to the subjects' verbal output, at least when subjects address concepts that refer to tangible objects. Using imitation games, we explore and expand on the apparently arbitrary relation between bodily experiences and linguistic skills in midwifery. In alignment with several findings within grounded cognition studies, the results presented suggest that somehow personal experiences make a linguistic difference, noticeable to contributory experts. (shrink)