Spatial aspects of words are associated with their canonical locations in the real world. Yet little research has tested whether spatial associations denoted in language comprehension generalize to their corresponding images. We directly tested the spatial aspects of mental imagery in picture and word processing (Experiment 1). We also tested whether spatial representations of motion words produce similar perceptual-interference effects as demonstrated by object words (Experiment 2). Findings revealed that words denoting an upward spatial location produced slower responses to targets (...) appearing at the top of the display, whereas words denoting a downward spatial location produced slower responses to targets appearing at the bottom of the display. Perceptual-interference effects did not obtain for pictures or for words lacking a spatial relation. These findings provide greater empirical support for the perceptual-symbols system theory (Barsalou, 1999, 2008). (shrink)

According to embodied theories of language (ETLs), word meaning relies on sensorimotor brain areas, generally dedicated to acting and perceiving in the real world. More specifically, words denoting actions are postulated to make use of neural motor areas, while words denoting visual properties draw on the resources of visual brain areas. Therefore, there is a direct correspondence between word meaning and the experience a listener has had with a word's referent on the brain level. Behavioral and neuroimaging studies have provided (...) evidence in favor of ETLs; however, recent studies have also shown that sensorimotor information is recruited in a flexible manner during language comprehension (e.g., Raposo et al. ; Van Dam et al., ), leaving open the question as to what level of language processing sensorimotor activations contribute. In this study, we investigated the time course of modality‐specific contributions (i.e., the contribution of action information) as to word processing by manipulating both (a) the linguistic and (b) the action context in which target words were presented. Our results demonstrate that processes reflecting sensorimotor information play a role early in word processing (i.e., within 200 ms of word presentation), but that they are sensitive to the linguistic context in which a word is presented. In other words, when sensorimotor information is activated, it is activated quickly; however, specific words do not reliably activate a consistent sensorimotor pattern. (shrink)

Manipulation of physical models such as tangrams and tiles is a popular approach to teaching early mathematics concepts. This pedagogical approach is extended by new computational media, where mathematical entities such as equations and vectors can be virtually manipulated. The cognitive and neural mechanisms supporting such manipulation-based learning—particularly how actions generate new internal structures that support problem-solving—are not understood. We develop a model of the way manipulations generate internal traces embedding actions, and how these action-traces recombine during problem-solving. This model (...) is based on a study of two groups of sixth-grade students solving area problems. Before problem-solving, one group manipulated a tangram, the other group answered a descriptive test. Eye-movement trajectories during problem-solving were different between the groups. A second study showed that this difference required the tangram's geometrical structure, just manipulation was not enough. We propose a theoretical model accounting for these results, and discuss its implications. (shrink)

The debate between the amodal and the grounded views of cognition seems to be stuck. Their only substantial disagreement is about the vehicle or format of concepts. Amodal theorists reject the grounded claim that concepts are couched in the same modality-specific format as representations in sensory systems. The problem is that there is no clear characterization of format or its neural correlate. In order to make the disagreement empirically meaningful and move forward in the discussion we need a neurocognitive criterion (...) for representational format. I argue that efficient coding models in computational neuroscience can be used to characterize modal codes: These are codes which satisfy special informational demands imposed by sensory tasks. Additionally, I examine recent studies on neural coding and argue that although they do not provide conclusive evidence for either the grounded or the amodal views, they can be used to determine what predictions these approaches can make and what experimental and theoretical developments would be required to settle the debate. (shrink)

Self-knowledge is knowledge of one’s own states (or processes) in an indexical mode of presentation. The philosophical debate is concentrating on mental states (or processes). If we characterize self-knowledge by natural language sentences, the most adequate utterance has a structure like “I know that I am in mental state M”. This common sense characterization has to be developed into an adequate description. In this investigation we will tackle two questions: (i) What precisely is the phenomenon referred to by “self-knowledge” and (...) how can we adequately describe a form of self-knowledge which we might realistically enjoy? (ii) Can we have self-knowledge given the fact that the meaning of some words which we utter depends on the environment or the speech community? The theory we defend argues that we have to distinguish the public meaning of utterances, on the one hand, and the mental representations which are constituting a mental state of an individual, on the other. Self-knowledge should be characterized on the level of mental representations while the semantics of utterances self-attributing mental states should be treated separately. Externalism is only true for the public meaning of utterances but not for beliefs and other mental states including self-knowledge. (shrink)

Predictive Processing (PP) is an increasingly influential neurocognitive-computational framework. PP research has so far focused predominantly on lower level perceptual, motor, and various psychological phenomena. But PP seems to face a “scale-up challenge”: How can it be extended to conceptual thought, language, and other higher cognitive competencies? Compositionality, arguably a central feature of conceptual thought, cannot easily be accounted for in PP because it is not couched in terms of classical symbol processing. I argue, using the example of language, that (...) there is no strong reason to think that PP cannot be scaled up to higher cognition. I suggest that the tacitly assumed common-sense conception of language as Generative Grammar (“folk linguistics”) and its notion of composition leads to the scale-up concerns. Fodor’s Language of Thought Hypothesis (LOTH) plays the role of a cognitive computational paradigm for folk linguistics. Therefore, we do not take LOTH as facing problems with higher cognition, at least with regard to compositionality. But PP can plausibly play the role of a cognitive-computational paradigm for an alternative conception of language, namely Construction Grammar. If Construction Grammar is a plausible alternative to folk linguistics, then PP is not in a worse position than LOTH. (shrink)

Concept contextualism is the view that the information associated with a concept is dependent on the context in which it is tokened. This view is gaining support in recent years. The received and c...

It is known that properties of words such as their imageability can influence our ability to remember those words. However, it is not known if other object-related properties can also influence our memory. In this study we asked whether a word representing a concrete object that can be functionally interacted with would enhance the memory representations for that item compared to a word representing a less manipulable object . Here participants incidentally encoded high-manipulability and low-manipulability words while making word judgments. (...) Using a between-subjects design, we varied the depth-of-processing involved in the word judgment task: participants judged the words based on personal experience , word length , or functionality . Participants were able to remember high-manipulability words better than low-manipulability words in both the personal experience and word length groups; thus presenting the first evidence that manipulability can influence memory. However, we observed better memory for low- than high-manipulability words in the functionality group. We explain this surprising interaction between manipulability and memory as being mediated by automatic vs. controlled motor-related cognition. (shrink)

Recently, there has been a great deal of interest in the idea that natural language enhances and extends our cognitive capabilities. Supporters of embodied cognition have been particularly interested in the way in which language may provide a solution to the problem of abstract concepts. Toward this end, some have emphasized the way in which language may act as form of cognitive scaffolding and others have emphasized the potential importance of language-based distributional information. This essay defends a version of the (...) cognitive enhancement thesis that integrates and builds on both of these proposals. I argue that the embodied representations associated with language processing serve as a supplementary medium for conceptual processing. The acquisition of a natural language provides a means of extending our cognitive reach by giving us access to an internalized combinatorial symbol system that augments and supports the context-sensitive embodied representational systems that exist independently of language. (shrink)

According to embodied theories of language (ETLs), word meaning relies on sensorimotor brain areas, generally dedicated to acting and perceiving in the real world. More specifically, words denoting actions are postulated to make use of neural motor areas, while words denoting visual properties draw on the resources of visual brain areas. Therefore, there is a direct correspondence between word meaning and the experience a listener has had with a word's referent on the brain level. Behavioral and neuroimaging studies have provided (...) evidence in favor of ETLs; however, recent studies have also shown that sensorimotor information is recruited in a flexible manner during language comprehension (e.g., Raposo et al. ; Van Dam et al., ), leaving open the question as to what level of language processing sensorimotor activations contribute. In this study, we investigated the time course of modality-specific contributions (i.e., the contribution of action information) as to word processing by manipulating both (a) the linguistic and (b) the action context in which target words were presented. Our results demonstrate that processes reflecting sensorimotor information play a role early in word processing (i.e., within 200 ms of word presentation), but that they are sensitive to the linguistic context in which a word is presented. In other words, when sensorimotor information is activated, it is activated quickly; however, specific words do not reliably activate a consistent sensorimotor pattern. (shrink)

Biosemiosis is a process of choice-making between simultaneously alternative options. It is well-known that, when sufficiently young children encounter a new word, they tend to interpret it as pointing to a meaning that does not have a word yet in their lexicon rather than to a meaning that already has a word attached. In previous research, the strategy was shown to be optimal from an information theoretic standpoint. In that framework, interpretation is hypothesized to be driven by the minimization of (...) a cost function: the option of least communication cost is chosen. However, the information theoretic model employed in that research neither explains the weakening of that vocabulary learning bias in older children or polylinguals nor reproduces Zipf’s meaning-frequency law, namely the non-linear relationship between the number of meanings of a word and its frequency. Here we consider a generalization of the model that is channeled to reproduce that law. The analysis of the new model reveals regions of the phase space where the bias disappears consistently with the weakening or loss of the bias in older children or polylinguals. The model is abstract enough to support future research on other levels of life that are relevant to biosemiotics. In the deep learning era, the model is a transparent low-dimensional tool for future experimental research and illustrates the predictive power of a theoretical framework originally designed to shed light on the origins of Zipf’s rank-frequency law. (shrink)

Abilitism is an approach to the metaphysics of concepts according to which each concept consists of a managing cognitive ability coordinating other abilities (cognitive and non-cognitive) and a set of subordinate abilities associated with this managing ability. As I argue here, if we accept the abilitist approach, we can efficiently solve such puzzles in the metaphysics of concepts as the partial possession problem, the concept pluralism problem, etc. However, there are some possible objections to abilitism, concerning the abilitist explanation of (...) compositional properties of concepts, knowledge-that, an extension/intension of concepts, and the idea that concepts are constituents of thought. As I demonstrate here, these objections can be answered. (shrink)

Prominent accounts of language use (those of Grice, Lewis, Stalnaker, Sperber and Wilson among others) have viewed basic communicative acts as essentially involving the attitudes of the participating agents. Developmental data poses a dilemma for these accounts, since it suggests children below age four are competent communicators but would lack the ability to conceptualise communication if philosophers and linguists are right about what communication is. This paper argues that this dilemma is quite serious and that these prominent accounts would be (...) undermined if an adequate more minimal alternative were available. Just such a minimalist account of communication is offered, drawing on ideas from relevance theory and situation theory. (shrink)

Western science claims to provide unique, objective information about the world. This is supported by the observation that peoples across cultures will agree upon a common description of the physical world. Further, the use of scientific instruments and mathematics is claimed to enable the objectification of science. In this work, carried out by reviewing the scientific literature, the above claims are disputed systematically by evaluating the definition of physical reality and the scientific method, showing that empiricism relies ultimately upon the (...) human senses for the evaluation of scientific theories and that measuring instruments cannot replace the human sensory system. Nativist and constructivist theories of human sensory development are reviewed, and it is shown that nativist claims of core conceptual knowledge cannot be supported by the findings in the literature, which shows that perception does not simply arise from a process of maturation. Instead, sensory function requires a long process of learning through interactions with the environment. To more rigorously define physical reality and systematically evaluate the stability of perception, and thus the basis of empiricism, the development of the method of dimension analysis is reviewed. It is shown that this methodology, relied upon for the mathematical analysis of physical quantities, is itself based upon empiricism, and that all of physical reality can be described in terms of the three fundamental dimensions of mass, length and time. Hereafter the sensory modalities that inform us about these three dimensions are systematically evaluated. The following careful analysis of neuronal plasticity in these modalities shows that all the relevant senses acquire from the environment the capacity to apprehend physical reality. It is concluded that physical reality is acquired rather than given innately, and leads to the position that science cannot provide unique results. Rather, those it can provide are sufficient for a particular environmental setting. (shrink)

The ability to understand and communicate about the actions of others is a fundamental aspect of our daily activity. How can we talk about what others are doing? What qualities do different actions have such that they cause us to see them as being different or similar? What is the connection between what we see and the development of concepts and words or expressions for the things that we see? To what extent can two different people see and talk about (...) the same things? Is there a common basis for our perception, and is there then a common basis for the concepts we form and the way in which the concepts become lexicalized in language? The broad purpose of this thesis is to relate aspects of perception, categorization and language to action recognition and conceptualization. This is achieved by empirically demonstrating a prototype structure for action categories and by revealing the effect this structure has on language via the semantic organization of verbs for natural actions. The results also show that implicit access to categorical information can affect the perceptual processing of basic actions. These findings indicate that our understanding of human actions is guided by the activation of high level information in the form of dynamic action templates or prototypes. More specifically, the first two empirical studies investigate the relation between perception and the hierarchical structure of action categories, i.e., subordinate, basic, and superordinate level action categories. Subjects generated lists of verbs based on perceptual criteria. Analyses based on multidimensional scaling showed a significant correlation for the semantic organization of a subset of the verbs for English and Swedish speaking subjects. Two additional experiments were performed in order to further determine the extent to which action categories exhibit graded structure, which would indicate the existence of prototypes for action categories. The results from typicality ratings and category verification showed that typicality judgments reliably predict category verification times for instances of different actions. Finally, the results from a repetition priming paradigm suggest that high level information about the categorical differences between actions can be implicitly activated and facilitates the later visual processing of displays of biological motion. This facilitation occurs for upright displays, but appears to be lacking for displays that are shown upside down. These results show that the implicit activation of information about action categories can play a critical role in the perception of human actions. (shrink)

A great deal of research has focused on the question of whether or not concepts are embodied as a rule. Supporters of embodiment have pointed to studies that implicate affective and sensorimotor systems in cognitive tasks, while critics of embodiment have offered nonembodied explanations of these results and pointed to studies that implicate amodal systems. Abstract concepts have tended to be viewed as an important test case in this polemical debate. This essay argues that we need to move beyond a (...) pretheoretical notion of abstraction. Against the background of current research and theory, abstract concepts do not pose a single, unified problem for embodied cognition but, instead, three distinct problems: the problem of generalization, the problem of flexibility, and the problem of disembodiment. Identifying these problems provides a conceptual framework for critically evaluating, and perhaps improving upon, recent theoretical proposals. (shrink)