The underlying structures that are common to the world's languages bear an intriguing connection with early emerging forms of “core knowledge” (Spelke & Kinzler, 2007), which are frequently studied by infant researchers. In particular, grammatical systems often incorporate distinctions (e.g., the mass/count distinction) that reflect those made in core knowledge (e.g., the non-verbal distinction between an object and a substance). Here, I argue that this connection occurs because non-verbal core knowledge systematically biases processes of language evolution. This account potentially explains (...) a wide range of cross-linguistic grammatical phenomena that currently lack an adequate explanation. Second, I suggest that developmental researchers and cognitive scientists interested in (non-verbal) knowledge representation can exploit this connection to language by using observations about cross-linguistic grammatical tendencies to inspire hypotheses about core knowledge. (shrink)

This article discusses the importance of social interaction for the development of the representations for symbolic communication. We suggest that there is no need to distinguish between different representational systems emerging at different stages of development. Instead, we propose that representations are rich right from the beginning of a child’s life, and that they are driven mainly by acting and interacting in the physical and social world. The more variety in a child’s interactional experience (i.e., synchrony, sequentiality, and prediction), the (...) more enriched and abstracted the representations become. We review literature providing evidence for the ways in which infants’ development toward symbolic communication benefits from repeated social (inter)action and consider some implications for computational approaches. (shrink)

Do children’s single words related to motion and change also encode aspects of environmental events highlighted by Talmy’s motion event analysis? If so, these meanings may predict children’s early verb meanings. Analyzing the kinds of meanings expressed in single “dynamic event words” through motion event semantics yields links between early true verbs in sentences and the semantics encoded in these single words. Dynamic event words reflect the sense of temporal and spatial reversibility established in the late sensorimotor period. We propose (...) that these dynamic meanings provide the semantic foundation for the most common verbs included in early sentences, and thus a bootstrap to full development of the verb repertoire. In this study, we followed the spoken language development of five children. We identified dynamic event words as encoding dynamic change in the following dimensions: spatial direction in relation to self; vertical spatial direction; figure/ground relationships; and temporal event sequences. Verbs continuing the semantics previously identified in dynamic event words occurred early and dominated the verb repertoire through 24 months of age. (shrink)

This article discusses the importance of social interaction for the development of the representations for symbolic communication. We suggest that there is no need to distinguish between different representational systems emerging at different stages of development. Instead, we propose that representations are rich right from the beginning of a child’s life, and that they are driven mainly by acting and interacting in the physical and social world. The more variety in a child’s interactional experience (i.e., synchrony, sequentiality, and prediction), the (...) more enriched and abstracted the representations become. We review literature providing evidence for the ways in which infants’ development toward symbolic communication benefits from repeated social (inter)action and consider some implications for computational approaches. (shrink)

This paper proposes how various disciplinary theories of cognition may be combined into a unifying, sub-symbolic, computational theory of cognition. The following theories are considered for integration: psychological theories, including the theory of event coding, event segmentation theory, the theory of anticipatory behavioral control, and concept development; artificial intelligence and machine learning theories, including reinforcement learning and generative artificial neural networks; and theories from theoretical and computational neuroscience, including predictive coding and free energy-based inference. In the light of such a (...) potential unification, it is discussed how abstract cognitive, conceptualized knowledge and understanding may be learned from actively gathered sensorimotor experiences. The unification rests on the free energy-based inference principle, which essentially implies that the brain builds a predictive, generative model of its environment. Neural activity-oriented inference causes the continuous adaptation of the currently active predictive encodings. Neural structure-oriented inference causes the longer term adaptation of the developing generative model as a whole. Finally, active inference strives for maintaining internal homeostasis, causing goal-directed motor behavior. To learn abstract, hierarchical encodings, however, it is proposed that free energy-based inference needs to be enhanced with structural priors, which bias cognitive development towards the formation of particular, behaviorally suitable encoding structures. As a result, it is hypothesized how abstract concepts can develop from, and thus how they are structured by and grounded in, sensorimotor experiences. Moreover, it is sketched-out how symbol-like thought can be generated by a temporarily active set of predictive encodings, which constitute a distributed neural attractor in the form of an interactive free-energy minimum. The activated, interactive network attractor essentially characterizes the semantics of a concept or a concept composition, such as an actual or imagined situation in our environment. Temporal successions of attractors then encode unfolding semantics, which may be generated by a behavioral or mental interaction with an actual or imagined situation in our environment. Implications, further predictions, possible verification and falsifications, as well as potential enhancements into a fully spelled-out unified theory of cognition are discussed at the end of the paper. (shrink)

Name der Zeitschrift: Semiotica Jahrgang: 2018 Heft: 225 Seiten: 19-38.

The article focuses on meaning generation in music and language cognition based on complexes of image schemas. We hypothesize that schemas are involved in dynamic interactions fostering online complex conceptual construction found both in language and elsewhere in various cognitive code expressions. Expanding on recent work, we propose that an account of image-schema interaction should include the notion of scalarity, a higher-order parameter which captures the intensity with which schemas occur and/or interact with one another. In that sense, schemas are (...) proposed to have a binary valence (positive or negative) and a three-tier range of intensity levels. We focus on some examples of the interaction of force, path, link, balance, and containment image schemas in language and music to illustrate how a formal routine emerging from our proposal may help in addressing not only aspects of propositional semantics, but also affective and connotative nuances in musical and linguistic expression. (shrink)

I discuss three arguments that have been advanced in support of the epistemic mentalist view, i.e., the view that infants' social cognitive abilities manifest a capacity to attribute beliefs. The argument from implicitness holds that SCAs already reflect the possession of an “implicit” and “rudimentary” capacity to attribute representational states. Against it, I note that SCAs are significantly limited, and have likely evolved to respond to contextual information in situated interaction with others. I challenge the argument from parsimony by claiming (...) that parsimony per se favors neither a mentalist nor a behavior-reading account. Finally, I argue that early SCAs do not develop continuously into four-year-olds' belief attribution abilities. Accordingly, the argument from developmental continuity is empirically inadequate. Careful analysis of both the empirical data and the theoretical assumptions leading to the epistemic mentalist view is needed in order to improve our understanding of SCAs in earl.. (shrink)

• In this paper we combine motion captured data with linguistic notions in a game-like intelligent tutoring system, in order to help elementary school students to better differentiate literal from metaphorical uses of motion verbs, based on embodied information. In addition to the thematic goal, we intend to improve young students’ attention and spatiotemporal memory, by presenting sensorimotor data experimentally collected from thirty two participants in our motion capturing labs. Furthermore, we examine the accomplishment of game’s goals and compare them (...) to curriculum’s approach. Sixty nine elementary school students were randomly divided in two experimental groups (game and traditional) and one control group, which did not undergo any intervention. All groups were tested in pre and posttests. Even though the diagnostic pretests present a uniform picture, two way analysis of variance suggests that the experimental groups showed progress in posttests and, more specifically, game group remarkably progressed in the verbs/actions presented during the intervention. Furthermore, in the game condition the participants needed gradually shorter period of time to identify the avatar’s actions. This finding was considered as a first indication of attentional and spatiotemporal memory’s improvement, while the game’s assistance features cultivated students’ metacognitive perception. (shrink)