Objects are reminiscent of actions often performed with them: knife and apple remind us on peeling the apple or cutting it. Mnemonic representations of object-related actions (action codes) evoked by the sight of an object may constrain and hence facilitate recognition of unrolling actions. The present fMRI study investigated if and how action codes influence brain activation during action observation. The average number of action codes (NAC) of 51 sets of objects was rated by a group of n = 24 (...) participants. In an fMRI study, different volunteers were asked to recognize actions performed with the same objects presented in short videos. To disentangle areas reflecting the storage of action codes from those exploiting them, we showed object-compatible and object-incompatible (pantomime) actions. Areas storing action codes were considered to positively co-vary with NAC in both object-compatible and object-incompatible action; due to its role in tool-related tasks, we here hypothesized left anterior inferior parietal cortex (aIPL). In contrast, areas exploiting action codes were expected to show this correlation only in object-compatible but not incompatible action, as only object-compatible actions match one of the active action codes. For this interaction, we hypothesized ventrolateral premotor cortex (PMv) to join aIPL due to its role in biasing competition in IPL. We found left anterior intraparietal sulcus (IPS) and left posterior middle temporal gyrus (pMTG) to co-vary with NAC. In addition to these areas, action codes increased activity in object-compatible action in bilateral PMv, right IPS, and lateral occipital cortex (LO). Findings suggest that during action observation, the brain derives possible actions from perceived objects, and uses this information to shape action recognition. In particular, the number of expectable actions quantifies the activity level at PMv, IPL, and pMTG, but only PMv reflects their biased competition while observed action unfolds. (shrink)

The extended mind view and the embodied-grounded view of cognition and language are typically considered as rather independent perspectives. In this paper we propose a possible integration of the two views and support it proposing the idea of “Words As social Tools” (WAT). In this respect, we will propose that words, also due to their social and public character, can be conceived as quasi-external devices that extend our cognition. Moreover, words function like tools in that they enlarge the bodily space (...) of action thus modifying our sense of body. To support our proposal, we review the relevant literature on tool-use and on words as tools and report recent evidence indicating that word use leads to an extension of space close to the body. In addition, we outline a model of the neural processes that may underpin bodily space extension via word use and may reflect possible effects on cognition of the use of words as external means. We also discuss how reconciling the two perspectives can help to overcome the limitations they encounter if considered independently. (shrink)

In this paper, I question the notion that tool-use must be driven by an internal representation which specifies the “motor program” enacted in the behaviour of the tool-user. Rather, it makes more sense to define tool-use in terms of characteristics of the dynamics of this behaviour. As the behaviour needs to be adjusted to suit changes in context, so there is unlikely to be a one-to-one, linear mapping between an action and its effect. Thus, tool-use can best be described using (...) concepts from Nonlinear Dynamics. Such an approach can be used to create a sort of cybernetic model of tool-use. However, there is a danger that such a model can either lead us back to internal representations or could fail to capture cognitive aspects of behaviour. In particular, the question of how the craftworker’s intent can be enacted in the use of tools to produce a specific object seems to be lost in the cybernetic account. My solution is two-fold. First, the “model” is created on-the-fly and adapted through moment-by-moment interactions in the system of tool-user–tool–material–environment. This means that, rather than assuming a pre-defined internal representation that drives behaviour, I propose that cognition involves the selection of salient parameters that characterize the behaviour and the continued monitoring and management of behaviour in terms of these parameters. Second, intent is only loosely defined a priori but crystallizes through the continued interactions between craftworker and object through a process in which the affordances of the object become apparent to, and responded to by, the craftworker. (shrink)

Over the past 15 years, there have been two increasingly popular approaches to the study of meaning in cognitive science. One, based on theories of embodied cognition, treats meaning as a simulation of perceptual and motor states. An alternative approach treats meaning as a consequence of the statistical distribution of words across spoken and written language. On the surface, these appear to be opposing scientific paradigms. In this review, we aim to show how recent cross-disciplinary developments have done much to (...) reconcile these two approaches. The foundation to these developments has been the recognition that intralinguistic distributional and sensory-motor data are interdependent. We describe recent work in philosophy, psychology, cognitive neuroscience, and computational modeling that are all based on or consistent with this conclusion. We conclude by considering some possible directions for future research that arise as a consequence of these developments. (shrink)

In his novel Remembrance of Things Past, Marcel Proust argues that conventional descriptions of the phenomenology of consciousness are incomplete because they focus too much on the highly-salient sensory information that dominates each moment of awareness and ignore the network of associations that lies in the background. In this paper, I explicate Proust’s theory of conscious experience and show how it leads him directly to a theory of aesthetic perception. Proust’s division of awareness into two components roughly corresponds to William (...) James’ division of the stream of thought into a “nucleus” and “fringe.” Proust argues that the function of art is to evoke the underlying associative network indirectly in the mind of the observer by using carefully chosen sensory surfaces to control the stream of thought. I propose a possible neural basis for this Proustian/Jamesian phenomenology, and argue that the general principles of Proustian aesthetics can be applied to all forms of art. I conclude that a scientific theory of art should follow in a straightforward manner from a scientific theory of consciousness. (shrink)

The present article addresses the logic of the sphere, or the Sphere Model of Consciousness developed by Patrizio Paoletti over three decades of research. M.E.D. Ed., 2002; Flussi, territori, luogo II. M.E.D. Ed., 2002; Fare il punto nave. M.E.D. Ed., 2005; In: Proceedings conference at Leslie and Susan Gonda Multidisciplinary Brain Research Center. Bar Ilan University. Faculty of Neuroscience, Israel, 2007; Osservazione—Quaderni di Pedagogia per il Terzo Millennio, Ed. 3P, 2011; Mediazione—Quaderni di Pedagogia per il Terzo Millennio, Ed. 3P, 2011). (...) The SMC model has been experimentally applied in the educational field and lies at the base of neuroscientific and psychoeducational research conducted by the Paoletti Foundation. In recent years, it has been studied by several researchers in the field of neuroscience. Following a logical-mathematical introduction regarding the properties of the spherical shape, we illustrate for the first time the structuring of the model and its neural foundations. We emphasize the central space of the sphere, defined by the geometric model and highlight its descriptive and heuristic properties in relation to the study of consciousness. Finally, we present educational applications of the model, particularly with respect to the center of the sphere, defined in the current context as the “place of pre-existence.”. (shrink)

Synesthesia is a phenomenon in which an additional nonstandard perceptual experience occurs consistently in response to ordinary stimulation applied to the same or another modality. Recent studies suggest an important role of semantic representations in the induction of synesthesia. In the present proposal we try to link the empirically grounded theory of sensory-motor contingency and mirror system based embodied simulation to newly discovered cases of swimming-style color synesthesia. In the latter color experiences are evoked only by showing the synesthetes a (...) picture of a swimming person or asking them to think about a given swimming style. Neural mechanisms of mirror systems seem to be involved here. It has been shown that for mirror-sensory synesthesia, such as mirror-touch or mirror-pain synesthesia, concurrent experiences are caused by the overactivity in the mirror neuron system responding to the specific observation. The comparison of different forms of synesthesia has the potential of challenging conventional thinking on this phenomenon and providing a more general, sensory-motor account of synesthesia encompassing cases driven by semantic or emulational rather than pure sensory or motor representations. (shrink)

We propose a view of embodied representations that is alternative to both symbolic/linguistic approaches and purely sensorimotor views of cognition, and can account for procedural and declarative knowledge manipulation. In accordance with recent evidence in cognitive neuroscience and psychology, we argue that anticipatory and simulative mechanisms, which arose during evolution for action control and not for cognition, determined the first form of representational content and were exapted for increasingly sophisticated cognitive uses. In particular, procedural and declarative forms of knowledge can (...) be explained, respectively, in terms of on-line sensorimotor anticipation and off-line simulations of potential actions, which can give access to tacit knowledge and make it explicit. That is, mechanisms that evolved for the on-line prediction of the consequences of one's own actions (i.e. forward models) determine a (procedural) form of representation, and became exapted for off-line use. They can therefore be used to produce (declarative) knowledge of the world, by running a simulation of the action that would produce the relevant information. We conclude by discussing how embodied representations afford a form of internal manipulation that can be described as internalized situated action. (shrink)

The peripersonal space is an adaptive and flexible interface between the body and the environment that fulfills a dual-motor function: preparing the body for voluntary object-oriented actions to interact with incentive stimuli and preparing the body for defensive responses when facing potentially harmful stimuli. In this position article, we provide arguments for the sensorimotor rooting of the peripersonal space representation and highlight the variables that contribute to its flexible and adaptive characteristics. We also demonstrate that peripersonal space represents a mediation (...) zone between the body and the environment contributing to not only the control of goal-directed actions but also the organization of social life. The whole of the data presented and discussed led us to the proposal of a new theoretical framework linking the peripersonal action space and the interpersonal social space and we highlight how this theoretical framework can account for social behaviors in populations with socio-emotional deficits. (shrink)

The topic is characterized by a highly interdisciplinary approach to the issue of action and language integration. Such an approach, combining computational models and cognitive robotics experiments with neuroscience, psychology, philosophy, and linguistic approaches, can be a powerful means that can help researchers disentangle ambiguous issues, provide better and clearer definitions, and formulate clearer predictions on the links between action and language. In the introduction we briefly describe the papers and discuss the challenges they pose to future research. We identify (...) four important phenomena the papers address and discuss in light of empirical and computational evidence: (a) the role played not only by sensorimotor and emotional information but also of natural language in conceptual representation; (b) the contextual dependency and high flexibility of the interaction between action, concepts, and language; (c) the involvement of the mirror neuron system in action and language processing; (d) the way in which the integration between action and language can be addressed by developmental robotics and Human-Robot Interaction. (shrink)

We come prepared to track events and objects, building our knowledge base while foraging for coherence. Classical pragmatism recognizes that the acquisition of knowledge is in part a contact sport (e.g. Peirce, Dewey). One of the aims of neuroscience is to capture human experience. One route to perhaps achieve this may be through the study of the visual system and its expansion in our evolutionary history. Embodied cephalic systems, as Dewey knew well, are tied to self-corrective inquiry. A philosophy of (...) neuroscience needs to capture how such events are tracked, tested through experience, and subsequently modified in the brain to comprise a knowledge base. (shrink)

The mental representation of one’s own body does not necessarily correspond to the physical body. For instance, a dissociation between perceived and actual reach-ability has been shown, that is, individuals perceive that they can reach objects that are out of grasp. We presented participants with 3D pictures of objects located at four different distances, namely near-reaching space, actual-reaching space, perceived-reaching space and non-reaching space. Immediately after they were presented with function, manipulation, observation or pointing verbs and were required to judge (...) if the verb was compatible with the object.Participants were faster with function and manipulation verbs than with observation and pointing verbs. Strikingly, with both function and manipulation verbs participants were faster when objects were presented in actual than the perceived reaching space. These findings suggest that our knowledge of the world is implicitly built online through behaviour, and is not necessarily reflected in explicit estimates or conscious representations. (shrink)

Computational models of meaning trained on naturally occurring text successfully model human performance on tasks involving simple similarity measures, but they characterize meaning in terms of undifferentiated bags of words or topical dimensions. This has led some to question their psychological plausibility (Murphy, 2002;Schunn, 1999). We present here a fully automatic method for extracting a structured and comprehensive set of concept descriptions directly from an English part‐of‐speech‐tagged corpus. Concepts are characterized by weighted properties, enriched with concept–property types that approximate classical (...) relations such as hypernymy and function. Our model outperforms comparable algorithms in cognitive tasks pertaining not only to concept‐internal structures (discovering properties of concepts, grouping properties by property type) but also to inter‐concept relations (clustering into superordinates), suggesting the empirical validity of the property‐based approach. (shrink)

The Complex-First Paradox consists in a set of collectively incompatible but individually well-confirmed propositions that regard the evolution, development, and cortical realization of the meanings of concrete nouns. Although these meanings are acquired earlier than those of other word classes, they are semantically more complex and their cortical realizations more widely distributed. For a neurally implemented syntaxsemantics interface, it should thus take more effort to establish a link between a concept and its lexical expression. However, in ontogeny and phylogeny, capabilities (...) demanding more effort, ceteris paribus, develop and evolve later than those demanding less effort. The paradox points to an explanatory deficit in linguistic theory. (shrink)

In this response to Malt's and Prinz's commentaries, I argue that neo-empiricist hypotheses fail to threaten the argument for the elimination of ‘concept’ because they are unlikely to be true of all concepts, if they are true at all. I also defend the hypothesis that we possess bodies of knowledge retrieved by default from long-term memory, and I argue that prototypes, exemplars, and theories form genuinely distinct concepts.

We advance a theory of inductive reasoning based on similarity, and test it on arguments involving mammal categories. To measure similarity, we quantified the overlap of neural activation in left Brodmann area 19 and the left ventral temporal cortex in response to pictures of different categories; the choice of of these regions is motivated by previous literature. The theory was tested against probability judgments for 40 arguments generated from 9 mammal categories and a common predicate. The results are interpreted in (...) the context of Hume’s thesis relating similarity to inductive inference. (shrink)

This article notes the convergence of recent thinking in neuroscience and grounded cognition regarding the way we understand mental representation and recollection: ideas are dynamic and multi-modal, actively created at the point of recall. Also, neurophysiologically, re-entrant signalling among cortical circuits allows non-conscious processing to support our deliberative thoughts and actions. The qualitative research we describe examines the exchanges occurring during semi-structured interviews with 360 children age 3–13, including 294 from New Zealand and 66 from China concerning their understanding of (...) the shape and motion of the Earth, Sun and Moon. We look closely at the relationships between what is revealed as children manipulate their own play-dough models and their apparent understandings of ESM concepts. In particular, we focus on the switching taking place between what is said, what is drawn and what is modelled. The evidence is supportive of Edelman’s view that memory is non-representational and that concepts are the outcome of perceptual mappings, a view which is also in accord with Barsalou’s notion that concepts are simulators or skills which operate consistently across several modalities. Quantitative data indicate that the dynamic structure of memory/concept creation is similar in both genders and common to the cultures/ethnicities compared and that repeated interviews in this longitudinal research lead to more advanced modelling skills and/or more advanced shape and motion concepts, the results supporting hypotheses. (shrink)

In this précis, I review the main points and arguments developed at greater length in Doing without Concepts, and I explain why eliminating the notion of concept would contribute to the progress of the psychology of higher cognition.

The study of human intelligence was once dominated by symbolic approaches, but over the last 30 years an alternative approach has arisen. Symbols and processes that operate on them are often seen today as approximate characterizations of the emergent consequences of sub- or nonsymbolic processes, and a wide range of constructs in cognitive science can be understood as emergents. These include representational constructs (units, structures, rules), architectural constructs (central executive, declarative memory), and developmental processes and outcomes (stages, sensitive periods, neurocognitive (...) modules, developmental disorders). The greatest achievements of human cognition may be largely emergent phenomena. It remains a challenge for the future to learn more about how these greatest achievements arise and to emulate them in artificial systems. (shrink)

Embodied theories of language postulate that language meaning is stored in modality-specific brain areas generally involved in perception and action in the real world. However, the temporal dynamics of the interaction between modality-specific information and lexical-semantic processing remain unclear. We investigated the relative timing at which two types of modality-specific information (action-based and visual-form information) contribute to lexical-semantic comprehension. To this end, we applied a behavioral priming paradigm in which prime and target words were related with respect to (1) action (...) features, (2) visual features, or (3) semantically associative information. Using a Go/No-Go lexical decision task, priming effects were measured across four different inter-stimulus intervals (ISI = 100, 250, 400, and 1000 ms) to determine the relative time course of the different features. Notably, action priming effects were found in ISIs of 100, 250, and 1000 ms whereas a visual priming effect was seen only in the ISI of 1000 ms. Importantly, our data suggest that features follow different time courses of activation during word recognition. In this regard, feature activation is dynamic, measurable in specific time windows but not in others. Thus the current study (1) demonstrates how multiple ISIs can be used within an experiment to help chart the time course of feature activation and (2) provides new evidence for embodied theories of language. (shrink)

The structure of people’s conceptual knowledge of concrete nouns has traditionally been viewed as hierarchical (Collins & Quillian, 1969). For example, superordinate concepts (vegetable) are assumed to reside at a higher level than basic‐level concepts (carrot). A feature‐based attractor network with a single layer of semantic features developed representations of both basic‐level and superordinate concepts. No hierarchical structure was built into the network. In Experiment and Simulation 1, the graded structure of categories (typicality ratings) is accounted for by the flat (...) attractor network. Experiment and Simulation 2 show that, as with basic‐level concepts, such a network predicts feature verification latencies for superordinate concepts (vegetable ). In Experiment and Simulation 3, counterintuitive results regarding the temporal dynamics of similarity in semantic priming are explained by the model. By treating both types of concepts the same in terms of representation, learning, and computations, the model provides new insights into semantic memory. (shrink)