Embodiment matters to perception and action. Beyond the triviality that, under normal circumstances, we need a body in order to perceive the world and act in it, our particular embodiment, right here, right now, both enables and constrains our perception of possibilities for action. In this chapter, we provide empirical support for the idea that the structural and morphological features of the body can narrow the set of our possible interactions with the environment by shaping the way we perceive the (...) possibilities for action provided. We argue that this narrowing holds true in the perception of what we call strongly embodied affordances, that is, relevant micro-affordances that have a genuinely demanding characteristic, as well as in the perception of actions performed by others. In particular, we show that perceptual contents are shaped by fine-grained morphological features of the body, such as specific hand-shapes, and that they change according to our possibility to act upon them with this body, in this situation, at this moment. We argue that these considerations provide insight into distinguishing a variety of experienced affordance relations that can aid us in better understanding the relevance of embodiment for perception and experience. (shrink)

Using a model of cognition as extended and enactive, we examine the role of materiality in making minds as exemplified by lithics and writing, forms associated with conceptual thought and meta-awareness of conceptual domains. We address ways in which brain functions may change in response to interactions with material forms, the attributes of material forms that may cause such change, and the spans of time required for neurofunctional reorganization. We also offer three hypotheses for investigating co-influence and change in cognition (...) and material culture. This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No. 785793. (shrink)

The present study investigated how multisensory integration in peripersonal space is modulated by limb posture and limb congruency . This was done separately for the upper limbs and the lower limbs . The crossmodal congruency task was used to measure peripersonal space integration for the hands and the feet. It was found that the peripersonal space representation for the hands but not for the feet is dynamically updated based on both limb posture and limb congruency. Together these findings show how (...) dynamic cues from vision, proprioception, and touch are integrated in peripersonal limb space and highlight fundamental differences in the way in which peripersonal space is represented for the upper and lower extremity. (shrink)

The theory of embodied cognition can provide HCI practitioners and theorists with new ideas about interac-tion and new principles for better designs. I support this claim with four ideas about cognition: (1) interacting with tools changes the way we think and perceive – tools, when manipulated, are soon absorbed into the body schema, and this absorption leads to fundamental changes in the way we perceive and conceive of our environments; (2) we think with our bodies not just with our brains; (...) (3) we know more by doing than by seeing – there are times when physically performing an activity is better than watching someone else perform the activity, even though our motor resonance system fires strongly during other person observa-tion; (4) there are times when we literally think with things. These four ideas have major implications for interaction design, especially the design of tangible, physical, context aware, and telepresence systems. (shrink)

In this article, I link the empirical hypothesis that neural representations of sensory stimulation near the body involve a unique motor component to the idea that the perceptual field is structured by skillful bodily activity. The neurophenomenological view that emerges is illuminating in its own right, though it may also have practical consequences. I argue that recent experiments attempting to alter the scope of these near space sensorimotor representations are actually equivocal in what they show. I propose resolving this ambiguity (...) by treating these representations as responsive to the development or degeneration of know-how—which can be isolated as an appropriate object for scientific investigation. (shrink)

This article has two goals. First, it synthesizes and critically assesses current scientific knowledge about the cognitive bases of human tool use. Second, it shows how the cognitive traits reviewed help to explain why technological accumulation evolved so markedly in humans, and so modestly in apes.

This article argues for a more rigorous distinction between body extensions on the one hand and incorporation of non-bodily objects into the body on the other hand. Real re-embodiment would be a matter of taking things (most often technologies) into the body, i.e. of incorporation of non-bodily items into the body. This, however, is a difficult process often limited by a number of conditions of possibility that are absent in the case of ‘mere’ body extensions. Three categories are discussed: limb (...) extensions/prostheses, perceptual extensions/prostheses and cognitive extensions/prostheses. For each category, a distinction between extensions and incorporations is proposed, and the conditions of possibility for real incorporation are discussed. These conditions of possibility differ in each category, but in general they ask for radical or fundamental alterations not only in the motor and/or sensory or cognitive constitution of a human subject, but also in his or her subjective experience. (shrink)

The purpose of this paper is to demonstrate the usefulness of the concept of possibility , and not merely that of actuality , for an inquiry into the bodily constitution of experience. The paper will study how the possibilities of action that may (or may not) be available to the subject help to shape the meaning attributed to perceived objects and to the situation occupied by the subject within her environment. This view will be supported by reference to empirical evidence (...) provided by recent and current research on the perceptual estimation of distances and the effects brought about by the use of a tool on the organisation of our perceived immediate space. (shrink)

Body representations are known to be dynamically modulated or extended through tool use. Here, we review findings that demonstrate the importance of a user's tool experience or expertise for successful tool embodiment. Examining expert tool users, such as individuals who use tools in professional sports, people who use chopsticks at every meal, or spinal injury patients who use a wheelchair daily, offers new insights into the role of expertise in tool embodiment: Not only does tool embodiment differ between novices and (...) experts, but experts may experience enhanced changes to their body representation when interacting with their own, personal tool. The findings reviewed herein reveal the importance of assessing tool skill in future studies of tool embodiment. (shrink)

One key issue when conceiving the body as a multisensory object is how the cognitive system integrates visible instances of the self and other bodies with one’s own somatosensory processing, to achieve self-recognition and body ownership. Recent research has strongly suggested that shadows cast by our own body have a special status for cognitive processing, directing attention to the body in a fast and highly specific manner. The aim of the present article is to review the most recent scientific contributions (...) addressing how body shadows affect both sensory/perceptual and attentional processes. The review examines three main points: (1) body shadows as a special window to investigate the construction of multisensory body perception; (2) experimental paradigms and related findings; (3) open questions and future trajectories. The reviewed literature suggests that shadows cast by one’s own body promote binding between personal and extrapersonal space and elicit automatic orienting of attention toward the body-part casting the shadow. Future research should address whether the effects exerted by body shadows are similar to those observed when observers are exposed to other visual instances of their body. The results will further clarify the processes underlying the merging of vision and somatosensation when creating body representations. (shrink)

Recent studies have shown the importance of integrating multisensory information in the body representation for constituting self-consciousness. However, one idea that has received only scant attention is that our body representation is also constituted by knowledge of bodily visual characteristics . Here in two experiments we used a full body crossmodal congruency task in which visual distractors were presented on a photograph of the participant, another person, who was either familiar or unfamiliar, or an object. Results revealed that during the (...) ‘self-condition’ CCEs were enhanced compared to the ‘other condition’. The CCE was similar for unfamiliar and familiar others. CCEs for the object condition were significantly smaller. The results show that presentation of an irrelevant image of a body affects multimodal processing and that the effect is enhanced when that image is of the self. The results hold intriguing implications for body representation in social situations. (shrink)

When subjects view stimulation of a rubber hand while feeling congruent stimulation of their own hand, they may come to feel that the rubber hand is part of their own body. This illusion of body ownership is termed ‘Rubber Hand Illusion’ . We investigated sensitivity of RHI to spatial mismatches between visual and somatic experience. We compared the effects of spatial mismatch between the stimulation of the two hands, and equivalent mismatches between the postures of the two hands. We created (...) the mismatch either by adjusting stimulation or posture of the subject’s hand, or, in a separate group of subjects, by adjusting stimulation or posture of the rubber hand. The matching processes underlying body ownership were asymmetrical. The illusion survived small changes in the subject’s hand posture, but disappeared when the same posture transformations were applied to the rubber hand. Mismatch between the stimulation delivered to the subject’s hand and the rubber hand abolished the illusion. The combination of these two situations is of particular interest. When the subject’s hand posture was slightly different from the rubber hand posture, the RHI remained as long as stimulation of the two hands was congruent in a hand-centred spatial reference frame, even though the altered posture of the subject’s hand meant that stimulation was incongruent in external space. Conversely, the RHI was reduced when the stimulation was incongruent in hand-centred space but congruent in external space. We conclude that the visual–tactile correlation that causes the RHI is computed within a hand-centred frame of reference, which is updated with changes in body posture. Current sensory evidence about what is ‘me’ is interpreted with respect to a prior mental body representation. (shrink)

This paper investigates the role of a pre-existing body-model that is an enabling constraint for the incorporation of objects into the body. This body-model is also a basis for the distinction between body extensions (e.g., in the case of tool-use) and incorporation (e.g., in the case of successful prosthesis use). It is argued that, in the case of incorporation, changes in the sense of body-ownership involve a reorganization of the body-model, whereas extension of the body with tools does not involve (...) changes in the sense of body-ownership. (shrink)

This paper argues that material culture has the ability to change and shape our bodies by transforming and extending the boundaries of our body schema. To explore this argument I concentrate on the relationship between the Mycenaean body and the Mycenaean sword. Focusing on the early Mycenaean period I propose that the centre of consciousness and bodily awareness for the Mycenaean person, and for the warrior in particular, is not some ‘internal’ Cartesian ‘I’, but the tip of the sword. Through (...) the tip of the sword the Mycenaean person is simultaneously reach out, makes sense of and apprehends the world. The sword as an enactive sign brings about a whole new semiotic field of embodied activity offering a new means of engaging the world and as such a novel understanding of what is to be a Mycenaean person and body. (shrink)

Philosophical considerations as well as several recent studies from neurophysiology, neuropsychology, and psychophysics converged in showing that the peripersonal space is structured in a body-centred manner and represented through integrated sensory inputs. Multisensory representations may deserve the function of coding peripersonal space for avoiding or interacting with objects. Neuropsychological evidence is reviewed for dynamic interactions between space representations and action execution, as revealed by the behavioural effects that the use of a tool, as a physical extension of the reachable space, (...) produces on visual–tactile extinction. In particular, tool-use transiently modifies action space representation in a functionally effective way. The possibility is discussed that the investigation of multisensory space representations for action provides an empirical way to consider in its specificity pre-reflexive self-consciousness by considering the intertwining of self-relatedness and object-directness of spatial experience shaped by multisensory and sensorimotor integrations. (shrink)

Objects which a human agent controls by efferent activities can be perceived by the agent as belonging to his or her body. This suggests that what an agent counts as “body” is plastic, depending on what she or he controls. Yet there are possible limitations for such momentary plasticity. One of these limitations is that sensations stemming from the body and sensations stemming from objects outside the body are not integrated if they do not sufficiently “match”. What “matches” and what (...) does not is conceivably determined by long–term experience with the perceptual changes that body movements typically produce. Children have accumulated less sensorimotor experience than adults have. Consequently, they express higher flexibility to integrate body-internal and body-external signals, independent of their “match” as suggested by rubber hand illusion studies. However, children’s motor performance in tool use is more affected by mismatching body-internal and body-external action effects than that of adults, possibly because of less developed means to overcome such mismatches. We review research on perception-action interactions, multisensory integration, and developmental psychology to build bridges between these research fields. By doing so, we account for the flexibility of the sense of body ownership for actively controlled events and its development through ontogeny. This gives us the opportunity to validate the suggested mechanisms for generating ownership by investigating their effects in still developing and incomplete stages in children. We suggest testable predictions for future studies investigating both body ownership and motor skills throughout the lifespan. (shrink)

Sensory substitution devices provide through an unusual sensory modality (the substituting modality, e.g., audition) access to features of the world that are normally accessed through another sensory modality (the substituted modality, e.g., vision). In this article, we address the question of which sensory modality the acquired perception belongs to. We have recourse to the four traditional criteria that have been used to define sensory modalities: sensory organ, stimuli, properties, and qualitative experience (Grice, 1962), to which we have added the criteria (...) of behavioral equivalence (Morgan, 1977), dedication (Keeley, 2002), and sensorimotor equivalence (O’Regan & Noe¨, 2001). We discuss which of them are fulfilled by perception through sensory substitution devices and whether this favors the view that perception belongs to the substituting or to the substituted modality. Though the application of a number of criteria might be taken to point to the conclusion that perception with a sensory substitution device belongs to the substituted modality, we argue that the evidence leads to an alternative view on sensory substitution. According to this view, the experience after sensory substitution is a transformation, extension, or augmentation of our perceptual capacities, rather than being something equivalent or reducible to an already existing sensory modality. We develop this view by comparing sensory substitution devices to other ‘‘mind-enhancing tools’’ such as pen and paper, sketchpads, or calculators. An analysis of sensory substitution in terms of mind-enhancing tools unveils it as a thoroughly transforming perceptual experience and as giving rise to a novel form of perceptual interaction with the environment. (shrink)

Many studies have suggested that the motor system is organized in a hierarchical fashion, around the prototypical end location associated with using objects. However, most studies supporting the hierarchical view have used well-known actions and objects that are highly over-learned. Accordingly, at present it is unclear if the hierarchical principle applies to learning the use of novel objects as well. In the present study we found that when learning to use a novel object subjects acquired an action representation of the (...) end location associated with using the object, as evidenced by slower responses in an action observation task, when the object was presented at an incorrect end location. By showing the importance of knowledge about end locations when learning to use a novel object, the present study suggests that end locations are a fundamental organizing feature of the human motor system. (shrink)

This paper investigates the role of a pre-existing body-model that is an enabling constraint for the incorporation of objects into the body. This body-model is also a basis for the distinction between body extensions (e.g., in the case of tool-use) and incorporation (e.g., in the case of successful prosthesis use). It is argued that, in the case of incorporation, changes in the sense of body-ownership involve a reorganization of the body-model, whereas extension of the body with tools does not involve (...) changes in the sense of body-ownership. (shrink)

The brain represents the body in different ways for different purposes. Several concepts and even more numerous labels have historically been proposed to define these representations in operational terms. Recent evidence of embodiment of external objects has added complexity to an already quite intricate picture. In particular, because of their perceptual and motor effects, both rubber hands and tools can be conceived as embodied, that is, represented in the brain as if they were parts of one's own body. But are (...) there any limits to what we can embody? What constraints lay upon embodiment? And are they similar both for motor embodiment and for perceptual embodiment? Here, we consider the implications emerging from the different, and up-to-now relatively separate research domains of tool use and rubber hand illusion for understanding the rules of embodiment. In particular, we compare what the embodiment of tools and prostheses may or may not have in common. We conclude that in both cases, although for different reasons and with different constraints, embodiment is only partial. (shrink)