The theory of embodied cognition can provide HCI practitioners and theorists with new ideas about interac-tion and new principles for better designs. I support this claim with four ideas about cognition: (1) interacting with tools changes the way we think and perceive – tools, when manipulated, are soon absorbed into the body schema, and this absorption leads to fundamental changes in the way we perceive and conceive of our environments; (2) we think with our bodies not just with our brains; (...) (3) we know more by doing than by seeing – there are times when physically performing an activity is better than watching someone else perform the activity, even though our motor resonance system fires strongly during other person observa-tion; (4) there are times when we literally think with things. These four ideas have major implications for interaction design, especially the design of tangible, physical, context aware, and telepresence systems. (shrink)

Drawing on research in narrative theory and literary aesthetics, text and discourse processing, phenomenology and the experimental cognitive sciences, this paper outlines an embodied theory of presence in the reading of literary narrative. Contrary to common assumptions, it is argued that there is no straightforward relation between the degree of detail in spatial description on one hand, and the vividness of spatial imagery and presence on the other. It is also argued that presence arises from a first-person, enactive process of (...) sensorimotor simulation/ resonance, rather than from mere visualizing from the perspective of a passive, third-person observer. In sections 1 to 3, an inter-theoretical argument is presented, proposing that presence may be effectively cued by explicit references to object -directed bodily movement. In section 4, an attempt is made at explaining which ways of embedding such references in the narrative may be particularly productive at eliciting presence. (shrink)

Philosophical considerations as well as several recent studies from neurophysiology, neuropsychology, and psychophysics converged in showing that the peripersonal space is structured in a body-centred manner and represented through integrated sensory inputs. Multisensory representations may deserve the function of coding peripersonal space for avoiding or interacting with objects. Neuropsychological evidence is reviewed for dynamic interactions between space representations and action execution, as revealed by the behavioural effects that the use of a tool, as a physical extension of the reachable space, (...) produces on visual–tactile extinction. In particular, tool-use transiently modifies action space representation in a functionally effective way. The possibility is discussed that the investigation of multisensory space representations for action provides an empirical way to consider in its specificity pre-reflexive self-consciousness by considering the intertwining of self-relatedness and object-directness of spatial experience shaped by multisensory and sensorimotor integrations. (shrink)

Recent experimental findings reveal dissociations of conscious and nonconscious performance in many fields of psychological research, suggesting that conscious and nonconscious effects result from qualitatively different processes. A connectionist view of these processes is put forward in which consciousness is the consequence of construction processes taking place in three types of working memory in a specific type of recurrent neural network. The recurrences arise by feeding back output to the input of a central (representational) network. They are assumed to be (...) intemalizations of motor-sensory feedback through the environment. In this manner, a subvocal-phonological, a visuo-spatial, and a somatosensory working memory may have developed. Representations in the central network, which constitutes long-term memory, can be kept active by rehearsal in the feedback loops. The sequentially recurrent architecture allows for recursive symbolic operations and the formation of (auditory, visual, or somatic) models of the external world which can be maintained, transformed and temporarily combined with other information in working memory. Moreover, the quasi-input from the loop directs subsequent attentional processing. The view may contribute to a formal framework to accommodate findings from disparate fields such as working memory, sequential reasoning, and conscious and nonconscious processes in memory and emotion. In theory, but probably not very soon in practice, such connectionist models might simulate aspects of consciousness. (shrink)

This review addresses the role of early sensory areas in the awareness of tactile information in humans. The results of recent studies dealing with this important topic are critically discussed: In particular, we report on evidence from neuropsychology, neurophysiology, neuroimaging, and behavioral experiments that have highlighted the crucial role played by the primary somatosensory cortex in mediating our awareness of tactile information. Phenomena, such as tactile hallucinations, tactile illusions, the perception of supernumerary limbs, and synaesthesia are also discussed. The research (...) reviewed here clearly shows that the activation of SI is necessary, but not sufficient, for the awareness of touch. On the basis of the evidence outlined here, we propose a neurocognitive model that provides a conceptual framework in which to interpret the results of the literature regarding tactile consciousness. (shrink)

People’s awareness of tactile stimuli has been investigated in far less detail than their awareness of stimuli in other sensory modalities. In an attempt to fill this gap, we provide an overview of studies that are pertinent to the topic of tactile consciousness. We discuss the results of research that has investigated phenomena such as “change blindness”, phantom limb sensations, and numerosity judgments in tactile perception, together with the results obtained from the study of patients affected by deficits that can (...) adversely affect tactile perception such as neglect, extinction, and numbsense. The similarities as well as some of the important differences that have emerged when visual and tactile conscious information processing have been compared using similar experimental procedures are highlighted. We suggest that conscious information processing in the tactile modality cannot be separated completely from the more general processing of spatial information in the brain. Finally, the importance of considering tactile consciousness within the larger framework of multisensory information processing is also discussed. (shrink)

The same neural structures involved in the unconscious modeling of our acting body in space also contribute to our awareness of the lived body and of the objects that the world contains. Neuroscientific research also shows that there are neural mechanisms mediating between the multi-level personal experience we entertain of our lived body, and the implicit certainties we simultaneously hold about others. Such personal and body-related experiential knowledge enables us to understand the actions performed by others, and to directly decode (...) the emotions and sensations they experience. A common functional mechanism is at the basis of both body awareness and basic forms of social understanding: embodied simulation. It will be shown that the present proposal is consistent with some of the perspectives offered by phenomenology. (shrink)

Which is my body and how do I distinguish it from the bodies of others, or from objects in the surrounding environment? The perception of our own body and more particularly our sense of body ownership is taken for granted. Nevertheless experimental findings from body ownership illusions (BOIs), show that under specific multisensory conditions, we can experience artificial body parts or fake bodies as our own body parts or body respectively. The aim of the present paper is to discuss how (...) and why BOIs are induced. We review several experimental findings concerning the spatial, temporal and semantic principles of crossmodal stimuli that have been applied to induce BOIs. On the basis of these principles, we discuss theoretical approaches concerning the underlying mechanism of BOIs. We propose a conceptualization based on Bayesian causal inference for addressing how our nervous system could infer whether an object belongs to our own body, using multisensory, sensorimotor and semantic information, and we discuss how this can account for several experimental findings. Finally, we point to neural network models as an implementational framework within which the computational problem behind BOIs could be addressed in the future. (shrink)