How deeply does action influence perception? Does action performance affect the perception of object features directly related to action only? Or does it concern also object features such as colors, which are not held to directly afford action? The present study aimed at answering these questions. We asked participants to repeatedly grasp a handled mug hidden from their view before judging whether a visually presented mug was blue rather than cyan. The motor training impacted on their perceptual judgments, by speeding (...) participants’ responses, when the handle of the presented mug was spatially aligned with the trained hand. The priming effect did not occur when participants were trained to merely touch the mug with their hand closed in a fist. This indicates that action performance may shape the perceptual judgment on object features, even when these features are colors and do not afford any action. How we act on surrounding objects is therefore not without consequence for how we experience them. (shrink)

Humans possess the ability to extract highly organized perceptual structures from sequences of temporal stimuli. For instance, we can organize specific rhythmical patterns into hierarchical, or metrical, systems. Despite the evidence of a fundamental influence of the motor system in achieving this skill, few studies have attempted to investigate the organization of our motor representation of rhythm. To this aim, we studied—in musicians and non-musicians—the ability to perceive and reproduce different rhythms. In a first experiment participants performed a temporal order-judgment (...) task, for rhythmical sequences presented via auditory or tactile modality. In a second experiment, they were asked to reproduce the same rhythmic sequences, while their tapping force and timing were recorded. We demonstrate that tapping force encodes the metrical aspect of the rhythm, and the strength of the coding correlates with the individual’s perceptual accuracy. We suggest that the similarity between perception and tapping-force organization indicates a common representation of rhythm, shared between the perceptual and motor systems. (shrink)

Several canonical experimental paradigms have been proposed to study the typical behavioral phenomenon and the nature of learning in sequential keypress tasks. A characteristic feature of most paradigms is that they are representative of externally-specified sequencing—motor tasks where the environment or task paradigm extrinsically provides the sequence of stimuli, i.e., the responses are stimulus-driven. Previous studies utilizing such canonical paradigms have largely overlooked the learning behaviors in a more realistic class of motor tasks that involve internally-guided sequencing—where the sequence of (...) motor actions is self-generated or internally-specified. In this work, we use the grid-navigation task as an instance of internally-guided sequencing to investigate the nature of learning in such paradigms. The participants performed Grid-Sailing Task, which required navigating a 5 × 5 grid from start to goal position while using a particular key-mapping among the three cursor-movement directions and the three keyboard buttons. The participants performed two behavioral experiments—Single-SG and Mixed-SG condition. The Single-SG condition required performing GST on a single SG position repeatedly, whereas the Mixed-SG condition involved performing GST using the same KM on two novel SG positions presented in a random, inter-mixed manner. In the Single-SG condition, we show that motor learning contributes to the sequence-specific learning in GST with the repeated execution of the same trajectories. In the Mixed-SG condition, since the participants utilize the previously learned KM, we anticipate a transfer of learning from the Single-SG condition. The acquisition and transfer of a KM-specific internal model facilitates efficient trajectory planning on novel SG conditions. The acquisition of such a KM-specific internal model amounts to trajectory-independent cognitive learning in GST. We show that cognitive learning contributes to the learning in GST by showing transfer-related performance improvements in the Mixed-SG condition. In sum, we show the role of cognitive and motor learning processes in internally-guided sequencing and further make a case for using GST-like grid-navigation paradigms in investigating internally guided skill learning. (shrink)

The Action-sentence Compatibility Effect is often taken as supporting the fundamental role of the motor system in understanding sentences that describe actions. This effect would be related to an internal “simulation,” i.e., the reactivation of past perceptual and motor experiences. However, it is not easy to establish whether this simulation predominantly involves spatial imagery or motor anticipation. In the classical ACE experiments, where a real motor response is required, the direction and motor representations are mixed. In order to disentangle spatial (...) and motor aspects involved in the ACE, we performed six experiments in different conditions, where the motor component was always reduced, asking participants to judge the sensibility of sentences by moving a mouse, thus requiring a purely spatial representation, compatible with nonmotor interpretations. In addition, our experiments had the purpose of taking into account the possible confusion of effects of practice and of compatibility. Also, in contrast to the usual paradigm, we included no-transfer filler sentences in the analysis. The ACE was not found in any experiment, a result that failed to support the idea that the ACE could be related to a simulation where spatial aspects rather than motor ones prevail. Strong practice effects were always found and were carved out from results. A surprising effect was that no-transfer sentences were processed much slower than others, perhaps revealing a sort of participants’ awareness of the structure of stimuli, i.e., their finding that some of them involved motion and others did not. The relevance of these outcomes for the embodiment theory is discussed. (shrink)

The self-reference effect refers to better memory for self-relevant than for other-relevant information. Generally, the SRE is found in conditions in which links between the stimuli and the self are forged in the encoding phase. To investigate the possibility that such conditions are not prerequisites for the SRE, this research developed two conditions by using two recognition tasks involving abstract geometric shapes. One was the cue-in-encoding condition in which self- and other-cues were presented to construct links with AGSs during the (...) encoding phase, and the other was the cue-in-retrieval condition in which self- and other-cues were presented to construct links with AGSs during the retrieval phase. The SRE was found in both conditions. The findings reveal that self-cues merely presented during the retrieval phase are sufficient to induce the SRE. Links between the stimuli and the self constructed during the encoding phase may not be necessary prerequisites for the SRE. (shrink)

Butz, Achimova, Bilkey, and Knott provide a topic overview and discuss whether the special issue contributions may imply that event‐predictive abilities constitute a root for conceptual human thought, because they enable complex, mutually beneficial, but also intricately competitive, social interactions and language communication.

Butz, Achimova, Bilkey, and Knott provide a topic overview and discuss whether the special issue contributions may imply that event‐predictive abilities constitute a root for conceptual human thought, because they enable complex, mutually beneficial, but also intricately competitive, social interactions and language communication.

Inspired by, and in close relation with, the contributions of this special issue, Kuperberg elegantly links event comprehension, production, and learning. She proposes an overarching hierarchical generative framework of processing events enabling us to make sense of the world around us and to interact with it in a competent manner.

Are there logically possible types of conscious experience that are nomologically impossible, given independently justified assumptions about the neural underpinnings of consciousness in human beings? In one sense, this is trivial: just consider the fact that the types of perceptual experiences we can have are limited by our sensory organs. But there may be non-trivial types of conscious experience that are impossible. For instance, if there is a basic type of self-consciousness, corresponding to a phenomenal property that is nomologically necessary (...) for consciousness, then experiences lacking this phenomenal property will be impossible. More generally, it may be that there are causal dependencies between the neural mechanisms that are required to instantiate distinct phenomenal properties. If this is the case, instantiating one of these phenomenal properties without certain others may be impossible, which means there are non-trivial cases of nomologically impossible types of conscious experience. This paper clarifies this hypothesis, outlines a general methodology for its investigation, and relates it to research on radical disruptions of self-consciousness. (shrink)

The aim of this paper is to understand the functional role of mental representations and intentionality in skilled actions from a systems related perspective. Therefore, we will evaluate the function of representation and then discuss the cognitive architecture of skilled actions in more depth. We are going to describe the building blocks and levels of the action system that enable us to control movements such as striking the tennis ball at the right time, or grasping tools in manual action. Based (...) on this theoretical understanding the measurement of mental representations and related research results concerning mental representation in skilled action are presented in an overview. This leads to the question how mental representations develop and change during learning. Finally, to consolidate the functional understanding of mental representation in skilled action and interaction, we provide examples how to use the measurement of mental representation in humans to inform technical systems. (shrink)

Events—the experiences we think we are having and recall having had—are constructed; they are not what actually occurs. What occurs is ongoing dynamic, multidimensional, sensory flow, which is somehow transformed via psychological processes into structured, describable, memorable units of experience. But what is the nature of the redescription processes that fluently render dynamic sensory streams as event representations? How do such processes cope with the ubiquitous novelty and variability that characterize sensory experience? How are event‐rendering skills acquired and how do (...) event representations change with development? This review considers emerging answers to these questions, beginning with evidence that an implicit tendency to monitor predictability structure via statistical learning is key to event rendering. That is, one way that the experience of bounded events (e.g., actions within behavior, words within speech) arises is with the detection of “troughs” in sensory predictability. Interestingly, such troughs in predictability are often predictable; these regions of predictable‐unpredictability provide articulation points to demarcate one event from another in representations derived from the actual streaming information. In our information‐optimization account, a fluent event‐processor predicts such troughs and selectively attends to them—while suppressing attention to other regions—as sensory streams unfold. In this way, usage of attentional resources is optimized for efficient sampling of the most relevant, information‐rich portions of the unfolding flow of sensation. Such findings point to the development of event‐processing fluency—whether in action, language, or other domains—depending crucially on rapid and continual cognitive reorganization. As knowledge of predictability grows, attention is adaptively redeployed. Accordingly, event experiences undergo continuous alteration. (shrink)

Storchak, Ehlis, and Fallgatter provide an extensive literature review on electrophysiological measurements, which indicate that general predictive deficits in self‐monitoring are associated with various positive symptoms in patients with schizophrenia.

Looking times and gaze behavior indicate that infants can predict the goal state of an observed simple action event (e.g., object‐directed grasping) already in the first year of life. The present paper mainly focuses on infants’ predictive gaze‐shifts toward the goal of an ongoing action. For this, infants need to generate a forward model of the to‐be‐obtained goal state and to disengage their gaze from the moving agent at a time when information about the action event is still incomplete. By (...) about 6 months of age, infants show goal‐predictive gaze‐shifts, but mainly for familiar actions that they can perform themselves (e.g., grasping) and for familiar agents (e.g., a human hand). Therefore, some theoretical models have highlighted close relations between infants’ ability for action‐goal prediction and their motor development and/or emerging action experience. Recent research indicates that infants can also predict action goals of familiar simple actions performed by non‐human agents (e.g., object‐directed grasping by a mechanical claw) when these agents display agency cues, such as self‐propelled movement, equifinality of goal approach, or production of a salient action effect. This paper provides a review on relevant findings and theoretical models, and proposes that the impacts of action experience and of agency cues can be explained from an action‐event perspective. In particular, infants’ goal‐predictive gaze‐shifts are seen as resulting from an interplay between bottom‐up processing of perceptual information and top‐down influences exerted by event schemata that store information about previously executed or observed actions. (shrink)

I aim to show that the content of our perceptual states depends counterfactually on the action we want to perform. Most philosophical and psychological theories of perception claim or at least assume the opposite: they conceive of perception as allpurpose: what we want to do does not influence what we see. I will argue that the content of one's perceptual state does vary as the action one is inclined to perform varies. To put it very simply, what we see does (...) indeed depend on what we want to do. After clarifying what counterfactual dependence means in my claim, I will give a two step argument. (a) one's visual attention (sometimes) depends counterfactually on one's intention to perform an action (everything else being equal) and (b) one's perceptual content (always) depends counterfactually on one's visual attention (everything else being equal). If we put these claims together, what we get is that one's perceptual content depends counterfactually on one's intention to perform an action (everything else being equal). (shrink)

The ability to understand and communicate about the actions of others is a fundamental aspect of our daily activity. How can we talk about what others are doing? What qualities do different actions have such that they cause us to see them as being different or similar? What is the connection between what we see and the development of concepts and words or expressions for the things that we see? To what extent can two different people see and talk about (...) the same things? Is there a common basis for our perception, and is there then a common basis for the concepts we form and the way in which the concepts become lexicalized in language? The broad purpose of this thesis is to relate aspects of perception, categorization and language to action recognition and conceptualization. This is achieved by empirically demonstrating a prototype structure for action categories and by revealing the effect this structure has on language via the semantic organization of verbs for natural actions. The results also show that implicit access to categorical information can affect the perceptual processing of basic actions. These findings indicate that our understanding of human actions is guided by the activation of high level information in the form of dynamic action templates or prototypes. More specifically, the first two empirical studies investigate the relation between perception and the hierarchical structure of action categories, i.e., subordinate, basic, and superordinate level action categories. Subjects generated lists of verbs based on perceptual criteria. Analyses based on multidimensional scaling showed a significant correlation for the semantic organization of a subset of the verbs for English and Swedish speaking subjects. Two additional experiments were performed in order to further determine the extent to which action categories exhibit graded structure, which would indicate the existence of prototypes for action categories. The results from typicality ratings and category verification showed that typicality judgments reliably predict category verification times for instances of different actions. Finally, the results from a repetition priming paradigm suggest that high level information about the categorical differences between actions can be implicitly activated and facilitates the later visual processing of displays of biological motion. This facilitation occurs for upright displays, but appears to be lacking for displays that are shown upside down. These results show that the implicit activation of information about action categories can play a critical role in the perception of human actions. (shrink)

Hoerl & McCormack argue that animals cannot represent past situations and subsume animals’ memory-like representations within a model of the world. I suggest calling these memory-like representations as what they are without beating around the bush. I refer to them as event memories and explain how they are different from episodic memory and how they can guide action in animal cognition.

Learning in intelligent systems is a result of direct or indirect interaction with the environment. Humans can learn by way of different states of (inter-)action such as the execution or the imagery of an action, but their unique potential to induce brain-related as well as mind-related changes in the motor action system is still being debated. The systematic repetition of different states of action (e.g., execution and imagery in terms of physical and mental practice) and their contribution to the learning (...) of complex motor actions has traditionally been approached by way of performance improvements. More recently, approaches highlighting the role of action representation in the learning of complex motor actions have evolved. In the present perspective paper, we build on brain-related findings and sketch recent research on learning by way of imagery and execution from a hierarchical, perceptual-cognitive approach to the motor action system. These findings provide valuable insights into the learning of intelligent systems from a perceptual-cognitive, representation-based perspective and as such add to our current understanding of action representation in memory and its changes with practice. Future research should build bridges between approaches in order to more thoroughly understand functional changes throughout the learning process, and to jointly contribute to developing intelligent cognitive systems and their application in robotics, rehabilitation, or sports. (shrink)

The dynamics of neural populations capture the laws of the mindThis paper focuses on the level of neural networks. Examining the case of recurrent neural networks, the paper argues that the dynamics of neural populations form a privileged level of explanation in cognitive science. According to Schöner, this level is privileged, because it enables cognitive scientists to discover the laws governing organisms’ cognition and behaviour.

According to sensorimotor theory perceiving is a bodily skill involving exercise of an implicit know-how of the systematic ways that sensations change as a result of potential movements, that is, of sensorimotor contingencies. The theory has been most successfully applied to vision and touch, while perceptual modalities that rely less on overt exploration of the environment have not received as much attention. In addition, most research has focused on philosophically grounding the theory and on psychologically elucidating sensorimotor laws, but the (...) theory’s ramifications for neuroscience still remain underexamined. Here we sketch the beginnings of a research program that could address these two outstanding challenges in terms of auditory perception. We review the neuroscience literature on passive listening, which is defined as listening without overt bodily movement, and conclude that sensorimotor theory provides a unique perspective on the consistent finding of motor system activation. In contrast to competing theories, this activation is predicted to be involved not only in the perception of speech- and action-related sounds, but in auditory perception in general. More specifically, we propose that the auditory processing associated with supplementary motor areas forms part of the neural basis of the exercise of sensorimotor know-how: these areas’ recognized role in facilitating spontaneous motor responses to sound and supporting flexible engagement of sensorimotor processes to guide auditory experience and enable auditory imagery, can be understood in terms of two key characteristics of sensorimotor interaction, its “alerting capacity” and “corporality”, respectively. We also highlight that there is more to the inside of the body than the brain: there is an opportunity to develop sensorimotor theory into new directions in terms of the still poorly understood active processes of the peripheral auditory system. (shrink)

Pseudo‐mechanistic explanations in psychology and cognitive neuroscienceThis paper focuses on the level of systems/cognitive neuroscience. It argues that the great majority of explanations in psychology and cognitive neuroscience is “pseudo‐mechanistic.” On the basis of various case studies, Hommel argues that cognitive neuroscience should move beyond what he calls an “Aristotelian phase” to become a mature “Galilean” science seeking to discover actual mechanisms of cognitive phenomena.

The role of personal background knowledge—in particular knowledge about the context of production of an artwork—has been only marginally taken into account in cognitive approaches to art. Addressing this issue is crucial to enhancing these approaches’ explanatory power and framing their collaboration with the humanities (Bullot and Reber 2012). This paper sketches a model of the experience of artworks based on the mechanisms of intention attribution, and shows how this model makes it possible to address the issue of personal background (...) knowledge empirically. I claim that the role of intention attribution in art experience has been incorrectly accounted in the literature because of an overly narrow definition of “intention.” I suggest that the observer can recover not only the artist’s abstract projects, but any kind of mental states that have played a causal role during the production of the work. In addition, I suggest that this recovery occurs in large part unconsciously and/or implicitly. I provide support for these claims by distinguishing three families of psychological mechanisms of intention attribution that are activated by artworks: one involved in the cognition of artifacts, one devoted to communication, and one involved in action perception. (shrink)

Cognition is not, and could not possibly be, entirely representational in character. There is also a phenomenal form of cognitive expression that registers the intrinsic properties of mental states themselves. Arguments against the reality of this intrinsic phenomenal dimension to mental experience have focused either on its supposed impossibility, or secondly, the non-appearance of any such qualities to introspection. This paper argues to the contrary, that the registration of cognitive state properties does take place independently of representational content; and necessarily (...) so, since it supports an independent function—self-management. Given the fact that unlike a computer, the brain must, of necessity, operate itself, it needs to be in touch with itself to do so. Intrinsic phenomenal forms of cognitive expression allow the brain to do just that by registering characteristics of the cognitive states themselves. Self-management might well prove to constitute the prime reason for the emergence of subjectivity itself. (shrink)

ABSTRACTThe Theory of Event Coding predicts that exposure to affective cues can automatically trigger affectively congruent behaviour due to shared representational codes. An intriguing hypothesis from this theory is that exposure to aversive cues can automatically trigger actions that have previously been learned to result in aversive outcomes. Previous work has indeed found such a compatibility effect on reaction times in forced-choice tasks, but not for action selection in free-choice tasks. Failure to observe this compatibility effect for aversive cues in (...) free choice tasks suggests that control processes aimed at directing behaviour toward positive outcomes may overrule the automatic activation of affectively congruent responses in case of aversive cues. The present study tested whether minimising such control could cause selection of actions that have been learned to result in aversive outcomes. Results showed incidental exposure to aversive cues biased selection of behaviours with learned aver... (shrink)

I aim to show that perception depends counterfactually on the action we want to perform. Perception is not all-purpose: what we want to do does influence what we see. After clarifying how this claim is different from the one at stake in the cognitive penetrability debate and what counterfactual dependence means in my claim, I will give a two-step argument: one’s perceptual attention depends counterfactually on one’s intention to perform an action and one’s perceptual processing depends counterfactually on one’s perceptual (...) attention. If we put these claims together, what we get is that one’s perceptual processing depends counterfactually on one’s intention to perform an action. (shrink)

The information age can be dated to the work of Norbert Wiener and Claude Shannon in the 1940s. Their work on cybernetics and information theory, and many subsequent developments, had a profound influence on reshaping the field of psychology from what it was prior to the 1950s. Contemporaneously, advances also occurred in experimental design and inferential statistical testing stemming from the work of Ronald Fisher, Jerzy Neyman, and Egon Pearson. These interdisciplinary advances from outside of psychology provided the conceptual and (...) methodological tools for what is often called the cognitive revolution but is more accurately described as the information-processing revolution. Cybernetics set the stage with the idea that everything ranging from neurophysiological mechanisms to societal activities can be modeled as structured control systems with feedforward and feedback loops. Information theory offered a way to quantify entropy and information, and promoted theorizing in terms of information flow. Statistical theory provided means for making scientific inferences from the results of controlled experiments and for conceptualizing human decision making. With those three pillars, a cognitive psychology adapted to the information age evolved. The growth of technology in the information age has resulted in human lives being increasingly interweaved with the cyber environment, making cognitive psychology an essential part of interdisciplinary research on such interweaving. Continued engagement in interdisciplinary research at the forefront of technology development provides a chance for psychologists not only to refine their theories but also to play a major role in the advent of a new age of science. (shrink)

To evoke the impression of movement in the “immobile” image is one of the central motivations of the visual art, and the activating effect of images has been discussed in art psychology already some hundred years ago. However, this topic has up to now been largely neglected by the researchers in cognitive psychology and neuroscience. This study investigates – from an interdisciplinary perspective – the formation of lateralised instances of motion when an observer perceives movement in an image. A first (...) step was to identify images that evoke a perception of movement in a certain direction and to give this a rating. Reaction times leading to the engagement of a joystick following the presentation of images are used to evidence the postulated movement occasioned by the perception of movement in an image. Where the required direction of joystick moves matched the expected perception of movement direction in the image, considerably shorter reaction times were recorded. The experiment was able to prove a “movement-image compatibility effect” in observers of images. Based on this, the paper revisits and brings up to date the theses on motor sensory response to images which were developed in art psychology at the beginning of the 20th century. It furthermore contributes an embodiment theory interpretation to the prevalent representational explanation of compatibility effects. (shrink)

Modern computer-based applications often require the user to interact with avatars. Depending on the task at hand, spatial dissociation between the orientations of the user and the avatars might arise. As a consequence, the user has to adopt the avatar's perspective and identify herself/himself with the avatar, possibly changing the user's self-representation in the process. The present study aims to identify the conditions that benefit this change of perspective with objective performance measures and subjective self-estimations by integrating the idea of (...) avatar-ownership into the cognitive phenomenon of spatial compatibility. Two different instructions were used to manipulate a user's perceived ownership of an avatar used in otherwise identical situations. Users with the high-ownership instruction reported higher levels of perceived ownership of the avatar and showed larger spatial compatibility effects from the avatar's point of view in comparison to the low ownership instruction. This supports the hypothesis that perceived ownership benefits perspective taking. (shrink)