The purpose of this paper is to defend what I call the action-oriented coding theory (ACT) of spatially contentful visual experience. Integral to ACT is the view that conscious visual experience and visually guided action make use of a common subject-relative or 'egocentric' frame of reference. Proponents of the influential two visual systems hypothesis (TVSH), however, have maintained on empirical grounds that this view is false (Milner & Goodale, 1995/2006; Clark, 1999; 2001; Campbell, 2002; Jacob & Jeannerod, 2003; Goodale & (...) Milner, 2004). One main source of evidence for TVSH comes from behavioral studies of the comparative effects of size-contrast illusions on visual awareness and visuo- motor action. This paper shows that not only is the evidence from illusion studies inconclusive, there is a better, ACT-friendly interpretation of the evidence that avoids serious theoretical difficulties faced by TVSH. (shrink)

Beat perception has received very little attention from either philosophers of mind or philosophers of music. This neglect is unfortunate, for the topic is rich with philosophical interest. This article addresses two questions. The first concerns the nature of our experience of musical beat. Here, we argue that experiences of beat are forms of auditory perception. The second question concerns the nature of musical beat itself: what are beats? We defend a form of anthropocentric realism about beats: beats are mind‐independent (...) properties of sound sequences whose nature can be understood only in relation to our perceptual capacities. (shrink)

In the present study, cross-modal (i.e., across sensory modalities such as smell and sound) iconicity (i.e., resemblance) and indexicality (i.e., contiguity) in lexical sensory and emotional signs in Finnish Sign Language will be considered from an articulatory perspective (i.e., the production of signs). Such cross-modal iconicity has not been extensively studied previously, so here, with the help of cognitive semiotics, I aim to carefully describe the cross-modal patterns observed across 118 signs, including 60 sensory signs and 58 emotional signs. The (...) analysis is framed within the theoretical model of Semiotic Hierarchy, which entails a non-reductionist view of meaning. In addition, a pheno-methodological triangulation will be applied: phenomenology (first-person method), literature of phenomenological and semiotic descriptions (second-person perspective) and experimental findings (third-person perspective). The results of this analysis show that (a) 71 of the 118 sensory and emotional signs are cross-modally indexical, (b) only 10 of the 71 signs can be regarded as cross-modally iconic, (c) cross-modal iconicity is highly diagrammatic, (d) iconicity and indexicality are highly integrated, and (e) articulatory feedback matters in the formation of semiotic patterns. This study contributes to our understanding of cross-modal iconicity in signed languages, as well as studies in semiotic systems more generally. (shrink)

Our senses receive a manifold of sensory signals at any given moment in our daily lives. For a coherent and unified representation of information and precise motor control, our brain needs to temporally bind the signals emanating from a common causal event and segregate others. Traditionally, different mechanisms were proposed for the temporal binding phenomenon in multisensory and motor-sensory contexts. This paper reviews the literature on the temporal binding phenomenon in both multisensory and motor-sensory contexts and suggests future research directions (...) for advancing the field. Moreover, by critically evaluating the recent literature, this paper suggests that common computational principles are responsible for the temporal binding in multisensory and motor-sensory contexts. These computational principles are grounded in the Bayesian framework of uncertainty reduction rooted in the Helmholtzian idea of unconscious causal inference. (shrink)

The sounds that result from our movement and that mark the outcome of our actions typically convey useful information concerning the state of our body and its movement, as well as providing pertinent information about the stimuli with which we are interacting. Here we review the rapidly growing literature investigating the influence of non-veridical auditory cues (i.e., inaccurate in terms of their context, timing, and/or spectral distribution) on multisensory body and action perception, and on motor behavior. Inaccurate auditory cues provide (...) a unique opportunity to study cross-modal processes: the ability to detect the impact of each sense when they provide a slightly different message is greater. Additionally, given that similar cross-modal processes likely occur regardless of the accuracy or inaccuracy of sensory input, studying incongruent interactions are likely to also help us predict interactions between congruent inputs. The available research convincingly demonstrates that perceptions of the body, of movement, and of surface contact features (e.g., roughness) are influenced by the addition of non-veridical auditory cues. Moreover, auditory cues impact both motor behavior and emotional valence, the latter showing that sounds that are highly incongruent with the performed movement induce feelings of unpleasantness (perhaps associated with lower processing fluency). Such findings are relevant to the design of auditory cues associated with product interaction, and the use of auditory cues in sport performance and therapeutic situations given the impact on motor behavior. (shrink)

The simultaneous perception of multimodal sensory information is important for effective reactions to the external environment. In relation to the effect on time perception, voluntary movement and rhythmic stimuli have already been identified in previous studies to be associated with improved accuracy of temporal order judgments. Here, we examined whether the combination of voluntary movement and rhythmic stimuli improves the just noticeable difference in audio-tactile TOJ Tasks. Four different experimental conditions were studied, involving two types of movements and two types (...) of stimulus presentation. In the voluntary movement condition, after the auditory stimulus participants moved their right index finger voluntarily and naturally, while in the involuntary movement condition, their right index finger was moved by the tactile device. The stimuli were provided in a rhythmic or one-time only manner by hitting inside the first joint of the participants' right index finger using a tactile device. Furthermore, in the rhythmical tactile conditions, tactile stimuli were presented rhythmically to the right index finger 5 times consecutively. On the other hand, in the one-time tactile conditions, tactile stimuli was presented one-time only to the right index finger. Participants made an order judgment for the fifth tactile stimuli and the first and only auditory stimuli. In our TOJ tasks, auditory-tactile stimulus pairs were presented to participants with varying stimulus-onset asynchronies. For the two stimuli presented at a time that were shifted by the SOA, the participants were asked to judge which one was presented first, and they were given a two-choice answer. Using a non-parametric test, our results showed that voluntary movement and rhythmic tactile stimuli were both effective in improving the JNDs in TOJ Tasks. However, in the combination of voluntary movement and rhythmic tactile stimuli, we found that there was no significant difference in JNDs in our experiments. (shrink)

Long-standing neglect of the chemical senses in the philosophy of perception is due, mostly, to their being regarded as ‘lower’ senses. Smell, taste, and chemically irritated touch are thought to produce mere bodily sensations. However, empirically informed theories of perception can show how these senses lead to perception of objective properties, and why they cannot be treated as special cases of perception modelled on vision. The senses of taste, touch, and smell also combine to create unified perceptions of flavour. The (...) nature of these multimodal experiences and the character of our awareness of them puts pressure on the traditional idea that each episode of perception goes one or other of the five senses. Thus, the chemical senses, far from being peripheral to the concerns of the philosophy of perception, may hold important clues to the multisensory nature of perception in general. (shrink)

This paper examines the basic question of how we can come to form accurate beliefs about the world when we do not fully know how good or bad our evidence is. Here, we show, using simulations with otherwise optimal agents, the cost of misjudging the quality of our evidence. We compare different strategies for correctly estimating that quality, such as outcome‐ and expectation‐based updating. We also identify conditions under which misjudgment of evidence quality can nevertheless lead to accurate beliefs, as (...) well as those conditions where no strategy will help. These results indicate both where people will nevertheless succeed and where they will fail when information quality is degraded. (shrink)

The success of the Bayesian approach to perception suggests probabilistic perceptual representations. But if perceptual representation is probabilistic, why doesn't normal conscious perception reflect the full probability distributions that the probabilistic point of view endorses? For example, neurons in MT/V5 that respond to the direction of motion are broadly tuned: a patch of cortex that is tuned to vertical motion also responds to horizontal motion, but when we see vertical motion, foveally, in good conditions, it does not look at all (...) horizontal. This article argues that the best Bayesian approach to this problem does not require probabilistic representation. (shrink)

Social interactions in daily life necessitate the integration of social signals from different sensory modalities. In the aging literature, it is well established that the recognition of emotion in facial expressions declines with advancing age, and this also occurs with vocal expressions. By contrast, crossmodal integration processing in healthy aging individuals is less documented. Here, we investigated the age-related effects on emotion recognition when faces and voices were presented alone or simultaneously, allowing for crossmodal integration. In this study, 31 young (...) adults (M = 25.8 years) and 31 older adults (M = 67.2 years) were instructed to identify several basic emotions (happiness, sadness, anger, fear, disgust) and a neutral expression, which were displayed as visual (facial expressions), auditory (nonverbal affective vocalizations) or crossmodal (simultaneous, congruent facial and vocal affective expressions) stimuli. The results showed that older adults performed slower and worse than younger adults at recognizing negative emotions from isolated faces and voices. In the crossmodal condition, although slower, older adults were as accurate as younger except for anger. Importantly, additional analyses using the ‘race model’ demonstrate that older adults benefited to the same extent as younger adults from the combination of facial and vocal emotional stimuli. These results help explain some conflicting results in the literature and may clarify emotional abilities related to daily life that are partially spared among older adults. (shrink)

Twenty years ago, the first report on the sound-induced double flash illusion, a visual illusion induced by sound, was published. In this paradigm, participants are presented with different numbers of auditory and visual stimuli. In case of an incongruent number of auditory and visual stimuli, the influence of auditory information on visual perception can lead to the perception of the illusion. Thus, combining two auditory stimuli with one visual stimulus can induce the perception of two visual stimuli, the so-called fission (...) illusion. Alternatively, combining one auditory stimulus with two visual stimuli can induce the perception of one visual stimulus, the so-called fusion illusion. Overall, current research shows that the illusion is a reliable indicator of multisensory integration. It has also been replicated using different stimulus combinations, such as visual and tactile stimuli. Importantly, the robustness of the illusion allows the widespread use for assessing multisensory integration across different groups of healthy participants and clinical populations and in various task setting. This review will give an overview of the experimental evidence supporting the illusion, the current state of research concerning the influence of cognitive processes on the illusion, the neural mechanisms underlying the illusion, and future research directions. Moreover, an exemplary experimental setup will be described with different options to examine perception, alongside code to test and replicate the illusion online or in the laboratory. (shrink)

While distinguishing between the actions and physical boundaries of self and other (non-self) is usually straightforward there are contexts in which such differentiation is challenging. For example, self–other ambiguity may occur when actions of others are similar or complementary to those of the self. Even in the absence of such situational challenges, individuals experiencing hallucinations have difficulties with this distinction, often experiencing thoughts or actions of self as belonging to other agents. This paper explores the role of ambiguity in self–other (...) differentiation, drawing from developmental, psychodynamic, and neurocognitive perspectives. A key proposal is that engagement in contexts that make distinctions between self and other challenging yet necessary allow reality-testing skills related to agency to develop. Attunement in typical caregiver–infant interactions is framed as a safe but inherently ambiguous environment that provides optimal condition for the infant to develop a coherent self–other sense. Vulnerability to psychosis may be related to limited access to such an environment in early development. However, the perceptual, cognitive, and social skills that contribution to attribution are likely to be malleable following infancy and improve though opportunities for boundary play in similarly ambiguous settings. Using music-making to illustrate, we postulate that engagement in intricate joint-actions that blurs agentic boundaries can contribute to the continued development of an adaptive sense of self and other essential to healthy social functioning. Increased insight into the self–other ambiguity may enhance our understanding of mechanisms underlying “self-disorders” such as schizophrenia and eventually extend the range of social and arts-based therapeutic possibilities. (shrink)

Through advances in production and treatment technologies, transparent glass has become an increasingly versatile material and a global hallmark of modern architecture. In the shape of invisible barriers, it defines spaces while simultaneously shaping their lighting, noise, and climate conditions. Despite these unique architectural qualities, little is known regarding the human experience with glass barriers. Is a material that has been described as being simultaneously there and not there from an architectural perspective, actually there and/or not there from perceptual, behavioral, (...) and social points of view? In this article, we review systematic observations and experimental studies that explore the impact of transparent barriers on human cognition and action. In doing so, the importance of empirical and multidisciplinary approaches to inform the use of glass in contemporary architecture is highlighted and key questions for future inquiry are identified. (shrink)

The debate about direct perception encompasses different topics, one of which concerns the richness of the contents of perceptual experiences. Can we directly perceive only low-level properties, like edges, colors etc., or can we perceive high-level properties and entities as well? The aim of the paper is to defend the claim that the content of our perceptual experience can include emotions and also person impressions. Using these examples, an argument is developed to defend a liberal-content view for core examples of (...) social cognition. This view is developed and contrasted with accounts which claim that in the case of registering another person’s emotion while seeing them, we have to describe the relevant content not as the content of a perceptual experience, but of a perceptual belief. The paper defends the view that perceptual experiences can have a rich content yet remain separable from beliefs formed on the basis of the experience. How liberal and enriched the content of a perceptual experience is will depend upon the expertise a person has developed in the field. This is supported by the argument that perceptual experiences can be systematically enriched by perceiving affordances of objects, by pattern recognition or by top-down processes, as analyzed by processes of cognitive penetration or predictive coding. (shrink)

We develop a version of a direct perception account of emotion recognition on the basis of a metaphysical claim that emotions are individuated as patterns of characteristic features. On our account, emotion recognition relies on the same type of pattern recognition as is described for object recognition. The analogy allows us to distinguish two forms of directly perceiving emotions, namely perceiving an emotion in the absence of any top-down processes, and perceiving an emotion in a way that significantly involves some (...) top-down processes ; and, in addition, an inference-based evaluation of an emotion. Our model clarifies the epistemology of emotion recognition. (shrink)

The phenomenology of controlled action depends on comparisons between predicted and actually perceived sensory feedback called action-effects. We investigated if intervening task-irrelevant but semantically related information influences monitoring processes that give rise to a sense of control. Participants judged whether a moving box “obeyed” or “disobeyed” their own arrow keystrokes or visual cues representing the computer’s choices . During 1 s delays between keystrokes/cues and box movements, participants vocalized directions cued by letters inside the box. Congruency of cued vocalizations was (...) manipulated relative to previously selected keystrokes and upcoming box movements. In Experiment 1, reported obey moves and feelings of control reflected the true frequency of obey moves, but were also modulated by vocalizations. Incongruent vocalizations reduced reported obey moves, whereas congruent vocalizations increased them. In Experiment 2, vocalizations had stronger effects when their congruence with primary-task box movement was consistent for several consecutive moves before congruence changed. In Experiment 3, analogous impacts of vocalizations occurred when the computer selected the directions and participants judged whether the computer had control of the box. We conclude that predicted and perceived action-effects associated with semantically related but separate and ostensibly irrelevant actions can be conflated with one another. This interference is not restricted to actions performed with the same effector or within the same modality, or even by the same actor. Thus in estimating degrees of control, the mind integrates across ongoing action systems, whether or not they are logically task-relevant. (shrink)

Sense of agency is a compelling but fragile experience that is augmented or attenuated by internal signals and by external cues. A disruption in SoA may characterise individual symptoms of mental illness such as delusions of control. Indeed, it has been argued that generic SoA disturbances may lie at the heart of delusions and hallucinations that characterise schizophrenia. A clearer understanding of how sensorimotor, perceptual and environmental cues complement, or compete with, each other in engendering SoA may prove valuable in (...) deepening our understanding the agency disruptions that characterise certain focal neurological disorders and mental illnesses. Here we examine the integration of SoA cues in health and illness, describing a simple framework of this integration based on Bayesian principles. We extend this to consider how alterations in cue integration may lead to aberrant experiences of agency. (shrink)

In his groundbreaking book, Against Coherence (2005), Erik Olsson presents an ingenious impossibility theorem that appears to show that there is no informative relationship between probabilistic measures of coherence and higher likelihood of truth. Although Olsson's result provides an important insight into probabilistic models of epistemological coherence, the scope of his negative result is more limited than generally appreciated. The key issue is the role conditional independence conditions play within the witness testimony model Olsson uses to establish his result. Olsson (...) maintains that his witness model yields charitable ceteris paribus conditions for any theory of probabilistic coherence. Not so. In fact, Olsson's model, like Bayesian witness models in general, selects a peculiar class of models that are in no way representative of the range of options available to coherence theorists. Recent positive results suggest that there is a way to develop a formal theory of coherence after all. Further, although Bayesian witness models are not conducive to the truth, they are conducive to reliability. (shrink)

Recent research on proprioception reveals that it relies on a systematically distorted model of bodily dimensions. This generates a puzzle about proprioception in action control: action requires accurate bodily parameters. Proprioception is crucial for ordinary action, but if it relies on a systematically distorted body model, then proprioception should contain systematic errors. But we cannot respond by discarding proprioception from motor control, since we know from the severe problems deafferented agents face in acting that ordinary action requires proprioception. The solution (...) is that the possibility of bodily action is provided for by multimodal body representations for action. (shrink)

Although acoustic frequency is not a spatial property of physical objects, in common language, pitch, i.e., the psychological correlated of frequency, is often labeled spatially (i.e., “high in pitch” or “low in pitch”). Pitch-height is known to modulate (and interact with) the response of participants when they are asked to judge spatial properties of non-auditory stimuli (e.g., visual) in a variety of behavioral tasks. In the current study we investigated whether the modulatory action of pitch-height extended to the haptic estimation (...) of height of a virtual step. We implemented a HW/SW setup which is able to render virtual 3D objects (stair-steps) haptically through a PHANTOM device, and to provide real-time continuous auditory feedback depending on the user interaction with the object. The haptic exploration was associated with a sinusoidal tone whose pitch varied as a function of the interaction point’s height within (i) a narrower and (ii) a wider pitch range, or (iii) a random pitch variation acting as a control audio condition. Explorations were also performed with no sound (haptic only). Participants were instructed to explore the virtual step freely, and to communicate height estimation by opening their thumb and index finger to mimic the step riser height, or verbally by reporting the height in centimeters of the step riser. We analyzed the role of musical expertise by dividing participants into non musicians and musicians. Results showed no effects of musical pitch on high-realistic haptic feedback. Overall there is no difference between the two groups in the proposed multimodal conditions. Additionally, we observed a different haptic response distribution between musicians and non musicians when estimations of the auditory conditions are matched with estimations in the no sound condition. (shrink)

Ferdinand Pöhlmann argues that a sense of one’s own basic abilities to move is a constitutive condition on the ability to perceive the world spatially. This constitutive relation explains why egocentric spatial representation is to be regarded as a kind of self-representation. In arguing for these claims, conceptual as well as empirical questions are discussed and an overview of accounts that take action as a constitutive condition on spatial representation is given. The picture that emerges is linked to the phenomenological (...) (Scheler) as well as to the analytic (Evans) tradition in the Philosophy of Mind.​. (shrink)

We defend our multifactorial weighting model of the sense of agency and our critique of the comparator model against the critiques that have been brought forward by and . Building on the specification of our model that emerges from this response, we will suggest a distinct mechanism how weighting of different agency factors might work: internal and external agency cues are constantly weighted according to their reliability in a given situation. Thus, the weighting process underlying the sense of agency might (...) follow the principles of optimal cue integration. We review recent empirical evidence for this hypothesis, demonstrating that the multifactorial weighting model is not only testable, but has in fact already received first empirical support. (shrink)

A simple experimental paradigm creates the powerful illusion that one is touching one’s own hand even when the two hands are separated by 15 cm. The participant uses her right hand to administer stimulation to a prosthetic hand while the Examiner provides identical stimulation to the participant’s receptive left hand. Change in felt position of the receptive hand toward the prosthetic hand has previously led to the interpretation that the participant experiences self-touch at the location of the prosthetic hand, and (...) experiences a sense of ownership of the prosthetic hand. Our results argue against this interpretation. We assessed change in felt position of the participant’s receptive hand but we also assessed change in felt position of the participant’s administering hand. Change in felt position of the administering hand was significantly greater than change in felt position of the receptive hand. Implications for theories of ownership are discussed. (shrink)