The distinction between top-down and bottom-up effects is widely relied on in experimental psychology. However, there is an important problem with the way it is normally defined. Top-down effects are effects of previously-stored information on processing the current input. But on the face of it that includes the information that is implicit in the operation of any psychological process – in its dispositions to transition from some types of representational state to others. This paper suggests a way to distinguish information (...) stored in that way from the kind of influence of prior information that psychologists are concerned to classify as a top-down effect. So-drawn, the distinction is not just of service to theoretical psychology. Asking about the extent of top-down processing is one way to pose some of the questions at issue in philosophical debates about cognitive penetrability – about the extent of the influence of cognitive states on perception. The existence of a theoretically-useful perception-cognition distinction has come under pressure, but even if it has to be abandoned, some of the concerns addressed in the cognitive penetrability literature can be recaptured by asking about the extent of top-down influences on any given psychological process. That formulation is more general, since it can be applied to any psychological process, not just those that are paradigmatically perceptual. (shrink)

What grounds my experience of my body as my own? The body that one experiences is always one’s own, but it does not follow that one always experiences it as one’s own. One might even feel that a body part does not belong to oneself despite feeling sensations in it, like in asomatognosia. The article aims at understanding the link between bodily sensations and the sense of ownership by investigating the role played by the body schema.

According to the decomposition thesis, perceptual experiences resolve without remainder into their different modality-specific components. Contrary to this view, I argue that certain cases of multisensory integration give rise to experiences representing features of a novel type. Through the coordinated use of bodily awareness—understood here as encompassing both proprioception and kinaesthesis—and the exteroceptive sensory modalities, one becomes perceptually responsive to spatial features whose instances couldn’t be represented by any of the contributing modalities functioning in isolation. I develop an argument for (...) this conclusion focusing on two cases: 3D shape perception in haptic touch and experiencing an object’s egocentric location in crossmodally accessible, environmental space. (shrink)

Philosophers and cognitive scientists of perception by custom have investigated individual sense modalities in relative isolation from each other. However, perceiving is, in a number of respects, multimodal. The traditional sense modalities should not be treated as explanatorily independent. Attention to the multimodal aspects of perception challenges common assumptions about the content and phenomenology of perception, and about the individuation and psychological nature of sense modalities. Multimodal perception thus presents a valuable opportunity for a case study in mature interdisciplinary cognitive (...) science. This chapter aims to raise these issues against the background of unimodal approaches in the study of perception. It presents some of the central empirical findings concerning multimodality, and it explains the philosophical implications of these findings. Foremost, it aims to encourage and open avenues for future research. (shrink)

The first part of this survey article presented a cartography of some of the more extensively studied forms of multisensory processing. In this second part, I turn to examining some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical debates concerning the modularity of perception, cognitive penetration, and the individuation of the senses.

It is tempting to hold that perceptual experience amounts to a co-conscious collection of visual, auditory, tactual, gustatory, and olfactory episodes. If so, each aspect of perceptual experience on each occasion is associated with a specific modality. This paper, however, concerns a core variety of multimodal perceptual experience. It argues that there is perceptually apparent intermodal feature binding. I present the case for this claim, explain its consequences for theorizing about perceptual experience, and defend it against objections. I maintain that (...) just as one thing may perceptually appear at once to jointly bear several features associated with the same sense modality, one thing also may perceptually appear at once to jointly bear features associated with different sense modalities. For instance, just as something may visually appear at once to be both red and round, or to have a red part and a green part, something may multimodally perceptually appear at once to be both bright and loud, or to have a red part and a rough part. The main lesson, I argue, is that perceiving is not just co-consciously seeing, hearing, feeling, tasting, and smelling at the same time. And perceptual phenomenal character is not on each occasion exhausted by that which is distinctive to or associated with a given modality, along with that which accrues thanks to simple co-consciousness. Not all ways of perceiving are modality specific. I defend this account against three main objections: that singular content theorists avoid my conclusions; that apparent infusion of perceptible features is required for perceptually apparent binding but does not occur intermodally; and that the diversity of objects across modalities makes perceptually apparent intermodal binding rare. (shrink)

This paper presents forms of multimodal perceptual experience that undermine the claim that each aspect of perceptual experience is modality specific. In particular, it argues against the thesis that all phenomenal character is modality specific (even making an allowance for co-conscious unity). It concludes that a multimodal perceptual episode may have phenomenal features beyond those that are associated with the specific modalities.

Haptic touch is an inherently active and exploratory form of perception, involving both coordinated movements and an array of distinct sensory receptors in the skin. For this reason, some have claimed that haptic touch is not a single sense, but rather a multisensory collection of distinct sensory systems. Though this claim is often made, it relies on what I regard as a confused conception of multisensory interaction. In its place, I develop a nuanced hierarchy of multisensory involvement. According to this (...) hierarchy, touch turns out to be a single modality in that its various receptors assign their features to the same tangible objects. When we grasp an object a range of distinct properties?shape, warmth, heft, texture, etc.?are all felt to belong to the object, just as different visual properties are associated with a visual object. Paradigm multisensory experiences, on the other hand, involve associations between distinct perceptual experiences, as when the way something looks affects the way something sounds. Thus despite its functional and physiological diversity, haptic touch can be regarded as a single sense. (shrink)

The last couple of years have seen a rapid growth of interest in the study of crossmodal correspondences – the tendency for our brains to preferentially associate certain features or dimensions of stimuli across the senses. By now, robust empirical evidence supports the existence of numerous crossmodal correspondences, affecting people’s performance across a wide range of psychological tasks – in everything from the redundant target effect paradigm through to studies of the Implicit Association Test, and from speeded discrimination/classification tasks through (...) to unspeeded spatial localisation and temporal order judgment tasks. However, one question that has yet to receive a satisfactory answer is whether crossmodal correspondences automatically affect people’s performance , as opposed to reflecting more of a strategic, or top-down, phenomenon. Here, we review the latest research on the topic of crossmodal correspondences to have addressed this issue. We argue that answering the question will require researchers to be more precise in terms of defining what exactly automaticity entails. Furthermore, one’s answer to the automaticity question may also hinge on the answer to a second question: Namely, whether crossmodal correspondences are all ‘of a kind’, or whether instead there may be several different kinds of crossmodal mapping . Different answers to the automaticity question may then be revealed depending on the type of correspondence under consideration. We make a number of suggestions for future research that might help to determine just how automatic crossmodal correspondences really are. (shrink)

From playing basketball to ordering at a food counter, we frequently and effortlessly coordinate our attention with others towards a common focus: we look at the ball, or point at a piece of cake. This non-verbal coordination of attention plays a fundamental role in our social lives: it ensures that we refer to the same object, develop a shared language, understand each other’s mental states, and coordinate our actions. Models of joint attention generally attribute this accomplishment to gaze coordination. But (...) are visual attentional mechanisms sufficient to achieve joint attention, in all cases? Besides cases where visual information is missing, we show how combining it with other senses can be helpful, and even necessary to certain uses of joint attention. We explain the two ways in which non-visual cues contribute to joint attention: either as enhancers, when they complement gaze and pointing gestures in order to coordinate joint attention on visible objects, or as modality pointers, when joint attention needs to be shifted away from the whole object to one of its properties, say weight or texture. This multisensory approach to joint attention has important implications for social robotics, clinical diagnostics, pedagogy and theoretical debates on the construction of a shared world. (shrink)

The last decade has seen great progress in the study of the nature of crossmodal links in exogenous and endogenous spatial attention . Exogenous spatial cuing studies of human crossmodal attention and multisensory integration. In C. Spence, & J. Driver , Crossmodal space and crossmodal attention . Oxford, UK: Oxford University Press.], for a recent review). A growing body of research now highlights the existence of robust crossmodal links between auditory, visual, and tactile spatial attention. However, until recently, studies of (...) exogenous and endogenous attention have proceeded relatively independently. In daily life, however, these two forms of attentional orienting continuously compete for the control of our attentional resources, and ultimately, our awareness. It is therefore critical to try and understand how exogenous and endogenous attention interact in both the unimodal context of the laboratory and the multisensory contexts that are more representative of everyday life. To date, progress in understanding the interaction between these two forms of orienting has primarily come from unimodal studies of visual attention. We therefore start by summarizing what has been learned from this large body of empirical research, before going on to review more recent studies that have started to investigate the interaction between endogenous and exogenous orienting in a multisensory setting. We also discuss the evidence suggesting that exogenous spatial orienting is not truly automatic, at least when assessed in a crossmodal context. Several possible models describing the interaction between endogenous and exogenous orienting are outlined and then evaluated in terms of the extant data. (shrink)

How do humans manage to keep track of a gradually changing object or person as the same persisting individual despite the fact that the extraction of information about this individual must often rely on heterogeneous information sources and heterogeneous tracking methods? The article introduces the Empirical Tracking of Individuals theory to address this problem. This theory proposes an analysis of the concept of integrated tracking, which refers to the capacity to acquire, store, and update information about the identity and location (...) of individuals in our environment. It hypothesizes that certain functions of attention are a key to explaining how the cognitive flexibility of the human mind overcomes the heterogeneity of sources and methods in integrated tracking. At least two premises lend support to this hypothesis. First, heterogeneity of tracking sources is overcome by the combination of information from multiple perceptual modalities and a phenomenon of multisensory 'transparency'. Second, heterogeneity of tracking sources and methods may also be overcome by inferences that combine information across domains to acquire reasons to believe propositions about the target's location and identity. (shrink)

Many situations require the simultaneous processing of auditory and visual information, however, stimuli presented to one sensory modality can sometimes interfere with processing in a second sensory modality (i.e., modality dominance). The current study further investigated modality dominance by examining how task demands and bimodal presentation affect speeded auditory and visual discriminations. Participants in the current study had to quickly determine if two words, two pictures, or two word-picture pairings were the same or different, and we manipulated task demands across (...) three different conditions. In an immediate recognition task, there was only one second between the two stimuli/stimulus pairs and auditory dominance was found. Compared to the respective unimodal baselines, pairing pictures and words together slowed down visual responses and sped up auditory responses. Increasing the interstimulus interval to four seconds and blocking verbal rehearsal weakened auditory dominance effects, however, conflicting and redundant visual cues sped up auditory discriminations. Thus, simultaneously presenting pictures and words had different effects on auditory and visual processing, with bimodal presentation slowing down visual processing and speeding up auditory processing. These findings are consistent with a proposed mechanism underlying auditory dominance, which posits that auditory stimuli automatically grab attention and attenuate/delay visual processing. (shrink)

Provides the theoretical and psychological framework to the philosophy of sounds and audition. I address auditory scene analysis, spatial hearing, the audible qualities, and cross-modal interactions.

The participants in the present study had to make speeded elevation discrimination responses to visual targets presented to the left or right of central fixation following the presentation of a task-irrelevant auditory cue on either the same or opposite side. In Experiment 1, the cues were presented from in front of the participants (from the same azimuthal positions as the visual targets). A standard crossmodal exogenous spatial cuing effect was observed, with participants responding significantly faster in the elevation discrimination task (...) to visual targets when both the auditory cues and the visual targets were presented on the same side. Experiment 2 replicated the exogenous spatial cuing effect for frontal visual targets following both front and rear auditory cues. The results of Experiment 3 demonstrated that the participants had little difficulty in correctly discriminating the location from which the sounds were presented. Thus, taken together, the results of the three experiments reported here demonstrate that the exact co-location of auditory cues and visual targets is not necessary to attract spatial attention. Implications of these results for the design of real-world warning signals are discussed. (shrink)

In Western common sense, one speaks of there being five human senses, a claim apparently challenged by the biological and psychological sciences. Part of this challenge comes in the form of claiming the existence of additional senses. Part of the challenge comes from positing multiple senses where common sense only speaks of one, such as with the fractionation of “touch” into pressure and temperature senses. One conceptual difficulty in thinking about the number and division of senses is that it's not (...) clear whether the different senses constitute natural kinds and, if not, what kind of kind they are. Should we favor antirealism with respect to the senses, akin to the arguments of some concerning the nature of species or race? I will argue that this first problem is compounded by another: that we ought to be pluralists with respect to the senses—what is meant by the term “sense” varies from context to context, varying even between scientific contexts. (shrink)

This paper concerns epistemic developments in the field of sensory perception. I argue that Uexküll’s concept of the Umwelträume and certain principles of multisensory integration explain and describe in similar terms the manner in which different sensory modalities interact. Indeed, they both concern knowledge, describing in spatial terms how the mind makes itself up, makes up its objects, and how the objects, in turn, make up the mind. My intention is to set side by side these two trends of thought (...) in order to mutually explain them. I suggest that there is some sort of dialectic at work between the Umwelträume and multisensory integration: in the first case interaction between the senses results in the creation of high definition subjects, whereas in the latter the interaction of the senses results in high definition objects. (shrink)