Psychophysics and neuroscience demonstrate that different sensory systems interact and influence each other. Perceiving involves extensive cooperation and coordination among systems associated with sight, hearing, touch, smell, and taste. Nonetheless, it remains unclear in what respects conscious perceptual awareness is multisensory. This paper distinguishes six differing varieties of multisensory awareness, explicates their consequences, and thereby elucidates the multisensory nature of perception. It argues on these grounds that perceptual awareness need not be exhausted by that which is associated with each of (...) the respective sensory modalities along with whatever accrues thanks to simple co-consciousness. (shrink)

I argue that the neural realizers of experiences of trying are not distinct from the neural realizers of actual trying . I then ask how experiences of trying might relate to the perceptual experiences one has while acting. First, I assess recent zombie action arguments regarding conscious visual experience, and I argue that contrary to what some have claimed, conscious visual experience plays a causal role for action control in some circumstances. Second, I propose a multimodal account of the experience (...) of acting. According to this account, the experience of acting is a temporally extended, co-conscious collection of agentive and perceptual experiences, functionally integrated and structured both by multimodal perceptual processing as well as by what an agent is, at the time, trying to do. (shrink)

This chapter examines how our sense modalities interact in the perception of persistence. The chapter concentrates on two questions. The first concerns perceptual processing—do perceptual computations of object persistence ever integrate and compute over representations from more than one modality? It argues that this question should be answered affirmatively. The second question concerns perceptual experience—do experiences of object persistence ever exhibit a constitutively multisensory phenomenal character, or is the phenomenology of object persistence always uniquely associated with just one modality? The (...) chapter argues that the available evidence underdetermines the answer to this question, but suggests ways it might be empirically resolved. (shrink)

It is common to characterize pain with touch-related terms, like ‘cutting’, ‘pressing’, ‘sharp’, and ‘pulsing’, or temperature-related terms, like ‘hot’ or ‘burning’. This suggests that many pains are phenomenally multimodal because they are experienced as having some tactile-like or thermal-like character. The goal of this chapter is to investigate the structure of phenomenally multimodal pain experiences. It is argued that the usual accounts of multimodal structure proposed in investigations regarding exteroceptive experiences cannot be plausibly applied to multimodal experiences of pain. (...) Instead, an alternative framework is proposed which characterizes the structure of tactile-like and thermal-like pains by referring to the notion of crossmodal correspondences. (shrink)

Some have defended a Fregean view of perceptual content. On this view, the constituents of perceptual contents are Fregean modes of presentation (MOPs). In this paper, I propose that perceptual MOPs are best understood in terms of object files. Object files are episodic representations that store perceptual information about objects. This information is updated when sensory conditions change. On the proposed view, when a subject perceptually represents some object a under two distinct MOPs, then the subject initiates two object files (...) that both refer to a. My defense of this view appeals to its satisfaction of four constraints that I argue theories of perceptual MOPs should satisfy. Furthermore, I show that some existent accounts of perceptual MOPs fail to satisfy them. The defended constraints also indicate what is unique about perceptual, as opposed to linguistic or cognitive, MOPs. (shrink)

Each of our sensory modalities—vision, touch, taste, etc.—works on a slightly different timescale, with differing temporal resolutions and processing lag. This raises the question of how, or indeed whether, these sensory streams are co-ordinated or ‘bound’ into a coherent multisensory experience of the perceptual ‘now’. In this paper I evaluate one account of how temporal binding is achieved: the temporal windows hypothesis, concluding that, in its simplest form, this hypothesis is inadequate to capture a variety of multisensory phenomena. Rather, the (...) evidence suggests the existence of a more complex temporal structure in which multiple overlapping windows support distinct functional mechanisms. To aid in the precise formulation of such views, I propose a taxonomy of temporal window types and their characteristics that in turn suggests promising avenues for future empirical and philosophical research. I conclude by examining some philosophical implications of multi-window models for the metaphysics of perception and perceptual experience more generally. (shrink)

Some philosophers have argued that we do not hear sounds as located in the environment. Others have objected that this straightforwardly contradicts the phenomenology of auditory experience. And from this they draw metaphysical conclusions about the nature of sounds—that they are events or properties of vibrating surfaces rather than waves or sensations. I argue that there is a minimal, but recognizable, notion of audition to which this phenomenal objection does not apply. While this notion doesn’t correspond to our ordinary notion (...) of auditory experience, it does—in conjunction with our lack of an uncontroversial individuation of the senses and recent interest in distinctively multisensory features of perceptual experiences—raise the possibility of more expansive notions of audition, including some that do plausibly count as corresponding to our everyday notion of audition, that lack the spatial phenomenology cited in the objection. Until this possibility is ruled out, the phenomenal objection and metaphysical conclusions drawn from it remain inconclusive. (shrink)

Cognitive scientists have long known that the modalities interact during perceptual processing. Cross-modal illusions like the ventriloquism effect show that the course of processing in one modality can alter the course of processing in another. But how do the modalities interact in the specific domain of object perception? This paper distinguishes and analyzes two kinds of multisensory interaction in object perception. First, the modalities may bind features to a single object or event. Second, the modalities may cooperate when differentiating an (...) object or event from its surroundings. I critically evaluate evidence for various forms of multisensory binding. I then consider the case for multisensory differentiation. I argue that existing evidence for multisensory differentiation is inconclusive. I highlight ways that the issue might be empirically resolved. (shrink)

Introduction to the topical collection "The Structure of Perceptual Objects"—with contributions by Mohan Matthen, EJ Green, Alisa Mandrigin, Blazej Skrzypulec, and Anna Drożdżowicz.

This paper presents an account of the senses and what differentiates them that is compatible with richly multisensory perception and consciousness. According to this proposal, senses are ways of perceiving. Each sense is a subfaculty that comprises a collection of perceptual capacities. What each sense shares and what differentiates one sense from another is the manner in which those capacities are exercised. Each way of perceiving involves a distinct type of information gathering, individuated by the information it functions to extract (...) and the medium from which it does so. This approach distinguishes the project of characterizing and differentiating senses from that of attributing experiences to sensory modalities. Perceptual experiences are episodes in which perceptual capacities are exer- cised. Conscious perceptual episodes may be ascribed to distinct sensory modalities, according to the manners in which perceptual capacities are deployed on an occasion. According to this account, senses are not exclusive. First, their capacities may overlap. Second, perceptual episodes, including conscious experiences, may belong to multiple senses. Indeed, some episodes require the joint use of several senses. In this account, subjects have only limited first-person knowledge of the senses they employ. (shrink)

Is the flavor of mint reducible to the minty smell, the taste, and the menthol-like coolness on the roof of one’s mouth, or does it include something over and above these—something not properly associated with any one of the contributing senses? More generally, are there features of perceptual experiences—so-called novel features—that are not associated with any of our senses taken singly? This question has received a lot of attention of late. Yet surprisingly little attention has been paid to the question (...) of what it means to say that a feature is associated with a sensory modality in the first place. Indeed, there is only one fully developed proposal in the literature, due to Casey O’Callaghan. I argue that this proposal is too permissive to inform the debate over novel features. I go on to argue that all attempts to formulate a better proposal along these lines fail. The corollary of my arguments is that the question of the existence of novel features is poorly formed. Furthermore, the problem generalizes, with the result that we should not rely on our pre-theoretical notions of the senses as the basis of theorizing about the features of perceptual experiences. (shrink)

It is commonly believed that human perceptual experiences can be, and usually are, multimodal. What is more, a stronger thesis is often proposed that some perceptual multimodal characters cannot be described simply as a conjunction of unimodal phenomenal elements. If it is the case, then a question arises: what is the additional mode of combination that is required to adequately describe the phenomenal structure of multimodal experiences? The paper investigates what types of audio–visual experiences have phenomenal character that cannot be (...) analysed as a mere conjunction of visual and auditory elements; and how can we properly characterise the required, additional mode of perceptual combination. Three main modes of combination are considered: instantiation, parthood, and grouping. It is argued that some phenomena involving intermodal relations, like spatial and temporal ventriloquism, can be analysed in terms of audio–visual, perceptual grouping. On the other hand, cases of intermodal binding need a different treatment. Experiences involving audio–visual binding should be analysed as experiences presenting objects or events which instantiate, or which have a proper part instantiating, both visually and auditorily determined properties. (shrink)

Objects are central in visual, auditory, and tactual perception. But what counts as a perceptual object? I address this question via a structural unity schema, which specifies how a collection of parts must be arranged to compose an object for perception. On the theory I propose, perceptual objects are composed of parts that participate in causally sustained regularities. I argue that this theory falls out of a compelling account of the function of object perception, and illustrate its applications to multisensory (...) perception. I also argue that the account avoids problems faced by standard views of visual and auditory objects. (shrink)

Intermodal representationalists hold that the phenomenal characters of experiences are fully determined by their contents. In contrast, intramodal representationalists hold that the phenomenal characters of experiences are determined by their contents together with their intentional modes or manners of representation, which are nonrepresentational features corresponding roughly to the sensory modalities. This paper discusses a kind of experience that provides evidence for an intermodal representationalist view: intermodal experiences, experiences that unify experiences in different modalities. I argue that such experiences are much (...) easier to explain on the intermodal view. (shrink)

In crossmodal identification, a subject token identifies an item perceived in one sensory modality with an item perceived in another sensory modality. Does crossmodal identification always occur in cognition, or does crossmodal identification sometimes take place in perception? This paper argues that crossmodal identification occurs in cognition, and not in perception. Nevertheless, multisensory perception is not unalive to crossmodal identity. Experimental evidence demonstrates that perception is differentially sensitive to the identity of individuals presented to distinct senses. Such sensitivity enhances recognition (...) and improves action. This approach relies on distinguishing crossmodal identification from perceiving crossmodal identity. Perception registers crossmodal identity, but crossmodal identification as such belongs to thought. (shrink)

Object perception deploys a suite of perceptual capacities that constrains attention, guides reidentification, subserves recognition, and anchors demonstrative thought. Objects for perception—perceptual objects—are the targets of such capacities. Characterizing perceptual objects for multisensory perception faces two puzzles. First is the diversity of objects across sensory modalities. Second is the unity of multisensory perceptual objects. This paper resolves the puzzles. Objects for perception are structured mereologically complex individuals. Perceptual objects are items that bear perceptible features and have perceptible parts arranged to (...) form a unified whole. This circumscribes the targets of object perception where neutral talk concerning intentional objects and objects of perception cannot. Nonetheless, it is more permissive than identifying perceptual objects with material bodies, which excludes too much and leans too heavily on vision. The account thus is tailored to capture the role of objects in perception beyond vision: tactual, auditory, and olfactory objects are individuals with differing structures. Its flexibility also enables the account to accommodate shared objects for multisensory perception: multisensory perceptual objects are mereologically complex individuals with hybrid structure. For instance, one can bimodally perceive a common whole with parts accessible to one but not both modalities. Each sense provides a partial perspective on a complex whole that is perceptible through the coordinated use of multiple senses. Understanding perceptual objects as structured mereologically complex individuals thus provides a theoretically useful notion of an object for multisensory perception that resolves the puzzles of diversity and of unity. (shrink)

The Bayesian model of multisensory cue integration proposed by Ernst and Banks provides an attractive model for understanding a way that our sensory systems may interact. Moreover, it has been suggested that the process of multisensory integration that it models underpins conscious experiences with multisensory representational contents merged across modalities. Should we therefore take empirical support for the Bayesian model as evidence of the multimodality of perception? Focusing on evidence of integration across vision and touch, I argue that apparent support (...) for the model does not warrant the rejection of the view that each of our conscious perceptual experiences is associated with one and only one sense modality. (shrink)