Multisensory processing encompasses all of the various ways in which the presence of information in one sensory modality can adaptively influence the processing of information in a different modality. In Part I of this survey article, I begin by presenting a cartography of some of the more extensively investigated forms of multisensory processing, with a special focus on two distinct types of multisensory integration. I briefly discuss the conditions under which these different forms of multisensory processing occur as well as (...) their important perceptual consequences and interrelations. In Part II, I then turn to examining of some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical attempts to individuate the senses. (shrink)

The first part of this survey article presented a cartography of some of the more extensively studied forms of multisensory processing. In this second part, I turn to examining some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical debates concerning the modularity of perception, cognitive penetration, and the individuation of the senses.

According to the decomposition thesis, perceptual experiences resolve without remainder into their different modality-specific components. Contrary to this view, I argue that certain cases of multisensory integration give rise to experiences representing features of a novel type. Through the coordinated use of bodily awareness—understood here as encompassing both proprioception and kinaesthesis—and the exteroceptive sensory modalities, one becomes perceptually responsive to spatial features whose instances couldn’t be represented by any of the contributing modalities functioning in isolation. I develop an argument for (...) this conclusion focusing on two cases: 3D shape perception in haptic touch and experiencing an object’s egocentric location in crossmodally accessible, environmental space. (shrink)

Intermodal representationalists hold that the phenomenal characters of experiences are fully determined by their contents. In contrast, intramodal representationalists hold that the phenomenal characters of experiences are determined by their contents together with their intentional modes or manners of representation, which are nonrepresentational features corresponding roughly to the sensory modalities. This paper discusses a kind of experience that provides evidence for an intermodal representationalist view: intermodal experiences, experiences that unify experiences in different modalities. I argue that such experiences are much (...) easier to explain on the intermodal view. (shrink)

How can we think about things in the outside world? There is still no widely accepted theory of how mental representations get their meaning. In light of pioneering research, Nicholas Shea develops a naturalistic account of the nature of mental representation with a firm focus on the subpersonal representations that pervade the cognitive sciences.

Newcomers to the philosophy of mind are sometimes resistant to the idea that pain is a mental state. If asked to defend their view, they might say something like this: pain is a physical state, it is a state of the body. A pain in one’s leg feels to be in the leg, not ‘in the mind’. After all, sometimes people distinguish pain which is ‘all in the mind’ from a genuine pain, sometimes because the second is ‘physical’ while the (...) first is not. And we also occasionally distinguish mental pain (which is normally understood as some kind of emotional distress) from the ‘physical pain’ one feels in one’s body. So what can be meant by saying that pain is a mental state? Of course, it only takes a little reflection shows that this naive view is mistaken. Pain is a state of consciousness, or an event in consciousness, and whether or not all states of mind are conscious, it is indisputable that only minds, or states of mind, are conscious.2 But does the naive view tell us anything about the concept of pain, or the concept of mind? I think it does. In this paper, I shall give reasons for thinking that consciousness is a form of intentionality, the mind’s ‘direction upon its objects’. I shall claim that the consciousness involved in bodily sensations like pain is constituted by the mind’s direction upon the part or region of the body where the sensation feels to be. Given this, it is less surprising that the naive view of pain says what it does: the apparent ‘physicality’ of pain is a consequence of confusing the object of the intentional state—the part of the body in which the pain is felt—with the state of being in pain. (shrink)

Drawing on insights from causal theories of reference, teleosemantics, and state space semantics, a theory of naturalized mental representation. In A Mark of the Mental, Karen Neander considers the representational power of mental states—described by the cognitive scientist Zenon Pylyshyn as the “second hardest puzzle” of philosophy of mind. The puzzle at the heart of the book is sometimes called “the problem of mental content,” “Brentano's problem,” or “the problem of intentionality.” Its motivating mystery is how neurobiological states can have (...) semantic properties such as meaning or reference. Neander proposes a naturalistic account for sensory-perceptual representations. Neander draws on insights from state-space semantics, causal theories of reference, and teleosemantic theories. She proposes and defends an intuitive, theoretically well-motivated but highly controversial thesis: sensory-perceptual systems have the function to produce inner state changes that are the analogs of as well as caused by their referents. Neander shows that the three main elements—functions, causal-information relations, and relations of second-order similarity—complement rather than conflict with each other. After developing an argument for teleosemantics by examining the nature of explanation in the mind and brain sciences, she develops a theory of mental content and defends it against six main content-determinacy challenges to a naturalized semantics. (shrink)

Nearly every theory of perception just focuses on one sense at a time; but most of the time we perceive using multiple senses. Casey O'Callaghan offers a revisionist multisensory philosophy of perception: he explores how our senses work together and influence each other, leading to surprising perceptual illusions and novel forms of experience.

Beyond Vision brings together eight essays by Casey O'Callaghan which draw theoretical and philosophical lessons about perception, the nature of its objects, and sensory awareness. O'Callaghan focuses on auditory perception, perception of spoken language, and multisensory perception.

How should interaction between the senses affect thought about them? I try to capture some ways in which non sense-specific perception might be thought to make it impossible or pointless or explanatorily idle to distinguish between senses. This task is complicated by there being more than one view of the nature of the senses, and more than one kind of non sense-specific perception. I argue, in particular, that provided we are willing to forgo certain assumptions about, for instance, the relationship (...) between modes or kinds of experience, and about how one should count perceptual experiences at a time, at least one way of thinking about the senses survives the occurrence of various kinds of non sense-specific perception relatively unscathed. (shrink)

The representational theory of phenomenal experience is often stated in terms of a supervenience thesis: Byrne recently characterises it as the thesis that “there can be no difference in phenomenal character without a difference in content”, while according to Tye, “[a]t a minimum, the thesis is one of supervenience: necessarily, experiences that are alike in their representational contents are alike in their phenomenal character.” Consequently, much of the debate over whether representationalism is true centres on purported counter-examples – that is (...) to say, purported failures of supervenience. The refutation of putative counter-examples has been, it seems to me, by and large successful. But there is a certain class of these for which the representationalist response has been something less than completely convincing. These are the cross-modality cases. I will explain what I mean, and then argue that the response in question is not only unconvincing but actually undermines the representationalist position. (shrink)

Cross-modal perceptual illusions occur when a stimulus to one modality impacts perceptual experience associated with another modality. Unlike synaesthesia, cross-modal illusions are intelligible as results of perceptual strategies for dealing with sensory stimulation to multiple modalities, rather than as mere quirks. I argue that understanding cross-modal illusions reveals an important flaw in a widespread conception of the senses, and of their role in perceptual experience, according to which understanding perception and perceptual experience is a matter of assembling independently viable stories (...) about vision, audition, olfaction, and the rest. (shrink)

My thesis is that perceptual awareness is richly multisensory. I argue for this conclusion on the grounds that certain forms of multisensory perceptual experience are incompatible with the claim that each aspect of a perceptual experience is associated with some specific sensory modality or another. First, I explicate what it is for some feature of a conscious perceptual episode to be modality specific. Then, I argue based on philosophical and experimental evidence that some novel intermodal features are perceptible only through (...) the coordinated use of multiple senses. I appeal to cases that involve consciously perceptible feature instances and feature types that could not be perceptually experienced through the use of individual sense modalities working on their own or simply in parallel and co-consciously. Finally, I offer an account of how to type perceptual experiences by modality that makes room for richly multisensory experiences. (shrink)

It is tempting to hold that perceptual experience amounts to a co-conscious collection of visual, auditory, tactual, gustatory, and olfactory episodes. If so, each aspect of perceptual experience on each occasion is associated with a specific modality. This paper, however, concerns a core variety of multimodal perceptual experience. It argues that there is perceptually apparent intermodal feature binding. I present the case for this claim, explain its consequences for theorizing about perceptual experience, and defend it against objections. I maintain that (...) just as one thing may perceptually appear at once to jointly bear several features associated with the same sense modality, one thing also may perceptually appear at once to jointly bear features associated with different sense modalities. For instance, just as something may visually appear at once to be both red and round, or to have a red part and a green part, something may multimodally perceptually appear at once to be both bright and loud, or to have a red part and a rough part. The main lesson, I argue, is that perceiving is not just co-consciously seeing, hearing, feeling, tasting, and smelling at the same time. And perceptual phenomenal character is not on each occasion exhausted by that which is distinctive to or associated with a given modality, along with that which accrues thanks to simple co-consciousness. Not all ways of perceiving are modality specific. I defend this account against three main objections: that singular content theorists avoid my conclusions; that apparent infusion of perceptible features is required for perceptually apparent binding but does not occur intermodally; and that the diversity of objects across modalities makes perceptually apparent intermodal binding rare. (shrink)

Psychophysics and neuroscience demonstrate that different sensory systems interact and influence each other. Perceiving involves extensive cooperation and coordination among systems associated with sight, hearing, touch, smell, and taste. Nonetheless, it remains unclear in what respects conscious perceptual awareness is multisensory. This paper distinguishes six differing varieties of multisensory awareness, explicates their consequences, and thereby elucidates the multisensory nature of perception. It argues on these grounds that perceptual awareness need not be exhausted by that which is associated with each of (...) the respective sensory modalities along with whatever accrues thanks to simple co-consciousness. (shrink)

Standard accounts of the senses attempt to answer the question how and why we count five senses ; none of the standard accounts is satisfactory. Any adequate account of the senses must explain the significance of the senses, that is, why distinguishing different senses matters. I provide such an explanation, and then use it as the basis for providing an account of the senses and answering the counting question.

Standard accounts of the senses attempt to answer the question how and why we count five senses (the counting question); none of the standard accounts is satisfactory. Any adequate account of the senses must explain the significance of the senses, that is, why distinguishing different senses matters. I provide such an explanation, and then use it as the basis for providing an account of the senses and answering the counting question.

Following on from ecological theories of perception, such as the one proposed by [Gibson, J. J. . The senses considered as perceptual systems. Boston: Houghton Mifflin] this paper reviews the literature on the multisensory interactions underlying the perception of flavor in order to determine the extent to which it is really appropriate to consider flavor perception as a distinct perceptual system. We propose that the multisensory perception of flavor may be indicative of the fact that the taxonomy currently used to (...) define our senses is simply not appropriate. According to the view outlined here, the act of eating allows the different qualities of foodstuffs to be combined into unified percepts; and flavor can be used as a term to describe the combination of tastes, smells, trigeminal, and tactile sensations as well as the visual and auditory cues, that we perceive when tasting food. (shrink)

I argue that we should reject the sparse view that there are or could be only a small number of rather distinct senses. When one appreciates this then one can see that there is no need to choose between the standard criteria that have been proposed as ways of individuating the senses—representation, phenomenal character, proximal stimulus and sense organ—or any other criteria that one may deem important. Rather, one can use these criteria in conjunction to form a fine-grained taxonomy of (...) the senses. We can think of these criteria as defining a multidimensional space within which we can locate each of the senses that we are familiar with and which also defines the space of possible senses there could be. (shrink)

This paper provides a categorization of cross-modal experiences. There are myriad forms. Doing so allows us to think clearly about the nature of different cross-modal experiences and allows us to clearly formulate competing hypotheses about the kind of experiences involved in different cross-modal phenomena.

Two proposals have recently, and independently, been made about a space of possible sensory modalities. In this paper I examine these different proposals, and offer one of my own. I suggest that there are several spaces associated with distinct kinds of sensory modality.

Haptic touch is an inherently active and exploratory form of perception, involving both coordinated movements and an array of distinct sensory receptors in the skin. For this reason, some have claimed that haptic touch is not a single sense, but rather a multisensory collection of distinct sensory systems. Though this claim is often made, it relies on what I regard as a confused conception of multisensory interaction. In its place, I develop a nuanced hierarchy of multisensory involvement. According to this (...) hierarchy, touch turns out to be a single modality in that its various receptors assign their features to the same tangible objects. When we grasp an object a range of distinct properties?shape, warmth, heft, texture, etc.?are all felt to belong to the object, just as different visual properties are associated with a visual object. Paradigm multisensory experiences, on the other hand, involve associations between distinct perceptual experiences, as when the way something looks affects the way something sounds. Thus despite its functional and physiological diversity, haptic touch can be regarded as a single sense. (shrink)

I argue for sensory pluralism. This is the view that there are many forms of sensory interaction and unity, and no single category that classifies them all. In other words, sensory interactions do not form a single natural kind. This view suggests that how we classify sensory systems (and the experiences they generate) partly depends on our explanatory purposes. I begin with a detailed discussion of the issue as it arises for our understanding of thermal perception, followed by a general (...) account and defense of sensory pluralism. (shrink)

In this lucid portrayal of human behavior, Fred Dretske provides an original account of the way reasons function in the causal explanation of behavior.

One way to characterize the special relation that one has to one's own body is to say that only one's body appears to one from the inside. Although widely accepted, the nature of this specific experiential mode of presentation of the body is rarely spelled out. Most definitions amount to little more than lists of the various body senses (including senses of posture, movement, heat, pressure, and balance). It is true that body senses provide a kind of informational access to (...) one's own body, which one has to no other bodies, by contrast to external senses like vision, which can take many bodies as their object. But a theory of bodily awareness needs to take into account recent empirical evidence that indicates that bodily awareness is infected by a plague of multisensory effects, regardless of any dichotomy between body senses and external senses. Here I will argue in favour of a multimodal conception of bodily awareness. I will show that the body senses fail to fully account for the content of bodily experiences. I will then propose that vision helps compensate for the insufficiencies of the body senses in people who can see. I will finally argue that the multimodality of bodily experiences does not prevent privileged access to one's body. (shrink)

Since its publication in 1959, Individuals has become a modern philosophical classic. Bold in scope and ambition, it continues to influence debates in metaphysics, philosophy of logic and language, and epistemology. Peter Strawson's most famous work, it sets out to describe nothing less than the basic subject matter of our thought. It contains Strawson's now famous argument for descriptive metaphysics and his repudiation of revisionary metaphysics, in which reality is something beyond the world of appearances. Throughout, Individuals advances some highly (...) influential and controversial ideas, such as 'non-solipsistic consciousness' and the concept of a person a 'primitive concept'. (shrink)

There are two main ways in which things with minds, like us, differ from things without minds, like tables and chairs. First, we are conscious--there is something that it is like to be us. We instantiate phenomenal properties. Second, we represent, in various ways, our world as being certain ways. We instantiate representational properties. Jeff Speaks attempts to make progress on three questions: What are phenomenal properties? What are representational properties? How are the phenomenal and the representational related?

Is consciousness multisensory? Obviously it is multisensory in certain ways. Human beings typically possess the capacity to have experiences in at least the five familiar sensory modalities, and quite possibly in a number of other less commonly recognised modalities as well. But there are other respects in which it is far from obvious that consciousness is multisensory. This chapter is concerned with one such respect. Οur concern here is with whether consciousness contains experiences associated with distinct modalities at the same (...) time. We will describe those who endorse a positive answer to this question as endorsing a multisensory view (MSV) of the structure of consciousness, and those who endorse a negative answer to this question as having a unisensory view (USV) of the structure of consciousness. (shrink)

Is there a space of the sensory modalities? Such a space would be one in which we can represent all the actual, and at least some of the possible, sensory modalities. The relative position of the senses in this space would indicate how similar and how different the senses were from each other. The construction of such a space might reveal unconsidered features of the actual and possible senses, help us to define what a sense is, and provide grounds that (...) we might use to decide what is one token sense rather than multiple token senses. -/- In this paper, I explore, refine, and defend the idea that we can construct such a space—an idea that I briefly proposed in earlier work (Macpherson 2011a and 2011b). In doing so, I defend the idea from an objection that Richard Gray (2012) has voiced. Gray claims that the dimensions of the space of sensory modalities must generate a non-­‐arbitrary ordering of the senses. He argues that we cannot find dimensions that do so. I disagree. I identify different ways in which a space could be arbitrary but I argue that we can define a space of the sensory modalities in a non-arbitrary manner. I give examples of what the dimensions might be. (shrink)

This paper presents forms of multimodal perceptual experience that undermine the claim that each aspect of perceptual experience is modality specific. In particular, it argues against the thesis that all phenomenal character is modality specific (even making an allowance for co-conscious unity). It concludes that a multimodal perceptual episode may have phenomenal features beyond those that are associated with the specific modalities.

It is through touch that we are able to interact directly with the world; it is our primary conduit of both pleasure and pain. Touch may be our most immediate and powerful sense—“the first sense" because of the central role it plays in experience. In this book, Matthew Fulkerson proposes that human touch, despite its functional diversity, is a single, unified sensory modality. Fulkerson offers a philosophical account of touch, reflecting the interests, methods, and approach that define contemporary philosophy; but (...) his argument is informed throughout by the insights and constraints of empirical work on touch. Human touch is a multidimensional object of investigation, Fulkerson writes, best served by using a variety of methods and approaches. -/- To defend his view of the unity of touch, Fulkerson describes and argues for a novel, unifying role for exploratory action in touch. He goes on to fill in the details of this unified, exploratory form of perception, offering philosophical accounts of tool use and distal touch, the representational structure of tangible properties, the spatial content of touch, and the role of pleasure in tactual experience. -/- Fulkerson’s argument for the unique role played by exploratory action departs notably from traditional vision-centric philosophical approaches to perception, challenging the received view that action plays the same role in all sensory modalities. The robust philosophical account of touch he offers in The First Sense has significant implications for our general understanding of perception and perceptual experience. (shrink)

Lycan not only uses the numerous arguments against materialism, and functionalist theories of mind in particular, to gain a more detailed positive view of the ..

In this provocative book, Fred Dretske argues that to achieve an understanding of the mind it is not enough to understand the biological machinery by means of...

How ought we differentiate the senses? What, say, distinguishes vision from audition? The question comes in two versions. First, there is the traditional problem of individuating the senses in humans. Second, there is also an important question about what sensory modalities we ought to attribute to non-human animals, a version of the question that has been virtually ignored by philosophers. Modality ought to be construed as an “avenue into” an organism for information external to the central nervous system. Six proposed (...) criteria found in the philosophical literature concerning the senses are reviewed. Initially, four criteria—physics, neurobiology, behavior, and evolutionary or developmental dedication—are shown to be individually necessary and jointly sufficient. Next, two criteria—Aristotle's proper objects of sensation criterion and Grice's sensation or qualia criterion—are considered and rejected. One overarching goal here is to show that there is interesting contemporary work left to be done on this ancient philosophical question. (shrink)

In discussions of perception and its relation to knowledge, it is common to distinguish what one comes to believe on the basis of perception from the distinctively perceptual basis of one's belief. The distinction can be drawn in terms of propositional contents: there are the contents that a perceiver comes to believe on the basis of her perception, on the one hand; and there are the contents properly attributed to perception itself, on the other. Consider the content.

The senses, or sensory modalities, constitute the different ways we have of perceiving the world, such as seeing, hearing , touching, tasting, and smelling. But what makes the senses different? How many senses are there? How many could there be? Wha t interaction takes place between the senses? This introduction is a guide to thinking about these questions.

In the case of ventriloquism, seeing the movement of the ventriloquist dummy’s mouth changes your experience of the auditory location of the vocals. Some have argued that cases like ventriloquism provide evidence for the view that at least some of the content of perception is fundamentally multimodal. In the ventriloquism case, this would mean your experience has constitutively audio-visual content (not just a conjunction of an audio content and visual content). In this paper, I argue that cases like ventriloquism do (...) not in fact warrant that conclusion. I then try to make sense of crossmodal cases without appealing to fundamentally multimodal content. (shrink)