This is the editors' Introduction to a special issue of the journal, Multisensory Research. European philosophers of the modern period found multisensory perception to be impossible because they thought that perceptual ideas are defined by how they are experienced. Under this conception, the individual modalities are determinables of ideas—just as colour is a determinable that embraces red and blue, so also the visual is a determinable that embraces colour and (visually experienced) shape. Since no idea is experienced (...) as, for example, both visual and auditory, there can be no such thing as audiovisual perception. This conception of modality is not directly contested, but a variety of perceptual phenomena are listed that could raise interesting questions if treated as multimodal in origin. (shrink)

Suppose that you are at a live jazz show. The drummer begins a solo. You see the cymbal jolt and you hear the clang. But in addition seeing the cymbal jolt and hearing the clang, you are also aware that the jolt and the clang are part of the same event. Casey O’Callaghan (forthcoming) calls this awareness “intermodal feature binding awareness.” Psychologists have long assumed that multimodal perceptions such as this one are the result of a subpersonal feature binding mechanism (...) (see Vatakis and Spence, 2007, Kubovy and Schutz, 2010, Pourtois et al., 2000, and Navarra et al., 2012). I present new evidence against this. I argue that there is no automatic feature binding mechanism that couples features like the jolt and the clang together. Instead, when you experience the jolt and the clang as part of the same event, this is the result of an associative learning process. The cymbal’s jolt and the clang are best understood as a single learned perceptual unit, rather than as automatically bound. I outline the specific learning process in perception called “unitization,” whereby we come to “chunk” the world into multimodal units. Unitization has never before been applied to multimodal cases. Yet I argue that this learning process can do the same work that intermodal binding would do, and that this issue has important philosophical implications. Specifically, whether we take multimodal cases to involve a binding mechanism or an associative process will have impact on philosophical issues from Molyneux’s question to the question of how active or passive we consider perception to be. (shrink)

This chapter examines how our sense modalities interact in the perception of persistence. The chapter concentrates on two questions. The first concerns perceptual processing—do perceptual computations of object persistence ever integrate and compute over representations from more than one modality? It argues that this question should be answered affirmatively. The second question concerns perceptual experience—do experiences of object persistence ever exhibit a constitutively multisensory phenomenal character, or is the phenomenology of object persistence always uniquely associated with just one (...) modality? The chapter argues that the available evidence underdetermines the answer to this question, but suggests ways it might be empirically resolved. (shrink)

The idea that there are five senses dates back to Aristotle, who was one of the first philosophers to examine them systematically. Though it has become conventional wisdom, many scientists and philosophers would argue that this idea is outdated and inaccurate. Indeed, they have given many different answers to this question, ranging from just three (the number of different kinds of physical energy we can detect) to 33 or more senses. Perhaps surprisingly, the issue remains controversial, partly because it is (...) not clear exactly what should count as a ‘sense’. Should proprioception, balance and kinaesthesis, amongst others, be considered additional senses? And if so, how do we figure out how many senses we really have? -/- (Published in Turkish under the title ‘Çok Duyumlu Algi’). (shrink)

The first part of this survey article presented a cartography of some of the more extensively studied forms of multisensory processing. In this second part, I turn to examining some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical debates concerning the modularity of perception, cognitive penetration, and the individuation (...) of the senses. (shrink)

Sense interaction is ubiquitous. All conscious experiences involve at least some interaction between the senses. One of the most debated questions in recent scholarship concerns the proper way of characterizing the phenomenology of multisensory experiences. According to Charles Spence and Tim Bayne (2015), the phenomenal character of multisensory integration is reducible to the co-conscious sum of modality-specific features. Following Casey O'Callaghan (2015), we can call this The Thesis of Minimal Multimodality. The main goal of the paper is to (...) refute the thesis and show that the effect of multisensory integration is reflected in experience in a way that is not exhausted by (the sum of) modality-specific phenomenal features. Whereas O'Callaghan's strategy in trying to prove this consists in providing phenomenological evidence that runs contrary to what Spence and Bayne hold, he does not, however, put into question what has become since T. Nagel's famous essay (1974) the standard conception of the phenomenal. By drawing conceptual resources in the work of Husserl and Merleau-Ponty, I will elaborate another approach and explain why the phenomenal character of experience cannot be reduced to its "what it's like" character. Phenomenal experience is thicker, and also includes various forms of bodily self-experiences and felt possibilities of action and behaviours. Building on these and like insights, the main objective of the paper is to outline a phenomenological account of multimodal perception and sensory interaction. I will draw three main conclusions. First, I will argue that both Husserl and Merleau-Ponty would, too, reject The Thesis of Minimal Multimodality and endorse the strong, Constitutive Thesis that O'Callaghan defends. More interestingly still, we will see, secondly, that the widening of phenomenal consciousness that they argue for allows to generalize the constitutive thesis, thereby showing that all perceptual experience constitutively depend on the interplay of two or more senses. Spelling out the details of this claim will bring me, thirdly, to specify the intrinsic relation between normativity and perceptual experience. In short, I will argue that the mechanisms responsible for multimodality make a phenomenological difference evaluable in normative terms. (shrink)

According to the decomposition thesis, perceptual experiences resolve without remainder into their different modality-specific components. Contrary to this view, I argue that certain cases of multisensory integration give rise to experiences representing features of a novel type. Through the coordinated use of bodily awareness—understood here as encompassing both proprioception and kinaesthesis—and the exteroceptive sensory modalities, one becomes perceptually responsive to spatial features whose instances couldn’t be represented by any of the contributing modalities functioning in isolation. I develop an argument (...) for this conclusion focusing on two cases: 3D shape perception in haptic touch and experiencing an object’s egocentric location in crossmodally accessible, environmental space. (shrink)

Multisensory processing encompasses all of the various ways in which the presence of information in one sensory modality can adaptively influence the processing of information in a different modality. In Part I of this survey article, I begin by presenting a cartography of some of the more extensively investigated forms of multisensory processing, with a special focus on two distinct types of multisensory integration. I briefly discuss the conditions under which these different forms of multisensory processing (...) occur as well as their important perceptual consequences and interrelations. In Part II, I then turn to examining of some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical attempts to individuate the senses. (shrink)

This chapter distinguishes between two kinds of ordinary multisensory experience that go beyond mere co-consciousness of features (e.g., the experience that results from concurrently hearing a sound in the hallway and seeing the cup on the table). In one case, a sensory experience in one modality creates a perceptual demonstrative to whose referent qualities are attributed in another sensory modality. For example, when you hear someone speak, auditory experience attributes audible qualities to a seen event, a person’s speaking motions. (...) The second kind of multisensory experience attributes features experienced in several sensory modalities to one and the same object via a process of amodal perceptual integration, i.e., integration that occurs separately from processing within the individual sensory modalities. Multisensory experiences arising from holding and seeing a tomato or from seeing the Indian curry boil and smelling it are examples of the second kind of multisensory experience. At the end of the chapter we look at synesthesia, a kind of atypical multisensory experience, and argue that one version of this phenomenon may be able to shed light on the neural mechanism underlying amodally integrated multisensory experience. (shrink)

It is tempting to think that one’s perceptual evidence comprises just what issues from perceiving with each of the respective sensory modalities. However, empirical, rational, and phenomenological considerations show that one’s perceptual evidence can outstrip what one possesses due to perceiving with each separate sense. Some novel perceptual evidence stems from the coordinated use of multiple senses. This paper argues that some perceptual evidence in this respect is distinctively multisensory.

Molyneux’s question is, very roughly, that of whether a blind person's prior acquaintance with shape properties by touch alone would suffice for visually identifying those properties, if her sight were restored. The question is at least in part an empirical one, and various scientific attempts have been made to answer it not only for sight and haptic touch but also for various other sensory modalities. This paper is not aimed at answering Molyneux’s original or related questions. Rather, our aim here (...) is to bring his question to bear on the nature of multisensory integration. In particular, we argue that variants on Molyneux's question spell trouble for a dominant view of multisensory integration and develop an alternative account that is immune to these problems. Finally, we show that the answer to Molyneux’s original question has interesting consequences for whether our alternative account is true of all cases of multisensory experience. (shrink)

This is an excerpt from a report on the workshop on multisensory integration at the University of Toronto, on May 9th and 10th, 2014, written by Kevin Connolly, Aaron Henry, Zoe Jenkin, and Andrew MacGregor, and available at: http://networksensoryresearch.utoronto.ca/Events_%26_Discussion.html This excerpt explores the question: What can multisensory processing tell us about multisensory awareness?

In this paper we argue that object perception may be affected by what we call “perceptual frames.” Perceptual frames are adaptations of the perceptual system that guide how perceptual objects are singled out from a sensory environment. These adaptations are caused by perceptual learning and realized through bottom-up functional processes such that sensory information is organized in a subject-dependent way leading to idiosyncratic perceptual object representations. Through domain-specific training, perceptual learning, and the acquisition of object-knowledge, it is possible to (...) modulate the adaptive perceptual system such that its ability to represent becomes bespoke. Different perceivers with different perceptual frames may, therefore, receive the same sensory information and perceive different perceptual objects due to the effects of framing. Consequently, we demonstrate the plausibility of this account by surveying empirical data concerning the functions of (1) multisensory integration, (2) amodal completion, and (3) predictive anticipation. Regarding (1), we argue that the perceptual system’s optimization processes employ perceptual frames to facilitate multisensory feature binding. Regarding (2), we argue that amodal completion can occur with or without the help of mental imagery, yet either instance of amodal completion requires perceptual frames. Regarding (3), we demonstrate that perceptually anticipating an object’s motion involves the implementation of perceptual frames. We conclude that framing effects are a matter of perceptual diversity and highlight the need to accommodate unique perspectives in the philosophy and science of perception. (shrink)

Higher animals need to identify and track material objects because they depend on interactions with them for nutrition, reproduction, and social interaction. This paper investigates the perception of material objects. It argues, first, that material objects are tagged, in all five external senses, as bearers of the features detected by them. This happens through a perceptual process, here entitled Generalized Completion, which creates the appearance of objects that have properties that transcend the activation of sensory receptors. The paper shows, (...) secondly, that material objects are privileged subjects for perceived motion and interaction. That is, they are perceived as subjects for these properties while their parts seem to be subjects only derivatively. Material objects are the only perceptual subjects that are both multisensory and privileged. (shrink)

In crossmodal identification, a subject token identifies an item perceived in one sensory modality with an item perceived in another sensory modality. Does crossmodal identification always occur in cognition, or does crossmodal identification sometimes take place in perception? This paper argues that crossmodal identification occurs in cognition, and not in perception. Nevertheless, multisensory perception is not unalive to crossmodal identity. Experimental evidence demonstrates that perception is differentially sensitive to the identity of individuals presented to distinct (...) senses. Such sensitivity enhances recognition and improves action. This approach relies on distinguishing crossmodal identification from perceiving crossmodal identity. Perception registers crossmodal identity, but crossmodal identification as such belongs to thought. (shrink)

Higher animals need to identify and track material objects because they depend on interactions with them for nutrition, reproduction, and social interaction. This paper investigates the perception of material objects. It argues, first, that material objects are tagged, in all five external senses, as bearers of the features detected by them. This happens through a perceptual process, here entitled Generalized Completion, which creates the appearance of objects that have properties that transcend the activation of sensory receptors. The paper shows, (...) secondly, that material objects are privileged subjects for perceived motion and interaction. That is, they are perceived as subjects for these properties while their parts seem to be subjects only derivatively. Material objects are the only perceptual subjects that are both multisensory and privileged. (shrink)

Our emotional states affect how we perceive the world. If I am stressed, annoyed, or irritated, I might experience the sound of children laughing and screaming as they play around the house in a negative manner — it is unpleasant, loud, piercing, and so on. Yet, if I’m in a relaxed, happy, loving mood, the very same sounds might be experienced as pleasant, playful, warm, and so on. The sounds being made by the children are the same in both cases, (...) but how they are experienced differs. The auditory experience is affected by the emotional state that I am in. I perceive the sounds differently depending on how I’m feeling. Although this might at first seem to be a trivial observation, it certainly is not. We take for granted that our perceptual experiences give rise to justified beliefs and knowledge. Thus, if my perceptual experience of an object can differ based on my emotional state, and I take my perceptual experience to justify my beliefs and even lead to knowledge, then we might have a problem. If emotions — which are not fixed and in large part uncontrolled — affect our ability to accurately perceive the world, then they may undermine the justified beliefs and knowledge gained on the basis of our perceptual experience of the world. My goal here is to explore this potential problem. -/- I consider how we might understand the effect that emotions have on the justification of our perceptual beliefs about the world, beliefs that we acquire from a variety of sensory modalities — audition, gustation olfaction, and so on. I take the problem to be associated with one of two forms of perceptual influence: penetration or multisensory integration. In any given perceptual moment there are multiple sensory modalities and mental states at play, each affecting the overall experience. Whether we understand the influence of emotion on perception as a form of non-perceptual penetration or a form of non-visual sensory perception of the inner body — interoception — the potential epistemological difficulties remain: how can we be said to acquire justified beliefs and knowledge on the basis of such influenced perceptual experience. As has been the norm, only the five exteroceptive senses of vision, audition, olfaction, taste and touch are typically discussed in the context of sensory perception. However, as I argue, there is strong reason to accept the claim that emotional experience is a form of interoception, and that interoception ought to be considered when discussing sensory perception. In this way, then, I propose that clarifying the role played by interoception in sense perception across modalities is necessary if we are to make progress on the epistemological problems at hand. (shrink)

Our emotional states affect how we perceive the world. If I am stressed, annoyed, or irritated, I might experience the sound of children laughing and screaming as they play around the house in a negative manner — it is unpleasant, loud, piercing, and so on. Yet, if I’m in a relaxed, happy, loving mood, the very same sounds might be experienced as pleasant, playful, warm, and so on. The sounds being made by the children are the same in both cases, (...) but how they are experienced differs. The auditory experience is affected by the emotional state that I am in. I perceive the sounds differently depending on how I’m feeling. Although this might at first seem to be a trivial observation, it certainly is not. We take for granted that our perceptual experiences give rise to justified beliefs and knowledge. Thus, if my perceptual experience of an object can differ based on my emotional state, and I take my perceptual experience to justify my beliefs and even lead to knowledge, then we might have a problem. If emotions — which are not fixed and in large part uncontrolled — affect our ability to accurately perceive the world, then they may undermine the justified beliefs and knowledge gained on the basis of our perceptual experience of the world. My goal here is to explore this potential problem. -/- I consider how we might understand the effect that emotions have on the justification of our perceptual beliefs about the world, beliefs that we acquire from a variety of sensory modalities — audition, gustation olfaction, and so on. I take the problem to be associated with one of two forms of perceptual influence: penetration or multisensory integration. In any given perceptual moment there are multiple sensory modalities and mental states at play, each affecting the overall experience. Whether we understand the influence of emotion on perception as a form of non-perceptual penetration or a form of non-visual sensory perception of the inner body — interoception — the potential epistemological difficulties remain: how can we be said to acquire justified beliefs and knowledge on the basis of such influenced perceptual experience. As has been the norm, only the five exteroceptive senses of vision, audition, olfaction, taste and touch are typically discussed in the context of sensory perception. However, as I argue, there is strong reason to accept the claim that emotional experience is a form of interoception, and that interoception ought to be considered when discussing sensory perception. In this way, then, I propose that clarifying the role played by interoception in sense perception across modalities is necessary if we are to make progress on the epistemological problems at hand. (shrink)

The dual role of olfaction in both smelling and tasting, i.e. flavour perception, makes it an important test case for philosophical theories of sensory individuation. Indeed, the psychologist Paul Rozin claimed that olfaction is a “dual sense”, leading some scientists and philosophers to propose that we have not one, but two senses of smell: orthonasal and retronasal olfaction. In this paper I consider how best to understand Rozin’s claim, and upon what grounds one might judge there to be one (...) or two distinct olfactory modalities. I conclude that while Rozin may be right that humans have dual occurrences of an olfactory ‘sense’, the concept of a sense-modality, and hence the ‘sense’ of smell, is ambiguous between two different notions: a physiological sensory channel and an experiential modality, along the lines suggested by J. J. Gibson. Furthermore, recognising that these are complementary rather than competing conceptions of a sense-modality enables the formulation of a powerful ‘dual-concept’ framework for posing and addressing questions concerning the complex architecture of human multisensory experience. (shrink)

Each of our sensory modalities—vision, touch, taste, etc.—works on a slightly different timescale, with differing temporal resolutions and processing lag. This raises the question of how, or indeed whether, these sensory streams are co-ordinated or ‘bound’ into a coherent multisensory experience of the perceptual ‘now’. In this paper I evaluate one account of how temporal binding is achieved: the temporal windows hypothesis, concluding that, in its simplest form, this hypothesis is inadequate to capture a variety of multisensory phenomena. (...) Rather, the evidence suggests the existence of a more complex temporal structure in which multiple overlapping windows support distinct functional mechanisms. To aid in the precise formulation of such views, I propose a taxonomy of temporal window types and their characteristics that in turn suggests promising avenues for future empirical and philosophical research. I conclude by examining some philosophical implications of multi-window models for the metaphysics of perception and perceptual experience more generally. (shrink)

We can discern two opposing viewpoints regarding synesthesia. According to the first, it is an oddity, an outlier, or a disordered condition. According to the second, synesthesia is pervasive, driving creativity, metaphor, or language itself. Which is it? Ultimately, I favor the first perspective, according to which cross-sensory synesthesia is an outlying condition. But the second perspective is not wholly misguided. My discussion has three lessons. First, synesthesia is just one of a variety of effects in which one sense modality (...) causally impacts and reshapes experience associated with another. These effects are utterly common. However, due to their unfamiliarity, and to their conflict with a widespread conception of the role of the senses in perception and perceptual experience, until recently they have been surprising. Second, synesthesia nevertheless must be distinguished from other inter-modal effects that lead to misperception, such as crossmodal illusions. Third, synesthesia also may be distinguished from the potentially much broader class of synesthetic effects, which could be common across the population and within individuals. (shrink)

From playing basketball to ordering at a food counter, we frequently and effortlessly coordinate our attention with others towards a common focus: we look at the ball, or point at a piece of cake. This non-verbal coordination of attention plays a fundamental role in our social lives: it ensures that we refer to the same object, develop a shared language, understand each other’s mental states, and coordinate our actions. Models of joint attention generally attribute this accomplishment to gaze coordination. But (...) are visual attentional mechanisms sufficient to achieve joint attention, in all cases? Besides cases where visual information is missing, we show how combining it with other senses can be helpful, and even necessary to certain uses of joint attention. We explain the two ways in which non-visual cues contribute to joint attention: either as enhancers, when they complement gaze and pointing gestures in order to coordinate joint attention on visible objects, or as modality pointers, when joint attention needs to be shifted away from the whole object to one of its properties, say weight or texture. This multisensory approach to joint attention has important implications for social robotics, clinical diagnostics, pedagogy and theoretical debates on the construction of a shared world. (shrink)

How many senses do humans possess? Five external senses, as most cultures have it—sight, hearing, touch, smell, and taste? Should proprioception, kinaesthesia, thirst, and pain be included, under the rubric bodily sense? What about the perception of time and the sense of number? Such questions reduce to two. 1. How do we distinguish a sense from other sorts of information-receiving faculties? 2. By what principle do we distinguish the senses? Aristotle discussed these questions in the De Anima. H. P. (...) Grice revived them in 1967. More recently, they have taken on fresh interest as a result of a collection of essays edited by Fiona Macpherson. This entry reviews some approaches to these questions and advances some new ideas for the reader’s consideration. It proposes that the senses constitute an integrated learning system, membership in which answers question 1. It also proposes that the modalities can be distinguished from one another in two ways, by the means of information pick-up and by the kinds of activity that a perceiver undertakes to make use of them. (shrink)

Humans coordinate their focus of attention with others, either by gaze following or prior agreement. Though the effects of joint attention on perceptual and cognitive processing tend to be examined in purely visual environments, they should also show in multisensory settings. According to a prevalent hypothesis, joint attention enhances visual information encoding and processing, over and above individual attention. If two individuals jointly attend to the visual components of an audiovisual event, this should affect the weighing of visual information (...) during multisensory integration. We tested this prediction in this preregistered study, using the well-documented sound-induced flash illusions, where the integration of an incongruent number of visual flashes and auditory beeps results in a single flash being seen as two (fission illusion) and two flashes as one (fusion illusion). Participants were asked to count flashes either alone or together, and expected to be less prone to both fission and fusion illusions when they jointly attended to the visual targets. However, illusions were as frequent when people attended to the flashes alone or with someone else, even though they responded faster during joint attention. Our results reveal the limitations of the theory that joint attention enhances visual processing as it does not affect temporal audiovisual integration. (shrink)

This paper presents an account of the senses and what differentiates them that is compatible with richly multisensory perception and consciousness. According to this proposal, senses are ways of perceiving. Each sense is a subfaculty that comprises a collection of perceptual capacities. What each sense shares and what differentiates one sense from another is the manner in which those capacities are exercised. Each way of perceiving involves a distinct type of information gathering, individuated by the information it functions (...) to extract and the medium from which it does so. This approach distinguishes the project of characterizing and differentiating senses from that of attributing experiences to sensory modalities. Perceptual experiences are episodes in which perceptual capacities are exer- cised. Conscious perceptual episodes may be ascribed to distinct sensory modalities, according to the manners in which perceptual capacities are deployed on an occasion. According to this account, senses are not exclusive. First, their capacities may overlap. Second, perceptual episodes, including conscious experiences, may belong to multiple senses. Indeed, some episodes require the joint use of several senses. In this account, subjects have only limited first-person knowledge of the senses they employ. (shrink)

Long-standing neglect of the chemical senses in the philosophy of perception is due, mostly, to their being regarded as ‘lower’ senses. Smell, taste, and chemically irritated touch are thought to produce mere bodily sensations. However, empirically informed theories of perception can show how these senses lead to perception of objective properties, and why they cannot be treated as special cases of perception modelled on vision. The senses of taste, touch, and smell also combine to create unified (...) perceptions of flavour. The nature of these multimodal experiences and the character of our awareness of them puts pressure on the traditional idea that each episode of perception goes one or other of the five senses. Thus, the chemical senses, far from being peripheral to the concerns of the philosophy of perception, may hold important clues to the multisensory nature of perception in general. (shrink)

Mirror neuron research has come a long way since the early 1990s, and many theorists are now stressing the heterogeneity and complexity of the sensorimotor properties of fronto-parietal circuits. However, core aspects of the initial ‘ mirror mechanism ’ theory, i.e. the idea of a symmetric encapsulated mirroring function translating sensory action perceptions into motor formats, still appears to be shaping much of the debate. This article challenges the empirical plausibility of the sensorimotor segregation implicit in the original mirror metaphor. (...) It is proposed instead that the teleological organization found in the broader fronto-parietal circuits might be inherently sensorimotor. Thus the idea of an independent ‘purely perceptual’ goal understanding process is questioned. Further, it is hypothesized that the often asymmetric, heterogeneous and contextually modulated mirror and canonical neurons support a function of multisensory mapping and tracking of the perceiving agents affordance space. Such a shift in the interpretative framework offers a different theoretical handle on how sensorimotor processes might ground various aspects of intentional action choice and social cognition. Mirror neurons would under the proposed “social affordance model” be seen as dynamic parts of larger circuits, which support tracking of currently shared and competing action possibilities. These circuits support action selection processes—but also our understanding of the options and action potentials that we and perhaps others have in the affordance space. In terms of social cognition ‘ mirror ’ circuits might thus help us understand not only the intentional actions others are actually performing—but also what they could have done, did not do and might do shortly. (shrink)

This chapter offers an indirect defence of the Evansian conception of egocentric space, by showing how it resolves a puzzle concerning the unity of egocentric spatial perception. The chapter outlines several common assumptions about egocentric perspectival structure and argues that a subject’s experience, both within and across her sensory modalities, may involve multiple structures of this kind. This raises the question of how perspectival unity is achieved, such that these perspectival structures form a complex whole, rather than merely disunified (...) set of individually, distinctively structured experiences. The shortcomings of variety of accounts are considered: switch accounts ; sensory accounts; transformation accounts; and ultimate accounts. These shortcomings are addressed by a further kind of account provided by the Evansian conception – an agentive account – according to which egocentrically structured experiences present the world in relation to parts of a single thing, the body as a dynamic unity. (shrink)

We argue that animals are not cognitively stuck in time. Evidence pertaining to multisensory temporal order perception strongly suggests that animals can represent at least some temporal relations of perceived events.

We perceive in many ways. But several dubious presuppositions about the senses mask this diversity of perception. Philosophers, scientists, and engineers alike too often presuppose that the senses (vision, audition, etc.) are independent sources of information, perception being a sum of these independent contributions. We too often presuppose that we can generalize from vision to other senses. We too often presuppose that vision itself is best understood as a passive receptacle for an image thrown by a lens. In (...) this essay we illustrate how reflection on results from the cognitive sciences undermine these (and many other) traditional presuppositions. Our illustration situates the remaining essays in the volume, Perception and its Modalities, which further extend the case against various traditional presuppositions, and offer alternatives ways to understand the senses and their role in perception. While many of the essays in this volume represent competing views and draw on different fields, from conceptual analysis to engineering, most contributors believe that to understand perception properly, we need to treat as foundational the idea that the senses work together. From that agreement, new paradigms for theorizing about perception begin to emerge. (shrink)

There is converging evidence that high doses of hallucinogenic drugs can produce significant alterations of self-experience, described as the dissolution of the sense of self and the loss of boundaries between self and world. This article discusses the relevance of this phenomenon, known as “drug-induced ego dissolution (DIED)”, for cognitive neuroscience, psychology and philosophy of mind. Data from self-report questionnaires suggest that three neuropharmacological classes of drugs can induce ego dissolution: classical psychedelics, dissociative anesthetics and agonists of the kappa opioid (...) receptor (KOR). While these substances act on different neurotransmitter receptors, they all produce strong subjective effects that can be compared to the symptoms of acute psychosis, including ego dissolution. It has been suggested that neuroimaging of DIED can indirectly shed light on the neural correlates of the self. While this line of inquiry is promising, its results must be interpreted with caution. First, neural correlates of ego dissolution might reveal the necessary neurophysiological conditions for the maintenance of the sense of self, but it is more doubtful that this method can reveal its minimally sufficient conditions. Second, it is necessary to define the relevant notion of self at play in the phenomenon of DIED. This article suggests that DIED consists in the disruption of subpersonal processes underlying the “minimal” or “embodied” self, i.e., the basic experience of being a self rooted in multimodal integration of self-related stimuli. This hypothesis is consistent with Bayesian models of phenomenal selfhood, according to which the subjective structure of conscious experience ultimately results from the optimization of predictions in perception and action. Finally, it is argued that DIED is also of particular interest for philosophy of mind. On the one hand, it challenges theories according to which consciousness always involves self-awareness. On the other hand, it suggests that ordinary conscious experience might involve a minimal kind of self-awareness rooted in multisensory processing, which is what appears to fade away during DIED. (shrink)

This contribution examines two radically different explanations of our phenomenal intuitions, one reductive and one strongly non-reductive, and identifies two germane ideas that could benefit many other theories of consciousness. Firstly, the ability of sophisticated agent architectures with a purely physical implementation to support certain functional forms of qualia or proto-qualia appears to entail the possibility of machine consciousness with qualia, not only for reductive theories but also for the nonreductive ones that regard consciousness as ubiquitous in Nature. Secondly, analysis (...) of introspective psychological material seems to hint that, under the threshold of our ordinary waking awareness, there exist further ‘submerged’ or ‘subliminal’ layers of consciousness which constitute a hidden foundation and support and another source of our phenomenal intuitions. These ‘submerged’ layers might help explain certain puzzling phenomena concerning subliminal perception, such as the apparently ‘unconscious’ multisensory integration and learning of subliminal stimuli. (shrink)

With a Call for Essays, the special issue Multimodality sought contributions that accept not only the material but also the body-bound dependence of media perception and understanding. To this end, contributions were included that shed light on both the structural and signifying potential of artistic works through multimodal analysis. Particular attention was paid to contributions that clarify how the structural features - the modes - of the arts, their perception, and their signifying potential in terms of content are (...) interrelated and how they are to be understood in communicative and thus socioculturally relevant terms. Thus, in addition to neuroscientific contributions, those from cultural anthropology, art history, image and art studies, and literary studies were included. -/- Articles -/- 8 Martina Sauer and Christiane Wagner - Introduction -/- 11 Giada Lombardi and Giuseppe Di Cesare - From Neuroscience to Art: The Role of ‘Vitality Forms’ in the Investigation of Multimodality -/- 25 Martina Sauer - Abstract - Affective – Multimodal: Interaction between Medium and Perception of Moving Images from the Viewpoint of Cassirer’s, Langer’s and Krois’ Embodiment Theories -/- 49 Göran Sonesson - The Secrets of Plastic Language Revealed: Multimodality, Polysemiosis, and Iconicity -/- 71 Natalia Igl - Making Sense of the Material: Multisensory Reader Involvement in Contemporary Multimodal Novels -/- 87 J. Philippe Thompson - Art is All: Proust’s Life Lessons Through Perception and Art -/- 107 Hans Dieter Huber - Philippe Parreno and the Exhibition as a Multimodal Aesthetic Experience -/- 135 Jörg U. Lensing - The Performing Human Being in a Media Interaction Space: Multi- and intermodal productions by the Düsseldorf Theater der Klänge (Theatre of Sounds) . (shrink)

Some philosophers have argued that we do not hear sounds as located in the environment. Others have objected that this straightforwardly contradicts the phenomenology of auditory experience. And from this they draw metaphysical conclusions about the nature of sounds—that they are events or properties of vibrating surfaces rather than waves or sensations. I argue that there is a minimal, but recognizable, notion of audition to which this phenomenal objection does not apply. While this notion doesn’t correspond to our ordinary notion (...) of auditory experience, it does—in conjunction with our lack of an uncontroversial individuation of the senses and recent interest in distinctively multisensory features of perceptual experiences—raise the possibility of more expansive notions of audition, including some that do plausibly count as corresponding to our everyday notion of audition, that lack the spatial phenomenology cited in the objection. Until this possibility is ruled out, the phenomenal objection and metaphysical conclusions drawn from it remain inconclusive. (shrink)

This chapter critically assesses recent arguments that acquiring the ability to categorize an object as belonging to a certain high-level kind can cause the relevant kind property to be represented in visual phenomenal content. The first two arguments, developed respectively by Susanna Siegel (2010) and Tim Bayne (2009), employ an essentially phenomenological methodology. The third argument, developed by William Fish (2013), by contrast, is supported by an array of psychophysical and neuroscientific findings. I argue that while none of these arguments (...) ultimately proves successful, there is a substantial body of empirical evidence that information originating outside the visual system can nonetheless modulate the way an object’s low-level attributes visually appear. Visual phenomenal content, I show, is not only significantly influenced by crossmodal interactions between vision and other exteroceptive senses such as touch and audition, but also by interactions between vision and non-perceptual systems involved in motor planning and construction of the proprioceptive body-image. (shrink)

ABSTRACT The difference between perception and cognition seems introspectively obvious in many cases. Perceiving and thinking have also been assigned quite different roles, in epistemology, in theories of reference and of mental content, in philosophy of psychology, and elsewhere. Yet what is the nature of the distinction? In what way, or ways, do perception and cognition differ? The paper reviews recent work on these questions. Four main respects in which perception and cognition have been held to differ (...) are discussed. First, their phenomenal character, such as the often-remarked vivacity or immediacy of perception. Second, the way in which they represent the world, e.g. the non-propositional nature of the contents, or non-discursive character of the vehicles, that have been held to characterise perceptual representation. Third, their place in cognitive architecture, i.e., roughly, in the information-flow of the mind, such as their alleged (non-)modularity. Fourth, their mind-world relations, e.g. the way in which perceptions seem to be tightly causally linked with distal or proximal stimuli. Against this background, we distinguish some main options for an account of the perception/cognition distinction, in particular concerning whether there is one, several, or no interesting and principled distinction(s) to be drawn here. (shrink)

“Perception is controlled hallucination,” according to proponents of predictive processing accounts of vision. I say they are right that something like this is a consequence of their view but wrong in how they have pursued the idea. The focus of my counterproposal is the causal theory of perception, which I develop in terms of a productive concept of causation. Cases of what otherwise seem like successful perception are instead mere veridical hallucination if predictive processing accounts are correct, (...) I argue, because of the role played within such accounts by absences, which cannot enter into productive causal relations. -/- I offer two arguments in support of the productive theory of perception. The first is loosely Kantian, focusing on the role that receptivity and spontaneity play in perception. The second focuses on what perception and hallucination have in common. I conclude with a series of objections and replies. (shrink)

Perception can’t have disjunctive content. Whereas you can think that a box is blue or red, you can’t see a box as being blue or red. Based on this fact, I develop a new problem for the ambitious predictive processing theory, on which the brain is a machine for minimizing prediction error, which approximately implements Bayesian inference. I describe a simple case of updating a disjunctive belief given perceptual experience of one of the disjuncts, in which Bayesian inference and (...) predictive coding pull in opposite directions, with the former implying that one’s confidence in the belief should increase, and the latter implying that it should decrease. Thus, predictive coding fails to approximately implement Bayesian inference across the interface between belief and perception. (shrink)

This paper defends doubts about the existence of genuine moral perception, understood as the claim that at least some moral properties figure in the contents of perceptual experience. Standard examples of moral perception are better explained as transitions in thought whose degree of psychological immediacy varies with how readily non-moral perceptual inputs, jointly with the subject's background moral beliefs, training, and habituation, trigger the kinds of phenomenological responses that moral agents are normally disposed to have when they represent (...) things as being morally a certain way. (shrink)

It has been objected recently that naïve realism is inconsistent with an empirically well-supported hypothesis that unconscious perception is possible. Because epistemological disjunctivism is plausible only in conjunction with naïve realism (for a reason I provide), the objection reaches it too. In response, I show that the unconscious perception hypothesis can be changed from a problem into an advantage of epistemological disjunctivism. I do this by suggesting that: (i) naïve realism is consistent with the hypothesis; (ii) the contrast (...) between epistemological disjunctivism and epistemic externalism explains the difference in epistemic import between conscious and unconscious perception. (shrink)

Moral perceptualism is the theory that perception and perceptual experience is attuned to moral features in our environment. This idea has received renewed attention in the last 15–20 years, for its potential to do theoretical work in moral epistemology and moral psychology. In this paper, I review the main motivations and arguments for moral perceptualism, the variety of theories that go under the heading of “moral perception,” and the three biggest challenges to moral perception. https://youtu.be/9cc_1zykq80.

Visual perception is widely taken to present properties such as redness, roundness, and so on. This in turn might be thought to give rise to accuracy conditions for experience, and so content, regardless of which metaphysical view of perception one endorses. An influential version of this argument—Susanna Siegel’s ’Argument from Appearing’—aims to establish the existence of content as common ground between representational and relational views of perception. This goes against proponents of ‘austere’ relationalism who deny that content (...) plays a substantive role in philosophical explanations of conscious perceptual experience. Though Siegel’s argument purports to be neutral with respect to the metaphysics of perception, it relies upon an equivocation between the presentation of property-types and property-instances. Consequently, the argument begs the question against the austere relational view, and so fails to establish the desired conclusion. So while relationalists can and should allow that experiences have accuracy conditions, it does not follow from this that they have contents of any philosophically interesting or significant kind. (shrink)

Moral perceptualism is the view that perceptual experience is attuned to pick up on moral features in our environment, just as it is attuned to pick up on mundane features of an environment like textures, shapes, colors, pitches, and timbres. One important family of views that incorporate moral perception are those of virtue theorists and sensibility theorists. On these views, one central ability of the virtuous agent is her sensitivity to morally relevant features of situations, where this sensitivity is (...) often spoken of in perceptual terms. However, sensibility theorists have often not been careful to specify how to understand their claims about moral sensibilities as perceptual. In this paper, we distinguish between what we call Attentional Moral Perception and Contentful Moral Perception. We argue that sensibility theorists should endorse Attentional Moral Perception, because it has very powerful empirical evidence in its favor, and it can play all of the explanatory roles that the sensibility theorist needs in her theory of moral sensibilities. (shrink)

Recently, it has been objected that naïve realism is inconsistent with an empirically well-supported claim that mental states of the same fundamental kind as ordinary conscious seeing can occur unconsciously (SFK). The main aim of this paper is to establish the following conditional claim: if SFK turns out to be true, the naïve realist can and should accommodate it into her theory. Regarding the antecedent of this conditional, I suggest that empirical evidence renders SFK plausible but not obvious. For it (...) is possible that what is currently advocated as unconscious perception of the stimulus is in fact momentaneous perceptual awareness (or residual perceptual awareness) of the stimulus making the subject prone to judge in some way rather than another, or to act in some way rather than another. As to the apodosis, I show that neither the core of naïve realism nor any of its main motivations is undermined if SFK is assumed. On the contrary, certain incentives for endorsing naïve realism become more tempting on this assumption. Since the main motivations for naïve realism retain force under SFK, intentionalism is neither compulsory nor the best available explanation of unconscious perception. (shrink)

When we see an object, we also represent those parts of it that are not visible. The question is how we represent them: this is the problem of amodal perception. I will consider three possible accounts: (a) we see them, (b) we have non-perceptual beliefs about them and (c) we have immediate perceptual access to them, and point out that all of these views face both empirical and conceptual objections. I suggest and defend a fourth account, according to which (...) we represent the occluded parts of perceived objects by means of mental imagery. This conclusion could be thought of as a (weak) version of the Strawsonian dictum, according to which “imagination is a necessary ingredient of perception itself”. (shrink)

In this Introduction we introduce the central themes of the Evaluative Perception volume. After identifying historical and recent contemporary work on this topic, we discuss some central questions under three headings: (1) Questions about the Existence and Nature of Evaluative Perception: Are there perceptual experiences of values? If so, what is their nature? Are experiences of values sui generis? Are values necessary for certain kinds of experience? (2) Questions about the Epistemology of Evaluative Perception: Can evaluative experiences (...) ever justify evaluative judgments? Are experiences of values necessary for certain kinds of justified evaluative judgments? (3) Questions about Value Theory and Evaluative Perception: Is the existence of evaluative experience supported or undermined by particular views in value theory? Are particular views in value theory supported or undermined by the existence of value experience? (shrink)

According to the perceptual theory of emotions, emotions are perceptions of evaluative properties. The account has recently faced a barrage of criticism recently by critics who point out varies disanalogies between emotion and paradigmatic perceptual experiences. What many theorists fail to note however, is that many of the disanalogies that have been raised to exclude emotions from being perceptual states that represent evaluative properties have also been used to exclude high-level properties from appearing in the content of perception. This (...) suggests that emotions are perceptions of high level properties and perceptual theorists can marshal the arguments used by proponents of high-level perception to defend the perceptual theory. This paper therefore defends an account of emotion as high-level perception. (shrink)

Several philosophers think there are important analogies between emotions and perceptual states. Furthermore, considerations about the rational assessibility of emotions have led philosophers—in some cases, the very same philosophers—to think that the content of emotions must be propositional content. If one finds it plausible that perceptual states have propositional contents, then there is no obvious tension between these views. However, this view of perception has recently been attacked by philosophers who hold that the content of perception is object-like. (...) I shall argue for a view about the content of emotions and perceptual states which will enable us to hold both that emotional content is analogous to perceptual content and that both emotions and perceptual states can have propositional contents. This will involve arguing for a pluralist view of perceptual content, on which perceptual states can have both contents which are proposition-like and contents which are object-like. I shall also address two significant objections to the claim that emotions can have proposition-like contents. Meeting one of these objections will involve taking on a further commitment: the pluralist account of perceptual content will have to be one on which the contents of perception can be non-conceptual. (shrink)

Sarah McGrath argues that moral perception has an advantage over its rivals in its ability to explain ordinary moral knowledge. I disagree. After clarifying what the moral perceptualist is and is not committed to, I argue that rival views are both more numerous and more plausible than McGrath suggests: specifically, I argue that inferentialism can be defended against McGrath’s objections; if her arguments against inferentialism succeed, we should accept a different rival that she neglects, intuitionism; and, reductive epistemologists can (...) appeal to non-naturalist commitments to avoid McGrath’s counterexamples. (shrink)