According to “actionism” (Noë 2010), perception constitutively depends on implicit knowledge of the way sensory stimulations vary as a consequence of the perceiver’s self-movement. My aim in this contribution is to develop an alternative conception of the role of action in perception present in the work of Gareth Evans using resources provided by Ruth Millikan’s biosemantic theory of mental representation.

Sensory substitution devices provide through an unusual sensory modality (the substituting modality, e.g., audition) access to features of the world that are normally accessed through another sensory modality (the substituted modality, e.g., vision). In this article, we address the question of which sensory modality the acquired perception belongs to. We have recourse to the four traditional criteria that have been used to define sensory modalities: sensory organ, stimuli, properties, and qualitative experience (Grice, 1962), to which we have added the criteria (...) of behavioral equivalence (Morgan, 1977), dedication (Keeley, 2002), and sensorimotor equivalence (O’Regan & Noe¨, 2001). We discuss which of them are fulfilled by perception through sensory substitution devices and whether this favors the view that perception belongs to the substituting or to the substituted modality. Though the application of a number of criteria might be taken to point to the conclusion that perception with a sensory substitution device belongs to the substituted modality, we argue that the evidence leads to an alternative view on sensory substitution. According to this view, the experience after sensory substitution is a transformation, extension, or augmentation of our perceptual capacities, rather than being something equivalent or reducible to an already existing sensory modality. We develop this view by comparing sensory substitution devices to other ‘‘mind-enhancing tools’’ such as pen and paper, sketchpads, or calculators. An analysis of sensory substitution in terms of mind-enhancing tools unveils it as a thoroughly transforming perceptual experience and as giving rise to a novel form of perceptual interaction with the environment. (shrink)

In this report, the phenomenology of two blind users of a sensory substitution device – “The vOICe” – that converts visual images to auditory signals is described. The users both report detailed visual phenomenology that developed within months of immersive use and has continued to evolve over a period of years. This visual phenomenology, although triggered through use of The vOICe, is likely to depend not only on online visualization of the auditory signal but also on the users’ previous (albeit (...) distant) experience of veridical vision (e.g. knowledge of shapes and visual perspective). Once established, the sensory substitution mapping between the auditory and visual domains is not confined to when the device is worn and, thus, may constitute an example of acquired synaesthesia. (shrink)

Visual information can be provided to blind users through sensory substitution devices that convert images into sound. Through extensive use to develop expertise, some blind users have reported visual experiences when using such a device. These blind expert users have also reported visual phenomenology to other sounds even when not using the device. The blind users acquired synthetic synaesthesia, with visual experience evoked by sounds only after gaining such expertise. Sensorimotor learning may facilitate and perhaps even be required to develop (...) expertise in the use of multimodal information. Furthermore, other areas where expertise is acquired in dividing attention amongst cross-modal information or integrating such information might also give rise to synthetic synaesthesia. (shrink)

Sensory substitution presents the philosopher of cognitive science with a particularly interesting case. Using prosthetics to map visual stimuli onto other modalities, such as touch or audition, otherwise blind individuals may develop perceptual capacities and behaviours commonly associated with sight. Experienced users can distinguish ‘visually’ presented objects and will even jerk back from a looming surface. Whether perception with sensory substitution devices should be classed as a type of vision, some other modality, or a new sense remains a matter of (...) debate, however. In the following, I review arguments commonly used to rebut the visual interpretation and, drawing on recent experimental studies and phenomenological self-reports, construct a novel case for treating sensory substitution as a visual process. (shrink)

In the “Notes for Lectures on “Private Experience‘ and “Sense Data‘", Wittgenstein endorsed one kind of inverted spectrum hypothesis and rejected another. This paper argues that the kind of inverted spectrum hypothesis that Wittgenstein endorsed is the thin end of the wedge that precludes a Wittgensteinian critique of the kind of inverted spectrum hypothesis he rejected. I will attempt to explicate the difference between the innocuous and dangerous scenarios, to give arguments in favor of the coherence of the dangerous scenario, (...) and to show that the standard arguments to the effect that the dangerous scenario is impossible are flawed or ineffective against the version of the dangerous scenario whose coherence I will be advocating. I will also agree with what I think is Wittgenstein’s position that the kind of inverted spectrum hypothesis he rejected lets qualia in the door, where qualia are qualities of experiential states whose phenomenal character cannot be expressed in natural language. Further, I will argue that acknowledging the coherence of the innocuous inverted spectrum commits Wittgenstein to the coherence of the dangerous inverted spectrum, thereby undermining Wittgenstein’s deepest views about the mind. In other work, I have used the inverted spectrum hypothesis as an argument against functionalism and representationism, but here the focus is on its role in arguing for the possibility of qualia. (shrink)

The fact that you see some particular object seems to be due to the causal relation between your visual experience and that object, rather than to your experiences’ phenomenal character. On the one hand, whenever some phenomenal element of your experience stands in the right sort of causal relation to some object, your experience presents that object (your experience’s phenomenology doesn’t need to match that object). On the other hand, you can’t have a perceptual experience that presents some object unless (...) you stand in the right sort of causal relation to that object (no matter how closely your experience’s phenomenology matches some object). According to the continuity thesis, property perception is similar to object perception in these two respects. A standard reason to reject the continuity thesis is the assumption that the environmental properties that a perceptual experience presents are determined by its phenomenal properties (which are not determined by the environmental properties that cause the experience). I maintain that the continuity thesis is false but for a different reason: perceptual experiences present both objects and properties via manners of presentation; but, whereas perceptual manners of presentation for objects are purely relational, perceptual manners of presentation for properties are satisfactional. (shrink)

Sensory substitution devices make use of one substituting modality to get access to environmental information normally accessed through another modality . Based on behavioural and neuroimaging data, some authors have claimed that using a vision-substituting device results in visual perception. Reviewing these data, we contend that this claim is untenable. We argue that the kind of information processed by a SSD is metamodal, so that it can be accessed through any sensory modality and that the phenomenology associated with the use (...) of a SSD is best described in terms of spatial phenomenology, only. (shrink)

Block (Trends Cogn Sci 7:285–286, 2003) and Prinz (PSYCHE 12:1–19, 2006) have defended the idea that SSD perception remains in the substituting modality (auditory or tactile). Hurley and Noë (Biol Philos 18:131–168, 2003) instead argued that after substantial training with the device, the perceptual experience that the SSD user enjoys undergoes a change, switching from tactile/auditory to visual. This debate has unfolded in something like a stalemate where, I will argue, it has become difficult to determine whether the perception acquired (...) through the coupling with an SSD remains in the substituting or the substituted modality. Within this puzzling deadlock two new approaches have been recently suggested. Ward and Meijer (Conscious Cogn 19:492–500, 2010) describe SSD perception as visual-like but characterize it as a kind of artificially induced synaesthesia. Auvray et al. (Perception 36:416–430, 2007) and Auvray and Myin (Cogn Sci 33:1036–1058, 2009) suggest that SSDs let their users experience a new kind of perception. Deroy and Auvray (forthcoming) refine this position, and argue that this new kind of perception depends on pre-existing senses without entirely aligning with any of them. So, they have talked about perceptual experience in SSDs as going "beyond vision". In a similar vein, MacPherson (Oxford University Press, New York, 2011a) claims that “if the subjects (SSD users) have experiences with both vision-like and touch-like representational characteristics then perhaps they have a sense that ordinary humans do not” (MacPherson in Oxford University Press, New York, 2011a, p. 139). (shrink)

The enactive approach to perception is generating an extensive amount of interest and debate in the cognitive sciences. One particularly contentious issue has been how best to characterize the perceptual experiences reported by subjects who have mastered the skillful use of a perceptual supplementation (PS) device. This paper argues that this issue cannot be resolved with the use of third-person methodologies alone, but that it requires the development of a phenomenological pragmatics. In particular, it is necessary that the experimenters become (...) skillful in the use of PS devices themselves. The "Enactive Torch" is proposed as an experimental platform which is cheap, non-intrusive and easy to replicate, so as to enable researchers to corroborate reported experiences with their own phenomenology more easily. (shrink)