This chapter distinguishes between two kinds of ordinary multisensory experience that go beyond mere co-consciousness of features (e.g., the experience that results from concurrently hearing a sound in the hallway and seeing the cup on the table). In one case, a sensory experience in one modality creates a perceptual demonstrative to whose referent qualities are attributed in another sensory modality. For example, when you hear someone speak, auditory experience attributes audible qualities to a seen event, a person’s speaking motions. The (...) second kind of multisensory experience attributes features experienced in several sensory modalities to one and the same object via a process of amodal perceptual integration, i.e., integration that occurs separately from processing within the individual sensory modalities. Multisensory experiences arising from holding and seeing a tomato or from seeing the Indian curry boil and smelling it are examples of the second kind of multisensory experience. At the end of the chapter we look at synesthesia, a kind of atypical multisensory experience, and argue that one version of this phenomenon may be able to shed light on the neural mechanism underlying amodally integrated multisensory experience. (shrink)

Studies have shown that both serotonin and glutamate receptor systems play a crucial role in the mechanisms underlying drug-induced synesthesia. The specific nature of these mechanisms, however, continues to remain elusive. Here we propose two distinct hypotheses for how synesthesia triggered by hallucinogens in the serotonin-agonist family may occur. One hypothesis is that the drug-induced destabilization of thalamic projections via GABAergic neuronal circuits from sensory areas leads to a disruption of low-level, spontaneous integration of multisensory stimuli. This sort of integration (...) regularly occurs when spatial and temporal attributes match. Destabilization of feedback loops, however, can result in incongruent experiences or binding of random thalamus activation with sensory input in a particular sensory modality. The second hypothesis builds on embodied cognition, cases in which visual images of external stimuli activate task-related neural regions. On this proposal, binding processes that do not normally generate awareness become accessible to consciousness as a result of decreased attentional discrimination among incoming stimuli. (shrink)

Grapheme-colour synaesthetes experience unusual colour percepts when they encounter letters and/or digits. Studies of English-speaking grapheme-colour synaesthetes have shown that synaesthetic colours are sometimes triggered by rule-based linguistic mechanisms . In contrast, little is known about synaesthesia in logographic languages such as Chinese. The current study shows the mechanisms by which synaesthetic speakers of Chinese colour their language. One hypothesis is that Chinese characters might be coloured by their constituent morphological units, known as radicals, and we tested this by eliciting (...) synaesthetic colours for characters while manipulating features of the radicals within them. We found that both the function and position of radicals influence the nature of the synaesthetic colour generated. Our data show that in Chinese, as in English, synaesthetic colours are influenced by systematic rules, rather than by random associations, and that these rules are based on existing psycholinguistic mechanisms of language processing. (shrink)

Studies of linguistic synaesthesias in English have shown a range of fine-grained language mechanisms governing the associations between colours on the one hand, and graphemes, phonemes and words on the other. However, virtually nothing is known about how synaesthetic colouring might operate in non-alphabetic systems. The current study shows how synaesthetic speakers of Mandarin Chinese come to colour the logographic units of their language. Both native and non-native Chinese speakers experienced synaesthetic colours for characters, and for words spelled in the (...) Chinese spelling systems of Pinyin and Bopomo. We assessed the influences of lexical tone and Pinyin/Bopomo spelling and showed that synaesthetic colours are assigned to Chinese words in a non-random fashion. Our data show that Chinese-speaking synaesthetes with very different native languages can exhibit both differences and similarities in the ways in which they come to colour their Chinese words. (shrink)

How can we explain the intentional nature of an expert’s actions, performed without immediate and conscious control, relying instead on automatic cognitive processes? How can we account for the differences and similarities with a novice’s performance of the same actions? Can a naturalist explanation of intentional expert action be in line with a philosophical concept of intentional action? Answering these and related questions in a positive sense, this dissertation develops a three-step argument. Part I considers different methods of explanations in (...) cognitive neuroscience (Bennett & Hacker’s philosophical, conceptual analysis; Marr’s three levels of explanation; Neural Correlates of Consciousness research; mechanistic explanation), defending ‘mechanistic explanation’ as a method that provides the necessary tools for integrating interdisciplinary insights into human action. Furthermore, a dynamic, explanatory mechanism allows the assessment of the impact of learning and development on expert action in a valuable way that other methods don’t. Part II continues by scrutinizing several cognitive neuroscientific theories of learning and development (neuroconstructivism; dual-processing theories; simulation theory; extended mind/cognition hypothesis), arguing for the complex interactions between different types of processing and different action representations involved in expert action performances. Moreover, according to our discussion of a particular ‘simulation theory’ these interactions can be influenced in several ways with the use of language, allowing an agent to configure a specific action representation for performance at a later stage. The results of Parts I and II are then applied in Part III to a parallel discussion of philosophical analyses of intentional action (discussing i.a. Frankfurt, Bratman, Pacherie and Ricoeur) and cognitive neuroscientific insights in it. Both approaches are found to converge in emphasizing the importance for an expert to develop stable patterns of actions that comply maximally not only with his intentions, but also with his motor expertise and with situational conditions. Consequently, his actions – automatic, or not – rely on this ‘sculpted space of actions’. (shrink)

Despite some principal similarities, there is no systematic comparison between the different types of synesthesia . This comprehensive review compares the three principal types of synesthesia and focuses on their phenomenological features and their relation to different etiological models. Implications of this comparison for the validity of the different etiological models are discussed.Comparison of the three forms of synesthesia show many more differences than similarities. This is in contrast to their representation in the literature, where they are discussed in many (...) respects as being virtually similar. Noteworthy is the much broader spectrum and intensity with the typical drug-induced synesthesias compared to genuine and acquired synesthesias. A major implication of the phenomenological comparison in regard to the etiological models is that genuine and acquired synesthesias point to morphological substrates, while drug-induced synesthesia appears to be based on functional changes of brain activity. (shrink)

In grapheme-color synesthesia, a number or letter can evoke two different and possibly conflicting color sensations at the same time. In this study, we investigate the relationship between synesthesia and executive control functions. First, no general skill differences were obtained between synesthetes and non-synesthetes in classic executive control paradigms. Furthermore, classic executive control effects did not interact with synesthetic behavioral effects. Third, we found support for our hypothesis that inhibition of a synesthetic color takes effort and time. Finally, individual differences (...) analyses showed no relationship between the two skills; performance on a ‘normal’ Stroop task does not predict performance on a synesthetic Stroop task. Across four studies, the current results consistently show no clear relationship between executive control functions and synesthetic behavioral effects. This raises the question of which mechanisms are at play in synesthetic ‘management’ during the presence of two conflicting sensations. (shrink)

Mirror-touch synaesthesia is a condition where observing touch to another’s body induces a subjective tactile sensation on the synaesthetes body. The present study explores which characteristics of the inducing stimulus modulate the synaesthetic touch experience. Fourteen mirror-touch synaesthetes watched videos depicting a touch event while indicating whether the video induced a tactile sensation, on which side of their body they felt this sensation and the intensity of the experienced sensation. Results indicate that the synaesthetes experience stronger tactile sensations when observing (...) touch to real bodies, whereas observing touch to dummy bodies, pictures of bodies and disconnected dummy body parts elicited weaker sensations. These results suggest that mirror-touch synaesthesia is not entirely bottom-up driven, but top-down information, such as knowledge about real and dummy body parts, also modulate the intensity of the experience. (shrink)

Synesthetic experiences of color have been traditionally conceptualized as a perceptual phenomenon. However, recent evidence suggests a role of higher order cognition in the formation of synesthetic experiences. Here, we discuss how synesthetic experiences of color differ from and influence veridical color processing, and how non-perceptual processes such as imagery and color memory might play a role in eliciting synesthetic color experience.

People with grapheme-color synesthesia perceive specific colors when viewing different letters or numbers. Previous studies have suggested that synesthetic color experience can be bistable when induced by an ambiguous character. However, the exact relationship between processes underlying the identity of an alphanumeric character and the experience of the induced synesthetic color has not been examined. In the present study, we explored this by focusing on the temporal relation of inducer identification and color emergence using inducers whose identity could be rendered (...) ambiguous upon rotation of the characters. Specifically, achromatic alphabetic letters and digits were presented at varying angles to 9 grapheme-color synesthetes. Results showed that grapheme identification and synesthetically perceived grapheme color covary with the orientation of the test stimulus and that synesthetes were slower naming the experienced color than identifying the character, particularly at intermediate angles where ambiguity was greatest. (shrink)

Synesthetic experiences of color have been traditionally conceptualized as a perceptual phenomenon. However, recent evidence suggests a role of higher order cognition in the formation of synesthetic experiences. Here, we discuss how synesthetic experiences of color differ from and influence veridical color processing, and how non-perceptual processes such as imagery and color memory might play a role in eliciting synesthetic color experience.

Grapheme-colour synaesthesia is a perceptual experience where graphemes, letters or words evoke a specific colour, which are experienced either as spatially coincident with the grapheme inducer (projector sub-type) or elsewhere, perhaps without a definite spatial location (associator sub-type). Here, we address the question of whether synaesthesia can be rapidly produced using a hypnotic colour suggestion to examine the possibility of ‘hypnotic synaesthesia’, i.e. subjectively experienced colour hallucinations similar to those experienced by projector synaesthetes. We assess the efficacy of this intervention (...) using an “embedded figures” test, in which participants are required to detect a shape (e.g., a square) composed of local graphemic elements. For grapheme-colour synaesthetes, better performance on the task has been linked to a higher proportion of graphemes perceived as coloured. We found no performance benefits on this test when using a hypnotic suggestion, as compared to a no-suggestion control condition. The same result was found when participants were separated according to the degree to which they were susceptible to the suggestion (number of coloured trials perceived). However, we found a relationship between accuracy and subjective reports of colour in those participants who reported a large proportion of coloured trials: trials in which the embedded figure was accurately recognised (relative to trials in which it was not) were associated with reports of more intense colours occupying a greater spatial extent. Collectively, this implies that hypnotic colour was only perceived after shape detection rather than aiding in shape detection via colour-based perceptual grouping. The results suggest that hypnotically induced colours are not directly comparable to synaesthetic ones. (shrink)

��Grapheme-color synaesthesia is a neurological phenomenon in which particular graphemes, such as the numeral 9, automatically induce the simultaneous perception of a particular color, such as the color red. To test whether the concurrent color sensations in graphemecolor synaesthesia are treated as meaningful stimuli, we recorded event-related brain potentials as 8 synaesthetes and 8 matched control subjects read sentences such as ‘‘Looking very clear, the lake was the most beautiful hue of 7.’’ In synaesthetes, but not control subjects, congruous graphemes, (...) compared with incongruous graphemes, elicited a more negative N1 component, a less positive P2 component, and a less negative N400 component. Thus, contextual congruity of synaesthetically induced colors altered the brain response to achromatic graphemes beginning 100 ms postonset, affecting pattern-recognition, perceptual, and meaning-integration processes. The results suggest that grapheme-color synaesthesia is automatic and perceptual in nature and also suggest that the connections between colors and numbers are bidirectional. (shrink)

Extreme conditions like savantism, autism or synaesthesia, which have a neurological 2AH, UK basis, challenge the idea that other minds are similar to our own. In this paper we report a single case study of a man in whom all three of these conditions co-occur. We suggest, on the basis of this single case, that when savantism and synaesthesia co- occur, it is worthwhile testing for an undiagnosed Autism Spectrum Condition (ASC). This is because savantism has an established association with (...) ASC, and the combination of ASC with synaesthesia may increase the likelihood of savantism. The implications of these conditions for philosophy of mind are introduced. (shrink)

Synaesthesia is a heterogeneous phenomenon, even when considering one particular sub-type. The purpose of this study was to design a reliable and valid questionnaire for grapheme-colour synaesthesia that captures this heterogeneity. By the means of a large sample of 628 synaesthetes and a factor analysis, we created the Coloured Letters and Numbers questionnaire with 16 items loading on 4 different factors . These factors were externally validated with tests which are widely used in the field of synaesthesia research. The questionnaire (...) showed good test–retest reliability and construct validity . Our findings are discussed in the light of current theories and new ideas in synaesthesia research. More generally, the questionnaire is a useful tool which can be widely used in synaesthesia research to reveal the influence of individual differences on various performance measures and will be useful in generating new hypotheses. (shrink)

Motion-sound synesthesia is characterized by illusory auditory sensations linked to the pattern and rhythms of motion of visually experienced but soundless object, like an optical flow array, a ball bouncing or a horse galloping. In an MRI study with a group of three synesthetes and a group of eighteen control participants, we found structural changes in the brains of synesthetes in the subcortical multisensory areas of the superior and inferior colliculi. In addition, functional magnetic resonance imaging data showed activity in (...) motion-sensitive regions, as well as temporal and occipital areas, and the cerebellum. However, the synesthetes had a higher activation within the left and right cuneus, with stronger activations when viewing optical flow stimuli. There was also a general difference in connectivity of the colliculi with the above mentioned regions between the two groups. These findings implicate low-level mechanisms within the human neuroaxis as a substrate for local connectivity and cross activity between perceptual processes that are “distant” in terms of cortical topography. The present findings underline the importance of considering the role of subcortical systems and their connectivity to multimodal regions of the cortex and they strengthen a parsimonious account of synesthesia, at the least of the visual-auditory type. (shrink)

Recent research on synesthesia has focused on how the condition may depend on selective attention, but there is a lack of consensus on whether selective attention is required to bind colors to their grapheme inducers. In the present study, we used a novel change detection paradigm to examine whether synesthetic colors guide the subject’s attention to the location of the inducer or whether selective attention is required to act as a unique feature during visual search. If synesthetic experiences are elicited (...) by inducers without selective attention, then a target that is distinct from the distractors by virtue of its unique synesthetic color should capture attention. This should lead to efficiency in the search that is analogous to the efficiency in searches involving unique display colors. If, however, an inducer does not elicit a synesthetic color until the subject selectively attends to it, then the search should be as inefficient as for control subjects. We found that, not only does synesthesia not provide an advantage in complicated visual search tasks, it offers a slight disadvantage, supporting the re-entrant processing hypothesis about the mechanism underlying synesthesia. (shrink)

Time–space synesthetes report that they experience the months of the year as having a spatial layout. In Study 1, we characterize the phenomenology of calendar sequences produced by synesthetes and non-synesthetes, and show a conservative estimate of time–space synesthesia at 2.2% of the population. We demonstrate that synesthetes most commonly experience the months in a circular path, while non-synesthetes default to linear rows or rectangles. Study 2 compared synesthetes’ and non-synesthetes’ ability to memorize a novel spatial calendar, and revealed better (...) performance in synesthetes. The capacity to learn mappings between arbitrary spatial forms and temporal sequences is present in all individuals, and time–space synesthetes’ enhanced visuo-spatial memory abilities may underlie their creation of idiosyncratic spatial calendar forms. (shrink)