Mental imagery is early perceptual processing that is not triggered by corresponding sensory stimulation in the relevant sense modality. Multimodal mental imagery is early perceptual processing that is triggered by sensory stimulation in a different sense modality. For example, when early visual or tactile processing is triggered by auditory sensory stimulation, this amounts to multimodal mental imagery. Pulling together philosophy, psychology and neuroscience, I will argue in this paper that multimodal mental imagery plays (...) a crucial role in our engagement with musical works. Engagement with musical works is normally a multimodal phenomenon, where we get input from a number of sense modalities. But even if we screen out any input that is not auditory, multimodal mental imagery will still play an important role that musicians and composers often actively rely on. (shrink)

It has been repeatedly suggested that synesthesia is intricately connected with unusual ways of exercising one’s mental imagery, although it is not always entirely clear what the exact connection is. My aim is to show that all forms of synesthesia are forms of (often very different kinds of) mental imagery and, further, if we consider synesthesia to be a form of mental imagery, we get significant explanatory benefits, especially concerning less central cases of synesthesia where the inducer (...) is not sensory stimulation. (shrink)

If the sight of cortically blind people were restored, could they visually recognize a cube or a sphere? This is Molyneux’s question. I argue that the answer to this question depends on the specificities of the mental setup of these cortically blind people. Some cortically blind people have (sometimes quite vivid) visual imagery. Others don’t. The answer to Molyneux’s question depends on whether the blind subjects have had visual imagery before their sight was restored. If they did, the (...) answer to Molyneux’s question is yes, if they didn’t, the answer is no. There is no generic answer to Molyneux’s question. (shrink)

Traditional medical Artificial Intelligence models, approved for clinical use, restrict themselves to single-modal data e.g. images only, limiting their applicability in the complex, multimodal environment of medical diagnosis and treatment. Multimodal Transformer Models in healthcare can effectively process and interpret diverse data forms such as text, images, and structured data. They have demonstrated impressive performance on standard benchmarks like USLME question banks and continue to improve with scale. However, the adoption of these advanced AI models is not without (...) challenges. While multimodal deep learning models like Transformers offer promising advancements in healthcare, their integration requires careful consideration of the accompanying ethical and environmental challenges. (shrink)

Recent research in psycholinguistics suggests that language processing frequently involves mental imagery. This paper focuses on visual imagery and discusses two issues regarding the processing of polysemous words (i.e. words with multiple related meanings or senses) – co-predication and sense-relatedness. It aims to show how mental imagery can illuminate these two issues.

This research article examines the potential of multimodal techniques in promoting inclusive practices in the English language classroom, delving into the multidisciplinary fields of English Language Teaching (ELT) and inclusive education. This study intends to investigate how multimodal resources, such as visual aids, technology, and creative activities, may be effectively integrated to meet the various learning needs of students using a pedagogical lens. This paper examines the theoretical underpinnings and practical implications of using multimodal approaches in ELT (...) settings, shedding light on their potential to promote inclusivity, engagement, and language acquisition among learners with diverse abilities and backgrounds. It does this through a thorough literature review and analysis of pedagogical frameworks. (shrink)

This paper presents an analytical framework for analyzing how multimodal resources of emotion expression are semiotically materialized in discursive interactions specific to political discourse. Interested in how political personae are emotionally constructed through multimodal meaning-making practices, our analysis model assumes an interdisciplinary perspective, which integrates facial expression analysis – using FaceReader™ software –, the theory of emotional arcs and bodily actions (hand gestures) analysis that express emotions, in the analytical framework of multimodality. The results show how the (...) class='Hi'>multimodal choices that political actors make during discursive interactions allow them to build their political brand and make connections with the audience on an emotional level. (shrink)

The aim of this paper is to argue that our experience of artworks is normally multimodal. It is the result of perceptual processing in more than one sense modality. In other words, multimodal experience of art is not the exception; it is the rule. I use the example of music in order to demonstrate the various ways in which the visual sense modality influences the auditory processing of music and conclude that this should make us look more closely (...) at our practices of engaging with artworks. (shrink)

The problem of amodal perception is the problem of how we represent features of perceived objects that are occluded or otherwise hidden from us. Bence Nanay (2010) has recently proposed that we amodally perceive an object's occluded features by imaginatively projecting them into the relevant regions of visual egocentric space. In this paper, I argue that amodal perception is not a single, unitary capacity. Drawing appropriate distinctions reveals amodal perception to be characterized not only by mental imagery, as Nanay (...) suggests, but also by genuinely visual representations as well as beliefs. I conclude with some brief remarks on the role of object-directed bodily action in conferring a sense of unseen presence on an object's occluded features. (shrink)

Fictions evoke imagery, and their value consists partly in that achievement. This paper offers analysis of this neglected topic. Section 2 identifies relevant philosophical background. Section 3 offers a working definition of imagery. Section 4 identifies empirical work on visual imagery. Sections 5 and 6 criticize imagery essentialism, through the lens of genuine fictional narratives. This outcome, though, is not wholly critical. The expressed spirit of imagery essentialism is to encourage philosophers to ‘put the image (...) back into the imagination’. The weakened conclusion is that while an image is not essential to imagining, it should be returned to our theories of imagination. (shrink)

It is common to characterize pain with touch-related terms, like ‘cutting’, ‘pressing’, ‘sharp’, and ‘pulsing’, or temperature-related terms, like ‘hot’ or ‘burning’. This suggests that many pains are phenomenally multimodal because they are experienced as having some tactile-like or thermal-like character. The goal of this chapter is to investigate the structure of phenomenally multimodal pain experiences. It is argued that the usual accounts of multimodal structure proposed in investigations regarding exteroceptive experiences cannot be plausibly applied to (...) class='Hi'>multimodal experiences of pain. Instead, an alternative framework is proposed which characterizes the structure of tactile-like and thermal-like pains by referring to the notion of crossmodal correspondences. (shrink)

Historically, mental imagery has been defined as an experiential state - as something necessarily conscious. But most behavioural or neuroimaging experiments on mental imagery - including the most famous ones - don’t actually take the conscious experience of the subject into consideration. Further, recent research highlights that there are very few behavioural or neural differences between conscious and unconscious mental imagery. I argue that treating mental imagery as not necessarily conscious (as potentially unconscious) would bring much (...) needed explanatory unification to mental imagery research. It would also help us to reassess some of the recent aphantasia findings inasmuch as at least some subjects with aphantasia would be best described as having unconscious mental imagery. (shrink)

Mental imagery often occurs during testimonial belief transmission: a testifier often episodically remembers or imagines a scene while describing it, while a listener often imagines that scene as it’s described to her. I argue that getting clear on imagery’s psychological roles in testimonial belief transmission has implications for some fundamental issues in the epistemology of testimony. I first appeal to imagery cases to argue against a widespread “internalist” approach to the epistemology of testimony. I then appeal to (...) the same sort of case to argue for an alternative, externalist view. (shrink)

Poetry evokes mental imagery in its readers. But how is mental imagery precisely related to poetry? This article provides a systematic treatment. It clarifies two roles of mental imagery in relation to poetry—as an effect generated by poetry and as an efficient means for understanding and appreciating poetry. The article also relates mental imagery to the discussion on the ‘heresy of paraphrase’. It argues against the orthodox view that the imagistic effects of poetry cannot be captured (...) by prosaic paraphrase, but points to features of poetry that can shape aspects of mental imagery that are liable to be lost in paraphrase. (shrink)

One distinct interest in self-knowledge concerns whether one can know about one’s own mental states and processes, how much, and by what methods. One broad distinction is between accounts that centrally claim that we look inward for self-knowledge (introspective methods) and those that claim that we look outward for self-knowledge (transparency methods). It is here argued that neither method is sufficient, and that we see this as soon as we move beyond questions about knowledge of one’s beliefs, focusing instead on (...) how one distinguishes, for oneself, one’s veridical visual memories from mere (non-veridical) visual images. Given robust psychological and phenomenal similarities between episodic memories and mere imagery, the following is a genuine question that one might pose to oneself: “Do I actually remember that happening, or am I just imagining it?” After critical analysis of the transparency method (advocated by Byrne 2010, following Evans 1982) to this latter epistemological question, a brief sketch is offered of a more holistic and inferential method for acquisition of broader self-knowledge (broadly following the interpretive-sensory access account of Carruthers 2011). In a slogan, knowing more of the mind requires using more of the mind. (shrink)

What is the correct procedure for determining the contents of perception? Philosophers tackling this question increasingly rely on empirically-oriented procedures in order to reach an answer. I argue that this constitutes an improvement over the armchair methodology constitutive of phenomenal contrast cases, but that there is a crucial respect in which current empirical procedures remain limited: they are unimodal in nature, wrongly treating the senses as isolatable faculties. I thus have two aims: first, to motivate a reorientation of the admissible (...) contents debate into a multimodal framework, charting its various significances. The second is to explore whether any experimental studies of multimodal perception support a so-called Liberal (or ‘high-level’ or ‘rich’) account of perception’s admissible contents. I conclude that the McGurk effect and the ventriloquist effect are both explicable without the postulation of high-level content, but that at least one multimodal experimental paradigm may necessitate such content: the rubber hand illusion. One upshot of this argument is that Conservatives who claim that the Liberal view intolerably broadens the scope of perceptual illusions, particularly from the perspective of perceptual psychology, should pursue other arguments against that view. (shrink)

I examined the proposition that there are psychological limits on what scientific problems can be solved, and that these limits may be based on a failure to be able to produce imagable, observation-based models for any possible solution, a position suggested by philosopher Colin McGinn in an argument attempting to prove that the mind-body problem is unsolvable. I examined another likely candidate for an unsolvable problem -- the ultimate origin of the universe (i.e., what might have preceded the Big Bang (...) or any other starting point; why there should be something rather than nothing) -- by exploring the reasoning of physicists about this problem and measuring visual imagery frequency and vividness, with the expectation that those who most believed the problem unsolvable would be more frequent/vivid imagers and therefore more affected by the apparent impossibility of producing an imagable solution. Eight physicists were interviewed and imagery frequency and vividness measurements performed using Cohen & Saslona's IDQ-IHS and Marks's VVIQ, respectively. All subjects considered the problem unsolvable within today's physics and all but one thought the problem still meaningful, though none were optimistic about a solution. The one subject who dismissed the problem had the lowest imagery frequency score, and there was also a significant rank order correlation (r = 0.83, p < .02) between degree of belief in problem unsolvability (extended to include viewing the problem as meaningful and not already solved) and a composite imagery frequency/vividness score, though the sample was too small to control for some possible confounding factors. (shrink)

Defined as vicarious sensorimotor experiencing, mental imagery is a powerful source of aesthetic enjoyment in everyday life and, reportedly, one of the commonest things readers remember about literary narratives in the long term. Furthermore, it is positively correlated with other dimensions of reader response, most notably with emotion. Until recent decades, however, the phenomenon of mental imagery has been largely overlooked by modern literary scholarship. As an attempt to strengthen the status of mental imagery within the literary (...) and, more generally, aesthetic discipline, this dissertation proposes an analysis positioned at a confluence of literary theory and the cognitive sciences, especially the emergent research framework of embodied cognition. Questions asked throughout the dissertation include the following: a) What are the basic varieties of mental imagery in the reading of literary narrative? b) By what contents or narrative strategies are they most likely to be prompted? c) What is it like to experience a mental image of a particular variety? d) What are its psychophysiological underpinnings? e) How does a mental image of a particular variety relate to perception? f) How does it relate to higher-order meaning-making? Four prototypical imagery varieties are distinguished on the basis of two variables with two values each (referential vs. verbal domain; inner vs. outer stance). Gradual transitions and in-between imagery varieties are acknowledged. The imagery typology and related hypotheses are grounded in introspection but carefully supported with indirect empirical evidence and, whenever possible, formulated so as to facilitate direct validation. (shrink)

What is the relationship between perception and mental imagery? I aim to eliminate an answer that I call perceptualism about mental imagery. Strong perceptualism, defended by Bence Nanay, predictive processing theorists, and several others, claims that imagery is a kind of perceptual state. Weak perceptualism, defended by M. G. F. Martin and Matthew Soteriou, claims that mental imagery is a representation of a perceptual state, a view sometimes called The Dependency Thesis. Strong perceptualism is to be (...) rejected since it misclassifies imagery disorders and abnormalities as perceptual disorders and abnormalities. Weak Perceptualism is to be rejected since it gets wrong the aim and accuracy conditions of a whole class of mental imagery–projected mental imagery–and relies on an impoverished concept of perceptual states, ignoring certain of their structural features. Whatever the relationship between perception and imagery, the perceptualist has it wrong. (shrink)

Many philosophers treat mental imagery as a kind of perceptual representation – it is either a perceptual state, or a representation of a perceptual state. In the sciences, writers point to mental imagery by way of a standard gloss – mental imagery is said to be (often, early) perceptual processing not directly caused by sensory stimuli (Kosslyn et al. 1995). Philosophers sometimes adopt this gloss, which I will call the basic view. Bence Nanay endorses it, and appeals (...) to it in a number of places to argue that mental imagery plays various functional or explanatory roles, as well as to argue that some mental phenomena should be seen as forms of mental imagery. In places he goes even further, relying on this view of mental imagery to explain how mental imagery is a unified kind despite heterogeneous appearances, and using this view to support his claim that mental imagery is a natural kind. Nanay’s book – which is a both a useful introduction to the many ways that mental imagery appears in discussions across philosophy, neuroscience, and psychology, as well as an extended argument for the multi-faceted relevance of mental imagery to a range of projects in the philosophy of mind and psychology – thus also serves as a nice test case for whether this basic view of mental imagery is good enough to aid theorizing across philosophy and the sciences. I think not. I will illustrate why by looking at two areas. First, I will discuss Nanay’s argument regarding mental imagery and object files. Second, I will discuss an issue Nanay raises, regarding the relationship between mental and motor imagery. A longer discussion might look to many more areas – as already mentioned, Nanay’s book covers a wide range of mental phenomena – with the same lesson emerging. The nature of mental imagery cannot be fully understood without facing an array of choice points, many of which push us to make commitments beyond the basic view. (shrink)

We often ascribe possibility to the scenes that are displayed by mental or nonmental sensory images. The paper presents a novel argument for thinking that we are prima facie justified in ascribing metaphysical possibility to what is displayed by suitable visual images, and it argues that many of our imagery‐based ascriptions of metaphysical possibility are therefore prima facie justified. Some potential objections to the arguments are discussed, and some potential extensions of them, to cover nonvisual forms of imagery (...) and nonmetaphysical forms of possibility, are endorsed. (shrink)

This is an excerpt from a report that highlights and explores five questions which arose from the workshop on perceptual learning and perceptual recognition at the University of Toronto, Mississauga on May 10th and 11th, 2012. This excerpt explores the question: What are the origins of multimodal associations?

What triggers the execution of actions? What happens in that moment when an action is triggered? What mental state is there at the moment of action-execution that was not there a second before? My aim is to highlight the importance of a thus far largely ignored kind of mental state in the discussion of these old and much-debated questions: motor imagery. While there have been a fair amount of research in psychology and neuroscience on motor imagery in the (...) last 30 years or so, it is only recently that we start to understand the important role motor imagery plays in action initiation. And if, as these findings suggest, motor imagery plays an important role in action initiation, we can make progress not only in understanding action initiation in general but also in understanding what goes wrong in akratic actions and in relapse actions. Finally, this new picture of action-initiation also has far-reaching consequences for the relation between motivation and causation in naturalistic action-explanations. (shrink)

Hallucination is a big deal in contemporary philosophy of perception. The main reason for this is that the way hallucination is treated marks an important stance in one of the most hotly contested debates in this subdiscipline: the debate between 'relationalists' and 'representationalists'. I argue that if we take hallucinations to be a form of mental imagery, then we have a very straightforward way of arguing against disjunctivism: if hallucination is a form of mental imagery and if mental (...) imagery and perception have some substantive common denominator, then a fortiori, perception and hallucination will also have a substantive common denominator. (shrink)

With a Call for Essays, the special issue Multimodality sought contributions that accept not only the material but also the body-bound dependence of media perception and understanding. To this end, contributions were included that shed light on both the structural and signifying potential of artistic works through multimodal analysis. Particular attention was paid to contributions that clarify how the structural features - the modes - of the arts, their perception, and their signifying potential in terms of content are interrelated (...) and how they are to be understood in communicative and thus socioculturally relevant terms. Thus, in addition to neuroscientific contributions, those from cultural anthropology, art history, image and art studies, and literary studies were included. -/- Articles -/- 8 Martina Sauer and Christiane Wagner - Introduction -/- 11 Giada Lombardi and Giuseppe Di Cesare - From Neuroscience to Art: The Role of ‘Vitality Forms’ in the Investigation of Multimodality -/- 25 Martina Sauer - Abstract - Affective – Multimodal: Interaction between Medium and Perception of Moving Images from the Viewpoint of Cassirer’s, Langer’s and Krois’ Embodiment Theories -/- 49 Göran Sonesson - The Secrets of Plastic Language Revealed: Multimodality, Polysemiosis, and Iconicity -/- 71 Natalia Igl - Making Sense of the Material: Multisensory Reader Involvement in Contemporary Multimodal Novels -/- 87 J. Philippe Thompson - Art is All: Proust’s Life Lessons Through Perception and Art -/- 107 Hans Dieter Huber - Philippe Parreno and the Exhibition as a Multimodal Aesthetic Experience -/- 135 Jörg U. Lensing - The Performing Human Being in a Media Interaction Space: Multi- and intermodal productions by the Düsseldorf Theater der Klänge (Theatre of Sounds) . (shrink)

Maurice Merleau-Ponty is often interpreted as claiming that opportunities for action are directly present in perceptual experience. However, he does not provide much evidence for how or why this would occur, and one can doubt that this is an appropriate interpretation of his phenomenological descriptions. In particular, it could be argued the Merleau-Pontyian descriptions mistakenly attribute pre-perceptual or post-perceptual elements such as allocation of attention or judgment to the perceptual experience itself. This paper argues for the Merleau-Pontyian idea that opportunities (...) for action are present in perceptual experience. It further argues that the phenomenological descriptions can be supported and explained via reference to contemporary research on motor imagery. In particular, it will be argued that non-conscious, covert motor imagery is used to prepare for and regulate skilled actions, and that it is plausible that this imagery combines with perception (likely vision) to create a single experience of the environment as enabling action. The paper will also show that contemporary views on motor imagery are broadly compatible with Merleau-Ponty’s aims. (shrink)

From the perspective of distributed cognition I will stress how abduction is essentially multimodal, in that both data and hypotheses can have a full range of verbal and sensory representations, involving words, sights, images, smells, etc., but also kinesthetic – related to the ability to sense the position and location and orientation and movement of the body and its parts – and motor experiences and other feelings such as pain, and thus all sensory modalities. The presence of kinesthetic and (...) motor aspects demonstrates that abductive reasoning can be manipulative. We can also see, in this regard, how implicit factors take part in the abductive procedure, which consequently acquires the character of a kind of “thinking through doing”. This paper further describes 1) the fact that hypotheses in science can be built through different cognitive mediators and so they can also model the same cognitive aspect in different ways; how they can be carriers/ producers of knowledge in a multimodal way; 2) the problem of the possible non-explanatory and instrumental nature of abductive reasoning and the analysis of the consequences for induction; 3) the role of manipulative abduction in building new evidence/ experiments and how they trigger smart inductive inferences. (shrink)

The analysis of multimodal argumentation in advertising is a crucial and problematic area of research. While its importance is growing in a time characterized by images and pictorial messages, the methods used for interpreting and reconstructing the structure of arguments expressed through verbal and visual means capture only isolated dimensions of this complex phenomenon. This paper intends to propose and illustrate a methodology for the reconstruction and analysis of “double-mode” arguments in advertisements, combining the instruments developed in social semiotics, (...) pragmatics, and argumentation theory. An advertisement is processed through a five-step path. The analysis of its context, text genre, and images leads to a first representation of the messages that it encodes both pictorially and verbally (step 1). These first semantic representations are further enriched by including their polyphonic articulations and presuppositions (step 2), their explicatures (step 3), and their dialogical functions and illocutionary forces (step 4). These pragmatic steps retrieve the commitment structure of the ad, which allows a further argument analysis conducted through argumentation schemes (step 5). (shrink)

Mental images, or envisioning things with your "mind's eye," are now studied via multiple levels of observation and involve computational neuroscience, robotics and many disciplines that complement philosophy and form integral parts of cognitive science. MENTAL IMAGERY AND CREATIVITY offers an historical analysis of the use of "mental images" in science. This book also gives many useful illustrations, depicting roles of imagery with 21st century technology, including the usage of imagery, fMRIs and internet connections, allowing people to (...) control virtual avatars or robots at remote distances. Imagery formations and brain imaging techniques allow non-communicative patients, who appear to be in vegetative states, to communicate effectively, despite brain damage. Notwithstanding many 21st century developments of imagery combined with technology and science, many speculative accounts of imagery arose in the 20th century. Philosophic developments, regarding the relation between mental imagery and creativity, are provided in order to compare and contrast speculative and rational foundations. Creativity is defined in relation to problem-solving, inventiveness, art, discovery and cognitive formations of ranges of possibilities, arising before and after realizations (i.e., when one recognizes real and unreal events or solutions), involving images of events, solutions and alternatives. (shrink)

What is the mental representation that is responsible for implicit bias? What is this representation that mediates between the trigger and the biased behavior? My claim is that this representation is neither a propositional attitude nor a mere association. Rather, it is mental imagery: perceptual processing that is not directly triggered by sensory input. I argue that this view captures the advantages of the two standard accounts without inheriting their disadvantages. Further, this view also explains why manipulating mental (...) class='Hi'>imagery is among the most efficient ways of counteracting implicit bias. (shrink)

The objective of this article is twofold. In the first part, I discuss two issues central to any theoretical inquiry into mental imagery: embodiment and consciousness. I do so against the backdrop of second-generation cognitive science, more specifically the increasingly popular research framework of embodied cognition, and I consider two caveats attached to its current exploitation in narrative theory. In the second part, I attempt to cast new light on readerly mental imagery by offering a typology of what (...) I propose to be its four basic varieties. The typology is grounded in the framework of embodied cognition and it is largely compatible with key neuroscientific and other experimental evidence produced within the framework. For each imagery variety, I make some elementary suggestions as to how it may typically be cued by distinct narrative strategies. (shrink)

Visualizings, the simplest imaginings which employ visual imagery, have certain characteristic features; they are perspectival, for instance. Also, it seems that some but not all of our visualizings are imaginings of seeings. But it has been forcefully argued, for example by M.G.F. Martin and Christopher Peacocke, that all visualizings are imaginings of visual sensations. I block these arguments by providing an account of visualizings which allows for their perspectival nature and other features they typically have, but which also explains (...) how we can visualize things without thereby imagining visual sensations. (shrink)

Aphantasia is a condition that is often characterized as the impaired ability to create voluntary mental images. Aphantasia is assumed to selectively affect voluntary imagery mainly because even though aphantasics report being unable to visualize something at will, many report having visual dreams. We argue that this common characterization of aphantasia is incorrect. Studies on aphantasia are often not clear about whether they are assessing voluntary or involuntary imagery, but some studies show that several forms of involuntary (...) class='Hi'>imagery are also affected in aphantasia (including imagery in dreams). We also raise problems for two attempts to show that involuntary images are preserved in aphantasia. In addition, we report the results of a study about afterimages in aphantasia, which suggest that these tend to be less intense in aphantasics than in controls. Involuntary imagery is often treated as a unitary kind that is either present or absent in aphantasia. We suggest that this approach is mistaken and that we should look at different types of involuntary imagery case by case. Doing so reveals no evidence of preserved involuntary imagery in aphantasia. We suggest that a broader characterization of aphantasia, as a deficit in forming mental imagery, whether voluntary or not, is more appropriate. Characterizing aphantasia as a volitional deficit is likely to lead researchers to give incorrect explanations for aphantasia, and to look for the wrong mechanisms underlying it. (shrink)

Nanay (2017) argues for unconscious mental imagery, inter alia based on the assumption that successful performance in imagery tasks requires the manipulation of mental imagery. I challenge this assumption with the help of results presented in Shepard and Metzler (1971), Zeman et al. (2010), and Keogh and Pearson (2018). The studies suggest that imagery tasks can be successfully performed by means of cognitive/propositional strategies which do not rely on imagery.

This paper introduces a novel conceptualisation of mental imagery; namely, that is grease for the mind’s gears (MGT). MGT is not just a metaphor. Rather, it describes an important and overlooked higher-order function of mental imagery: that it aids various mental faculties discharge their characteristic functional roles. MGT is motivated by reflection on converging evidence from clinical, experimental and social psychology and solves at least two neglected conceptual puzzles about mental imagery. The first puzzle concerns imagery’s (...) architectural promiscuity; that is, its ability to assist diverse mental faculties and perform many different functions when doing so. The second puzzle concerns how to square imagery’s architectural promiscuity with its psychopathological relevance; that is, its being a maintaining cause, and possibly even a partial constituent, of several psychological disorders, including post-traumatic stress disorder, bipolar disorder and major depressive disorder. Mental imagery helps and harms human psychology to extreme degrees and this is something that calls for elucidation. MGT says that instead of facing perplexing heterogeneities here, we instead face a significant unity. On this score, MGT is argued to be superior to the currently dominant conception of imagery in the philosophical literature; namely, as a perception-like state of mind. (shrink)

It is often observed that images—including mental images—are in some sense representationally ambiguous. Some, including Jerry Fodor, have added that mental images only come to have determinate contents through the contribution of non-imagistic representations that accompany them. This paper agrees that a kind of ambiguity holds with respect to mental imagery, while arguing (pace Fodor) that this does not prevent imagery from having determinate contents in the absence of other, non-imagistic representations. Specifically, I argue that mental images can (...) represent determinate types of outlays of properties without help from any non-imagistic representations, yet can only become involved in the representation of particular objects through pairing with a non-imagistic representation of the right sort. These points are defended through reflection on the “Picture Principle,” the nature of depiction, and general principles for typing and individuating mental states. (shrink)

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: Are some of the basic units of consciousness multimodal?

Is it true that there is an analogy between modes of creation and such of perception? Respective to the cultural anthropological research of Ernst Cassirer, Susanne K. Langer and John M. Krois and by the analysis of a tape of the Swiss video-artist Pipilotti Rist this initial thesis of Formal Aesthetics shall be supported. - I - -/- Lässt sich die Behauptung stützen, dass zwischen Gestaltungsweisen und Wahrnehmungsweisen eine Analogie besteht? Aufbauend auf den kulturanthropologischen Forschungen von Ernst Cassirer, Susanne K. (...) Langer und John M. Krois sowie der Analyse eines Tapes der Schweizer Videokünstlerin Pipilotti Rist gilt es diese ursprünglich von der formalen Ästhetik aufgeworfene These zu untermauern. (shrink)

Unconscious logical inference seems to rely on the syntactic structures of mental representations (Quilty-Dunn & Mandelbaum 2018). Other transitions, such as transitions using iconic representations and associative transitions, are harder to assimilate to syntax-based theories. Here we tackle these difficulties head on in the interest of a fuller taxonomy of mental transitions. Along the way we discuss how icons can be compositional without having constituent structure, and expand and defend the “symmetry condition” on Associationism (the idea that associative links and (...) transitions are perfectly symmetric). In the end, we show how a BIT (“bare inferential transition”) theory can cohabitate with these other non-inferential mental transitions. (shrink)

The aim of this paper is to propose a new approach in the form of multimodality as a semiotic method that can be used by marketers and semioticians to induce online flow, a psychological state, on a brand website. First, we refer to multimodality as a semiotic analysis that can be used for a better optimization of semiotic resource sets in meaning-making, and we distinguish it from another similar concept: multimedia. Second, after a critical literature review, we address the flow (...) construct - a state of mind sometimes experienced by people who are deeply involved and immersed in some event, object or activity. Previous quantitative studies show a correlation between online flow experience and other variables such as design, content, sound and layout that are suggested to be its antecedents. In our study, these flow antecedents are viewed as sets of signs or modes that can be orchestrated in order to create different levels of perceived challenge for brand website users. We consider that multimodality can be used for a better optimization of these various meanings as expressed by modes that are "essentially different in nature" (Bateman, 2008, p.54). Also, we refer to the online marketing outcomes of the online flow experience, in order to outline its importance and its implications in the online environment. The main conclusion of our paper is that multimodality can be used by scholars and practitioners as a premise to induce online flow on a brand website, by optimizing the sets of signs or modes. Originality – our contribution consists of an interdisciplinary approach. We use concepts from semiotics, positive psychology, and online marketing for a better understanding of how marketers and semioticians can positively influence online customer behaviour. (shrink)

Aphantasia is a condition characterised by a deficit of mental imagery. Since several psychopathologies are partially maintained by mental imagery, it may be illuminating to consider the condition against the background of psychological disorder. After outlining current findings and hypotheses regarding aphantasia and psychopathology, this paper suggests that some support for defining aphantasia as a lack of voluntary imagery may be found here. The paper then outlines potentially fruitful directions for future research into aphantasia in general and (...) its relation to psychopathology in particular, including rethinking use of the SUIS to measure involuntary imagery, whether aphantasia offers protection against addiction, and whether hyperphantasia is a potential risk factor for maladaptive daydreaming, among others. (shrink)

Recently, the term ‘aphantasia’ has become current in scientific and public discourse to denote the absence of mental imagery. However, new terms for aphantasia or its subgroups have recently been proposed, e.g. ‘dysikonesia’ or ‘anauralia’, which complicates the literature, research communication and understanding for the general public. Before further terms emerge, we advocate the consistent use of the term ‘aphantasia’ as it can be used flexibly and precisely, and is already widely known in the scientific community and among the (...) general public. (shrink)

The paper examines the relationships between the contents of imaginative episodes and the mental images that often play a central role within them. It considers, for example, whether the presence of mental imagery is required for a mental episode to count as an imagining.

It is clear that visual imagery is somehow significantly visual. Some theorists, like Kosslyn, claim that the visual nature of visualisations derives from features of the neural processes which underlie those episodes. Pylyshyn claims, however, that it may merely reflect special features of the contents which we grasp when we visualise things. This paper discusses and rejects Pylyshyn's own attempts to identify the respects in which the contents of visualisations are notably visual. It then offers a novel and very (...) different account of what is distinctively sensory about the contents of sensory images. The paper's alternative account is used in explaining various pieces of phenomenological and behavioural data concerning visualisation. Finally, it is tentatively suggested that the proposed account of the contents of sensory images may also shed light upon some of the neurological data involving visualisation and sensory imagery more generally. (shrink)

It has been suggested that certain problems may be unsolvable because of the mind's cognitive structure, but we may wonder what problems, and exactly why. The ultimate origin of the universe and the mind-body problem seem to be two such problems. As to why, Colin McGinn has argued that the mind-body problem is unsolvable because any theoretical concepts about the brain will be observation-based and unable to connect to unobservable subjective experience. McGinn's argument suggests a requirement of imagability -- an (...) observation basis -- for physical causal explanation that cannot be met for either of these problems. Acausal descriptions may be possible but not the causal analyses that provide the greatest explanatory satisfaction, a psychological phenomenon that seems tied to the strength of the underlying observation basis but is affected by other factors as well. (shrink)

Everyday media consumption leaves no doubt that the perception of moving images from various media is characterized by experience and understanding. Corresponding research in this field has shown that the stimulus patterns flooding in on us are not only processed mentally, but also bodily. Building on this, the following study argues that incoming stimuli are processed not only visually, but multimodally, with all senses, and moreover affectively. The classical binding of a sensory organ to a medium, on whose delimitation the (...) common understanding of multimodality is based, is thus abolished. Can arguments for this assumption be found? Building on the research of cultural anthropologist Ernst Cassirer and his successors, the two American philosophers Susanne K. Langer and John M. Krois, and supported by research from the life sciences in which, in parallel, the arts also play an important role in understanding image formation, as in the work of Heinz Werner and, following on from this, in the more recent research of the child psychologist Daniel N. Stern in collaboration with mirror neuron research by the group of neuroscientists around Giacomo Rizzolatti in Parma, justifications for this will be provided. What the multimodal processing of film images is concretely based on will finally be made clear by means of an exemplary analysis of a video film by the Swiss artist Pipilotti Rist. It aims to prove, that the prerequisites for the thesis can only lie in the fact, that both the modes of perception (visual, tactile, auditory, olfactory, gustatory) as well as the medially conditioned modes of image formation are based on non-discursive, formal-abstract structures that are also processed affectively. At the same time, the analysis thus shows how the selection and composition of the vital experienced forms can provide information about the socio-culturally shaped self-image of the producer and the viewer. (shrink)

When we see an object, we also represent those parts of it that are not visible. The question is how we represent them: this is the problem of amodal perception. I will consider three possible accounts: (a) we see them, (b) we have non-perceptual beliefs about them and (c) we have immediate perceptual access to them, and point out that all of these views face both empirical and conceptual objections. I suggest and defend a fourth account, according to which we (...) represent the occluded parts of perceived objects by means of mental imagery. This conclusion could be thought of as a (weak) version of the Strawsonian dictum, according to which “imagination is a necessary ingredient of perception itself”. (shrink)

The relationship between perceptual experience and memory can seem to pose a chal- lenge for conceptualism, the thesis that perceptual experiences require the actualization of conceptual capacities. Since subjects can recall features of past experiences for which they lacked corresponding concepts at the time of the original experience, it would seem that a subject’s conceptual capacities do not impose a limit on what he or she can experience perceptually. But this conclusion ignores the fact that concepts can be composed of (...) other simpler concepts that a subject possessed earlier, and that de- monstrative capacities can explain how a subject can experience a particular feature of her environment, even when she lacks a fully general concept for that feature. Using these resources, conceptualism can explain the relation between perceptual experience and memory. Nevertheless, a puzzle remains for the defender of conceptualism. A cer- tain view about the relation between perceptual experience and mental imagery in epi- sodic memory – that imagery in recall matches the experience retained in it – can make it difficult to understand how conceptualism could be true. For if a subject’s conceptual capacities determine what the phenomenology of an experience (or memory of it) is like, then one would expect a perceptual experience and its recall in memory to differ in phenomenology if they involve different concepts. In this essay, I solve this puzzle for conceptualism by undermining the assumption that there is a match between im- agery in episodic memory and the phenomenal character of experience. (shrink)