Attempts to introduce Gestalt theory into the realm of visual neuroscience are discussed on both theoretical and experimental grounds. To define the framework in which these proposals can be defended, this paper outlines the characteristics of a standard model, which qualifies as a received view in the visual neurosciences, and of the research into natural images statistics. The objections to the standard model and the main questions of the natural images research are presented. On these grounds, this (...) paper defends the view that Gestalt psychology and experimental phenomenology provide a contribution to the research into perception by the construction of phenomenological models for an ecologically meaningful interpretation of the empirical evidence and the hypothetical constructs of the natural image research within the visual neuroscience. A formal framework for the phenomenological models is proposed, wherein Gestalt theoretical principles and empirical evidence are represented in terms of topological properties and relationships, which account for the order and structures that make the environment accessible to observers at a relevant behavioural level. It is finally argued that these models allow us to evaluate the principles and the empirical evidence of various natures which are integrated from different fields into the research into perception, and in particular into visual neurosciences. (shrink)

Neuroscience hasn’t shown how quite similar sensory circuits encode quite different colors and other qualia, nor how the unified pictorial form of images is encoded, nor how these codes yield conscious images. Neuroscience’s fixation here on cortical codes may be the culprit. Treating conscious images partly as retinal substances may avoid these problems. The evidence for conscious retinal images is that (a) the cortical codes for images are quite problematic, (b) injecting retinas with certain genes turns dichromats into (...) trichromats without cortical help, (c) retinas can discern colors by themselves without cortex, (d) retinal distortions appear in images but cortical distortions don’t, (e) retinal detectors support finely detailed colors, but V4 detectors don’t, due to their big receptive fields, (f) retinal activity has pictorial form, but viable cortical codes for pictorial form don’t exist. So, the colors and unified pictorial form of images arguably arise mainly across arrays of retinal detectors—not from abstract cortical codes. Images may be hidden in retinal activity beyond what EEGs show of it (cf. Strawson’s monism). Also, cortex refines these retinal images but cortical impairment (anesthesia, lesions, etc.) blocks awareness of them, for they’re no longer accessible to the mind’s subject-centered consciousness, resident in cortex. This proposal is largely testable and based in recent evidence. It avoids neuroscience’s elusive, problematic coded images and enigmatic explanations of how they become conscious. (shrink)

Common sense suggests that visual consciousness is essential to skilled motor action, but Andy Clark—inspired by Milner and Goodale's dual visual systems theory—has appealed to a wide range of experimental dissociations to argue that such an assumption is false. Critics of Clark's argument contend that the content driving motor action is actually within subjects' experience, just not easily discovered. In this article, I argue that even if such content exists, it cannot be guiding motor action, since a review (...) of current visual neuroscience indicates that the visual brain areas producing conscious representations are distinct from those driving motor action. (shrink)

Advances in neuroscience implicate reentrant signaling as the predominant form of communication between brain areas. This principle was used in a series of masking experiments that defy explanation by feed-forward theories. The masking occurs when a brief display of target plus mask is continued with the mask alone. Two masking processes were found: an early process affected by physical factors such as adapting luminance and a later process affected by attentional factors such as set size. This later process is (...) called masking by object substitution, because it occurs whenever there is a mismatch between the reentrant visual representation and the ongoing lower level activity. Iterative reentrant processing was formalized in a computational model that provides an excellent fit to the data. The model provides a more comprehensive account of all forms of visual masking than do the long-held feed-forward views based on inhibitory contour interactions. (shrink)

In this paper I argue that neuroscience has been harmed by the widespread adoption of seriously inadequate methodologies or philosophies of science - most notably inductivism and falsificationism. I argue that neuroscience, in seeking to understand the human brain and mind, needs to follow in the footsteps of evolution.

This paper questions two prima facie plausible claims concerning switching in the presence of ambiguous figures. The first is the claim that reversing is an instantaneous process. The second is the claim that the ability to reverse demonstrates the interpretive, inferential and constructive nature of visual processing. Empirical studies show that optical and cerebral events related to switching protract in time in a way that clashes with its perceived instantaneity. The studies further suggest an alternative theory of reversing: according (...) to such alternative, seeing the same thing in multiple ways is a matter of uncovering what is already present to the senses through visual search. (shrink)

Science is a crowning glory of the human spirit and its applications remain our best hope for social progress. However, there are limitations to existing science and perhaps to any science. The general mind-body problem is known to be currently intractable and mysterious (8). This is one of many deep problems that are generally agreed to be beyond the present purview of Science, including many quantum phenomena, etc. However, all of these famous unsolved problems are either remote from everyday experience (...) (entanglement, dark matter) or are hard to even define sharply (phenomenology, consciousness, etc.). In this note, we will consider some computational problems in vision that arise every time that we open our eyes and yet are demonstrably inconsistent with current theories of neural computation. The focus will be on two famous related phenomena, known as the neural binding problem and the experience of a detailed stable visual world. I, among many others, have struggled with these issues for more than fifty years (1, 2, 3). Somewhat paradoxically, the continuing progress in scientific methods and knowledge reveals that these are both unsolvable within existing neuroscience. By considering some basic facts about how the brain processes image input, we will show that, under the standard theory, there are not nearly enough brain neurons to compute what we experience as vision. Inconsistencies like the ones shown here have had a profound effect on paradigm change in the sciences. More directly, the discussions below suggest possible new theories and experiments. (shrink)

The question of whether cognition can influence perception has a long history in neuroscience and philosophy. Here, we outline a novel approach to this issue, arguing that it should be viewed within the framework of top-down information-processing. This approach leads to a reversal of the standard explanatory order of the cognitive penetration debate: we suggest studying top-down processing at various levels without preconceptions of perception or cognition. Once a clear picture has emerged about which processes have influences on those (...) at lower levels, we can re-address the extent to which they should be considered perceptual or cognitive. Using top-down processing within the visual system as a model for higher-level influences, we argue that the current evidence indicates clear constraints on top-down influences at all stages of information processing; it does, however, not support the notion of a boundary between specific types of information-processing as proposed by the cognitive impenetrability hypothesis. (shrink)

CONTENT Introduction .................................................................................. 9 1. The unexpected: “Epistemologically Different Worlds” .......... 15 1.1 Introduction ........................................................................ 15 1.2 Definitions .......................................................................... 16 1.3 Propositions for its .............................................................. 18 1.4 Propositions for Its and being ............................................ 24 1.5 The hyperverse ................................................................... 30 2. A general view on cognitive neuroscience................................ 37 3. Optimism for localization and the “mind reading”................... 58 3.1 Bechtel’s optimism ............................................................. 58 3.2 Gallant’s laboratory work................................................... 67 3.3 Other optimistic works ....................................................... 75 4. Skepticism in cognitive neuroscience....................................... 81 4.1 (...) Hardcastle’s skepticism ...................................................... 81 4.2 Uttal’s skepticism ............................................................... 88 5. Blood-oxygen-level-dependent (BOLD) of fMRI and local field potentials (LFPs)............................................................. 107 6. The localization problem (segmentation vs. integration) ......... 126 7. The binding problem ................................................................ 138 7.1 Introduction ....................................................................... 138 7.2 The “Feature-Integration Theory” (FIT)............................. 146 7.3 The synchrony or temporal coding theory (temporal binding). 153 7.3.1 Oscillations – a general framework ....................... 153 7.3.2 More details about frequency bands, activated neural areas and cognitive functions ........................ 160 8 7.3.3 Gamma range in visual cognition ............................. 168 7.3.4 Communication among neural areas through synchronized oscillations.......................................... 177 7.3.5 The main critics for temporal coding hypothesis... 187 8. Perception and object recognition ........................................... 194 8.1 Perception and object recognition.................................... 194 8.2 A few words about other notions in cognitive neuroscience .................................................................... 210 9. Space and the mind................................................................... 218 10. Crossmodal interactions ......................................................... 244 11. Holism in cognitive neuroscience........................................... 254 11.1 The parts-whole relationship ........................................... 254 11.2 Raichle’s default network............................................... 269 11.3 Conscious and unconscious mental states...................... 278 12. Fingelkurts’ approach or the status of cognitive neuroscience........................................................................... 293 Conclusion: The status of cognitive neuroscience: “No ontology landscape”..................................... 317. (shrink)

Perception is a first-person internal sensation induced within the nervous system at the time of arrival of sensory stimuli from objects in the environment. Lack of access to the first-person properties has limited viewing perception as an emergent property and it is currently being studied using third-person observed findings from various levels. One feasible approach to understand its mechanism is to build a hypothesis for the specific conditions and required circuit features of the nodal points where the mechanistic operation of (...) perception take place for one type of sensation in one species and to verify it for the presence of comparable circuit properties for perceiving a different sensation in a different species. The present work explains visual perception in mammalian nervous system from a first-person frame of reference and provides explanations for the homogeneity of perception of visual stimuli above flicker fusion frequency, the perception of objects at locations different from their actual position, the smooth pursuit and saccadic eye movements, the perception of object borders, and perception of pressure phosphenes. Using results from temporal resolution studies and the known details of visual cortical circuitry, explanations are provided for (a) the perception of rapidly changing visual stimuli, (b) how the perception of objects occurs in the correct orientation even though, according to the third-person view, activity from the visual stimulus reaches the cortices in an inverted manner and (c) the functional significance of well-conserved columnar organization of the visual cortex. A comparable circuitry detected in a different nervous system in a remote species-the olfactory circuitry of the fruit fly Drosophila melanogaster-provides an opportunity to explore circuit functions using genetic manipulations, which, along with high-resolution microscopic techniques and lipid membrane interaction studies, will be able to verify the structure-function details of the presented mechanism of perception. (shrink)

Though the following problem is not explicitly raised by her, it seems sufficiently similar to an issue of pertinence to Akins's "Black and White and Color" (this volume) to merit the moniker, Akins's Problem : Can there be a visual experience devoid of both color phenomenology and black-and-white phenomenology? The point of the present paper is to draw from Akins's paper the materials needed to sketch a case for a positive answer to Akins's Problem. I am unsure about how (...) much of what follows Akins will want to endorse, but I hope this helps move us forward in our collective pursuit of a theory of visual consciousness. (shrink)

This paper discusses the empirical findings concerning the visual aesthetic experience in a neurological context. Accordingly, the aim of this paper is to shed light on the common ground across neuroscience, psychology, and philosophy to pave new roads for empirical research. Cognitive models posit that the brain employs neural networks mediating bottom-up and top- down processes, and in effect, engenders emotion and reward throughout the visual aesthetic experience. Likewise, empathy and its corresponding recruitment of bodily processes may (...) facilitate the understanding of a visual artwork’s depicted emotion, which may allow the viewer to engage with the visual artwork from a psychological distance and, consequently, to experience pleasure regardless of the visual artwork’s emotional content. In conclusion, empathetic processes may be central to the visual aesthetic experience and should be considered by future empirical research investigating the visual aesthetic experience. (shrink)

Planar geometry was exploited for the computation of symmetric visual curves in the image plane, with consistent variations in local parameters such as sagitta, chordlength, and the curves’ height-to-width ratio, an indicator of the visual area covered by the curve, also called aspect ratio. Image representations of single curves (no local image context) were presented to human observers to measure their visual sensation of curvature magnitude elicited by a given curve. Nonlinear regression analysis was performed on both (...) the individual and the average data using two types of model: (1) a power function where. (shrink)

The concept of the receptive field, first articulated by Hartline, is central to visual neuroscience. The receptive field of a neuron encompasses the spatial and temporal properties of stimuli that activate the neuron, and, as Hubel and Wiesel conceived of it, a neuron’s receptive field is static. This makes it possible to build models of neural circuits and to build up more complex receptive fields out of simpler ones. Recent work in visual neurophysiology is providing evidence that (...) the classical receptive field is an inaccurate picture. The receptive field seems to be a dynamic feature of the neuron. In particular, the receptive field of neurons in V1 seems to be dependent on the properties of the stimulus. In this paper, we review the history of the concept of the receptive field and the problematic data. We then consider a number of possible theoretical responses to these data. (shrink)

This book consists of an edited collection of original essays of the highest academic quality by seasoned experts in their fields of cognitive science. The essays are interdisciplinary, drawing from many of the fields known collectively as “the cognitive sciences.” Topics discussed represent a significant cross-section of the most current and interesting issues in cognitive science. Specific topics include matters regarding machine learning and cognitive architecture, the nature of cognitive content, the relationship of information to cognition, the role of language (...) and communication in cognition, the nature of embodied cognition, selective topics in visual cognition, brain connectivity, computation and simulation, social and technological issues within the cognitive sciences, and significant issues in the history of neuroscience. This book will be of interest to both professional researchers and newer students and graduate students in the fields of cognitive science—including computer science, linguistics, philosophy, psychology and neuroscience. The essays are in English and are designed to be as free as possible of technical jargon and therefore accessible to young scholars and to scholars who are new to the cognitive neurosciences. In addition to several entries by single authors, the book contains several interesting roundtables where researchers contribute answers to a central question presented to those in the focus group on one of the core areas listed above. This exciting approach provides a variety of perspectives from across disciplines on topics of current concern in the cognitive sciences. (shrink)

Neuroscience investigates how neuronal processing circuits work, but it has problems explaining experiences this way. For example, it hasn’t explained how colour and shape circuits bind together in visual processing, nor why colours and other qualia are experienced so differently yet processed by circuits so similarly, nor how to get from processing circuits to pictorial images spread across inner space. Some theorists turn from these circuits to their electromagnetic fields to deal with such difficulties concerning the mind’s qualia, (...) unity, privacy, and causality. They include Kohler, Libet, Popper, Lindahl, Arhem, Charman, Pockett, John, McFadden, Fingelkurts, Maxwell, and Jones. They’re classifiable as computationalist, reductionist, dualist, realist, interactionist, epiphenomenalist, globalist, and localist. However, they’ve never been analysed together as a whole, which hinders evaluations of them. This article tries to rectify this. It concludes that while field theories face challenges, they aren’t easily dismissed, for they draw on considerable evidence and may avoid serious problems in neuroscience concerning the mind’s qualia, unity, causality, and ontology. (shrink)

We present a technique for the analysis of pattern formation by a class of models for the formation of ocular dominance stripes in the striate cortex of some mammals. The method, which employs the adiabatic approximation to derive a set of ordinary differential equations for patterning modes, has been successfully applied to reaction-diffusion models for striped patterns [1]. Models of ocular dominance stripes have been studied [2,3] by computation, or by linearization of the model equations. These techniques do not provide (...) a rationale for the origin of the stripes. We show here that stripe formation is a non-linear property of the models. Our analysis indicates that stripe selection is closely linked to a property in the dynamics of the models which arises from a symmetry between ipsilateral and contralateral synapses to the visual cortex of a given hemisphere. (shrink)

The segregation of image parts into foreground and background is an important aspect of the neural computation of 3D scene perception. To achieve such segregation, the brain needs information about border ownership; that is, the belongingness of a contour to a specific surface represented in the image. This article presents psychophysical data derived from 3D percepts of figure and ground that were generated by presenting 2D images composed of spatially disjoint shapes that pointed inward or outward relative to the continuous (...) boundaries that they induced along their collinear edges. The shapes in some images had the same contrast (black or white) with respect to the background gray. Other images included opposite contrasts along each induced continuous boundary. Psychophysical results demonstrate conditions under which figure-ground judgment probabilities in response to these ambiguous displays are determined by the orientation of contrasts only, not by their relative contrasts, despite the fact that many border ownership cells in cortical area V2 respond to a preferred relative contrast. Studies are also reviewed in which both polarity-specific and polarity-invariant properties obtain perceptual figure-ground grouping results. The FACADE and 3D LAMINART models are used to explain these data. Keywords: figure-ground separation, border ownership, perceptual grouping, surface filling-in, V2, V4, FACADE Theory. (shrink)

Perceptual neuroscience has identified mechanisms of perceptual grouping which account for the ways in which visual sensitivity to ordered structure and regularities expresses itself, in behavior and in the brain. The need to actively construct order, notably representations of objects in depth, is mandated as soon as visual signals reach the retina, given the occlusion of retinal signals by retinal veins and other retinal elements or blur. Multiple stages of neural processing transform fragmented signals into visual (...) key representations of 3D scenes that can be used to control effective behaviors. Since our survival depends on our ability to pick up order in the physical world, and since we conceive the physical world as an ordered one, our perception must somehow be sensitive to order. The articles from this collection illustrate how texture dissimilarity, boundary completion, surface filling-in, and figure-ground segregation generate perceptual order. (shrink)

The topic of the human face is addressed from a biocultural perspective, focusing on the empirical investigation of how the face is represented, perceived, and evaluated in artistic portraits and self-portraits from the XVth to the XVIIth century. To do so, the crucial role played by the human face in social cognition is introduced, starting from development, showing that neonatal facial imitation and face-to-face dyadic interactions provide the grounding elements for the construction of intersubjective bonds. The neuroscience of face (...) perception is concisely presented and discussed, together with the psychophysics of face perception and gaze exploration, introducing the notions of the left visual field advantage and the left gaze bias. The results of experiments on the perception and the emotional and aesthetic rating of artistic portraits and self-portraits are reported, showing that despite participants’ inability to tell self-portraits and portraits apart, greater emotional, communicative-social, and aesthetic ratings were attributed to self-portraits. It is concluded that neuroscience and experimental aesthetics can contribute to better understand the human face, hence to better understand ourselves. (shrink)

In this article I raise empirical challenges for the claim tha area MT/V5 is the neural correlate for visual experience as of motion (Block 2005). In particular, I focus on the claim that there is matching content between area MT, on one hand, and visual experience as of motion, on the other hand (Chalmers 2000, Block 2007). I survey two lines of empirical evidence which challenge the claim of matching content in area MT. The first line of evidence (...) covers new results in neuroscience which emphasize the ongoing dynamics in cortical activity. The second line of evidence focuses on results regarding area MT in particular (Maier et al. 2007 and Cohen and Newsome 2008). Together, the empirical results indicate that neural processing is context sensitive in a way that challenges the attribution of content to local areas of cortex, to area MT in particular. In the final part of the article I explore alternative approaches and discuss remaining issues. (shrink)

Do have pictures an impact on future? Yes, say theories of embodiment by making perceptual foundations in place of representational arrangements responsible for it. -/- Wirken sich Bildern auf die Zukunft aus? Ja sagen Verkörperungstheorien und machen dafür weniger Repräsentationsmodelle als Wahrnehmungsweisen verantwortlich.

A central debate in philosophy and neuroscience pertains to whether PFC activity plays an essential role in the neural basis of consciousness. Neuroimaging and electrophysiology studies have revealed that the contents of conscious perceptual experience can be successfully decoded from PFC activity, but these findings might be confounded by post- perceptual cognitive processes, such as thinking, reasoning, and decision-making, that are not necessary for con- sciousness. To clarify the involvement of the PFC in consciousness, we present a synthesis of (...) research that has used intracranial electrical stimulation (iES) for the causal modulation of neural activity in the human PFC. This research provides compelling evidence that iES of only certain prefrontal regions (i.e., orbitofrontal cortex and anterior cingu- late cortex) reliably perturbs conscious experience. Conversely, stimulation of anterolateral prefrontal sites, often con- sidered crucial in higher-order and global workspace theories of consciousness, seldom elicits any reportable alterations in consciousness. Furthermore, the wide variety of iES-elicited effects in the PFC (e.g., emotions, thoughts, and olfactory and visual hallucinations) exhibits no clear relation to the immediate environment. Therefore, there is no evidence for the kinds of alterations in ongoing perceptual experience that would be predicted by higher-order or global workspace theories. Nevertheless, effects in the orbitofrontal and anterior cingulate cortices suggest a specific role for these PFC subregions in supporting emotional aspects of conscious experience. Overall, this evidence presents a challenge for higher-order and global workspace theories, which commonly point to the PFC as the basis for con- scious perception based on correlative and possibly confounded information. (shrink)

Explanatory pluralism holds that the sorts of comprehensive theoretical and ontological economies, which microreductionists and New Wave reductionists envision and which antireductionists fear, offer misleading views of both scientific practice and scientific progress. Both advocates and foes of employing reductionist strategies at the interface of psychology and neuroscience have overplayed the alleged economies that interlevel connections (including identities) justify while overlooking their fundamental role in promoting scientific research. A brief review of research on visual processing provides support for (...) the explanatory pluralist=s general model of cross-scientific relations and discloses the valuable heuristic role hypothetical identities play in cross-scientific research. That model also supplies grounds for hesitation about the correlation objection to the psycho-physical identity theory and complaints about an explanatory gap in physicalist accounts of consciousness. These takes on psycho-neural connections miss both the sorts of considerations that motivate hypothetical identities in science and their fundamental contribution to progressive research. Thus, their focus on the contributions of research at multiple levels of analysis does not bar explanatory pluralists from considering heuristic identity theory (HIT). Arguably, it encourages it. (shrink)

A theory of the structure and cognitive function of the human imagination that attempts to do justice to traditional intuitions about its psychological centrality is developed, largely through a detailed critique of the theory propounded by Colin McGinn. Like McGinn, I eschew the highly deflationary views of imagination, common amongst analytical philosophers, that treat it either as a conceptually incoherent notion, or as psychologically trivial. However, McGinn fails to develop his alternative account satisfactorily because (following Reid, Wittgenstein and Sartre) he (...) draws an excessively sharp, qualitative distinction between imagination and perception, and because of his flawed, empirically ungrounded conception of hallucination. His arguments in defense of these views are rebutted in detail, and the traditional, passive, Cartesian view of visual perception, upon which several of them implicitly rely, is criticized in the light of findings from recent cognitive science and neuroscience. It is also argued that the apparent intuitiveness of the passive view of visual perception is a result of mere historical contingency. An understanding of perception (informed by modern visual science) as an inherently active process enables us to unify our accounts of perception, mental imagery, dreaming, hallucination, creativity, and other aspects of imagination within a single coherent theoretical framework. (shrink)

When approaching the nature and etiology of psychophysical problems in a given population, it is important to understand the causal relations, the mechanisms, and the processes which underlie given problems, issues, and disorders. This examination attempts to investigate the connection between neural pathophysiology and proprioceptive ontology of olfactory and visual cortical circuitry on the basis of the current scientific evidence indicated by the results of studies in which subjects underwent a series of therapeutic modalities focused on the improvement of (...) overall wellbeing with the utilization of devices and technologies to stimulate multiple motor vs. somatosensory processes. More specifically, the studies at the centers of this analysis incorporated physical movement and virtual reality interactions, with the supplement of olfactory stimulation. In this examination, such research is also investigated from a theoretical standpoint, with the ultimate goal to better determine which interventions are justified under the premise of a mutual support between empirical values (through laboratory examination) and logical deduction (via philosophical investigation). (shrink)

One of the most compelling questions still unanswered in neuroscience is how consciousness arises. In this article, we examine visual processing, the parietal lobe, and contralateral neglect syndrome as a window into consciousness and how the brain functions as the mind and we introduce a mechanism for the processing of visual information and its role in consciousness. We propose that consciousness arises from integration of information from throughout the body and brain by the thalamus and that the (...) thalamus reimages visual and other sensory information from throughout the cortex in a default three-dimensional space in the mind. We further suggest that the thalamus generates a dynamic default three-dimensional space by integrating processed information from corticothalamic feedback loops, creating an infrastructure that may form the basis of our consciousness. Further experimental evidence is needed to examine and support this hypothesis, the role of the thalamus, and to further elucidate the mechanism of consciousness. (shrink)

In my dissertation I critically survey existing theories of time consciousness, and draw on recent work in neuroscience and philosophy to develop an original theory. My view depends on a novel account of temporal perception based on the notion of temporal qualities, which are mental properties that are instantiated whenever we detect change in the environment. When we become aware of these temporal qualities in an appropriate way, our conscious experience will feature the distinct temporal phenomenology that is associated (...) with the passing of time. The temporal qualities model of perception makes two predictions about the mechanisms of time perception; one that time perception is modality specific and the other that it can occur without awareness. My argument for this view partially depends on a number of psychophysical experiments that I designed and implemented myself and which investigate subjective time distortions caused by looming visual stimuli. These results show that the mechanisms of conscious experience of time are distinct from the mechanisms of time perception, as my theory of temporal qualities predicts. (shrink)

Extended reality devices provide users with unprecedented immersive and hybrid perceptual experiences, and users will act their bodies according to the information perceived. This shows that visual perception plays a crucial role in the formation and shaping of self-perception and spatial position. Users have a strong perceptual experience of their physical presence and self-perception in the real world as a result of their avatar perspective based on visual perception in a virtual hybrid environment, as is issued by Chalmers (...) in his "Mirror Argument". However, users can still clearly differentiate their self and spatial experience between virtual and reality. To refute Chalmers' argument regarding perceptual experience in virtual reality, this article proposes a thought experiment called "Mary's Room in the Virtual Reality World" based on the experimental evidence of neuroscience. Finally, a possible future solution to this dilemma is presented. (shrink)

First described by Galton in 1880 and then remaining unnoticed for a century, recent investigations in neuroscience have shown that a condition called aphantasia appears in certain individuals, which causes them to be unable to experience visual mental imagery. Comparing aphantasia to hyperphantasia – i.e., photo-like memory – and considering the neurological basis of perceptual phenomena, we are revisiting Hume's division of perceptions into impressions and ideas. By showing different vivacities of mental phenomena and comparing them to neurological (...) research, we are stating that not only impressions and ideas differ "in the degrees of force and liveliness", but ideas and impressions amongst themselves as well. Such a gradual range of perceptions and mental images bears significant consequences for not only representational theory and historical interpretations, but linguistics and semiotics as well. (shrink)

Mental imagery is early perceptual processing that is not triggered by corresponding sensory stimulation in the relevant sense modality. Multimodal mental imagery is early perceptual processing that is triggered by sensory stimulation in a different sense modality. For example, when early visual or tactile processing is triggered by auditory sensory stimulation, this amounts to multimodal mental imagery. Pulling together philosophy, psychology and neuroscience, I will argue in this paper that multimodal mental imagery plays a crucial role in our (...) engagement with musical works. Engagement with musical works is normally a multimodal phenomenon, where we get input from a number of sense modalities. But even if we screen out any input that is not auditory, multimodal mental imagery will still play an important role that musicians and composers often actively rely on. (shrink)

A general definition of consciousness is: ‘consciousness is a mental aspect of a system or a process, which is a conscious experience, a conscious function, or both depending on the context’, where the term context refers to metaphysical views, constraints, specific aims, and so on. One of the aspects of visual consciousness is the visual subjective experience (SE) or the first person experience that occurs/emerges in the visual neural-network of thalamocortical system (which includes dorsal and ventral (...) class='Hi'>visual pathways and frontal cortex) during dynamic interactions among widely distributed neuronal groups. In this article, however, consciousness and SE are interchangeably used unless noted. Consciousness can be either access (reportable) or phenomenal consciousness. For access consciousness, the interactions are between feed forward stimulus dependent signals and fronto-parietal feedback attentional signals. The necessary ingredients for access (reportable) consciousness are (i) wakefulness, (ii) reentrant interactions among neural populations, (iii) fronto-parietal and thalamic-reticular-nucleus attentional signals that modulate consciousness, (iv) working memory that retains information for consciousness, (v) stimulus at or above threshold level, and (vi) neural-network proto-experiences (PEs) that are superposed SEs embedded in a neural-network. Attention and the ability to report are not necessary for phenomenal consciousness. The neural source for the arousal system is the ascending reticular activating system in the brain stem, which brings the thalamocortical neural networks to wakeful state as a baseline for consciousness to occur. Reentrant interactions among neural populations bind stimulus attributes (such as location and features) and entail consciousness. Attention could be the results of reentry and competitive interactions, and modulates the stimulus related feed forward signal and consciousness. The ‘sources’ of attention may be thalamic reticular nucleus for bottom-up or frontal cortex for top-down direction. The ‘target’ of visual attention is ‘V4/V8/VO’ for Red-Green (R-G) channel. The neural correlates of the psychophysical entity R-G channel appear to be ‘V4/V8/VO’-neural-network (retina → LGN ↔ V1 ↔ V2 ↔ ‘V4/V8/VO’, and areas for attention, memory, and wakefulness). The psychophysical Red-Green Channel, its neurophysiological correlates V4/V8/VO-neural-network, and related experience (such as redness) are integrated. The dual-aspect-dual-mode PE-SE framework (Vimal, J Integr Neurosci 7:49–73, 2008) was used to address the explanatory gap problem of materialism. Neural-network and related SEs are the results of the co-evolution and co-development of the material aspect (mass, charge, spin, force, quanta, and space-time) and the mental aspect of fundamental particles (strings or elementary particles (fermions and bosons)). Their mental aspects are considered as the carriers of superposed multiple possible experiences (SEs/PEs) in unexpressed form. These possibilities are actualized when neural-networks are formed via neural Darwinism, and a specific SE is selected by a matching process when the necessary ingredients of consciousness/SE are satisfied. A simple experimental design is suggested to address the necessary and sufficient attributes of consciousness. (shrink)

The human self has many facets: there is the physical body and then there are different concepts or representations supported by processes in the brain such as the ecological, social, temporal, conceptual, and experiential self. The mechanisms of operation and formation of the self are, however, largely unknown. The basis is constituted by the ecological or sensorimotor self that deals with the configuration of the body in space and its action possibilities. This self is prereflective, prelinguistic, and initially perhaps even (...) largely independent of visual inputs. Instead, somatosensory (tactile and proprioceptive) information both before and after birth may play a key part. In this paper, we propose that self-touch experience may be a fundamental mechanisms to bootstrap the formation of the sensorimotor self and perhaps even beyond. We will investigate this from the perspectives of phenomenology, developmental psychology, and neuroscience. In light of the evidence from fetus and infant development, we will speculate about the possible mechanisms that may drive the formation of first body representations drawing on self-touch experience. (shrink)

Skilled action typically requires that individuals guide their activities toward some goal. In skilled action, individuals do so excellently. We do not understand well what this capacity to guide consists in. In this paper I provide a case study of how individuals shift visual attention. Their capacity to guide visual attention toward some goal (partly) consists in an empirically discovered sub-system – the executive system. I argue that we can explain how individuals guide by appealing to the operation (...) of this sub-system. Understanding skill and skilled action thus requires appreciating the role of the executive system. (shrink)

This paper argues that the many and various conceptions of consciousness propounded by cognitive scientists and philosophers can all be understood as constituted with reference to four fundamental sorts of criterion: epistemic (concerned with kinds of consciousness), semantic (dealing with orders of consciousness), physiological (reflecting states of consciousness), and pragmatic (seeking to capture types of consciousness). The resulting four-fold taxonomy, intended to be exhaustive, suggests that all of the distinct varieties of consciousness currently encountered in cognitive neuroscience, the philosophy (...) of mind, clinical psychology, and other related fields ultimately refer to a unified natural process, analysed under four general aspects. The proposed taxonomy will, it is hoped, possess sufficient clarity to serve as a sound theoretical framework for further scientific studies, and to count as a significant step in the direction of a properly formulated unified concept of consciousness. (shrink)

In this book, well-known scholars describe new and exciting approaches to aesthetics, creativity, and psychology of the arts, approaching these topics from a point of view that is biological or related to biology and answering new questions with new methods and theories. All known societies produce and enjoy arts such as literature, music, and visual decoration or depiction. Judging from prehistoric archaeological evidence, this arose very early in human development. Furthermore, Darwin was explicit in attributing aesthetic sensitivity to lower (...) animals. These considerations lead us to wonder whether the arts might not be evolutionarily based. Although such an evolutionary basis is not obvious on the face of it, the idea has recently elicited considerable attention. The book begins with a consideration of ten theories on the evolutionary function of the arts, and this is followed by several chapters that consider the possible evolutionary function of specific arts such as music and literature. The theory of evolution was first drawn up in biology, but evolution is not confined to biology: genuinely evolutionary theories of sociocultural change can be formulated. That they need to be formulated is shown in several chapters that discuss regular trends in literature and scientific writings. Psychologists have recently rediscovered the obvious fact that thought and perception occur in the brain, so cognitive science moves ever closer to neuroscience. Several chapters give overviews of neurocognitive and neural network approaches to creativity and aesthetic appreciation. The book concludes with two exciting chapters describing brain-scan research on what happens in the brain during creativity and presenting a close examination of the relationship between genetically transmitted mental disorder and creativity. (shrink)

Everyday media consumption leaves no doubt that the perception of moving images from various media is characterized by experience and understanding. Corresponding research in this field has shown that the stimulus patterns flooding in on us are not only processed mentally, but also bodily. Building on this, the following study argues that incoming stimuli are processed not only visually, but multimodally, with all senses, and moreover affectively. The classical binding of a sensory organ to a medium, on whose delimitation the (...) common understanding of multimodality is based, is thus abolished. Can arguments for this assumption be found? Building on the research of cultural anthropologist Ernst Cassirer and his successors, the two American philosophers Susanne K. Langer and John M. Krois, and supported by research from the life sciences in which, in parallel, the arts also play an important role in understanding image formation, as in the work of Heinz Werner and, following on from this, in the more recent research of the child psychologist Daniel N. Stern in collaboration with mirror neuron research by the group of neuroscientists around Giacomo Rizzolatti in Parma, justifications for this will be provided. What the multimodal processing of film images is concretely based on will finally be made clear by means of an exemplary analysis of a video film by the Swiss artist Pipilotti Rist. It aims to prove, that the prerequisites for the thesis can only lie in the fact, that both the modes of perception (visual, tactile, auditory, olfactory, gustatory) as well as the medially conditioned modes of image formation are based on non-discursive, formal-abstract structures that are also processed affectively. At the same time, the analysis thus shows how the selection and composition of the vital experienced forms can provide information about the socio-culturally shaped self-image of the producer and the viewer. (shrink)

At the beginning of the 20th century, Gestalt psychologists put forward the concept of psychoneural isomorphism, which was meant to replace Fechner’s obscure notion of psychophysical parallelism and provide a heuristics that may facilitate the search for the neural correlates of the mind. However, the concept has generated much confusion in the debate, and today its role is still unclear. In this contribution, I will attempt a little conceptual spadework in clarifying the concept of psychoneural isomorphism, focusing exclusively on conscious (...) visual perceptual experience and its neural correlates. Firstly, I will outline the history of our concept, and its alleged metaphysical and epistemic roles. Then, I will clarify the nature of isomorphism and rule out its metaphysical role. Finally, I will review some epistemic roles of our concept, zooming in on the work of Jean Petitot, and suggest that it does not play a relevant heuristic role. I conclude suggesting that psychoneural isomorphism might be an indicator of robustness for certain mathematical descriptions of perceptual content. (shrink)

Along with hallucinations and illusions, afterimages have shaped the philosophical debate about the nature of perception. Often referred to as optical or visual illusions, experiences of afterimages have been abundantly exploited by philosophers to argue against naïve realism. This paper offers an alternative account to this traditional view by providing a tentative account of the colors of the afterimages from an objectivist perspective. Contrary to the widespread approach to afterimages, this paper explores the possibility that the colors of afterimages (...) are not ontologically different from “ordinary” colors and that experiences of afterimages fail to provide a motivation for rejecting naïve realism. (shrink)

Working memory, an important posit in cognitive science, allows one to temporarily store and manipulate information in the service of ongoing tasks. Working memory has been traditionally classified as an explicit memory system – that is, as operating on and maintaining only consciously perceived information. Recently, however, several studies have questioned this assumption, purporting to provide evidence for unconscious working memory. In this paper, we focus on visual working memory and critically examine these studies as well as studies of (...) unconscious perception that seem to provide indirect evidence for unconscious working memory. Our analysis indicates that current evidence does not support an unconscious working memory store, though we offer independent reasons to think that working memory may operate on unconsciously perceived information. (shrink)

For many years there has been a debate about the role of the parietal lobe in the generation of behavior. Does it generate movement plans (intention) or choose objects in the environment for further processing? To answer this, we focus on the lateral intraparietal area (LIP), an area that has been shown to play independent roles in target selection for saccades and the generation of visual attention. Based on results from a variety of tasks, we propose that LIP acts (...) as a priority map in which objects are represented by activity proportional to their behavioral priority. We present evidence to show that the priority map combines bottom-up inputs like a rapid visual response with an array of top-down signals like a saccade plan. The spatial location representing the peak of the map is used by the oculomotor system to target saccades and by the visual system to guide visual attention. (shrink)

Freud proposes that in unconscious processing, logical connections are also (heavily) based upon phonological similarities. Repressed concerns, for example, would also be expressed by way of phonologic ambiguity. In order to investigate a possible unconscious influence of phonological similarity, 31 participants were submitted to a tachistoscopic subliminal priming experiment, with prime and target presented at 1ms. In the experimental condition, the prime and one of the 2 targets were phonological reversed forms of each other, though graphemically dissimilar (e.g., “nice” and (...) “sign”); in the control condition the targets were pseudo-randomly attributed to primes to which they don’t belong. The experimental task was to “blindly” pick the choice most similar to the prime. ERPs were measured with a focus on the N320, which is known to react selectively to phonological mismatch in supraliminal visual word presentations. The N320 amplitude-effects at the electrodes on the midline and at the left of the brain significantly predicted the participants’ net behavioral choices more than half a second later, while their subjective experience is one of arbitrariness. Moreover, the social desirability score (SDS) significantly correlates with both the behavioral and the N320 brain responses of the participants. It is proposed that in participants with low SDS the phonological target induces an expected reduction of N320 and this increases their probability to pick this target. In contrast, high defensive participants have a perplexed brain reaction upon the phonological target, with a negatively peaking N320 as compared to control and this leads them to avoid this target more often. Social desirability, which is understood as reflecting defensiveness, might also manifest itself as a defense against the (energy-consuming) ambiguity of language. The specificity of this study is that all of this is happening totally out of awareness and at the level of very elementary linguistic distinctions. (shrink)

Higher-Order Thought (HOT) theories of consciousness maintain that the kind of awareness necessary for phenomenal consciousness depends on the cognitive accessibility that underlies reporting. -/- There is empirical evidence strongly suggesting that the cognitive accessibility that underlies the ability to report visual experiences depends on the activity of the dorsolateral prefrontal cortex (dlPFC). This area, however, is highly deactivated during the conscious experiences we have during sleep: dreams. HOT theories are jeopardized, as I will argue. I will briefly present (...) HOT theories in the first section. Section 2 offers empirical evidence to the effect that the cognitive accessibility that underlies the ability to report depends on the dorsolateral prefrontal cortex: dlPFC is the neural correlate of HOTs. Section 3 shows the evidence we have of the deactivation of this brain area during dreams and, in section 4, I present my argument. Finally, I consider and rejoin two possible replies that my opponent can offer: the possibility of an alternative neural correlate of HOTs during dreams and the denial that we have phenomenally conscious experiences during sleep. (shrink)

In the case of ventriloquism, seeing the movement of the ventriloquist dummy’s mouth changes your experience of the auditory location of the vocals. Some have argued that cases like ventriloquism provide evidence for the view that at least some of the content of perception is fundamentally multimodal. In the ventriloquism case, this would mean your experience has constitutively audio-visual content (not just a conjunction of an audio content and visual content). In this paper, I argue that cases like (...) ventriloquism do not in fact warrant that conclusion. I then try to make sense of crossmodal cases without appealing to fundamentally multimodal content. (shrink)

A recent fMRI study by Webb et al. (Cortical networks involved in visual awareness independent of visual attention, Proc Natl Acad Sci U S A 2016;113:13923–28) proposes a new method for finding the neural correlates of awareness by matching atten- tion across awareness conditions. The experimental design, however, seems at odds with known features of attention. We highlight logical and methodological points that are critical when trying to disentangle attention and awareness.

Recent advances in neuroimaging technologies have rendered multimodal analysis of operators’ cognitive processes in complex task settings and environments increasingly more practical. In this exploratory study, we utilized optical brain imaging and mobile eye tracking technologies to investigate the behavioral and neurophysiological differences among expert and novice operators while they operated a human-machine interface in normal and adverse conditions. In congruence with related work, we observed that experts tended to have lower prefrontal oxygenation and exhibit gaze patterns that are better (...) aligned with the optimal task sequence with shorter fixation durations as compared to novices. These trends reached statistical significance only in the adverse condition where the operators were prompted with an unexpected error message. Comparisons between hemodynamic and gaze measures before and after the error message indicated that experts’ neurophysiological response to the error involved a systematic increase in bilateral dorsolateral prefrontal cortex (dlPFC) activity accompanied with an increase in fixation durations, which suggests a shift in their attentional state, possibly from routine process execution to problem detection and resolution. The novices’ response was not as strong as that of experts, including a slight increase only in the left dlPFC with a decreasing trend in fixation durations, which is indicative of visual search behavior for possible cues to make sense of the unanticipated situation. A linear discriminant analysis model capitalizing on the covariance structure among hemodynamic and eye movement measures could distinguish experts from novices with 91% accuracy. Despite the small sample size, the performance of the linear discriminant analysis combining eye fixation and dorsolateral oxygenation measures before and after an unexpected event suggests that multimodal approaches may be fruitful for distinguishing novice and expert performance in similar neuroergonomic applications in the field. (shrink)

Recent advances in neuroimaging technologies have rendered multimodal analysis of operators’ cognitive processes in complex task settings and environments increasingly more practical. In this exploratory study, we utilized optical brain imaging and mobile eye tracking technologies to investigate the behavioral and neurophysiological differences among expert and novice operators while they operated a human-machine interface in normal and adverse conditions. In congruence with related work, we observed that experts tended to have lower prefrontal oxygenation and exhibit gaze patterns that are better (...) aligned with the optimal task sequence with shorter fixation durations as compared to novices. These trends reached statistical significance only in the adverse condition where the operators were prompted with an unexpected error message. Comparisons between hemodynamic and gaze measures before and after the error message indicated that experts’ neurophysiological response to the error involved a systematic increase in bilateral dorsolateral prefrontal cortex (dlPFC) activity accompanied with an increase in fixation durations, which suggests a shift in their attentional state, possibly from routine process execution to problem detection and resolution. The novices’ response was not as strong as that of experts, including a slight increase only in the left dlPFC with a decreasing trend in fixation durations, which is indicative of visual search behavior for possible cues to make sense of the unanticipated situation. A linear discriminant analysis model capitalizing on the covariance structure among hemodynamic and eye movement measures could distinguish experts from novices with 91% accuracy. Despite the small sample size, the performance of the linear discriminant analysis combining eye fixation and dorsolateral oxygenation measures before and after an unexpected event suggests that multimodal approaches may be fruitful for distinguishing novice and expert performance in similar neuroergonomic applications in the field. (shrink)

Patient suffering of major depressive disorder (MDD) often complain that subjective time seems to “drag” with respect to physical time. This may point toward a generalized dysfunction of temporal processing in MDD. In the present study, we investigated temporal preparation in MDD. “Temporal preparation” refers to an increased readiness to act before an expected event; consequently, reaction time should be reduced. MDD patients and age-matched controls were required to make a saccadic eye movement between a central and an eccentric (...) class='Hi'>visual target after a variable duration preparatory period. We found that MDD patients produced a larger number of premature saccades, saccades initiated prior to the appearance of the expected stimulus. These saccades were not temporally controlled; instead, they seemed to reflect reduced inhibitory control causing oculomotor impulsivity. In contrast, the latency of visually guided saccades was strongly influenced by temporal preparation in controls; significantly less so, in MDD patients. This observed reduced temporal preparation in MDD was associated with a faster decay of short-term temporal memory. Moreover, in patients producing a lot of premature responses, temporal preparation to early imperative stimuli was increased. In conclusion, reduced temporal preparation and short-term temporal memory in the oculomotor domain supports the hypothesis that temporal processing was altered in MDD patients. Moreover, oculomotor impulsivity interacted with temporal preparation. These observed deficits could reflect other underlying aspects of abnormal time experience in MDD. (shrink)

Current research on the various forms of autoscopic phenomena addresses the clinical and neurological correlates of out-of-body experiences, autoscopic hallucinations,and heautoscopy. Yet most of this research is based on functional magnetic resonance imaging results and focuses predominantly on abnormal cortical activity. Previously we proposed that visual consciousness resulted from the dynamic retinogeniculo-cortical oscillations, such that the photoreceptors dynamically integrated with visual and other vision-associated cortices, and was theorized to be mapped out by photoreceptor discs and rich retinal networks (...) which synchronized with the retinotopic mapping and the associated cortex. The feedback from neural input that is received from the thalamus and cortex via retinogeniculo-cortical oscillations and sent to the retina is multifold higher than feed-forward input to the cortex. This can effectively translate into out-of-body experiences projected onto the screen formed by the retina as it is perceived via feedback and feed-forward oscillations from the reticular thalamic nucleus, or “internal searchlight”. This article explores the role of the reticular thalamic nucleus and the retinogeniculo-cortical oscillations as pivotal internal components in vision and various autoscopic phenomena. (shrink)