This is an excerpt from a report that highlights and explores five questions which arose from the workshop on perceptual learning and perceptual recognition at the University of Toronto, Mississauga on May 10th and 11th, 2012. This excerpt explores the question: Does our representation of time provide and amodal framework for multi-sensory integration?

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: Is the mechanism of sensory integration spatio-temporal?

Based on but not limited to material from a conference at Brown University in 2011, Sensory Integration and the Unity of Consciousness is an ambitious collection that brings together two distinct but inter- twined topics.1 In what follows, I briefly explain what sensory integration and the unity of conscious- ness amount to, highlight the contents of the papers, and finally end with general observations and suggestions. I will spend more time on sensory integration, since (...) it is relatively unfamiliar terrain in philosophy. (shrink)

This report highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011: 1. What is the relationship between the unity of consciousness and sensory integration? 2. Are some of the basic units of consciousness multimodal? 3. How should we model the unity of consciousness? 4. Is the mechanism of sensory integration spatio-temporal? 5. How Should We Study Experience, Given Unity Relations?

What if a blind person could 'see' with her ears? Thanks to Sensory Substitution Devices (SSDs), blind people now have access to out-of-reach objects, a privilege reserved so far for the sighted. In this paper, we show that the philosophical debates have fundamentally been mislead to think that SSDs should be fitted among the existing senses or that they constitute a new sense. Contrary to the existing assumption that they get integrated at the sensory level, we present a (...) new thesis according to which they are not sensory, and get vertically integrated on the top of existing sensory abilities, from which they should be theoretically distinguished. (shrink)

When a user integrates a sensory substitution device into her life, the process involves perceptual learning, that is, ‘relatively long-lasting changes to an organism’s perceptual system that improve its ability to respond to its environment’ (Goldstone 1998: 585). In this paper, I explore ways in which the extensive literature on perceptual learning can be applied to help improve sensory substitution devices. I then use these findings to answer a philosophical question. Much of the philosophical debate surrounding sensory (...) substitution devices concerns what happens after perceptual learning occurs. In particular, should the resultant perceptual experience be classified in the substituted modality (as vision), in the substituting modality (as auditory or tactile), or in a new sense modality? I propose a novel empirical test to help resolve this philosophical debate. (shrink)

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: Are some of the basic units of consciousness multimodal?

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: How should we study experience, given unity relations?

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: How should we model the unity of consciousness?

It is typically assumed that while we know other people’s mental states by observing and interpreting their behavior, we know our own mental states by introspection, i.e., without interpreting ourselves. In his latest book, The opacity of mind: An integrative theory of self-knowledge, Peter Carruthers (2011) argues against this assumption. He holds that findings from across the cognitive sciences strongly suggest that self-knowledge of conscious propositional attitudes such as intentions, judgments, and decisions involves a swift and unconscious process of self-interpretation (...) that utilizes the same sensory channels that we employ when working out other people’s mental states. I provide an overview of Carruthers’ book before discussing a pathological case that challenges his account of self-knowledge and mentioning empirical evidence that undermines his use of a particular kind of data in his case against introspection of conscious attitudes. (shrink)

Our emotional states affect how we perceive the world. If I am stressed, annoyed, or irritated, I might experience the sound of children laughing and screaming as they play around the house in a negative manner — it is unpleasant, loud, piercing, and so on. Yet, if I’m in a relaxed, happy, loving mood, the very same sounds might be experienced as pleasant, playful, warm, and so on. The sounds being made by the children are the same in both cases, (...) but how they are experienced differs. The auditory experience is affected by the emotional state that I am in. I perceive the sounds differently depending on how I’m feeling. Although this might at first seem to be a trivial observation, it certainly is not. We take for granted that our perceptual experiences give rise to justified beliefs and knowledge. Thus, if my perceptual experience of an object can differ based on my emotional state, and I take my perceptual experience to justify my beliefs and even lead to knowledge, then we might have a problem. If emotions — which are not fixed and in large part uncontrolled — affect our ability to accurately perceive the world, then they may undermine the justified beliefs and knowledge gained on the basis of our perceptual experience of the world. My goal here is to explore this potential problem. -/- I consider how we might understand the effect that emotions have on the justification of our perceptual beliefs about the world, beliefs that we acquire from a variety of sensory modalities — audition, gustation olfaction, and so on. I take the problem to be associated with one of two forms of perceptual influence: penetration or multisensory integration. In any given perceptual moment there are multiple sensory modalities and mental states at play, each affecting the overall experience. Whether we understand the influence of emotion on perception as a form of non-perceptual penetration or a form of non-visual sensory perception of the inner body — interoception — the potential epistemological difficulties remain: how can we be said to acquire justified beliefs and knowledge on the basis of such influenced perceptual experience. As has been the norm, only the five exteroceptive senses of vision, audition, olfaction, taste and touch are typically discussed in the context of sensory perception. However, as I argue, there is strong reason to accept the claim that emotional experience is a form of interoception, and that interoception ought to be considered when discussing sensory perception. In this way, then, I propose that clarifying the role played by interoception in sense perception across modalities is necessary if we are to make progress on the epistemological problems at hand. (shrink)

The visuospatial system integrates inner and outer functional processes, organizing spatial, temporal, and social interactions between the brain, body, and environment. These processes involve sensorimotor networks like the eye–hand circuit, which is especially important to primates, given their reliance on vision and touch as primary sensory modalities and the use of the hands in social and environmental interactions. At the same time, visuospatial cognition is intimately connected with memory, self-awareness, and simulation capacity. In the present article, we review issues (...) associated with investigating visuospatial integration in extinct human groups through the use of anatomical and behavioral data gleaned from the paleontological and archaeological records. In modern humans, paleoneurological analyses have demonstrated noticeable and unique morphological changes in the parietal cortex, a region crucial to visuospatial management. Archaeological data provides information on hand–tool interaction, the spatial behavior of past populations, and their interaction with the environment. Visuospatial integration may represent a critical bridge between extended cognition, self-awareness, and social perception. As such, visuospatial functions are relevant to the hypothesis that human evolution is characterized by changes in brain–body–environment interactions and relations, which enhance integration between internal and external cognitive components through neural plasticity and the development of a specialized embodiment capacity. We therefore advocate the investigation of visuospatial functions in past populations through the paleoneurological study of anatomical elements and archaeological analysis of visuospatial behaviors. (shrink)

This paper attempts to answer a central question in unsupervised learning: what does it mean to “make sense” of a sensory sequence? In our formalization, making sense involves constructing a symbolic causal theory that both explains the sensory sequence and also satisfies a set of unity conditions. The unity conditions insist that the constituents of the causal theory – objects, properties, and laws – must be integrated into a coherent whole. On our account, making sense of sensory (...) input is a type of program synthesis, but it is unsupervised program synthesis. Our second contribution is a computer implementation, the Apperception Engine, that was designed to satisfy the above requirements. Our system is able to produce interpretable human-readable causal theories from very small amounts of data, because of the strong inductive bias provided by the unity conditions. A causal theory produced by our system is able to predict future sensor readings, as well as retrodict earlier readings, and impute (fill in the blanks of) missing sensory readings, in any combination. In fact, it is able to do all three tasks simultaneously. We tested the engine in a diverse variety of domains, including cellular automata, rhythms and simple nursery tunes, multi-modal binding problems, occlusion tasks, and sequence induction intelligence tests. In each domain, we test our engine's ability to predict future sensor values, retrodict earlier sensor values, and impute missing sensory data. The Apperception Engine performs well in all these domains, significantly out-performing neural net baselines. We note in particular that in the sequence induction intelligence tests, our system achieved human-level performance. This is notable because our system is not a bespoke system designed specifically to solve intelligence tests, but a general-purpose system that was designed to make sense of any sensory sequence. (shrink)

This report highlights and explores five questions which arose from the workshop on perceptual learning and perceptual recognition at the University of Toronto, Mississauga on May 10th and 11th, 2012: 1. How should we demarcate perceptual learning from perceptual development? 2. What are the origins of multimodal associations? 3. Does our representation of time provide an amodal framework for multi-sensory integration? 4. What counts as cognitive penetration? 5. How can philosophers and psychologists most fruitfully collaborate?

Phenomenology and physiology become commensurable through a self-organizational physiology and an "enactive" view of consciousness. Self-organizing processes appropriate and replace their own needed substrata, rather than merely being caused by interacting components. Biochemists apply this notion to the living/nonliving distinction. An enactive approach sees consciousness as actively executed by an agent rather than passively reacting to stimuli. Perception does not result from mere stimulation of brain areas by sensory impulses; unless motivated organismic purposes first anticipate and "look for" emotionally (...) relevant.stimuli, brain-sensory processing is not accompanied by perceptual consciousness. To see a soccer ball requires looking for it in the right place. The sell-organizing, emotionally motivated agent instigates this looking-for activity. (shrink)

Understanding the nature of pain depends, at least partly, on recognizing its subjectivity (thus, its first-person epistemology). This in turn requires using a first-person experiential method in addition to third-person experimental approaches to study it. This paper is an attempt to spell out what the former approach is and how it can be integrated with the latter. We start our discussion by examining some foundational issues raised by the use of introspection. We argue that such a first-person method in the (...) scientific study of pain (as in the study of any experience) is in fact indispensable by demonstrating that it has in fact been consistently used in conjunction with conventional third-person methodologies, and this for good reasons. We show that, contrary to what appears to be a widespread opinion, there is absolutely no reason to think that the use of such a first-person approach is scientifically and methodologically suspect. We distinguish between two uses of introspective methods in scientific experiments: one draws on the subjects’ introspective reports where any investigator has equal and objective access. The other is where the investigator becomes a subject of his own study and draws on the introspection of his own experiences. We give examples using and/or approximating both strategies that include studies of second pain summation and its relationship to neural activities, and brain imaging- psychophysical studies wherein sensory and affective qualities of pain are correlated with cerebral cortical activity. We explain what we call the experiential or phenomenological approach that has its origins in the work of Price and Barrell (1980). This approach capitalizes on the scientific prospects and benefits of using the introspection of the investigator. We distinguish between its vertical and horizontal applications. Finally, we conclude that integrating such an approach to standard third-person methodologies can only help us in having a fuller understanding of pain and of conscious experience in general. (shrink)

The discovery of so-called ‘mirror neurons’ - found to respond both to own actions and the observation of similar actions performed by others - has been enormously influential in the cognitive sciences and beyond. Given the self-other symmetry these neurons have been hypothesized as underlying a ‘mirror mechanism’ that lets us share representations and thereby ground core social cognitive functions from intention understanding to linguistic abilities and empathy. I argue that mirror neurons are important for very different reasons. Rather than (...) a symmetric ubiquitous or context- independent mechanism, I propose that these neurons are part of broader sensorimotor circuits, which help us navigate and predict the social affordance space that we meet others in. To develop both the critical and positive project I analyze the interpretive choices and the debate surrounding the mirror neuron research and show how the field is marred by highly questionable assumptions about respectively motor and social cognition. The discovery of mirror neurons - and the sensorimotor circuits of which these neurons are a part – actually empirically challenge many of these tacit assumptions. Findings of sensorimotor goal representations at levels of abstraction well beyond actual sensory information and kinetic movements challenge the idea of motor cognition as primarily output production. Additionally, the focus on 3rd person mindreading of hidden mental states is misguiding the field of social cognition. Much ‘mind-reading’ seems rooted in sensorimotor representations and a developmentally primary 2nd person understanding of actions and the mental lives of others, which precisely breaks the assumed dichotomy between mind and behavior. I propose a Social Affordance model where parallel fronto-parietal sensorimotor circuits support representations not just of other people’s actions but of the overall social affordance space. It is a process that monitors concrete goals and teleological possibilities that the environment affords respectively oneself and other present agents. With this model I hypothesize that the complex spectrum of sensorimotor integrations are indeed essential not only to normal action choice calibration but also to social cognitive abilities, as the sensorimotor teleological representations let us relate to others and understand their action choices in a shared pragmatic and intentional context. (shrink)

An ongoing mystery in sensory science is how sensation magnitude F(I), such as loudness, increases with increasing stimulus intensity I. No credible, direct experimental measures exist. Nonetheless, F(I) can be inferred algebraically. Differences in sensation have empirical (but non-quantifiable) minimum sizes called just-noticeable sensation differences, ∆F, which correspond to empirically-measurable just-noticeable intensity differences, ∆I. The ∆Is presumably cumulate from an empirical stimulus-detection threshold I_th up to the intensity of interest, I. Likewise, corresponding ∆Fs cumulate from the sensation at the (...) stimulus-detection threshold, F(I_th ), up to F(I). Regarding the ∆Is, however, it is unlikely that all of them will be known experimentally; the procedures are too lengthy. The customary approach, then, is to find ∆I at a few widely-spaced intensities, and then use those ∆Is to interpolate all ∆Is using some smooth continuous function. The most popular of those functions is Weber’s Law, ∆I⁄I=K. But that is often not even a credible approximation to the data. However, there are other equations for ∆I⁄I. Any such equation for ∆I⁄I can be combined with any equation for ∆F, through calculus, to altogether obtain F(I). Here, two assumptions for ∆F are considered: ∆F=B (Fechner’s Law) and (∆F⁄F)=g (Ekman’s Law). The respective integrals involve lower bounds I_th and F(I_th ). This stands in broad contrast to the literature, which heavily favors non-bounded integrals. We, hence, obtain 24 new, alternative equations for sensation magnitude F(I) (12 equations for (∆I⁄I) × 2 equations for ∆F). (shrink)

A major question in sensory science is how a sensation of magnitude F (such as loudness) depends upon a sensory stimulus of physical intensity I (such as a sound-pressure-wave of root-mean-square sound-pressure-level). An empirical just-noticeable sensation difference (∆F)_j at F_j specifies a just-noticeable intensity difference (∆I)_j at I_j. Classically, intensity differences accumulate from a stimulus-detection threshold I_th up to a desired intensity I. The corresponding sensation differences likewise accumulate up to F(I) from F(I_th ), the non-zero sensation (as (...) suggested by hearing studies) at I_th. Consequently, sensation growth F(I) can be obtained through classic Fechnerian integration, in which some empirically-based relation for the Weber Fraction, ∆I⁄I, is combined with either Fechner’s Law ∆F=B or Ekman’s Law (∆F⁄F)=g. The number of steps in I is equated to the number of steps in F; an infinite series ensues, whose higher-order terms are traditionally ignored (Fechnerian integration). But also, remarkably, so are the integration bounds I_th and F(I_th ). Here, we depart from orthodoxy by including those bounds. Bounded Fechnerian integration is first used to derive hypothetical sensation-growth equations for which the differential ∆F(I)=F(I+∆I)-F(I) does indeed return either Fechner’s Law or Ekman’s Law respectively. One relation emerges: linear growth of sensation F with intensity I. Subsequently, 24 sensation-growth equations F(I) that the author had derived using bounded Fechnerian integration (12 equations for the Weber Fraction (∆I⁄I), each combined with either Fechner’s Law or with Ekman’s Law) are scrutinized for whether their differentials F(I+∆I)-F(I) return the respective Fechner’s Law or Ekman’s Law, particularly in the previously-unexamined limits (∆I⁄I)≪1 and (∆I⁄I)→0. Classic claims made by Luce and Edwards (1958) are then examined, viz., that three popular forms of the Weber Fraction, when combined with Fechner’s Law, produce sensation-magnitude equations that subsequently return the selfsame Fechner’s Law. When sensation-growth equations are derived here using bounded Fechnerian integration, Luce and Edwards (1958) prove to be wrong. (shrink)

It is common to distinguish between “holist” and “reductionist” views of brain function, where the former envisions the brain as functioning as an indivisible unit and the latter as a collection of distinct units that serve different functions. Opposing reductionism, a number of researchers have pointed out that cortical network architecture does not respect functional boundaries, and the neuroanatomist V. Braitenberg proposed to understand the cerebral cortex as a “great mixing machine” of neuronal activity from sensory inputs, motor commands, (...) and intrinsically generated processes. In this paper, we offer a contextualization of Braitenberg’s point, and we review evidence for the interactions of neuronal activity from multiple sensory inputs and intrinsic neuronal processes in the cerebral cortex. We focus on new insights from studies on audiovisual interactions and on the influence of respiration on brain functions, which do not seem to align well with “reductionist” views of areal functional boundaries. Instead, they indicate that functional boundaries are fuzzy and context dependent. In addition, we discuss the relevance of the influence of sensory, proprioceptive, and interoceptive signals on cortical activity for understanding brain-body interactions, highlight some of the consequences of these new insights for debates on embodied cognition, and offer some suggestions for future studies. (shrink)

Autism spectrum disorder is characterised by differences in unimodal and multimodal sensory and proprioceptive processing, with complex biases towards local over global processing. Many of these elements are implicated in versions of the rubber hand illusion, which were therefore studied in high-functioning individuals with ASD and a typically developing control group. Both groups experienced the illusion. A number of differences were found, related to proprioception and sensorimotor processes. The ASD group showed reduced sensitivity to visuotactile-proprioceptive discrepancy but more accurate (...) proprioception. This group also differed on acceleration in subsequent reach trials. Results are discussed in terms of weak top-down integration and precision-accuracy trade-offs. The RHI appears to be a useful tool for investigating multisensory processing in ASD. (shrink)

All living things have sensory capacities. Plants, in particular, have sensory receptors, transduce the activations of these receptors, and process these outputs in order to manage actions that demand sensory integration. However, there is a kind of sensory function that plants cannot perform. They cannot sense something as other than themselves. Animals, by contrast, perceive. They experience two kinds of "othering impressions"—impressions of entities as located outside and available for interaction, and hence as distinct from (...) the perceiving subject. First, they represent external entities in a "body scheme" that enables sensorimotor interaction with these entities. Second, higher animals such as mammals and birds and possibly fish, represent these entities as located relative to a "cognitive map." These othering impressions are very important because they are the foundation for the human conceptions of the self and other. (shrink)

According to one theory, the brain is a sophisticated hypothesis tester: perception is Bayesian unconscious inference where the brain actively uses predictions to test, and then refine, models about what the causes of its sensory input might be. The brain’s task is simply continually to minimise prediction error. This theory, which is getting increasingly popular, holds great explanatory promise for a number of central areas of research at the intersection of philosophy and cognitive neuroscience. I show how the theory (...) can help us understand striking phenomena at three cognitive levels: vision, sensory integration, and belief. First, I illustrate central aspects of the theory by showing how it provides a nice explanation of why binocular rivalry occurs. Then I suggest how the theory may explain the role of the unified sense of self in rubber hand and full body illusions driven by visuotactile conflict. Finally, I show how it provides an approach to delusion formation that is consistent with one-deficit accounts of monothematic delusions. (shrink)

Recent research has begun to investigate sensory processing in relation to nonclinical variation in traits associated with the autism spectrum disorders (ASD). We propose that existing accounts of autistic perception can be augmented by considering a role for individual differences in top-down expectations for the precision of sensory input, related to the processing of state-dependent levels of uncertainty. We therefore examined ASD-like traits in relation to the rubber-hand illusion: an experimental paradigm that typically elicits crossmodal integration of (...) visual, tactile, and proprioceptive information in an unusual illusory context. Individuals with higher ASD-like traits showed reduced effects of the rubber-hand illusion on perceived arm position and reach-to-grasp movements, compared to individuals with lower ASD-like traits. These differences occurred despite both groups reporting the typical subjective experience of the illusion concerning visuotactile integration and ownership for the rubber hand. Together these results suggest that the integration of proprioceptive information with cues for arm position derived from the illusory context differs between individuals partly in relation to traits associated with ASD. We suggest that the observed differences in sensory integration can be best explained in terms of differing expectations regarding the precision of sensory estimates in contexts that suggest uncertainty. (shrink)

In their cognitive theory of emotion, Schachter and Singer proposed that feelings are separable from what they are about. As a test, they induced feelings of arousal by injecting epinephrine and then molded them into different emotions. They illuminated how feelings in one moment lead into the next to form a stream of conscious experience. We examine the construction of emotion in a similar spirit. We use the sensory integration process to understand how the brain combines disparate sources (...) of information to construct both perceptual and emotional models of the world even as the world continues to change. We emphasize two processes: affect segmentation (isolating the felt component of an emotion) and affect integration (recombining this feeling with its object). (shrink)

A myriad of sensations inform and direct us when we engage with the environment. To understand their influence on the development of our habitus it is important to focus on unifying processes in sensing. This approach allows us to include phenomena that elude a rather narrow view that focuses on each of the five discrete senses in isolation. One of the central questions addressed in this volume is whether there is something like a sensual habitus, and if there is, how (...) it can be defined. This is especially done by exploring the formation and habituation of the senses in and by a culturally shaped habitat. Two key concepts, Synaesthesia and Kinaesthetics, are addressed as essential components for an understanding of the interface of habitat and the rich and multisensory experience of a perceiving subject. At a Berlin-based conference Synaesthesia and Kinaesthetics, scholars from various disciplines gathered to discuss these issues. In bringing together the outcome of these discussions, this book gives new insights into the key phenomena of sensory integration and synaesthetic experiences, it enriches the perspectives on sensually embedded interaction and its habituation, and it expands this interdisciplinary inquiry to questions about the cultures of sensory habitus. (shrink)

Inducing the rubber hand illusion (RHI) requires that participants look at an imitation hand while it is stroked in synchrony with their occluded biological hand. Previous explanations of the RHI have emphasized multisensory integration, and excluded higher cognitive functions. We investigated the relationship between the RHI and higher cognitive functions by experimentally testing task switch (as measured by switch cost) and mind wandering (as measured by SART score); we also included a questionnaire for attentional control that comprises two subscales, (...) attention-shift and attention-focus. To assess experience of RHI, the Botvinick and Cohen (1998) questionnaire was used and illusion onset time was recorded. Our results indicate that rapidity of onset reliably indicates illusion strength. Regression analysis revealed that participants evincing less switch cost and higher attention-shift scores had faster RHI onset times, and that those with higher attention-shift scores experienced the RHI more vividly. These results suggest that the multi-sensory hypothesis is not sufficient to explain the illusion: higher cognitive functions should be taken into account when explaining variation in the experience of ownership for the rubber hand. (shrink)

Our perception of where touch occurs on our skin shapes our interactions with the world. Most accounts of cutaneous localisation emphasise spatial transformations from a skin-based reference frame into body-centred and external egocentric coordinates. We investigated another possible method of tactile localisation based on an intrinsic perception of ‘skin space’. The arrangement of cutaneous receptive fields (RFs) could allow one to track a stimulus as it moves across the skin, similarly to the way animals navigate using path integration. We (...) applied curved tactile motions to the hands of human volunteers. Participants identified the location midway between the start and end points of each motion path. Their bisection judgements were systematically biased towards the integrated motion path, consistent with the characteristic inward error that occurs in navigation by path integration. We thus showed that integration of continuous sensory inputs across several tactile RFs provides an intrinsic mechanism for spatial perception. (shrink)

Multisensory processing encompasses all of the various ways in which the presence of information in one sensory modality can adaptively influence the processing of information in a different modality. In Part I of this survey article, I begin by presenting a cartography of some of the more extensively investigated forms of multisensory processing, with a special focus on two distinct types of multisensory integration. I briefly discuss the conditions under which these different forms of multisensory processing occur as (...) well as their important perceptual consequences and interrelations. In Part II, I then turn to examining of some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical attempts to individuate the senses. (shrink)

We perceive in many ways. But several dubious presuppositions about the senses mask this diversity of perception. Philosophers, scientists, and engineers alike too often presuppose that the senses (vision, audition, etc.) are independent sources of information, perception being a sum of these independent contributions. We too often presuppose that we can generalize from vision to other senses. We too often presuppose that vision itself is best understood as a passive receptacle for an image thrown by a lens. In this essay (...) we illustrate how reflection on results from the cognitive sciences undermine these (and many other) traditional presuppositions. Our illustration situates the remaining essays in the volume, Perception and its Modalities, which further extend the case against various traditional presuppositions, and offer alternatives ways to understand the senses and their role in perception. While many of the essays in this volume represent competing views and draw on different fields, from conceptual analysis to engineering, most contributors believe that to understand perception properly, we need to treat as foundational the idea that the senses work together. From that agreement, new paradigms for theorizing about perception begin to emerge. (shrink)

According to the decomposition thesis, perceptual experiences resolve without remainder into their different modality-specific components. Contrary to this view, I argue that certain cases of multisensory integration give rise to experiences representing features of a novel type. Through the coordinated use of bodily awareness—understood here as encompassing both proprioception and kinaesthesis—and the exteroceptive sensory modalities, one becomes perceptually responsive to spatial features whose instances couldn’t be represented by any of the contributing modalities functioning in isolation. I develop an (...) argument for this conclusion focusing on two cases: 3D shape perception in haptic touch and experiencing an object’s egocentric location in crossmodally accessible, environmental space. (shrink)

It is an integral part of the phenomenology of mature perceptual experience that it seems to present to us an experience-independent world. I shall call this feature 'perceptual intentionality'. In this paper, I argue that perceptual intentionality is constructed by the structure of more basic sensory features, features that are not intentional themselves. This theory can explain why the same sensory feature can figure both in presentational and non-presentational experiences. There is a fundamental difference between the intentionality of (...) sensory experiences and the intentionality of thoughts: unlike the former, the latter is not constructed. (shrink)

In this paper we argue that object perception may be affected by what we call “perceptual frames.” Perceptual frames are adaptations of the perceptual system that guide how perceptual objects are singled out from a sensory environment. These adaptations are caused by perceptual learning and realized through bottom-up functional processes such that sensory information is organized in a subject-dependent way leading to idiosyncratic perceptual object representations. Through domain-specific training, perceptual learning, and the acquisition of object-knowledge, it is possible (...) to modulate the adaptive perceptual system such that its ability to represent becomes bespoke. Different perceivers with different perceptual frames may, therefore, receive the same sensory information and perceive different perceptual objects due to the effects of framing. Consequently, we demonstrate the plausibility of this account by surveying empirical data concerning the functions of (1) multisensory integration, (2) amodal completion, and (3) predictive anticipation. Regarding (1), we argue that the perceptual system’s optimization processes employ perceptual frames to facilitate multisensory feature binding. Regarding (2), we argue that amodal completion can occur with or without the help of mental imagery, yet either instance of amodal completion requires perceptual frames. Regarding (3), we demonstrate that perceptually anticipating an object’s motion involves the implementation of perceptual frames. We conclude that framing effects are a matter of perceptual diversity and highlight the need to accommodate unique perspectives in the philosophy and science of perception. (shrink)

Lilly was one of the greatest scientists and pioneers on the limits of human possibility but after his death a collective amnesia has descended and he is now almost forgotten. His Wiki is good but inevitably incomplete so here are a few missing details and viewpoints. Lilly was a generation (or more) ahead of his time. He is almost single-handedly responsible for the great interest in dolphins (which led to the Marine Mammal Protection Act in the USA and helped to (...) found the animal rights movement). In 1958 he noted that the brains of elephants and cetaceans were larger than ours, that we should not abuse them and that it was one our most important projects to communicate with them. He invented sensory isolation tanks (at NIMH in 1954) and used them extensively with and without powerful psychoactive drugs at a time when it was thought that either the brain would shut down or one would go insane if external stimuli were eliminated. He created methods for implanting electrodes in mammal brains and was planning to do it to himself. He was one of the first to make serious use of computers in bioscience research and created the hardware and software to make the first attempts to communicate with dolphins. He self experimented with dangerous physiological investigations in high altitude medicine for the military during WW2, took LSD with dolphins and movie stars, submitted himself to the rigors of various forms of yoga and of Arica training, and taught classes at Esalen. He was a computer pioneer who forsaw the rapid advances in A.I. and it's inevitable clash with humans. He was the first one to investigate the bizarre psychedelic ketamine (" vitamin K "), and his results (published in the two last chapters of his book `The Scientist`) are still the best data on the dose/effect relation of any psychedelic on one person. It cured his lifelong daily migraine headaches (see http://www.conspiracyarchive.com/UFOs/Gorightly.htm). And all this happened before most of us were born! He had courage, honesty and integrity that is rare anywhere and almost nonexistent in science. His goal was to find the ultimate truth about everything and he went about as far as anyone ever has. He had little patience with the stupid and hypocritical games one has to play to fit into monkey society. Of course the reaction of the establishment was predictable. He left the NIMH and was never given any government or academic support for the last 35 years of his life. His paper and comments at a conference on sensory deprivation were removed from the published version. He was not invited to government sponsored symposia on dolphins (he had refused to help develop them as weapons), though he clearly knew more about them than anyone in the world. He liked to live and work on the edge and few could keep up with him, as his books make clear. If you have read some of his other books it will be much easier going. He was a pioneer in consciousness research and pushed the boundaries of our understanding of who we are and what we might become. Among other things he catalogs the various states reached by drugs, meditation, and isolation, tries to determine their significance, and suggests how to use them. I very briefly review and comment on his life and work. -/- Those interested in all my writings in their most recent versions may download from this site my e-book ‘Philosophy, Human Nature and the Collapse of Civilization Michael Starks (2016)- Articles and Reviews 2006-2016’ by Michael Starks First Ed. 662p (2016). -/- All of my papers and books have now been published in revised versions both in ebooks and in printed books. -/- Talking Monkeys: Philosophy, Psychology, Science, Religion and Politics on a Doomed Planet - Articles and Reviews 2006-2017 (2017) https://www.amazon.com/dp/B071HVC7YP. -/- The Logical Structure of Philosophy, Psychology, Mind and Language in Ludwig Wittgenstein and John Searle--Articles and Reviews 2006-2016 (2017) https://www.amazon.com/dp/B071P1RP1B. -/- Suicidal Utopian Delusions in the 21st century: Philosophy, Human Nature and the Collapse of Civilization - Articles and Reviews 2006-2017 (2017) https://www.amazon.com/dp/B0711R5LGX -/- . (shrink)

In sensorimotor integration, representation involves an anticipatory model of the action to be performed. This model integrates efferent signals (motor commands), its reafferent consequences (sensory consequences of an organism’s own motor action), and other afferences (sensory signals) originated by stimuli independent of the action performed. Representation, a form of internal modeling, is invoked to explain the fact that behavior oriented to the achievement of future goals is relatively independent from the immediate environment. Internal modeling explains how a (...) cognitive system achieves its goals despite variations in the environment with insufficient and noisy sensory–perceptual data. In a self that acts intentionally on the environment, knowledge is dependent upon the necessity to guide actions directed toward an aim. The self-inner model, a representation of internal and external environments (including reafferent and afferent messages) and also of the behavior plans and desirable future states (aims) and efferent intentions (motor planning and motor command messages), is intrinsically linked to a thinking capacity, which is supposed to emerge from the binding of multiple influences. Thinking emerges when higher behavior strategies are considered possible and capable of leading to aims or the fulfillment of intentions. In this model, symbolization processes are projective and anticipatory and, in this way, beyond present referents. Symbolization occurs linked to action planning, command, and regulation in mental simulation. Meaning is related to an inner sense of a self that acts over the environment. (shrink)

Visual imagery is a form of sensory imagination, involving subjective experiences typically described as similar to perception, but which occur in the absence of corresponding external stimuli. We used the Activation Likelihood Estimation algorithm (ALE) to identify regions consistently activated by visual imagery across 40 neuroimaging studies, the first such meta-analysis. We also employed a recently developed multi-modal parcellation of the human brain to attribute stereotactic co-ordinates to one of 180 anatomical regions, the first time this approach has been (...) combined with the ALE algorithm. We identified a total 634 foci, based on measurements from 464 participants. Our overall comparison identified activation in the superior parietal lobule, particularly in the left hemisphere, consistent with the proposed ‘top-down’ role for this brain region in imagery. Inferior premotor areas and the inferior frontal sulcus were reliably activated, a finding consistent with the prominent semantic demands made by many visual imagery tasks. We observed bilateral activation in several areas associated with the integration of eye movements and visual information, including the supplementary and cingulate eye fields (SCEFs) and the frontal eye fields (FEFs), suggesting that enactive processes are important in visual imagery. V1 was typically activated during visual imagery, even when participants have their eyes closed, consistent with influential depictive theories of visual imagery. Temporal lobe activation was restricted to area PH and regions of the fusiform gyrus, adjacent to the fusiform face complex (FFC). These results provide a secure foundation for future work to characterise in greater detail the functional contributions of specific areas to visual imagery. (shrink)

What is the metaphysical nature of perceptual experience? What evidence does experience provide us with? These questions are typically addressed in isolation. In order to make progress in answering both questions, perceptual experience needs to be studied in an integrated manner. I develop a unified account of the phenomenological and epistemological role of perceptual experience, by arguing that sensory states provide perceptual evidence due to their metaphysical structure. More specifically, I argue that sensory states are individuated by the (...) perceptual capacities employed and that there is an asymmetric dependence between their employment in perception and their employment in hallucination and illusion. Due to this asymmetric dependence, sensory states provide us with evidence. (shrink)

According to the increasingly popular perceptual/representational accounts of pain (and other bodily sensations such as itches, tickles, orgasms, etc.), feeling pain in a body region is perceiving a non-mental property or some objective condition of that region, typically equated with some sort of (actual or potential) tissue damage. In what follows I argue that given a natural understanding of what sensory perception requires and how it is integrated with (dedicated) conceptual systems, these accounts are mistaken. I will also examine (...) the relationship between perceptual views and two (weak and strong) forms of representationalism about experience. I will argue that pains pose very serious problems for strong representationalism as well. (shrink)

Perception is the ultimate source of our knowledge about contingent facts. It is an extremely important philosophical development that starting in the last quarter of the twentieth century, philosophers have begun to change how they think of perception. The traditional view of perception focussed on sensory receptors; it has become clear, however, that perceptual systems radically transform the output of these receptors, yielding content concerning objects and events in the external world. Adequate understanding of this process requires that we (...) think of perception in new ways—how it operates, the differences among the modalities, and integration of content provided by the individual senses. Philosophers have developed new analytic tools, and opened themselves up to new ways of thinking about the relationship of perception to knowledge. The Oxford Handbook of the Philosophy of Perception is a collection of entries by leading researchers that reviews these new directions in philosophical thought. The Introduction to the Handbook reviews the history of the subject from its beginnings in ancient Greece to the nineteenth century, and the way that science and philosophy have together produced new conceptions during the last hundred years. It shows how the new thinking about perception has led to a complex web of theories. (shrink)

The cognitive phenomenology debate centers on two questions. (1) What is an apt characterization of the phenomenology of conscious thought? And (2), what role does this phenomenology play? I argue that the answers to the former question bear significantly on the answers to the latter question. In particular, I show that conservatism about cognitive phenomenology is not compatible with the view that phenomenology explains the constitution of conscious thought. I proceed as follows: To begin with, I analyze the phenomenology of (...) our sensory experiences and argue for a _weak phenomenal holism_ (WPH) about sensory phenomenology. Next, I explore how WPH can be integrated into the competing accounts of cognitive phenomenology. I argue that, given WPH, conservatism turns out to reduce phenomenal character to a merely concomitant phenomenon that has no explanatory power when it comes to the constitution of conscious thoughts. In contrast, liberalism is explanatorily more powerful in this respect. Finally, I propose a new version of liberalism that explains how phenomenology constitutes conscious thoughts and fits best with WPH. (shrink)

This chapter distinguishes between two kinds of ordinary multisensory experience that go beyond mere co-consciousness of features (e.g., the experience that results from concurrently hearing a sound in the hallway and seeing the cup on the table). In one case, a sensory experience in one modality creates a perceptual demonstrative to whose referent qualities are attributed in another sensory modality. For example, when you hear someone speak, auditory experience attributes audible qualities to a seen event, a person’s speaking (...) motions. The second kind of multisensory experience attributes features experienced in several sensory modalities to one and the same object via a process of amodal perceptual integration, i.e., integration that occurs separately from processing within the individual sensory modalities. Multisensory experiences arising from holding and seeing a tomato or from seeing the Indian curry boil and smelling it are examples of the second kind of multisensory experience. At the end of the chapter we look at synesthesia, a kind of atypical multisensory experience, and argue that one version of this phenomenon may be able to shed light on the neural mechanism underlying amodally integrated multisensory experience. (shrink)

One of the most compelling questions still unanswered in neuroscience is how consciousness arises. In this article, we examine visual processing, the parietal lobe, and contralateral neglect syndrome as a window into consciousness and how the brain functions as the mind and we introduce a mechanism for the processing of visual information and its role in consciousness. We propose that consciousness arises from integration of information from throughout the body and brain by the thalamus and that the thalamus reimages (...) visual and other sensory information from throughout the cortex in a default three-dimensional space in the mind. We further suggest that the thalamus generates a dynamic default three-dimensional space by integrating processed information from corticothalamic feedback loops, creating an infrastructure that may form the basis of our consciousness. Further experimental evidence is needed to examine and support this hypothesis, the role of the thalamus, and to further elucidate the mechanism of consciousness. (shrink)

We discuss the evolutionary transition from animals with limited experiencing to animals with unlimited experiencing and basic consciousness. This transition was, we suggest, intimately linked with the evolution of associative learning and with flexible reward systems based on, and modifiable by, learning. During associative learning, new pathways relating stimuli and effects are formed within a highly integrated and continuously active nervous system. We argue that the memory traces left by such new stimulus-effect relations form dynamic, flexible, and varied global (...) class='Hi'>sensory states, which we call categorizing sensory states . These CSSs acquired a function: they came to act as internal “evaluators” and led to positive and negative reinforcement of new behavior. They are therefore the simplest, distinct, first-person motivational states that an animal can have. They constitute what we call basic consciousness, and are the hallmark of animals that can experience. Since associative learning has been found in many invertebrate taxa that first appeared during the Cambrian era, we propose that the processes underlying basic consciousness are phylogenetically ancient, and that their emergence may have fueled the Cambrian explosion. (shrink)

According to Hubert Dreyfus’s famous claim that expertise is fundamentally “mindless,” experts in any domain perform most effectively when their activity is automatic and unmediated by concepts or cognitive processes like attention and memory. While several scholars have recently challenged the plausibility of Dreyfus’s “mindless” account of expertise for explaining a wide range of expert activities, there has been little consideration of the one form of expertise which might be most amenable to Dreyfus’s account – namely, perceptual expertise. Indeed, Dreyfus’s (...) account of expert coping is ultimately an account of perceptual expertise, in that an expert’s intuitive situational responses are thought to rely on a sophisticated repertoire of perceptual skills. In this paper, I examine the feedforward model of sensory processing that Dreyfus uses to illustrate the perceptual underpinnings of expert action, and consider its resonance with psychological research that characterizes perceptual expertise as being automatic, holistic, pre-attentive, and non-cognitive in nature. However, citing competing empirical research, I argue instead that Dreyfus’s model of perceptual expertise cannot adequately explain the integral roles of attention, memory, and conceptual knowledge in expert object recognition. I conclude that the Dreyfusian model of perceptual expertise fails – the perceptual repertoire of skills that grounds expert object recognition is not operative in isolation from the expert’s conceptual repertoire. (shrink)

The nature of “the self” has been one of the central problems in philosophy and more recently in neuroscience. This raises various questions: Can we attribute a self to animals? Do animals and humans share certain aspects of their core selves, yielding a trans-species concept of self? What are the neural processes that underlie a possible trans-species concept of self? What are the developmental aspects and do they result in various levels of self-representation? Drawing on recent literature from both human (...) and animal research, we suggest a trans-species concept of self that is based upon what has been called a “core-self” which can be described by self-related processing as a specific mode of interaction between organism and environment. When we refer to specific neural networks, we will here refer to the underlying system as the “core-SELF.” The core-SELF provides primordial neural coordinates that represent organisms as living creatures—at the lowest level this elaborates interoceptive states along with raw emotional feelings while higher medial cortical levels facilitate affective-cognitive integration . Developmentally, SRP allows stimuli from the environment to be related and linked to organismic needs, signaled and processed within core-self structures within subcorical-cortical midline structures that provide the foundation for epigenetic emergence of ecologically framed, higher idiographic forms of selfhood across different individuals within a species. These functions ultimately operate as a coordinated network. We postulate that core SRP operates automatically, is deeply affective, and is developmentally and epigenetically connected to sensory-motor and higher cognitive abilities. This core-self is mediated by SCMS, embedded in visceral and instinctual representations of the body that are well integrated with basic attentional, emotional and motivational functions that are apparently shared between humans, non-human mammals, and perhaps in a proto-SELF form, other vertebrates. Such a trans-species concept of organismic coherence is thoroughly biological and affective at the lowest levels of a complex neural network, and culturally and ecologically molded at higher levels of neural processing. It allows organisms to selectively adapt to and integrate with physical and social environments. Such a psychobiologically universal, but environmentally diversified, concept may promote novel trans-species studies of the core-self across mammalian species. (shrink)

We present a theoretical view of the cellular foundations for network-level processes involved in producing our conscious experience. Inputs to apical synapses in layer 1 of a large subset of neocortical cells are summed at an integration zone near the top of their apical trunk. These inputs come from diverse sources and provide a context within which the transmission of information abstracted from sensory input to their basal and perisomatic synapses can be amplified when relevant. We argue that (...) apical amplification enables conscious perceptual experience and makes it more flexible, and thus more adaptive, by being sensitive to context. Apical amplification provides a possible mechanism for recurrent processing theory that avoids strong loops. It makes the broadcasting hypothesized by global neuronal workspace theories feasible while preserving the distinct contributions of the individual cells receiving the broadcast. It also provides mechanisms that contribute to the holistic aspects of integrated information theory. As apical amplification is highly dependent on cholinergic, aminergic, and other neuromodulators, it relates the specific contents of conscious experience to global mental states and to fluctuations in arousal when awake. We conclude that apical dendrites provide a cellular mechanism for the context-sensitive selective amplification that is a cardinal prerequisite of conscious perception. (shrink)

The paper introduces measurement of fixation-speech intervals as an important tool for the study of the reading process. Using the theory of the organism-environment system, we developed experiments to investigate the time course of reading. By combining eye tracking with synchronous recording of speech during reading in a single measure, we issue a fundamental challenge to information processing models. Not only is FSI an authentic measure of the reading process, but it shows that we exploit verbal patterns, textual features and, (...) less directly, reading experience. Reading, we conclude, is not a matter of decoding linguistic information. Far from being a text-driven process, it depends on integrating both sensory and motor processes in an anticipatory meaning generation based on the history of experience and cultural context of the reader. Finally, we conclude with remarks on the social character and cognitive history of reading. (shrink)

Henry More argues that materialism cannot account for cases where a single subject or perceiver has multiple perceptions simultaneously. Since we clearly do have multiple perceptions at the same time--for example, when we see, hear, and smell simultaneously--More concludes that we are not wholly material. In response to More's argument, Margaret Cavendish adopts a two-fold strategy. First, she argues that there is no general obstacle to mental unification in her version of materialism. Second, Cavendish appeals to the mind or rational (...) matter--terms she often uses interchangeably—to explain the integration of sensory input from multiple senses. When the mind integrates perceptions across modalities, the different parts of rational matter share their knowledge so that they all come to perceive alike. When rational parts successfully communicate their knowledge, each part knows what all the others know. They pool their knowledge; they perceive alike. Thus, when someone hears, sees, and tastes, each part of her mind hears, sees, and tastes alike, in parallel and in unison. The Cavendishian mind, in short, approximates simplicity by achieving uniformity or homogeneity of perceptions across its parts. (shrink)

The recent developments in artificial intelligence (AI), particularly in light of the impressive capabilities of transformer-based Large Language Models (LLMs), have reignited the discussion in cognitive science regarding whether computational devices could possess semantic understanding or whether they are merely mimicking human intelligence. Recent research has highlighted limitations in LLMs’ reasoning, suggesting that the gap between mere symbol manipulation (syntax) and deeper understanding (semantics) remains wide open. While LLMs overcome certain aspects of the symbol grounding problem through human feedback, they (...) still lack true semantic understanding, struggling with common-sense reasoning and abstract thinking. This paper argues that while adding sensory inputs and embodying AI through sensorimotor integration with the environment might enhance its ability to connect symbols to real-world meaning, this alone would not close the gap between syntax and semantics. True meaning-making also requires a connection to subjective experience, which current AI lacks. The path to AGI must address the fundamental relationship between symbol manipulation, data processing, pattern matching, and probabilistic best guesses with true knowledge that requires conscious experience. A transition from AI to AGI can occur only if it possesses conscious experience, which is closely tied to semantic understanding. Recognition of this connection could furnish new philosophical insights into longstanding practical and philosophical questions for theories in biology and cognitive science and provide more meaningful tests of intelligence than the Turing test. (shrink)

We can perceive shapes visually and tactilely, and the information we gain about shapes through both sensory modalities is integrated smoothly into and functions in the same way in our behavior independently of whether we gain it by sight or touch. There seems to be no reason in principle we couldn't perceive shapes through other sensory modalities as well, although as a matter of fact we do not. While we can identify shapes through other sensory modalities—e.g., I (...) may know by smell (the scent of mango) that the object causing my sensory experience is round—this is not perceiving an object as shaped, but rather inferring from the character of one's sensory experience and collateral information that an object of a certain shape caused it. That it is possible to perceive shape by other modalities, however, is suggested by the case of bats and aquatic mammals like dolphins which navigate through their environment by a form of sonar. It is plausible that they have some form of auditory representation of space, and so of shape. These facts about shape perception raise important questions about the relation between those features of perceptual experience which are intrinsic to different sensory modalities and the nature of our perceptual representation of shapes, and, more generally, of the space within which we perceive shaped objects to be located. John Campbell's paper, "Molyneux's Problem" (see above), raises a number of interesting and important questions about the nature of our perception of shape properties, particularly the cross-modal nature of shape perception, and ties them to more general questions about the nature both of perceptual.. (shrink)