The conclusions drawn by Benjamin Libet from his work with collegues on the timing of somatosensorial conscious experiences has met with a lot of praise and criticism. In this issue we find three examples of the latter. Here I attempt to place the divide between the two opponent camps in a broader perspective by analyzing the question of the relation between physical timing, neural timing, and experiential timing. The nervous system does a sophisticated job of recombining and recoding messages from (...) the sensorial surfaces and if these processes are slighted in a theory, it might become necessary to postulate weird operations, including subjective back-referral. Neuroscientifically inspired theories are of necessity still based on guesses, extrapolations, and philosophically dubious manners of speech. They often assume some neural correlate of consciousness as a part of the nervous system that transforms neural activity in reportable experiences. The majority of neuroscientists appear to assume that the NCC can compare and bind activity patterns only if they arrive simultaneously at the NCC. This leads to a search for synchrony or to theories in terms of the compensation of differences in neural delays . This is the main dimension of the Libet discussion. Examples from vision research, such as “temporal-binding-by-synchrony” and the “flash-lag” effect, are then used to illustrate these reasoning patterns in more detail. Alternatively one could assume symbolic representations of time and space that are not coded in their own dimension . Unless such tags are multiplexed with the quality message , one gets a binding problem for tags. One of the hidden aspects of the discussion between Libet and opponents appears to be the following. Is the NCC smarter than the rest of the nervous system, so that it can solve the problems of local sign and timing on its own, or are these pieces of information coded symbolically early on in the system? A supersmart NCC appears to be the assumption of Libet's camp . The wish to distribute the smartness evenly across all stages of processing in the nervous system appears to motivate the opponents. I argue that there are reasons to side with the latter group. (shrink)

The brains of higher mammals are extraordinary integrative devices. Signals from large numbers of functionally specialized groups of neurons distributed over many brain regions are integrated to generate a coherent, multimodal scene. Signals from the environment are integrated with ongoing, patterned neural activity that provides them with a meaningful context. We review recent advances in neurophysiology and neuroimaging that are beginning to reveal the neural mechanisms of integration. In addition, we discuss concepts and measures derived from information theory that lend (...) a theoretical basis to the notion of complexity as integration of information and suggest new experimental tests of these concepts. (shrink)

An object in continuous motion is perceived ahead of the briefly flashed object, although the two images are physically aligned , the phenomenon called flash-lag effect. Flash-lag effects have been found also with other continuously changing features such as color, pattern entropy, and brightness as well as with streamed pre- and post-target input without any change of the feature values of streaming items in feature space . We interpret all instances of the flash-lag as a consequence of a more fundamental (...) property of conscious perception in general: acceleration of the speed with which samples of perceptual information become represented in explicit format immediately after the stimulation onset. Decreased visual latency of the samples of stimulus information from the streamed input leads to the relative perceptual lag for the separately flashed stimulus because it is not preceded by adjacent sensory input that would have accelerated its perception. Experimental support for the notion of perceptual acceleration is reviewed. (shrink)

Multiple explanatory frameworks may be required to provide an adequate account of human cognition. This paper embeds the classical account within a neural network framework, exploring the encoding of syntacticallystructured objects over the synchronicdiachronic characteristics of networks. Synchronic structure is defined in terms of temporal binding and the superposition of states. To accommodate asymmetric relations, synchronic structure is subject to the type uniqueness constraint. The nature of synchronic structure is shown to underlie Xbar theory that characterizes the phrasal structure of (...) human languages. The derivation differentiates core Xbar properties from languagespecific properties. (shrink)

This is a bibliography of books and articles on consciousness in philosophy, cognitive science, and neuroscience over the last 30 years. There are three main sections, devoted to monographs, edited collections of papers, and articles. The first two of these sections are each divided into three subsections containing books in each of the main areas of research. The third section is divided into 12 subsections, with 10 subject headings for philosophical articles along with two additional subsections for articles in cognitive (...) science and neuroscience. Of course the division is somewhat arbitrary, but I hope that it makes the bibliography easier to use. This bibliography has first been compiled by Thomas Metzinger and David Chalmers to appear in print in two philosophical anthologies on conscious experience . From 1995 onwards it has been continuously updated by Thomas Metzinger, and now is freely available as a PDF-, RTF-, or HTML-file. This bibliography mainly attempts to cover the Anglo-Saxon and German debates, in a non-annotated, fully formatted way that makes it easy to "cut and paste" from the original file. To a certain degree this bibliography also contains items in other languages than English and German - all submissions in other languages are welcome. Last update of current version: July 13th, 2001. (shrink)

This article provides a retrospective, current and prospective overview on developments in brain research and neuroscience. Both theoretical and empirical studies are considered, with emphasis in the concept of multivariability and metastability in the brain. In this new view on the human brain, the potential multivariability of the neuronal networks appears to be far from continuous in time, but confined by the dynamics of short-term local and global metastable brain states. The article closes by suggesting some of the implications of (...) this view in future multidisciplinary brain research. (shrink)

In attempts to formulate a computational understanding of brain function, one of the fundamental concerns is the data structure by which the brain represents information. For many decades, a conceptual framework has dominated the thinking of both brain modelers and neurobiologists. That framework is referred to here as "classical neural networks." It is well supported by experimental data, although it may be incomplete. A characterization of this framework will be offered in the next section. Difficulties in modeling important functional aspects (...) of the brain on the basis of classical neural networks alone have led to the recognition that another, general mechanism must be invoked to explain brain function. That mechanism I call " binding." Binding by neural signal synchrony had been mentioned several times in the liter ature before it was fully formulated as a general phenomenon. Although experimental evidence for neural syn chrony was soon found, the idea was largely ignored for many years. Only recently has it become a topic of animated discussion. In what follows, I will summarize the nature and the roots of the idea of binding, especially of temporal binding, and will discuss some of the objec tions raised against it. (shrink)

We introduce a new version of the perceptual retouch model. This model was used for explaining properties of temporal interaction of successive objects in reaching conscious representation. The new model incorporates two interactive binding operations – binding features for objects and binding the bound feature-objects with a large scale oscillatory system that corresponds to perceptual consciousness. Here, the typical result of masking experiments – second object advantage in conscious perception – is achieved by applying the effects of a common synchronizing (...) oscillator with a delay. This delayed modulation of each of the feature-binding first-order oscillators that represent emerging and decaying neural activities of each of the objects guarantees that the oscillating synchrony of the feature-neurons of the following object is higher than the synchrony of the feature-neurons of the first presented object. Thus we model the fact that the following object dominates the preceding object in conscious perception. We also show the capacity of the model to simulate illusory misbinding of features from different objects. The third qualitative effect, the relative release of the first object from backward masking is achieved by priming the non-specific oscillatory modulation ahead in time. (shrink)

For a robot to be capable of development it must be able to explore its environment and learn from its experiences. It must find opportunities to experience the unfamiliar in ways that reveal properties valid beyond the immediate context. In this paper, we develop a novel method for using the rhythm of everyday actions as a basis for identifying the characteristic appearance and sounds associated with objects, people, and the robot itself. Our approach is to identify and segment groups of (...) signals in individual modalities based on their rhythmic variation, then to identify and bind causally-related groups of signals across different modalities. By including proprioception as a modality, this cross-modal binding method applies to the robot itself, and we report a series of experiments in which the robot learns about the characteristics of its own body. (shrink)

In spite of enormous recent interest in the neurobiology of the self, we currently have no global models of the brain that explain how its anatomical structure, connectivity, and physiological functioning create a unified self. In this article I present a triadic neurohierarchical model of the self that proposes that the self can be understood as the product of three hierarchical anatomical systems: The interoself system, the integrative self system, and the exterosensorimotor system. An analysis of these three systems and (...) their functional features indicates that the neural hierarchy possesses features of both non-nested and nested hierarchies that are necessary for the creation of a unified consciousness and self. These functional properties also make the central nervous system a biologically unique entity unlike anything else in nature. (shrink)

The problem of representing the spatial structure of images, which arises in visual object processing, is commonly described using terminology borrowed from propositional theories of cognition, notably, the concept of compositionality. The classical propositional stance mandates representations composed of symbols, which stand for atomic or composite entities and enter into arbitrarily nested relationships. We argue that the main desiderata of a representational system — productivity and systematicity — can (indeed, for a number of reasons, should) be achieved without recourse to (...) the classical, proposition-like compositionality. We show how this can be done, by describing a systematic and productive model of the representation of visual structure, which relies on static rather than dynamic binding and uses coarsely coded rather than atomic shape primitives. (shrink)

A key question in studying consciousness is how neural operations in the brain can identify streams of sensory input as belonging to distinct modalities, which contributes to the representation of qualitatively different experiences. The basis for identification of modalities is proposed to be constituted by self-organized comparative operations across a network of unimodal and multimodal sensory areas. However, such network interactions alone cannot answer the question how sensory feature detectors collectively account for an integrated, yet phenomenally differentiated experiential content. This (...) problem turns out to be different from, although related to, the binding problem. It is proposed that the neural correlate of an enriched, multimodal experience is constituted by the attractor state of a dynamic associative network. Within this network, unimodal and multimodal sensory maps continuously interact to influence each other’s attractor state, so that a feature change in one modality results in a fast re-coding of feature information in another modality. In this scheme, feature detection is coded by firing-rate, whereas firing phase codes relational aspects. (shrink)

We propose a non-representationalist framework for deep learning relying on a novel method computational phenomenology, a dialogue between the first-person perspective (relying on phenomenology) and the mechanisms of computational models. We thereby propose an alternative to the modern cognitivist interpretation of deep learning, according to which artificial neural networks encode representations of external entities. This interpretation mainly relies on neuro-representationalism, a position that combines a strong ontological commitment towards scientific theoretical entities and the idea that the brain operates on symbolic (...) representations of these entities. We proceed as follows: after offering a review of cognitivism and neuro-representationalism in the field of deep learning, we first elaborate a phenomenological critique of these positions; we then sketch out computational phenomenology and distinguish it from existing alternatives; finally we apply this new method to deep learning models trained on specific tasks, in order to formulate a conceptual framework of deep-learning, that allows one to think of artificial neural networks’ mechanisms in terms of lived experience. (shrink)

Computer vision systems are, on most counts, poor performers, when compared to their biological counterparts. The reason for this may be that computer vision is handicapped by an unreasonable assumption regarding what it means to see, which became prevalent as the notions of intrinsic images and of representation by reconstruction took over the field in the late 1970’s. Learning from biological vision may help us to overcome this handicap.