An object in continuous motion is perceived ahead of the briefly flashed object, although the two images are physically aligned , the phenomenon called flash-lag effect. Flash-lag effects have been found also with other continuously changing features such as color, pattern entropy, and brightness as well as with streamed pre- and post-target input without any change of the feature values of streaming items in feature space . We interpret all instances of the flash-lag as a consequence of a more fundamental (...) property of conscious perception in general: acceleration of the speed with which samples of perceptual information become represented in explicit format immediately after the stimulation onset. Decreased visual latency of the samples of stimulus information from the streamed input leads to the relative perceptual lag for the separately flashed stimulus because it is not preceded by adjacent sensory input that would have accelerated its perception. Experimental support for the notion of perceptual acceleration is reviewed. (shrink)

This article provides a retrospective, current and prospective overview on developments in brain research and neuroscience. Both theoretical and empirical studies are considered, with emphasis in the concept of multivariability and metastability in the brain. In this new view on the human brain, the potential multivariability of the neuronal networks appears to be far from continuous in time, but confined by the dynamics of short-term local and global metastable brain states. The article closes by suggesting some of the implications of (...) this view in future multidisciplinary brain research. (shrink)

We propose a non-representationalist framework for deep learning relying on a novel method computational phenomenology, a dialogue between the first-person perspective (relying on phenomenology) and the mechanisms of computational models. We thereby propose an alternative to the modern cognitivist interpretation of deep learning, according to which artificial neural networks encode representations of external entities. This interpretation mainly relies on neuro-representationalism, a position that combines a strong ontological commitment towards scientific theoretical entities and the idea that the brain operates on symbolic (...) representations of these entities. We proceed as follows: after offering a review of cognitivism and neuro-representationalism in the field of deep learning, we first elaborate a phenomenological critique of these positions; we then sketch out computational phenomenology and distinguish it from existing alternatives; finally we apply this new method to deep learning models trained on specific tasks, in order to formulate a conceptual framework of deep-learning, that allows one to think of artificial neural networks’ mechanisms in terms of lived experience. (shrink)

The conclusions drawn by Benjamin Libet from his work with collegues on the timing of somatosensorial conscious experiences has met with a lot of praise and criticism. In this issue we find three examples of the latter. Here I attempt to place the divide between the two opponent camps in a broader perspective by analyzing the question of the relation between physical timing, neural timing, and experiential timing. The nervous system does a sophisticated job of recombining and recoding messages from (...) the sensorial surfaces and if these processes are slighted in a theory, it might become necessary to postulate weird operations, including subjective back-referral. Neuroscientifically inspired theories are of necessity still based on guesses, extrapolations, and philosophically dubious manners of speech. They often assume some neural correlate of consciousness as a part of the nervous system that transforms neural activity in reportable experiences. The majority of neuroscientists appear to assume that the NCC can compare and bind activity patterns only if they arrive simultaneously at the NCC. This leads to a search for synchrony or to theories in terms of the compensation of differences in neural delays . This is the main dimension of the Libet discussion. Examples from vision research, such as “temporal-binding-by-synchrony” and the “flash-lag” effect, are then used to illustrate these reasoning patterns in more detail. Alternatively one could assume symbolic representations of time and space that are not coded in their own dimension . Unless such tags are multiplexed with the quality message , one gets a binding problem for tags. One of the hidden aspects of the discussion between Libet and opponents appears to be the following. Is the NCC smarter than the rest of the nervous system, so that it can solve the problems of local sign and timing on its own, or are these pieces of information coded symbolically early on in the system? A supersmart NCC appears to be the assumption of Libet's camp . The wish to distribute the smartness evenly across all stages of processing in the nervous system appears to motivate the opponents. I argue that there are reasons to side with the latter group. (shrink)

Multiple explanatory frameworks may be required to provide an adequate account of human cognition. This paper embeds the classical account within a neural network framework, exploring the encoding of syntacticallystructured objects over the synchronicdiachronic characteristics of networks. Synchronic structure is defined in terms of temporal binding and the superposition of states. To accommodate asymmetric relations, synchronic structure is subject to the type uniqueness constraint. The nature of synchronic structure is shown to underlie Xbar theory that characterizes the phrasal structure of (...) human languages. The derivation differentiates core Xbar properties from languagespecific properties. (shrink)

In spite of enormous recent interest in the neurobiology of the self, we currently have no global models of the brain that explain how its anatomical structure, connectivity, and physiological functioning create a unified self. In this article I present a triadic neurohierarchical model of the self that proposes that the self can be understood as the product of three hierarchical anatomical systems: The interoself system, the integrative self system, and the exterosensorimotor system. An analysis of these three systems and (...) their functional features indicates that the neural hierarchy possesses features of both non-nested and nested hierarchies that are necessary for the creation of a unified consciousness and self. These functional properties also make the central nervous system a biologically unique entity unlike anything else in nature. (shrink)

A key question in studying consciousness is how neural operations in the brain can identify streams of sensory input as belonging to distinct modalities, which contributes to the representation of qualitatively different experiences. The basis for identification of modalities is proposed to be constituted by self-organized comparative operations across a network of unimodal and multimodal sensory areas. However, such network interactions alone cannot answer the question how sensory feature detectors collectively account for an integrated, yet phenomenally differentiated experiential content. This (...) problem turns out to be different from, although related to, the binding problem. It is proposed that the neural correlate of an enriched, multimodal experience is constituted by the attractor state of a dynamic associative network. Within this network, unimodal and multimodal sensory maps continuously interact to influence each other’s attractor state, so that a feature change in one modality results in a fast re-coding of feature information in another modality. In this scheme, feature detection is coded by firing-rate, whereas firing phase codes relational aspects. (shrink)

For a robot to be capable of development it must be able to explore its environment and learn from its experiences. It must find opportunities to experience the unfamiliar in ways that reveal properties valid beyond the immediate context. In this paper, we develop a novel method for using the rhythm of everyday actions as a basis for identifying the characteristic appearance and sounds associated with objects, people, and the robot itself. Our approach is to identify and segment groups of (...) signals in individual modalities based on their rhythmic variation, then to identify and bind causally-related groups of signals across different modalities. By including proprioception as a modality, this cross-modal binding method applies to the robot itself, and we report a series of experiments in which the robot learns about the characteristics of its own body. (shrink)

Cognitive functions like perception, memory, language, or consciousness are based on highly parallel and distributed information processing by the brain. One of the major unresolved questions is how information can be integrated and how coherent representational states can be established in the distributed neuronal systems subserving these functions. It has been suggested that this so-called ''binding problem'' may be solved in the temporal domain. The hypothesis is that synchronization of neuronal discharges can serve for the integration of distributed neurons into (...) cell assemblies and that this process may underlie the selection of perceptually and behaviorally relevant information. As we intend to show here, this temporal binding hypothesis has implications for the search of the neural correlate of consciousness. We review experimental results, mainly obtained in the visual system, which support the notion of temporal binding. In particular, we discuss recent experiments on the neural mechanisms of binocular rivalry which suggest that appropriate synchronization among cortical neurons may be one of the necessary conditions for the buildup of perceptual states and awareness of sensory stimuli. (shrink)

The brains of higher mammals are extraordinary integrative devices. Signals from large numbers of functionally specialized groups of neurons distributed over many brain regions are integrated to generate a coherent, multimodal scene. Signals from the environment are integrated with ongoing, patterned neural activity that provides them with a meaningful context. We review recent advances in neurophysiology and neuroimaging that are beginning to reveal the neural mechanisms of integration. In addition, we discuss concepts and measures derived from information theory that lend (...) a theoretical basis to the notion of complexity as integration of information and suggest new experimental tests of these concepts. (shrink)

In attempts to formulate a computational understanding of brain function, one of the fundamental concerns is the data structure by which the brain represents information. For many decades, a conceptual framework has dominated the thinking of both brain modelers and neurobiologists. That framework is referred to here as "classical neural networks." It is well supported by experimental data, although it may be incomplete. A characterization of this framework will be offered in the next section. Difficulties in modeling important functional aspects (...) of the brain on the basis of classical neural networks alone have led to the recognition that another, general mechanism must be invoked to explain brain function. That mechanism I call " binding." Binding by neural signal synchrony had been mentioned several times in the liter ature before it was fully formulated as a general phenomenon. Although experimental evidence for neural syn chrony was soon found, the idea was largely ignored for many years. Only recently has it become a topic of animated discussion. In what follows, I will summarize the nature and the roots of the idea of binding, especially of temporal binding, and will discuss some of the objec tions raised against it. (shrink)

Computer vision systems are, on most counts, poor performers, when compared to their biological counterparts. The reason for this may be that computer vision is handicapped by an unreasonable assumption regarding what it means to see, which became prevalent as the notions of intrinsic images and of representation by reconstruction took over the field in the late 1970’s. Learning from biological vision may help us to overcome this handicap.

We introduce a new version of the perceptual retouch model. This model was used for explaining properties of temporal interaction of successive objects in reaching conscious representation. The new model incorporates two interactive binding operations – binding features for objects and binding the bound feature-objects with a large scale oscillatory system that corresponds to perceptual consciousness. Here, the typical result of masking experiments – second object advantage in conscious perception – is achieved by applying the effects of a common synchronizing (...) oscillator with a delay. This delayed modulation of each of the feature-binding first-order oscillators that represent emerging and decaying neural activities of each of the objects guarantees that the oscillating synchrony of the feature-neurons of the following object is higher than the synchrony of the feature-neurons of the first presented object. Thus we model the fact that the following object dominates the preceding object in conscious perception. We also show the capacity of the model to simulate illusory misbinding of features from different objects. The third qualitative effect, the relative release of the first object from backward masking is achieved by priming the non-specific oscillatory modulation ahead in time. (shrink)

Humans’ interactions with each other or with socially competent machines exhibit lawful coordination patterns at multiple levels of description. According to Coordination Dynamics, such laws specify the flow of coordination states produced by functional synergies of elements (e.g., cells, body parts, brain areas, people…) that are temporarily organized as single, coherent units. These coordinative structures or synergies may be mathematically characterized as informationally coupled self-organizing dynamical systems (Coordination Dynamics). In this paper, we start from a simple foundation, an elemental model (...) system for social interactions, whose behavior has been captured in the Haken-Kelso-Bunz (HKB) model. We follow a tried and tested scientific method that tightly interweaves experimental neurobehavioral studies and mathematical models. We use this method to further develop a body of empirical research that advances the theory toward more generalized forms. In concordance with this interdisciplinary spirit, the present paper is written both as an overview of relevant advances and as an introduction to its mathematical underpinnings. We demonstrate HKB’s evolution in the context of social coordination along several directions, with its applicability growing to increasingly complex scenarios. In particular, we show that accommodating for symmetry breaking in intrinsic dynamics and coupling, multiscale generalization and adaptation are principal evolutions. We conclude that a general framework for social coordination dynamics is on the horizon, in which models support experiments with hypothesis generation and mechanistic insights. (shrink)