Auditory scene analysis is critical for complex auditory processing. We study auditory segregation from the neural network perspective, and develop a framework for primitive auditory scene analysis. The architecture is a laterally coupled two‐dimensional network of relaxation oscillators with a global inhibitor. One dimension represents time and another one represents frequency. We show that this architecture, plus systematic delay lines, can in real time group auditory features into a stream by phase synchrony and segregate different streams by desynchronization. The network (...) demonstrates a set of psychological phenomena regarding primitive auditory scene analysis, including dependency on frequency proximity and the rate of presentation, sequential capturing, and competition among different perceptual organizations. We offer a neurocomputational theory—shifting synchronization theory—for explaining how auditory segregation might be achieved in the brain, and the psychological phenomenon of stream segregation. Possible extensions of the model are discussed. (shrink)

Sensorimotor synchronization, the coordination of physical actions in time with a rhythmic sequence, is a skill that is necessary not only for keeping the beat when making music, but in a wide variety of interpersonal contexts. Being able to attend to temporal regularities in the environment is a prerequisite for event prediction, which lies at the heart of many cognitive and social operations. It is therefore of value to assess and potentially stimulate SMS abilities, particularly in aging and neurocognitive disorders, (...) to understand intra-individual communication in the later stages of life, and to devise effective music-based interventions. While a bulk of research exists about SMS and movement-based interventions in Parkinson’s disease, a lot less is known about other types of neurodegenerative disorders, such as Alzheimer’s disease, vascular dementia, or frontotemporal dementia. In this review, we outline the brain and cognitive mechanisms involved in SMS with auditory stimuli, and how they might be subject to change in healthy and pathological aging. Globally, SMS with isochronous sounds is a relatively well-preserved skill in old adulthood and in patients with NCDs. At the same time, natural tapping speed decreases with age. Furthermore, especially when synchronizing to sequences at slow tempi, regularity and precision might be lower in older adults, and even more so in people with NCDs, presumably due to the fact that this process relies on attention and working memory resources that depend on the prefrontal cortex and parietal areas. Finally, we point out that the effect of the severity and etiology of NCDs on sensorimotor abilities is still unclear: More research is needed with moderate and severe NCD, comparing different etiologies, and using complex auditory signals, such as music. (shrink)

P3 is the most prominent of the electrical potentials of the human electroencephalogram that are sensitive to psychological variables. According to the most influential current hypothesis about its psychological significance [E. Donchin's], the “context updating” hypothesis, P3 reflects the updating of working memory. This hypothesis cannot account for relevant portions of the available evidence and it entails some basic contradictions. A more general formulation of this hypothesis is that P3 reflects the updating of expectancies. This version implies that P3-evoking stimuli (...) are initially unexpected but later become expected. This contradiction cannot be resolved within this formulation. The alternative “context closure” hypothesis retains the concept of “strategic information processing” emphasized by the context updating hypothesis. P3s are evoked by events that are awaited when subjects deal with repetitive, highly structured tasks; P3s arise from subjects' combining successive stimuli into larger units. The tasks in which P3s are elicited can accordingly be classified in terms of their respective formal sequences of stimuli. P3 may be a physiological indicator of excess activation being released from perceptual control areas. (shrink)

Music can be described as sequences of events that are structured in pitch and time. Studying music processing provides insight into how complex event sequences are learned, perceived, and represented by the brain. Given the temporal nature of sound, expectations, structural integration, and cognitive sequencing are central in music perception (i.e., which sounds are most likely to come next and at what moment should they occur?). This paper focuses on similarities in music and language cognition research, showing that music cognition (...) research provides insight into the understanding of not only music processing but also language processing and the processing of other structured stimuli. The hypothesis of shared resources between music and language processing and of domain-general dynamic attention has motivated the development of research to test music as a means to stimulate sensory, cognitive, and motor processes. (shrink)

The aim of this contribution is to broaden the concept of musical meaning from an abstract and emotionally neutral cognitive representation to an emotion-integrating description that is related to the evolutionary approach to music. Starting from the dispositional machinery for dealing with music as a temporal and sounding phenomenon, musical emotions are considered as adaptive responses to be aroused in human beings as the product of neural structures that are specialized for their processing. A theoretical and empirical background is provided (...) in order to bring together the findings of music and emotion studies and the evolutionary approach to musical meaning. The theoretical grounding elaborates on the transition from referential to affective semantics, the distinction between expression and induction of emotions, and the tension between discrete-digital and analog-continuous processing of the sounds. The empirical background provides evidence from several findings such as infant-directed speech, referential emotive vocalizations and separation calls in lower mammals, the distinction between the acoustic and vehicle mode of sound perception, and the bodily and physiological reactions to the sounds. It is argued, finally, that early affective processing reflects the way emotions make our bodies feel, which in turn reflects on the emotions expressed and decoded. As such, there is a dynamic tension between nature and nurture, which is reflected in the nature-nurture-nature cycle of musical sense-making. (shrink)

BackgroundCognitive deficits are one of the core features of major depressive disorder that play crucial role in functional recovery. Studies have explored cognitive deficits in MDD, however, given inconsistent results, especially in mild-moderate MDD. Recently, studies have explored music as cognitive ability in various clinical conditions. In MDD, large focus has been on evaluating emotion deficits and just a handful on music cognition. With growing evidence on use of music based intervention to target cognitive deficits, it is imperative to explore (...) nature of music cognitive ability in MDD.AimTo examine musical and neuro-cognitive deficits in patients with mild-moderate MDD.MethodsPatients diagnosed with mild or moderate MDD and matched healthy controls were evaluated on selected tests from NIMHANS Neuropsychological test battery and Montreal battery for evaluation of amusia.ResultsMDD group performed significantly lower than HC on working memory, verbal learning and retention. Three indices were computed for a comprehensive evaluation. Groups did not differ significantly in any of the indices- focused attention, executive function, learning and memory as well as on music cognition. Focused attention and memory index predicted music cognition in HC and the combined group. Attention alone contributed to 62.1% of variance in music cognition. Similarly, music cognition significantly predicted focused attention.ConclusionIndividuals with mild-moderate MDD show significant deficits in working memory, verbal learning and memory, however, not in music cognition. There exists a significant relationship between music cognition and attention, which could be implicated in use of music interventions to ameliorate cognitive deficits. Limitations of study include small sample size and heterogeneity. Future studies on larger cohort examining musical emotion perception and neurocognition is imperative to have deeper understanding of this debilitating condition. (shrink)

We address how listeners perceive temporal regularity in music performances, which are rich in temporal irregularities. A computational model is described in which a small system of internal self‐sustained oscillations, operating at different periods with specific phase and period relations, entrains to the rhythms of music performances. Based on temporal expectancies embodied by the oscillations, the model predicts the categorization of temporally changing event intervals into discrete metrical categories, as well as the perceptual salience of deviations from these categories. The (...) model's predictions are tested in two experiments using piano performances of the same music with different phrase structure interpretations (Experiment 1) or different melodic interpretations (Experiment 2). The model successfully tracked temporal regularity amidst the temporal fluctuations found in the performances. The model's sensitivity to performed deviations from its temporal expectations compared favorably with the performers' structural (phrasal and melodic) intentions. Furthermore, the model tracked normal performances (with increased temporal variability) better than performances in which temporal fluctuations associated with individual voices were removed (with decreased variability). The small, systematic temporal irregularities characteristic of human performances (chord asynchronies) improved tracking, but randomly generated temporal irregularities did not. These findings suggest that perception of temporal regularity in complex musical sequences is based on temporal expectancies that adapt in response to temporally fluctuating input. (shrink)

Previous studies of verbal short-term memory indicate that STM for serial order may be linked to language development and developmental language disorder. To clarify whether a domain-general mechanism is impaired in DLD, we studied the relations between age, non-verbal serial STM, and language competence. We hypothesized that non-verbal serial STM differences between groups of children with DLD and typically developing children are linked to their language acquisition differences. Fifty-one children with DLD and sixty-six TD children participated as part of the (...) HelSLI project in this cross-sectional study. The children were 4–6-year-old monolingual native Finnish speakers. They completed several tests of language and cognitive functioning, as well as new game-like tests of visual and auditory non-verbal serial STM. We used regression analyses to examine how serial STM moderates the effect of age on language. A non-verbal composite measure of serial visual and auditory STM moderated cross-sectional development of receptive language in the children with DLD. This moderation was not observed in the TD children. However, we found more rapid cross-sectional development of non-verbal serial STM in the TD children than in the children with DLD. The results suggest that children with DLD may be more likely to have compromised general serial STM processing and that superior non-verbal serial STM may be associated with better language acquisition in children with DLD. (shrink)

The study addresses the cyclically temporal aspect of sequence recognition, storage and recall using the Recurrent Oscillatory Self-Organizing Map (ROSOM), first introduced by Kaipainen, Papadopoulos and Karhu (1997). The unique solution of the network is that oscillatory States are assigned to network units, corresponding to their `readiness-to-fire''. The ROSOM is a categorizer, a temporal sequence storage system and a periodicity detector designed for use in an ambiguous cyclically repetitive environment. As its external input, the model accepts a multidimensional stream of (...) environment-describing feature configurations with implicit periodicities. The output of the model is one or a few closed cycles abstracted from such a stream, mapped as trajectories on a two-dimensional sheet with an organization reminiscent of multi-dimensional scaling. The model''s capabilities are explored with a variety of workbench data. (shrink)

Midwest Studies In Philosophy, EarlyView.

Our everyday interactions increasingly involve both embodied face-to-face communication and various forms of mediated and distributed communication such as email, skype, and facebook. In daily face-to-face communications, we are connected in rhythm and synchrony at multiple levels ranging from the moment-by-moment continuity of timed syllables to emergent body and vocal rhythms of pragmatic sense-making. Our human capacity to synchronize with each other may be essential for our survival as social beings. Moving our bodies and voices together in time embodies a (...) potent pragmatic purpose that of being together. In this synchrony of self with other, witnessing and being present become part of each other. There is growing research into how rhythm and synchrony operate in embodied face-to-face interaction and this provides parameters for investigating the relations and differences in how we connect and are socially present in the embodied and distributed settings, and understanding the effect of one setting upon the other. This paper explores the arena of research into rhythm in human interaction, musical and linguistic, with a focus on the movements of body and voice. It draws together salient issues and ideas that would form the basis for a framework of rhythm in embodied interaction. (shrink)

Unconscious processes, by whatever name they may be known , are invariably operationalized by the dissociation paradigm, any situation involving the dissociation between two indicators , one of availability and the other, of accessibility , such that, ε>α. Subliminal perception has been traditionally defined by a special case of the dissociation paradigm in which availability exceeds accessibility when accessibility is null . Construct validity issues bedevil all dissociation paradigms since it is not clear what might constitute appropriate indicators that, moreover, (...) are pure and exhaustive. Semantic and theoretic drifts in the recent literature—e.g., the confusion of different versions of the dissociation paradigm, the equation of conscious–unconscious with direct–indirect tests, and the foisting of the criterion of qualitative differences—have tended to undermine emerging theoretic parsimony. On the other hand, a crucial factor has been left out of theory development: time. Both ε and α can rise and fall over time, often asynchronously, and so dissociations may wax and wane and, even, reverse over time. Some laboratory evidence suggests that accessibility measures , as they approach chance, may actually dip below chance . If so, d′=0 , could be an averaging artifact of positive and negative d′s. Conscious accessibility is not either–or but more or less, and variable over time. (shrink)

To understand the endogenous components of the event-related brain potential (ERP), we must use data about the components' antecedent conditions to form hypotheses about the information-processing function of the underlying brain activity. These hypotheses, in turn, generate testable predictions about the consequences of the component. We review the application of this approach to the analysis of the P300 component. The amplitude of the P300 is controlled multiplicatively by the subjective probability and the task relevance of the eliciting events, whereas its (...) latency depends on the duration of stimulus evaluation. These and other factors suggest that the P300 is a manifestation of activity occurring whenever one's model of the environment must be revised. Tests of three predictions based on this “context updating” model are reviewed. Verleger's critique is based on a misconstrual of the model as well as a partial and misleading reading of the relevant literature. (shrink)

To understand the endogenous components of the event-related brain potential (ERP), we must use data about the components' antecedent conditions to form hypotheses about the information-processing function of the underlying brain activity. These hypotheses, in turn, generate testable predictions about the consequences of the component. We review the application of this approach to the analysis of the P300 component. The amplitude of the P300 is controlled multiplicatively by the subjective probability and the task relevance of the eliciting events, whereas its (...) latency depends on the duration of stimulus evaluation. These and other factors suggest that the P300 is a manifestation of activity occurring whenever one's model of the environment must be revised. Tests of three predictions based on this “context updating” model are reviewed. Verleger's critique is based on a misconstrual of the model as well as a partial and misleading reading of the relevant literature. (shrink)

In a century where humans and machines—powered by artificial intelligence or not—increasingly work together, it is of interest to understand human processing of multi-sensory stimuli in relation to attention and working memory. This paper explores whether and when supporting visual information with rhythmic auditory stimuli can optimize multi-sensory information processing. In turn, this can make the interaction between humans or between machines and humans more engaging, rewarding and activating. For this purpose a novel working memory paradigm was developed where participants (...) are presented with a series of five target digits randomly interchanged with five distractor digits. Their goal is to remember the target digits and recall them orally. Depending on the condition support is provided by audio and/or rhythm. It is expected that the sound will lead to a better performance. It is also expected that this effect of sound is different in case of rhythmic and non-rhythmic sound. Last but not least, some variability is expected across participants. To make correct conclusions, the data of the experiment was statistically analyzed in a classic way, but also predictive models were developed in order to predict outcomes based on a range of input variables related to the experiment and the participant. The effect of auditory support could be confirmed, but no difference was observed between rhythmic and non-rhythmic sounds. Overall performance was indeed affected by individual differences, such as visual dominance or perceived task difficulty. Surprisingly a music education did not significantly affect the performance and even tended toward a negative effect. To better understand the underlying processes of attention, also brain activation data, e.g., by means of electroencephalography, should be recorded. This approach can be subject to a future work. (shrink)