Musical performance is a multimodal experience, for performers and listeners alike. This paper reports on a pilot study which constitutes the first step toward a comprehensive approach to the experience of music as performed. We aim at bridging the gap between qualitative and quantitative approaches, by combining methods for data collection. The purpose is to build a data corpus containing multimodal measures linked to high-level subjective observations. This will allow for a systematic inclusion of the knowledge of music professionals in (...) an analytic framework, which synthesizes methods across established research disciplines. We outline the methods we are currently developing for the creation of a multimodal data corpus dedicated to the analysis and exploration of instrumental music performance from the perspective of embodied music cognition. This will enable the study of the multiple facets of instrumental music performance in great detail, as well as lead to the development of music creation techniques that take advantage of the cross-modal relationships and higher-level qualities emerging from the analysis of this multi-layered, multimodal corpus. The results of the pilot project suggest that qualitative analysis through stimulated recall is an efficient method for generating higher-level understandings of musical performance. Furthermore, the results indicate several directions for further development, regarding observational movement analysis, and computational analysis of coarticulation, chunking, and movement qualities in musical performance. We argue that the development of methods for combining qualitative and quantitative data are required to fully understand expressive musical performance, especially in a broader scenario in which arts, humanities, and science are increasingly entangled. The future work in the project will therefore entail an increasingly multimodal analysis, aiming to become as holistic as is music in performance. (shrink)

The theory of Participatory Discrepancies (or PDs) claims that minute temporal asynchronies (microtiming) in music performance are crucial for prompting bodily entrainment in listeners, which is a fundamental effect of the “groove” experience. Previous research has failed to find evidence to support this theory. The present study tested the influence of varying PD magnitudes on the beat-related body movement behavior of music listeners. 160 participants (79 music experts, 81 non-experts) listened to twelve music clips in either Funk or Swing style. (...) These stimuli were based on two audio recordings (one in each style) of expert drum and bass duo performances. In one series of six clips, the PDs were downscaled from their originally performed magnitude to complete quantization in steps of 20%. In another series of six clips, the PDs were upscaled from their original magnitude to double magnitude in steps of 20%. The intensity of the listeners’ beat-related head movement was measured using video-based motion capture technology and Fourier analysis. A mixed-design four-factor ANOVA showed that the PD manipulations had a significant effect on the expert listeners’ entrainment behavior. The experts moved more when listening to stimuli with PDs that were downscaled by 60% compared to completely quantized stimuli. This finding offers partial support for PD theory: PDs of a certain magnitude do augment entrainment in listeners. But the effect was found to be small to moderately sized, and it affected music expert listeners only. (shrink)

Humans possess the ability to extract highly organized perceptual structures from sequences of temporal stimuli. For instance, we can organize specific rhythmical patterns into hierarchical, or metrical, systems. Despite the evidence of a fundamental influence of the motor system in achieving this skill, few studies have attempted to investigate the organization of our motor representation of rhythm. To this aim, we studied—in musicians and non-musicians—the ability to perceive and reproduce different rhythms. In a first experiment participants performed a temporal order-judgment (...) task, for rhythmical sequences presented via auditory or tactile modality. In a second experiment, they were asked to reproduce the same rhythmic sequences, while their tapping force and timing were recorded. We demonstrate that tapping force encodes the metrical aspect of the rhythm, and the strength of the coding correlates with the individual’s perceptual accuracy. We suggest that the similarity between perception and tapping-force organization indicates a common representation of rhythm, shared between the perceptual and motor systems. (shrink)