The current study used cross-modal oddball tasks to examine cardiac and behavioral responses to changing auditory and visual information. When instructed to press the same button for auditory and visual oddballs, auditory dominance was found with cross-modal presentation slowing down visual response times more than auditory response times (Experiment 1). When instructed to make separate responses to auditory and visual oddballs, visual dominance was found with cross-modal presentation decreasing auditory discrimination and participants also made more visual-based than auditory-based errors on (...) cross-modal trials (Experiment 2). Experiment 3 increased task demands while requiring a single button press and found evidence of auditory dominance, suggesting that it is unlikely that increased task demands can account for the reversal in Experiment 2. Auditory processing speed was the best predictor of auditory dominance, with auditory dominance being stronger in participants who were slower at processing the sounds, whereas, auditory and visual processing speed and baseline heart rate variability did not predict visual dominance. Examination of cardiac responses that were time-locked with stimulus onset showed cross-modal facilitation effects, with auditory and visual discrimination occurring earlier in the course of processing in the cross-modal condition than in the unimodal conditions. The current findings showing that response demand manipulations reversed modality dominance and that time-locked cardiac responses show cross-modal facilitation, not interference, suggest that auditory and visual dominance effects may both be occurring later in the course of processing, not from disrupted encoding. (shrink)

The present studies examined whether implied tactile properties during language comprehension influence subsequent direct tactile perception, and the specificity of any such effects. Participants read sentences that implicitly conveyed information regarding tactile properties (e.g., Grace tried on a pair of thick corduroy pants while shopping) that were either related or unrelated to fabrics and varied in implied texture (smooth, medium, rough). After reading each sentence, participants then performed an unrelated rating task during which they felt and rated the texture of (...) a presented fabric. Results demonstrated that the texture properties implied in sentences influence direct tactile perception. Specifically, after reading about a smooth or rough texture, subsequent fabric ratings became notably smoother or rougher, respectively. However, we also show that there was some specificity to these effects: Fabric-related sentences elicited more specific and interactive effects on subsequent ratings. Together, we demonstrate that under certain circumstances, language comprehension can prime tactile representations and affect direct tactile perception. Results are discussed with regard to the nature and scope of multimodal mental simulation during reading. (shrink)

Although it is well documented that language plays an important role in cognitive development, there are different views concerning the mechanisms underlying these effects. Some argue that even early in development, effects of words stem from top‐down knowledge, whereas others argue that these effects stem from auditory input affecting attention allocated to visual input. Previous research (e.g., Robinson & Sloutsky, 2004a) demonstrated that non‐speech sounds attenuate processing of corresponding visual input at 8, 12, and 16 months of age, whereas the (...) current study demonstrates that words attenuate visual processing at 10 months but not at 16 months (Experiment 1). Furthermore, prefamiliarization with non‐speech sounds (Experiment 2) resulted in able processing of visual input by 16‐month‐olds. These findings suggest that some effects of labels found early in development may stem from familiarity with human speech. The possibility of general‐auditory factors underlying the effects of words on cognitive development is discussed. (shrink)

First, we discuss issues raised with respect to the Theory of Event Coding (TEC)'s scope, that is, its limitations and possible extensions. Then, we address the issue of specificity, that is, the widespread concern that TEC is too unspecified and, therefore, too vague in a number of important respects. Finally, we elaborate on our views about TEC's relations to other important frameworks and approaches in the field like stages models, ecological approaches, and the two-visual-pathways model. Footnotes1 We acknowledge the precedence (...) of both Freud¹s Instincts and Their Vicissitudes (1915) and Neisser¹s Stimulus Information and Its Vicissitudes (a term Neisser borrowed from Freud for his monograph “Cognitive psychology,” 1967). (shrink)

Many situations require the simultaneous processing of auditory and visual information, however, stimuli presented to one sensory modality can sometimes interfere with processing in a second sensory modality (i.e., modality dominance). The current study further investigated modality dominance by examining how task demands and bimodal presentation affect speeded auditory and visual discriminations. Participants in the current study had to quickly determine if two words, two pictures, or two word-picture pairings were the same or different, and we manipulated task demands across (...) three different conditions. In an immediate recognition task, there was only one second between the two stimuli/stimulus pairs and auditory dominance was found. Compared to the respective unimodal baselines, pairing pictures and words together slowed down visual responses and sped up auditory responses. Increasing the interstimulus interval to four seconds and blocking verbal rehearsal weakened auditory dominance effects, however, conflicting and redundant visual cues sped up auditory discriminations. Thus, simultaneously presenting pictures and words had different effects on auditory and visual processing, with bimodal presentation slowing down visual processing and speeding up auditory processing. These findings are consistent with a proposed mechanism underlying auditory dominance, which posits that auditory stimuli automatically grab attention and attenuate/delay visual processing. (shrink)

In two experiments I examined what favorable conditions of early source monitoring performances are and what cognitive, social-cognitive and social factors are relevant to early source monitoring performances. Experiment 1 revealed that an action encoding mode is a favorable condition for 4- and 5-year-olds? external and reality monitoring performances but not for the 3-year-olds? source monitoring performances. Experiment 2 revealed that the familarity with the person source is a favorable condition for younger 3-, older 3-, 4- and 5-year old children. (...) The experiment also showed that multiple source attributions are possible at the middle of the third year of life and that the internal source monitoring instruction can be optimized for older but not for younger 3-year-old children. Both experiments revealed specific relations between the examined source monitoring performances and the selected working memory performances, verbal abilities, theory of mind abilities and social factors. (shrink)

The phenomenology of controlled action depends on comparisons between predicted and actually perceived sensory feedback called action-effects. We investigated if intervening task-irrelevant but semantically related information influences monitoring processes that give rise to a sense of control. Participants judged whether a moving box “obeyed” or “disobeyed” their own arrow keystrokes or visual cues representing the computer’s choices . During 1 s delays between keystrokes/cues and box movements, participants vocalized directions cued by letters inside the box. Congruency of cued vocalizations was (...) manipulated relative to previously selected keystrokes and upcoming box movements. In Experiment 1, reported obey moves and feelings of control reflected the true frequency of obey moves, but were also modulated by vocalizations. Incongruent vocalizations reduced reported obey moves, whereas congruent vocalizations increased them. In Experiment 2, vocalizations had stronger effects when their congruence with primary-task box movement was consistent for several consecutive moves before congruence changed. In Experiment 3, analogous impacts of vocalizations occurred when the computer selected the directions and participants judged whether the computer had control of the box. We conclude that predicted and perceived action-effects associated with semantically related but separate and ostensibly irrelevant actions can be conflated with one another. This interference is not restricted to actions performed with the same effector or within the same modality, or even by the same actor. Thus in estimating degrees of control, the mind integrates across ongoing action systems, whether or not they are logically task-relevant. (shrink)

How do we share embodied knowledge? How do we understand the world through our bodies? How can we effectively interpret and communicate somatic experiences to a wider audience? These questions emerged during a collaborative research project Let’s Improv It (August 2016, Plymouth University), which set out to explore how kinaesthetic empathy and multisensory perception help us to understand our own actions, intentions and emotions, as well as those of others. We additionally questioned the role and perception of physical and emotional (...) touch within embodied knowledge. After a five-day practice-led investigation, a 20-minute improvised somatic movement score was developed with the aim of providing a novel experience of touch and movement. The authors collectively delivered the score and reflected on the outcomes of this experience over the course of a year (2016–2017). In this paper, we explore how our research project expanded the boundaries of the conventional concepts of knowledge and cognition. We see such participatory sessions, in which movement and embodied experience freely unfold in time and space, as a ‘laboratory’ in which we examine the underlying mechanisms of collaboration. We reflect on how such an experience can be seen as a creative process, or as an emergent, collaborative artwork. The participants are both the creators and, simultaneously, the audience of our improvised experience. The experience provided a non-judgmental context for physical engagement and observation, which is an outcome that will be introduced alongside participants’ feedback. Overall, the project revealed that shared embodied knowledge is highly appreciated, particularly among those without previous experience with embodied enquiry or movement research. (shrink)