We investigated how two cues to contrast—beat gesture and contrastive pitch accenting—affect comprehenders' cognitive load during processing of spoken referring expressions. In two visual‐world experiments, we orthogonally manipulated the presence of these cues and their felicity, or fit, with the local (sentence‐level) referential context in critical referring expressions while comprehenders' task‐evoked pupillary responses (TEPRs) were examined. In Experiment 1, beat gesture and contrastive accenting always matched the referential context of filler referring expressions and were therefore relatively felicitous on the global (...) (experiment) level, whereas in Experiment 2, beat gesture and contrastive accenting never fit the referential context of filler referring expressions and were therefore infelicitous on the global level. The results revealed that both beat gesture and contrastive accenting increased comprehenders' cognitive load. For beat gesture, this increase in cognitive load was driven by both local and global infelicity. For contrastive accenting, this increase in cognitive load was unaffected when cues were globally felicitous but exacerbated when cues were globally infelicitous. Together, these results suggest that comprehenders' cognitive resources are taxed by processing infelicitous use of beat gesture and contrastive accenting to convey contrast on both the local and global levels. (shrink)

Psycholinguistic research has long established that focus-marked words have a processing advantage over other words in an utterance, e.g. they are recognised more quickly and remembered better. More recently, studies have shown that listeners infer contextual alternatives to a focused word in a spoken utterance, when marked with a contrastive accent, even when the alternatives are not explicitly mentioned in the discourse. This has been shown by strengthened priming of contextual alternatives to the word, but not other noncontrastive semantic associates, (...) when it is contrastively accented, e.g. after hearing ``The {\em customer} opened the window", {\em salesman} is strongly primed, but not {\em product}. This is consistent with Rooth's (1992) theory that \deleted{the focus is not only the most informative part of an utterance, but also that} focus-marking signals the presence of alternatives to the focus. However, almost all of the research carried out in this area has been on Germanic languages. Further, most of this work has looked only at one kind of focus-marking, by contrastive accenting (prosody). This paper reports on a cross-modal lexical priming study in Mandarin Chinese, looking at whether focus-marking heightens activation, i.e. priming, of words and their alternatives. Two kinds of focus-marking were investigated: prosodic and syntactic. Prosodic prominence is an important means of focus-marking in Chinese, however, it is realised through pitch range expansion, rather than accenting. The results showed that focus\added{ed} words, as well as their alternatives, were primed when the subject prime word carried contrastive prosodic prominence. Syntactic focus-marking, however, did not enhance priming of focused words or their alternatives. Noncontrastive semantic associates were not primed with either kind of focus-marking. These results extend previous findings on focus and alternative priming for the first time to Chinese. They also suggest that the processing advantages of focus, including priming alternatives, are particularly related to prosodic prominence, at least in Chinese and Germanic languages. This research sheds light on what linguistic mechanisms listeners use to identify important information, generate alternatives and understand implicature necessary for successful communication. (shrink)

Intonation plays an integral role in comprehending spoken language. Listeners can rapidly integrate intonational information to predictively map a given pitch accent onto the speaker's likely referential intentions. We use mouse tracking to investigate two questions: (a) how listeners draw predictive inferences based on information from intonation? and (b) how listeners adapt their online interpretation of intonational cues when these are reliable or unreliable? We formulate a novel Bayesian model of rational predictive cue integration and explore predictions derived under a (...) concrete linking hypothesis relating a quantitative notion of evidential strength of a cue to the moment in time, relative to the unfolding speech signal, at which mouse trajectories turn towards the eventually selected option. In order to capture rational belief updates after concrete observations of a speaker's behavior, we formulate and explore an extension of this model that includes the listener's hierarchical beliefs about the speaker's likely production behavior. Our results are compatible with the assumption that listeners rapidly and rationally integrate all available intonational information, that they expect reliable intonational information initially, and that they adapt these initial expectations gradually during exposition to unreliable input. All materials, data, and scripts can be retrieved here: https://osf.io/dnbuk/. (shrink)

By manipulating the location of prosodic boundary and the semantic bias of the ambiguous “V+N1+de+N2” phrase, which is composed of one verb (V), one noun (N1), one functional word (de), and another noun (N2), this study investigated how prosodic boundary and the semantic bias affect the processing of temporary ambiguous sentences formed by the ambiguous phrase “V+N1+de+N2” through an eye movement experiment. We found the effect of prosodic boundary in the late processing stage and observed an interaction between prosodic boundary (...) and the semantic bias of ambiguous phrases as well. The participants required more time for fixation and more regressions occurred when the meaning of the ambiguous phrase guided by prosodic boundary was inconsistent with context, especially when the ambiguous phrase was biased to the narrative-object phrase. This result suggests that prosodic boundary affects the processing of temporal ambiguous sentences and is influenced by the semantic bias of the ambiguous phrase. These findings provide further evidence from Chinese that indicate that implicit prosody plays a general role in language comprehension. (shrink)