Studies of native syntactic processing often target phrase structure violations that do not occur in natural production. In contrast, this study examines how variation in basic word order is processed, looking specifically at structures traditionally labelled as violations but that do occur naturally. We examined Swedish verb-second and verb-third word order processing in adult native Swedish speakers, manipulating sentence-initial adverbials in acceptability judgements, in simultaneously recorded event-related potentials to visually presented sentences and in a written sentence completion task. An initial (...) corpus study showed that the adverbials differ in frequency in fronted position, and although all occur mainly with V2 word order, kanske occurs more frequently with V3 in natural production than both idag and hemma. The experimental results reflected these patterns such that V2 sentences were overall more frequently produced and were deemed more acceptable than V3 sentences. The ERP results consisted of a biphasic N400/P600 response to V3 word order that indicated effects of word retrieval and sentence reanalysis. We also found consistent effects of adverbials. As predicted, V3 was produced more frequently and judged as more acceptable in Kanske sentences than in sentences with the other two adverbials. The ERP analyses showed stronger effects for idag and hemma with V3, especially regarding the P600. The results suggest that the naturally occurring word order ‘violation’, V3 with kanske, is processed differently than V3 with other adverbials where the V2 norm is stronger. Moreover, these patterns are related to individuals’ own production patterns. Overall, the results suggest a more varied native word order processing than previously reported. (shrink)

Iconic gesture-speech integration is a relatively recent field of investigation with numerous researchers studying its various aspects. The results obtained are just as diverse. The definition of iconic gestures is often overlooked in the interpretations of results. Furthermore, while most behavioral studies have demonstrated an advantage of bimodal presentation, brain activity studies show a diversity of results regarding the brain regions involved in the processing of this integration. Clinical studies also yield mixed results, some suggesting parallel processing channels, others a (...) unique and integrated channel. This review aims to draw attention to the methodological variations in research on iconic gesture-speech integration and how they impact conclusions regarding the underlying phenomena. It will also attempt to draw together the findings from other relevant research and suggest potential areas for further investigation in order to better understand processes at play during speech integration process. (shrink)

Background -/- Previous literature suggests that those with reading disability (RD) have more pronounced deficits during semantic processing in reading as compared to listening comprehension. This discrepancy has been supported by recent neuroimaging studies showing abnormal activity in RD during semantic processing in the visual but not in the auditory modality. Whether effective connectivity between brain regions in RD could also show this pattern of discrepancy has not been investigated. Methodology/Principal Findings -/- Children (8- to 14-year-olds) were given a semantic (...) task in the visual and auditory modality that required an association judgment as to whether two sequentially presented words were associated. Effective connectivity was investigated using Dynamic Causal Modeling (DCM) on functional magnetic resonance imaging (fMRI) data. Bayesian Model Selection (BMS) was used separately for each modality to find a winning family of DCM models separately for typically developing (TD) and RD children. BMS yielded the same winning family with modulatory effects on bottom-up connections from the input regions to middle temporal gyrus (MTG) and inferior frontal gyrus(IFG) with inconclusive evidence regarding top-down modulations. Bayesian Model Averaging (BMA) was thus conducted across models in this winning family and compared across groups. The bottom-up effect from the fusiform gyrus (FG) to MTG rather than the top-down effect from IFG to MTG was stronger in TD compared to RD for the visual modality. The stronger bottom-up influence in TD was only evident for related word pairs but not for unrelated pairs. No group differences were noted in the auditory modality. Conclusions/Significance -/- This study revealed a modality-specific deficit for children with RD in bottom-up effective connectivity from orthographic to semantic processing regions. There were no group differences in connectivity from frontal regions, suggesting that the core deficit in RD is not in top-down modulation. (shrink)

In recent years, foreign language learning has been proposed as a possible cognitive intervention for older adults. However, the brain network and cognitive functions underlying FLL has remained largely unconfirmed in older adults. In particular, older and younger adults have markedly different cognitive profile—while older adults tend to exhibit decline in most cognitive domains, their semantic memory usually remains intact. As such, older adults may engage the semantic functions to a larger extent than the other cognitive functions traditionally considered the (...) most important. Using anatomical measurements and a cognitive test battery, the present study examined this hypothesis in twenty cognitively normal older adults, who participated in a two-month Italian learning programme. Results showed that the immediate learning success and long-term retention of Italian vocabularies were most consistently predicted by the anatomical measures of the left pars orbitalis and left caudal middle frontal cortex, which are implicated in semantic and episodic memory functions. Convergent evidence was also found based on the pattern of cognitive associations. Our results are consistent with a prominent role of semantic and episodic memory functions in vocabulary learning in older learners. (shrink)

Expectation-based theories of language comprehension, in particular Surprisal Theory, go a long way in accounting for the behavioral correlates of word-by-word processing difficulty, such as reading times. An open question, however, is in which component of the Event-Related brain Potential signal Surprisal is reflected, and how these electrophysiological correlates relate to behavioral processing indices. Here, we address this question by instantiating an explicit neurocomputational model of incremental, word-by-word language comprehension that produces estimates of the N400 and the P600—the two most (...) salient ERP components for language processing—as well as estimates of “comprehension-centric” Surprisal for each word in a sentence. We derive model predictions for a recent experimental design that directly investigates “world-knowledge”-induced Surprisal. By relating these predictions to both empirical electrophysiological and behavioral results, we establish a close link between Surprisal, as indexed by reading times, and the P600 component of the ERP signal. The resultant model thus offers an integrated neurobehavioral account of processing difficulty in language comprehension. (shrink)

It has been shown that counterintuitive ideas from mythological and religious texts are more acceptable than other world knowledge violations. In the present experiment we explored whether this relates to the way they are interpreted. Participants were presented with verification questions that referred to either the literal or a metaphorical meaning of the sentence previously read, in a block-wise design. Both behavioral and electrophysiological results converged. At variance to the literal interpretation of the sentences, the induced metaphorical interpretation specifically facilitated (...) the integration of religious counterintuitions, whereas the semantic processing of non-religious counterintuitions was not affected by the interpretation mode. We suggest that religious ideas tend to operate like other instances of figurative language, such as metaphors, facilitating their acceptability despite their counterintuitive nature. (shrink)

In order to memorize sentences we use both processes of language comprehension during encoding and processes of language production during maintenance. While the former processes are easily testable via controlled presentation of the input, the latter are more difficult to assess directly as language production is typically initiated and controlled internally. In the present event-related potential (ERP) study we track subvocal rehearsal of sentences, with the goal of studying the concomitant planning processes with the help of a silent cued-production task. (...) Native German participants read different types of sentences word-by-word, then were prompted by a visual cue to silently repeat each individual word, in a rehearsal phase. In order to assess both local and global effects of sentence planning, we presented correct sentences, syntactically or semantically violated sentences, or random word order sequences. Semantic violations during reading elicited an N400 effect at the noun violating the selectional restrictions of the preceding verb. Syntactic violations, induced by a gender incongruency between determiner and noun, led to a P600 effect at the same position. Different ERP patterns occurred during the silent production phase. Here, semantically violated sentences elicited an early fronto-central negativity at the verb, while syntactically violated sentences elicited a late right-frontal positivity at the determiner. Random word order was accompanied by long-lasting slow waves during the production phase. The findings are consistent with models of hierarchical sentence planning and further indicate that the ongoing working memory processes are qualitatively distinct from comprehension mechanisms and neurophysiologically specific for syntactic and lexical-semantic level planning. In conclusion, active working memory maintenance of sentences is likely to comprise specific stages of sentence production that are indicated by ERP correlates of syntactic and semantic planning at the phrasal and clausal level respectively. (shrink)

This paper reviews a series of experimental studies that address what we call ‘interface judgement’, which is the complex judgment involving integration from multiple levels of grammatical representation such as the syntax-semantics and prosody-semantics interface. We first discuss the results from the ERP literature connected to NPI licensing in different languages, paying particular attention to the N400 and the P600 as neural correlates of this specific phenomenon and focusing on the study by Xiang et al. (2016). The results of this (...) study show evidence that there are two distinct NPI licensing mechanisms, i.e., licensing and rescuing, in line with Giannakidou (1998, 2006). Then we discuss an acceptability judgement task on Greek NPIs which supports the negativity as a scale hypothesis (Zwarts 1995, 1996, Giannakidou 1998). For the semantics-prosody interface judgment, we discuss two types of findings on two different phenomena and languages: (i) the study by Giannakidou & Yoon (2016) on scalar and non-scalar NPIs in Greek and Korean, which serves as the foundation for Chatzikontantinou (2016)’s study of production data showing distinct prosodic properties in emphatic (scalar) and non-emphatic (non-scalar) Greek NPIs; (ii) a (production and perception) study by Etxeberria & Irurtzun (2015) on the prosodic disambiguation of the scalar/non-scalar readings of sentences containing the focus particle ‘ere’ in Basque. The main conclusion of the paper is that experimental methods of the kind discussed in the paper are useful in establishing physical, quantitative correlates of interface judgement. (shrink)

Studies have suggested that visually presented words are obligatorily decomposed into constituents that could be mapped to language representations. The present study aims to elucidate how orthographic processing of one constituent affects the other and vice versa during a word recognition task. Chinese orthographic system has characters representing syllables and meanings instead of suffixation roles, and the majority of Chinese characters are phonograms that can be further decomposed into phonetic radical and semantic radical. We propose that semantic radical combinability indexed (...) by semantic radicals and the effect of phonological consistency indexed by phonetic radicals would interact with each other during the reading of Chinese phonograms. Twenty-six right-handed native Chinese speakers were recruited to the study. Participants were presented with phonograms divided into four conditions following their semantic radical combinability and phonological consistency. EEG signals were recorded throughout the covert naming task. Our results show that there is an interaction effect between phonological consistency and semantic radical combinability on the right hemisphere N170 activity while reading phonograms. Semantic radical combinability influenced the right hemisphere N170 during the process of low-consistency character reading but not high-consistency character reading. On the other hand, the left hemisphere N170 revealed a more significant activity during reading high-consistency characters and was not affected by radical combinability. In addition, while low-consistency characters revealed a larger P200 than high-consistency characters, the semantic radical combinability effect on P200 was only significant when participants were reading high-consistency characters but not low-consistency characters. These results provide new information about how ERPs are involved in word recognition within the context of interaction among orthographic and phonological dimensions. (shrink)

Ten years ago, researchers using event-related brain potentials to study language comprehension were puzzled by what looked like a Semantic Illusion: Semantically anomalous, but structurally well-formed sentences did not affect the N400 component—traditionally taken to reflect semantic integration—but instead produced a P600 effect, which is generally linked to syntactic processing. This finding led to a considerable amount of debate, and a number of complex processing models have been proposed as an explanation. What these models have in common is that they (...) postulate two or more separate processing streams, in order to reconcile the Semantic Illusion and other semantically induced P600 effects with the traditional interpretations of the N400 and the P600. Recently, however, these multi-stream models have been called into question, and a simpler single-stream model has been proposed. According to this alternative model, the N400 component reflects the retrieval of word meaning from semantic memory, and the P600 component indexes the integration of this meaning into the unfolding utterance interpretation. In the present paper, we provide support for this “Retrieval–Integration ” account by instantiating it as a neurocomputational model. This neurocomputational model is the first to successfully simulate the N400 and P600 amplitude in language comprehension, and simulations with this model provide a proof of concept of the single-stream RI account of semantically induced patterns of N400 and P600 modulations. (shrink)

From an early age, exposure to a spoken language has allowed us to implicitly capture the structure underlying the succession of speech sounds in that language and to segment it into meaningful units. Statistical learning, the ability to pick up patterns in the sensory environment without intention or reinforcement, is thus assumed to play a central role in the acquisition of the rule-governed aspects of language, including the discovery of word boundaries in the continuous acoustic stream. Although extensive evidence has (...) been gathered from artificial languages experiments showing that children and adults are able to track the regularities embedded in the auditory input, as the probability of one syllable to follow another syllable in the speech stream, the developmental trajectory of this ability remains controversial. In this work, we have collected Event-Related Potentials while 5-year-old children and young adults were exposed to a speech stream made of the repetition of eight three-syllable nonsense words presenting different levels of predictability to mimic closely what occurs in natural languages and to get new insights into the changes that the mechanisms underlying auditory statistical learning might undergo through the development. The participants performed the aSL task first under implicit and, subsequently, under explicit conditions to further analyze if children take advantage of previous knowledge of the to-be-learned regularities to enhance SL, as observed with the adult participants. These findings would also contribute to extend our knowledge of the mechanisms available to assist SL at each developmental stage. Although behavioral signs of learning, even under explicit conditions, were only observed for the adult participants, ERP data showed evidence of online segmentation in the brain in both groups, as indexed by modulations in the N100 and N400 components. A detailed analysis of the neural data suggests, however, that adults and children rely on different mechanisms to assist the extraction of word-like units from the continuous speech stream, hence supporting the view that SL with auditory linguistic materials changes through development. (shrink)

Sentences such as "The author started the book" are indeterminate because they do not make explicit what the subject (the author) started doing with the object (the book). In principle, indeterminate sentences allow for an infinite number of interpretations. One theory, however, assumes that these sentences are resolved by semantic coercion, a linguistic process that forces the noun "book" to be interpreted as an activity (e.g., writing the book) or by a process that interpolates this activity information in the resulting (...) enriched semantic composition. An alternative theory, pragmatic, assumes classical semantic composition, whereby meaning arises from the denotation of words and how they are combined syntactically, with enrichment obtained via pragmatic inferences beyond linguistic-semantic processes. Cognitive neuroscience studies investigating the neuroanatomical and functional correlates of indeterminate sentences have shown activations either at the ventromedial pre-frontal cortex or at the left inferior frontal gyrus. These studies have supported the semantic coercion theory assuming that one of these regions is where enriched semantic composition takes place. Employing fMRI, we found that indeterminate sentences activate bilaterally the superior temporal gyrus, the right inferior frontal gyrus, and the anterior cingulate cortex, more so than control sentences ("The author wrote the book"). Activation of indeterminate sentences exceeded that of anomalous sentences ("…drank the book") and engaged more left- and right-hemisphere areas than other sentence types. We suggest that the widespread activations for indeterminate sentences represent the deployment of pragmatic-inferential processes, which seek to enrich sentence content without necessarily resorting to semantic coercion. (shrink)