Evidence from numerous studies using the visual world paradigm has revealed both that spoken language can rapidly guide attention in a related visual scene and that scene information can immediately influence comprehension processes. These findings motivated the coordinated interplay account (Knoeferle & Crocker, 2006) of situated comprehension, which claims that utterance‐mediated attention crucially underlies this closely coordinated interaction of language and scene processing. We present a recurrent sigma‐pi neural network that models the rapid use of scene information, exploiting an utterance‐mediated (...) attentional mechanism that directly instantiates the CIA. The model is shown to achieve high levels of performance (both with and without scene contexts), while also exhibiting hallmark behaviors of situated comprehension, such as incremental processing, anticipation of appropriate role fillers, as well as the immediate use, and priority, of depicted event information through the coordinated use of utterance‐mediated attention to the scene. (shrink)

What mechanisms underlie children’s language production? Structural priming—the repetition of sentence structure across utterances—is an important measure of the developing production system. We propose its mechanism in children is the same as may underlie analogical reasoning: structure-mapping. Under this view, structural priming is the result of making an analogy between utterances, such that children map semantic and syntactic structure from previous to future utterances. Because the ability to map relationally complex structures develops with age, younger children are less successful than (...) older children at mapping both semantic and syntactic relations. Consistent with this account, 4-year-old children showed priming only of semantic relations when surface similarity across utterances was limited, whereas 5-year-olds showed priming of both semantic and syntactic structure regardless of shared surface similarity. The priming of semantic structure without syntactic structure is uniquely predicted by the structure-mapping account because others have interpreted structural priming as a reflection of developing syntactic knowledge. (shrink)

Sequence learning is fundamental to a wide range of cognitive functions. Explaining how sequences—and the relations between the elements they comprise—are learned is a fundamental challenge to cognitive science. However, although hundreds of articles addressing this question are published each year, the actual learning mechanisms involved in the learning of sequences are rarely investigated. We present three experiments that seek to examine these mechanisms during a typing task. Experiments 1 and 2 tested learning during typing single letters on each trial. (...) Experiment 3 tested for “chunking” of these letters into “words.” The results of these experiments were used to examine the mechanisms that could best account for them, with a focus on two particular proposals: statistical transitional probability learning and discriminative error-driven learning. Experiments 1 and 2 showed that error-driven learning was a better predictor of response latencies than either n-gram frequencies or transitional probabilities. No evidence for chunking was found in Experiment 3, probably due to interspersing visual cues with the motor response. In addition, learning occurred across a greater distance in Experiment 1 than Experiment 2, suggesting that the greater predictability that comes with increased structure leads to greater learnability. These results shed new light on the mechanism responsible for sequence learning. Despite the widely held assumption that transitional probability learning is essential to this process, the present results suggest instead that the sequences are learned through a process of discriminative learning, involving prediction and feedback from prediction error. (shrink)

This study investigated inverse preference effects in L2 structural priming of English relative clauses and their potential influences on subsequent learning of target structures. One hundred fourteen Chinese learners of English at a low-to-intermediate proficiency level participated in a structural priming experiment with a pretest-posttest design. The experimental group underwent a priming task in which they orally produced syntactic structures immediately after viewing English object or passive relative clauses as primes, whereas the control group only read sentences unrelated to English (...) relative clauses. A grammaticality judgment task and a sentence completion task were used to measure the inverse preference effect and its subsequent effects on L2 learning. The results showed the presence of structural priming and inverse preference effects in immediate production, which extended to subsequent learning of L2. In subsequent grammaticality judgments and production, L2 learners performed better with English object relative clauses than with English passive relative clauses in comparison with the pretest. The results are discussed in terms of the structural frequency in both L1 and L2 as well as the implicit learning mechanisms of structural priming. (shrink)

Cognitive Science, Volume 46, Issue 1, January 2022.

Native language listeners engage in predictive processing in many processing situations and adapt their predictive processing to the statistics of the input. In contrast, second language listeners engage in predictive processing in fewer processing situations. The current study uses eye-tracking data from two experiments in bilinguals’ native language (L1) and second language (L2) to explore their predictive processing based on contrastive pitch accent cues, and their adaptation in the face of prediction errors. The results of the first experiment show inhibition (...) effects for unpredicted referents in both the L1 and the L2 that can be modeled with a Bayesian adaptation model, suggesting that bilinguals adapt their prediction in the face of prediction errors in a way that is compatible with the model. In contrast, the results of the second experiment, after a training phase that increased the predictive validity of the cue, show inhibition effects for unpredicted referents only in the L1, but not in the L2. In addition, the Bayesian adaptation model significantly predicts only the L1, but not the L2 data. The results are discussed with respect to adaptation to the statistical properties of the input. (shrink)

Upon hearing a scalar adjective in a definite referring expression such as “the big…,” listeners typically make anticipatory eye movements to an item in a contrast set, such as a big glass in the context of a smaller glass. Recent studies have suggested that this rapid, contrastive interpretation of scalar adjectives is malleable and calibrated to the speaker's pragmatic competence. In a series of eye‐tracking experiments, we explore the nature of the evidence necessary for the modulation of pragmatic inferences in (...) language comprehension, focusing on the complementary roles of top–down information ‐ (knowledge about the particular speaker's pragmatic competence) and bottom‐up cues (distributional information about the use of scalar adjectives in the environment). We find that bottom‐up evidence alone (e.g., the speaker says “the big dog” in a context with one dog), in large quantities, can be sufficient to trigger modulation of the listener's contrastive inferences, with or without top‐down cues to support this adaptation. Further, these findings suggest that listeners track and flexibly combine multiple sources of information in service of efficient pragmatic communication. (shrink)

Natural language involves both speaking and listening. Recent models claim that production and comprehension share aspects of processing and are linked within individuals (Dell & Chang, 2014; MacDonald, 2013; Pickering & Garrod, 2004; 2013a). Evidence for this claim has come from studies of cross-modality structural priming, mainly examining processing in the direction of comprehension to production. The current study replicated these comprehension to production findings and developed a novel cross-modal structural priming paradigm from production to comprehension using a temporally-sensitive online (...) measure of comprehension, Event-Related Potentials. For Comprehension-to-Production priming, participants first listened to active or passive sentences and then described target pictures using either structure. In Production-to-Comprehension priming, participants first described a picture using either structure and then listened to target passive sentences while EEG was recorded. Comprehension-to-Production priming showed the expected passive sentence priming for syntactic choice, but not response time or average syllable duration. In Production-to-Comprehension priming, primed, versus unprimed, passive sentences elicited a reduced N400. These effects support the notion that production and comprehension share aspects of processing and are linked within the individual. Moreover, this paradigm can be used for the exploration priming at different linguistic levels as well as the influence of extra-linguistic factors on natural language use. (shrink)

What are the semantic representations that underlie language production? We use structural priming to distinguish between two competing theories. Thematic roles define semantic structure in terms of atomic units that specify event participants and are ordered with respect to each other through a hierarchy of roles. Event structures instead instantiate semantic structure as embedded sub‐predicates that impose an order on verbal arguments based on their relative positioning in these embeddings. Across two experiments, we found that priming for datives depended on (...) the degree of overlap in event structures. Specifically, while all dative structures showed priming, due to common syntax, there was a boost for compositional datives priming other compositional datives. Here, the two syntactic forms have distinct event structures. In contrast, there was no boost in priming for dative light verbs, where the two forms map onto a single event representation. On the thematic roles hypothesis, we would have expected a similar degree of priming for the two cases. Thus, our results support event structural approaches to semantic representation and not thematic roles. (shrink)

Language learning requires linguistic input, but several studies have found that knowledge of second language rules does not seem to improve with more language exposure. One reason for this is that previous studies did not factor out variation due to the different rules tested. To examine this issue, we reanalyzed grammaticality judgment scores in Flege, Yeni-Komshian, and Liu's study of L2 learners using rule-related predictors and found that, in addition to the overall drop in performance due to a sensitive period, (...) L2 knowledge increased with years of input. Knowledge of different grammar rules was negatively associated with input frequency of those rules. To better understand these effects, we modeled the results using a connectionist model that was trained using Korean as a first language and then English as an L2. To explain the sensitive period in L2 learning, the model's learning rate was reduced in an age-related manner. By assigning different learning rates for syntax and lexical learning, we were able to model the difference between early and late L2 learners in input sensitivity. The model's learning mechanism allowed transfer between the L1 and L2, and this helped to explain the differences between different rules in the grammaticality judgment task. This work demonstrates that an L1 model of learning and processing can be adapted to provide an explicit account of how the input and the sensitive period interact in L2 learning. (shrink)

Although structural priming has been considered to be an independent cognitive process, recent evidence suggests that structural priming is modulated by sociocognitive factors such as social perception; speakers are more likely to mimic the sentence structure of a socially desirable interlocutor than the structure of a less desirable interlocutor. This study aims to further address the role of sociocognitive factors in language use by investigating how individual differences in social perception and tendency to align with others modulate same-verb structural priming. (...) In particular, we investigate how likely students are to repeat a sentence structure of a teacher depending on their perception of the teacher and their social monitoring tendency. Our results demonstrate that students’ tendency to imitate a sentence structure of the teacher is positively influenced by their perception of the teacher but negatively by social monitoring. We suggest that the effects may be accounted for in terms of their influence on attention and memory encoding. (shrink)

This paper argues that grammatical constructions, specifically argument structure constructions that determine the “who did what to whom” part of sentence meaning and how this meaning is expressed syntactically, can be considered a kind of relational category. That is, grammatical constructions are represented as the abstraction of the syntactic and semantic relations of the exemplar utterances that are expressed in that construction, and it enables the generation of novel exemplars. To support this argument, I review evidence that there are parallel (...) behavioral patterns between how children learn relational categories generally and how they learn grammatical constructions specifically. Then, I discuss computational simulations of how grammatical constructions are abstracted from exemplar sentences using a domain-general relational cognitive architecture. Last, I review evidence from adult language processing that shows parallel behavioral patterns with expert behavior from other cognitive domains. After reviewing the evidence, I consider how to integrate this account with other theories of language development. (shrink)

A central question in human development is how young children gain knowledge so fast. We propose that analogical generalization drives much of this early learning and allows children to generate new abstractions from experience. In this paper, we review evidence for analogical generalization in both children and adults. We discuss how analogical processes interact with the child's changing knowledge base to predict the course of learning, from conservative to domain-general understanding. This line of research leads to challenges to existing assumptions (...) about learning. It shows that it is not enough to consider the distribution of examples given to learners; one must consider the processes learners are applying; contrary to the general assumption, maximizing variability is not always the best route for maximizing generalization and transfer. (shrink)

Whilst certain verbs may appear in both the intransitive inchoative and the transitive causative constructions (The ball rolled/The man rolled the ball), others may appear in only the former (The man laughed/*The joke laughed the man). Some accounts argue that children acquire these restrictions using only (or mainly) statistical learning mechanisms such as entrenchment and pre-emption. Others have argued that verb semantics are also important. To test these competing accounts, adults (Experiment 1) and children aged 5–6 and 9–10 (Experiment 2) (...) were taught novel verbs designed to be construed — on the basis of their semantics — as either intransitive-only or alternating. In support of the latter claim, participants' grammaticality judgments revealed that even the youngest group respected these semantic constraints. Frequency (entrenchment) effects were observed for familiar, but not novel, verbs (Experiment 1). We interpret these findings in the light of a new theoretical account designed to yield effects of both verb semantics and entrenchment/pre-emption. (shrink)

Lexicalized theories of syntax often assume that verb-structure regularities are mediated by lemmas, which abstract over variation in verb tense and aspect. German syntax seems to challenge this assumption, because verb position depends on tense and aspect. To examine how German speakers link these elements, a structural priming study was performed which varied syntactic structure, verb position, and verb overlap.structural priming was found, both within and across verb position, but priming was larger when the verb position was the same between (...) prime and target. Priming was boosted by verb overlap, but there was no interaction with verb position. The results can be explained by a lemma model where tense and aspect are linked to structural choices in German. Since the architecture of this lemma model is not consistent with results from English, a connectionist model was developed which could explain the cross-linguistic variation in the production system. Together, these findings support the view that language learning plays an important role in determining the nature of structural priming in different languages. (shrink)

Three experiments investigated the processing of the implicature associated with some using a “gumball paradigm.” On each trial, participants saw an image of a gumball machine with an upper chamber with 13 gumballs and an empty lower chamber. Gumballs then dropped to the lower chamber and participants evaluated statements, such as “You got some of the gumballs.” Experiment 1 established that some is less natural for reference to small sets and unpartitioned sets compared to intermediate sets. Partitive some of was (...) less natural than simple some when used with the unpartitioned set. In Experiment 2, including exact number descriptions lowered naturalness ratings for some with small sets but not for intermediate size sets and the unpartitioned set. In Experiment 3, the naturalness ratings from Experiment 2 predicted response times. The results are interpreted as evidence for a Constraint-Based account of scalar implicature processing and against both two-stage, Literal-First models and pragmatic Default models. (shrink)

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume (...) that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation. We show how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, how they interweave production and comprehension processes, and how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal. (shrink)

This study provides evidence for implicit learning in syntactic comprehension. By reanalyzing data from a syntactic priming experiment (Thothathiri & Snedeker, 2008), we find that the error signal associated with a syntactic prime influences comprehenders' subsequent syntactic expectations. This follows directly from error‐based implicit learning accounts of syntactic priming, but it is unexpected under accounts that consider syntactic priming a consequence of temporary increases in base‐level activation. More generally, the results raise questions about the principles underlying the maintenance of implicit (...) statistical knowledge relevant to language processing, and about possible functional motivations for syntactic priming. (shrink)

We welcome the proposal to use forward models to understand predictive processes in language processing. However, Pickering & Garrod (P&G) miss the opportunity to provide a strong framework for future work. Forward models need to be pursued in the context of learning. This naturally leads to questions about what prediction error these models aim to minimize.

Pickering & Garrod's (P&G's) integrated model of production and comprehension includes no explicit role for nonlinguistic cognitive processes. Yet, how domain-general cognitive functions contribute to language processing has become clearer with well-specified theories and supporting data. We therefore believe that their account can benefit by incorporating functions like working memory and cognitive control into a unified model of language processing.

Both children and adults predict the content of upcoming language, suggesting that prediction is useful for learning as well as processing. We present an alternative model which can explain prediction behaviour as a by-product of language learning. We suggest that a consideration of language acquisition places important constraints on Pickering & Garrod's (P&G's) theory.

Statistical learning refers to the ability to identify structure in the input based on its statistical properties. For many linguistic structures, the relevant statistical features are distributional: They are related to the frequency and variability of exemplars in the input. These distributional regularities have been suggested to play a role in many different aspects of language learning, including phonetic categories, using phonemic distinctions in word learning, and discovering non-adjacent relations. On the surface, these different aspects share few commonalities. Despite this, (...) we demonstrate that the same computational framework can account for learning in all of these tasks. These results support two conclusions. The first is that much, and perhaps all, of distributional statistical learning can be explained by the same underlying set of processes. The second is that some aspects of language can be learned due to domain-general characteristics of memory. (shrink)

The psycholinguistic literature has identified two syntactic adaptation effects in language production: rapidly decaying short-term priming and long-lasting adaptation. To explain both effects, we present an ACT-R model of syntactic priming based on a wide-coverage, lexicalized syntactic theory that explains priming as facilitation of lexical access. In this model, two well-established ACT-R mechanisms, base-level learning and spreading activation, account for long-term adaptation and short-term priming, respectively. Our model simulates incremental language production and in a series of modeling studies, we show (...) that it accounts for (a) the inverse frequency interaction; (b) the absence of a decay in long-term priming; and (c) the cumulativity of long-term adaptation. The model also explains the lexical boost effect and the fact that it only applies to short-term priming. We also present corpus data that verify a prediction of the model, that is, that the lexical boost affects all lexical material, rather than just heads. (shrink)

Cognitive Science, Volume 46, Issue 2, February 2022.

Usage-based linguists and psychologists have produced a large body of empirical results suggesting that linguistic structure is derived from language use. However, while researchers agree that these results characterize grammar as an emergent phenomenon, there is no consensus among usage-based scholars as to how the various results can be explained and integrated into an explicit theory or model. Building on network theory, the current paper outlines a structured network approach to the study of grammar in which the core concepts of (...) syntax are analyzed by a set of relations that specify associations between different aspects of a speaker’s linguistic knowledge. These associations are shaped by domain-general processes that can give rise to new structures and meanings in language acquisition and language change. Combining research from linguistics and psychology, the paper proposes specific network analyses for the following phenomena: argument structure, word classes, constituent structure, constructions and construction families, and grammatical categories such as voice, case and number. The article builds on data and analyses presented inDiessel (2019;The Grammar Network. How Linguistic Structure is Shaped by Language Use) but approaches the topic from a different perspective. (shrink)

Inspired by, and in close relation with, the contributions of this special issue, Kuperberg elegantly links event comprehension, production, and learning. She proposes an overarching hierarchical generative framework of processing events enabling us to make sense of the world around us and to interact with it in a competent manner.

Journal Name: Cognitive Linguistics Issue: Ahead of print.

Syntactic priming in language production is the increased likelihood of using a recently encountered syntactic structure. In this paper, we examine two theories of why speakers can be primed: error‐driven learning accounts (Bock, Dell, Chang, & Onishi, 2007; Chang, Dell, & Bock, 2006) and activation‐based accounts (Pickering & Branigan, 1999; Reitter, Keller, & Moore, 2011). Both theories predict that speakers should be primed by the syntactic choices of others, but only activation‐based accounts predict that speakers should be able to prime (...) themselves. Here we test whether speakers can be primed by their own productions in three behavioral experiments and find evidence of structural persistence following both comprehension and speakers’ own productions. We also find that comprehension‐based priming effects are larger for rarer syntactic structures than for more common ones, which is most consistent with error‐driven accounts. Because neither error‐driven accounts nor activation‐based accounts fully explain the data, we propose a hybrid model. (shrink)

In this article, Peter and Rowland explore the role of implicit statistical learning in syntactic development. It is often accepted that the processes observed in classic implicit learning or statistical learning experiments play an important role in the acquisition of natural language syntax. As Peter and Rowland point out, however, the results from neither research strand can be used to fully explain how children's syntax becomes adult‐like. They propose to address this shortcoming by using the structural priming paradigm.

Memory is fleeting. New material rapidly obliterates previous material. How, then, can the brain deal successfully with the continual deluge of linguistic input? We argue that, to deal with this “Now-or-Never” bottleneck, the brain must compress and recode linguistic input as rapidly as possible. This observation has strong implications for the nature of language processing: (1) the language system must “eagerly” recode and compress linguistic input; (2) as the bottleneck recurs at each new representational level, the language system must build (...) a multilevel linguistic representation; and (3) the language system must deploy all available information predictively to ensure that local linguistic ambiguities are dealt with “Right-First-Time”; once the original input is lost, there is no way for the language system to recover. This is “Chunk-and-Pass” processing. Similarly, language learning must also occur in the here and now, which implies that language acquisition is learning to process, rather than inducing, a grammar. Moreover, this perspective provides a cognitive foundation for grammaticalization and other aspects of language change. Chunk-and-Pass processing also helps explain a variety of core properties of language, including its multilevel representational structure and duality of patterning. This approach promises to create a direct relationship between psycholinguistics and linguistic theory. More generally, we outline a framework within which to integrate often disconnected inquiries into language processing, language acquisition, and language change and evolution. (shrink)

This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing (PDP), a two-volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary (...) developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes. (shrink)