Infant language learners are faced with the difficult inductive problem of determining how new words map to novel or known objects in their environment. Bayesian inference models have been successful at using the sparse information available in natural child-directed speech to build candidate lexicons and infer speakers’ referential intentions. We begin by asking how a Bayesian model optimized for monolingual input generalizes to new monolingual or bilingual corpora and find that, especially in the case of the bilingual input, the model (...) shows a significant decrease in performance. In the next experiment, we propose the ME Model, a modified Bayesian model, which approximates infants’ mutual exclusivity bias to support the differential demands of monolingual and bilingual learning situations. The extended model is assessed using the same corpora of real child-directed speech, showing that its performance is more robust against varying input and less dependent than the Intentional Model on optimization of its parsimony parameter. We argue that both monolingual and bilingual demands on word learning are important considerations for a computational model, as they can yield significantly different results than when only one such context is considered. (shrink)

Recent laboratory experiments have shown that both infant and adult learners can acquire word‐referent mappings using cross‐situational statistics. The vast majority of the work on this topic has used unfamiliar objects presented on neutral backgrounds as the visual contexts for word learning. However, these laboratory contexts are much different than the real‐world contexts in which learning occurs. Thus, the feasibility of generalizing cross‐situational learning beyond the laboratory is in question. Adapting the Human Simulation Paradigm, we conducted a series of experiments (...) examining cross‐situational learning from children's egocentric videos captured during naturalistic play. Focusing on individually ambiguous naming moments that naturally occur during toy play, we asked how statistical learning unfolds in real time through accumulating cross‐situational statistics in naturalistic contexts. We found that even when learning situations were individually ambiguous, learners’ performance gradually improved over time. This improvement was driven in part by learners’ use of partial knowledge acquired from previous learning situations, even when they had not yet discovered correct word‐object mappings. These results suggest that word learning is a continuous process by means of real‐time information integration. (shrink)

The roles of linguistic, cognitive, and social-pragmatic processes in word learning are well established. If statistical mechanisms also contribute to word learning, they must interact with these processes; however, there exists little evidence for such mechanistic synergy. Adults use co-occurrence statistics to encode speech–object pairings with detailed sensitivity in stochastic learning environments (Vouloumanos, 2008). Here, we replicate this statistical work with nonspeech sounds and compare the results with the previous speech studies to examine whether exclusion constraints contribute equally to the (...) statistical learning of speech–object and nonspeech–object associations. In environments in which performance could benefit from exclusion, we find a learning advantage for speech over nonspeech, revealing an interaction between statistical and exclusion processes in associative word learning. (shrink)

Cognitive Science, Volume 46, Issue 4, April 2022.

A multimodal person representation contains information about what a person looks like and what a person sounds like. However, little is known about how children form these face-voice mappings. Here, we explored the possibility that two cognitive tools that guide word learning, a one-to-one mapping bias and fast mapping, also guide children’s learning about faces and voices. We taught 4- and 5-year-olds mappings between three individual faces and voices, then presented them with new faces and voices. In Experiment 1, we (...) found that children rapidly learned face-voice mappings from just a few exposures, and furthermore spontaneously mapped novel faces to novel voices using a one-to-one mapping bias (that each face can produce only one voice). In Experiment 2, we found that children’s face-voice representations are abstract, generalizing to novel tokens of a person. In Experiment 3, we found that children retained in memory the face-voice mappings that they had generated via inference (i.e., they showed evidence of fast mapping), and used these newly formed representations to generate further mappings between new faces and voices. These findings suggest that preschoolers’ rapid learning about faces and voices may be aided by biases that are similar to those that support word learning. (shrink)

In this study, Limburgian and Dutch 2.5- to 4-year-olds and adults took part in a word learning experiment. Following the procedure employed by Quam and Swingley (2010) and Singh et al. (2014), participants learned two novel word-object mappings. After training, word recognition was tested in correct pronunciation (CP) trials and mispronunciation (MP) trials featuring a pitch change. Since Limburgian is considered a restricted tone language, we expected that the pitch change would hinder word recognition in Limburgian, but not in non-tonal (...) Dutch listeners. Contrary to our expectations, both Limburgian and Dutch children appeared to be sensitive to pitch changes in newly learned words, indicated by a significant decrease in target fixation in MP trials compared to CP trials. Limburgian and Dutch adults showed very strong naming effects in both trial types. The results are discussed against the background of the influence of the native prosodic system. (shrink)

One of the great challenges in word learning is that words are typically uttered in a context with many potential referents. Children's tendency to associate novel words with novel referents, which is taken to reflect a mutual exclusivity (ME) bias, forms a useful disambiguation mechanism. We study semantic learning in pragmatic agents—combining the Rational Speech Act model with gradient‐based learning—and explore the conditions under which such agents show an ME bias. This approach provides a framework for investigating a pragmatic account (...) of the ME bias in humans but also for building artificial agents that display an ME bias. A series of analyses demonstrates striking parallels between our model and human word learning regarding several aspects relevant to the ME bias phenomenon: online inference, long‐term learning, and developmental effects. By testing different implementations, we find that two components, pragmatic online inference and incremental collection of evidence for one‐to‐one correspondences between words and referents, play an important role in modeling the developmental trajectory of the ME bias. Finally, we outline an extension of our model to a deep neural network architecture that can process more naturalistic visual and linguistic input. Until now, in contrast to children, deep neural networks have needed indirect access to (supposed to be novel) test inputs during training to display an ME bias. Our model is the first one to do so without using this manipulation. (shrink)

What mechanism implements the mutual exclusivity bias to map novel labels to objects without names? Prominent theoretical accounts of mutual exclusivity (e.g., Markman, 1989, 1990) propose that infants are guided by their knowledge of object names. However, the mutual exclusivity constraint could be implemented via monitoring of object novelty (see Merriman, Marazita, & Jarvis, 1995). We sought to discriminate between these contrasting explanations across two preferential looking experiments with 22-month-olds. In Experiment 1, infants viewed three objects: one name-known, two name-unknown. (...) Of the two name-unknown objects, one was novel, and the other had been previously familiarized. The infants responded to hearing a novel label by increasing attention only to the novel, name-unknown object. In a second experiment in which the name-known object was absent, a novel label increased infants’ attention to a novel object beyond baseline preference for novelty. The experiments provide clear evidence for a novelty-based mechanism. However, differences in the time course of disambiguation across experiments suggest that novelty processing may be influenced by contextual factors. (shrink)

Identifying the referent of novel words is a complex process that young children do with relative ease. When given multiple objects along with a novel word, children select the most novel item, sometimes retaining the word‐referent link. Prior work is inconsistent, however, on the role of object novelty. Two experiments examine 18‐month‐old children's performance on referent selection and retention with novel and known words. The results reveal a pervasive novelty bias on referent selection with both known and novel names and, (...) across individual children, a negative correlation between attention to novelty and retention of new word‐referent links. A computational model examines possible sources of the bias, suggesting novelty supports in‐the‐moment behavior but not retention. Together, results suggest that when lexical knowledge is weak, attention to novelty drives behavior, but alone does not sustain learning. Importantly, the results demonstrate that word learning may be driven, in part, by low‐level perceptual processes. (shrink)

Biosemiosis is a process of choice-making between simultaneously alternative options. It is well-known that, when sufficiently young children encounter a new word, they tend to interpret it as pointing to a meaning that does not have a word yet in their lexicon rather than to a meaning that already has a word attached. In previous research, the strategy was shown to be optimal from an information theoretic standpoint. In that framework, interpretation is hypothesized to be driven by the minimization of (...) a cost function: the option of least communication cost is chosen. However, the information theoretic model employed in that research neither explains the weakening of that vocabulary learning bias in older children or polylinguals nor reproduces Zipf’s meaning-frequency law, namely the non-linear relationship between the number of meanings of a word and its frequency. Here we consider a generalization of the model that is channeled to reproduce that law. The analysis of the new model reveals regions of the phase space where the bias disappears consistently with the weakening or loss of the bias in older children or polylinguals. The model is abstract enough to support future research on other levels of life that are relevant to biosemiotics. In the deep learning era, the model is a transparent low-dimensional tool for future experimental research and illustrates the predictive power of a theoretical framework originally designed to shed light on the origins of Zipf’s rank-frequency law. (shrink)