Statistical learning refers to the ability to identify structure in the input based on its statistical properties. For many linguistic structures, the relevant statistical features are distributional: They are related to the frequency and variability of exemplars in the input. These distributional regularities have been suggested to play a role in many different aspects of language learning, including phonetic categories, using phonemic distinctions in word learning, and discovering non-adjacent relations. On the surface, these different aspects share few commonalities. Despite this, (...) we demonstrate that the same computational framework can account for learning in all of these tasks. These results support two conclusions. The first is that much, and perhaps all, of distributional statistical learning can be explained by the same underlying set of processes. The second is that some aspects of language can be learned due to domain-general characteristics of memory. (shrink)

For many years the evolution of language has been seen as a disreputable topic, mired in fanciful “just so stories” about language origins. However, in the last decade a new synthesis of modern linguistics, cognitive neuroscience and neo-Darwinian evolutionary theory has begun to make important contributions to our understanding of the biology and evolution of language. I review some of this recent progress, focusing on the value of the comparative method, which uses data from animal species to draw inferences about (...) language evolution. Discussing speech first, I show how data concerning a wide variety of species, from monkeys to birds, can increase our understanding of the anatomical and neural mechanisms underlying human spoken language, and how bird and whale song provide insights into the ultimate evolutionary function of language. I discuss the “descended larynx” of humans, a peculiar adaptation for speech that has received much attention in the past, which despite earlier claims is not uniquely human. Then I will turn to the neural mechanisms underlying spoken language, pointing out the difficulties animals apparently experience in perceiving hierarchical structure in sounds, and stressing the importance of vocal imitation in the evolution of a spoken language. Turning to ultimate function, I suggest that communication among kin (especially between parents and offspring) played a crucial but neglected role in driving language evolution. Finally, I briefly discuss phylogeny, discussing hypotheses that offer plausible routes to human language from a non-linguistic chimp-like ancestor. I conclude that comparative data from living animals will be key to developing a richer, more interdisciplinary understanding of our most distinctively human trait: language. (shrink)

Many events that humans and other species experience contain regularities in which certain elements within an event predict certain others. While some of these regularities involve tracking the co‐occurrences between temporally adjacent stimuli, others involve tracking the co‐occurrences between temporally distant stimuli (i.e., nonadjacent dependencies, NADs). Prior research shows robust learning of adjacent dependencies in humans and other species, whereas learning NADs is more difficult, and often requires support from properties of the stimulus to help learners notice the NADs. Here, (...) we report on seven experiments that examined NAD learning from various types of visual stimuli, exploring the effects of dynamic motion on adults' NAD learning from visual sequences involving human and nonhuman agents. We tested adults' NAD learning from visual sequences of human actions, object transformations, static images of human postures, and static images of an object in different postures. We found that dynamic motion aids the acquisition of NADs. We also found that learning NADs in sequences involving human agents is more robust compared to sequences involving nonhuman objects. We propose that dynamic motion and human agents both independently result in richer representations that provide a stronger signal for NAD learning. (shrink)

Humans have the ability to learn surprisingly complicated statistical information in a variety of modalities and situations, often based on relatively little input. These statistical learning (SL) skills appear to underlie many kinds of learning, but despite their ubiquity, we still do not fully understand precisely what SL is and what individual differences on SL tasks reflect. Here, we present experimental work suggesting that at least some individual differences arise from stimulus-specific variation in perceptual fluency: the ability to rapidly or (...) efficiently code and remember the stimuli that SL occurs over. Experiment 1 demonstrates that participants show improved SL when the stimuli are simple and familiar; Experiment 2 shows that this improvement is not evident for simple but unfamiliar stimuli; and Experiment 3 shows that for the same stimuli (Chinese characters), SL is higher for people who are familiar with them (Chinese speakers) than those who are not (English speakers matched on age and education level). Overall, our findings indicate that performance on a standard SL task varies substantially within the same (visual) modality as a function of whether the stimuli involved are familiar or not, independent of stimulus complexity. Moreover, test–retest correlations of performance in an SL task using stimuli of the same level of familiarity (but distinct items) are stronger than correlations across the same task with stimuli of different levels of familiarity. Finally, we demonstrate that SL performance is predicted by an independent measure of stimulus-specific perceptual fluency that contains no SL component at all. Our results suggest that a key component of SL performance may be related to stimulus-specific processing and familiarity. (shrink)

Extracting the regularities of our environment is one of our core cognitive abilities. To study the fine-grained dynamics of the extraction of embedded regularities, a method combining the advantages of the artificial language paradigm and the serial response time task was used with a group of Guinea baboons in a new automatic experimental device. After a series of random trials, monkeys were exposed to language-like patterns. We found that the extraction of embedded patterns positioned at the end of larger patterns (...) was faster than the extraction of initial embedded patterns. This result suggests that there is a learning advantage for the final element of a sequence that benefits from the contextual information provided by previous elements. (shrink)

Following in a psychological and musicological tradition beginning with Leonard Meyer, and continuing through David Huron, we present a functional, cognitive account of the phenomenon of expectation in music, grounded in computational, probabilistic modeling. We summarize a range of evidence for this approach, from psychology, neuroscience, musicology, linguistics, and creativity studies, and argue that simulating expectation is an important part of understanding a broad range of human faculties, in music and beyond.

Poverty of the Stimulus Arguments have convinced many linguists and philosophers of language that a domain specific language acquisition device (LAD) is necessary to account for language learning. Here we review empirical evidence that casts doubt on the necessity of this domain specific device. We suggest that more attention needs to be paid to the early stages of language acquisition. Many seemingly innate language-related abilities have to be learned over the course of several months. Further, the language input contains rich (...) stochastic information that can be accessed by domain-general learning mechanisms. Computer simulation has shown how mechanisms that are not domain specific can exploit the information contained in language. We conclude that (i) Poverty of the Stimulus Arguments need to be conceptually clarified and (ii) more empirical research needs to be carried out before we can rule out that data driven general purpose mechanisms can account for language learning. (shrink)

Cognitive Science, Volume 46, Issue 9, September 2022.

Learning the structure of event sequences is a ubiquitous problem in cognition and particularly in language. One possible solution is to learn a probabilistic generative model of sequences that allows making predictions about upcoming events. Though appealing from a neurobiological standpoint, this approach is typically not pursued in connectionist modeling. Here, we investigated a sequential version of the restricted Boltzmann machine, a stochastic recurrent neural network that extracts high-order structure from sensory data through unsupervised generative learning and can encode contextual (...) information in the form of internal, distributed representations. We assessed whether this type of network can extract the orthographic structure of English monosyllables by learning a generative model of the letter sequences forming a word training corpus. We show that the network learned an accurate probabilistic model of English graphotactics, which can be used to make predictions about the letter following a given context as well as to autonomously generate high-quality pseudowords. The model was compared to an extended version of simple recurrent networks, augmented with a stochastic process that allows autonomous generation of sequences, and to non-connectionist probabilistic models. We conclude that sequential RBMs and stochastic simple recurrent networks are promising candidates for modeling cognition in the temporal domain. (shrink)

Our target article argued that a genetically specified Universal Grammar (UG), capturing arbitrary properties of languages, is not tenable on evolutionary grounds, and that the close fit between language and language learners arises because language is shaped by the brain, rather than the reverse. Few commentaries defend a genetically specified UG. Some commentators argue that we underestimate the importance of processes of cultural transmission; some propose additional cognitive and brain mechanisms that may constrain language and perhaps differentiate humans from nonhuman (...) primates; and others argue that we overstate or understate the case against co-evolution of language genes. In engaging with these issues, we suggest that a new synthesis concerning the relationship between brains, genes, and language may be emerging. (shrink)

Human language is a salient example of a neurocognitive system that is specialized to process complex dependencies between sensory events distributed in time, yet how this system evolved and specialized remains unclear. Artificial Grammar Learning (AGL) studies have generated a wealth of insights into how human adults and infants process different types of sequencing dependencies of varying complexity. The AGL paradigm has also been adopted to examine the sequence processing abilities of nonhuman animals. We critically evaluate this growing literature in (...) species ranging from mammals (primates and rats) to birds (pigeons, songbirds, and parrots) considering also cross‐species comparisons. The findings are contrasted with seminal studies in human infants that motivated the work in nonhuman animals. This synopsis identifies advances in knowledge and where uncertainty remains regarding the various strategies that nonhuman animals can adopt for processing sequencing dependencies. The paucity of evidence in the few species studied to date and the need for follow‐up experiments indicate that we do not yet understand the limits of animal sequence processing capacities and thereby the evolutionary pattern. This vibrant, yet still budding, field of research carries substantial promise for advancing knowledge on animal abilities, cognitive substrates, and language evolution. (shrink)

Prelinguistic infants must find a way to isolate meaningful chunks from the continuous streams of speech that they hear. BootLex, a new model which uses distributional cues to build a lexicon, demonstrates how much can be accomplished using this single source of information. This conceptually simple probabilistic algorithm achieves significant segmentation results on various kinds of language corpora - English, Japanese, and Spanish; child- and adult-directed speech, and written texts; and several variations in coding structure - and reveals which statistical (...) characteristics of the input have an influence on segmentation performance. BootLex is then compared, quantitatively and qualitatively, with three other groups of computational models of the same infant segmentation process, paying particular attention to functional characteristics of the models and their similarity to human cognition. Commonalities and contrasts among the models are discussed, as well as their implications both for theories of the cognitive problem of segmentation itself, and for the general enterprise of computational cognitive modeling. (shrink)

Christiansen & Chater (C&C) argue persuasively that Universal Grammar (UG) could not have arisen through evolutionary processes. I provide additional suggestions to strengthen the argument against UG evolution. Further, I suggest that C&C's solution to the logical problem of language evolution faces several problems. Widening the focus to mechanisms of general cognition and inclusion of animal communication research might overcome these problems.

In this article, we hypothesize that individuals with autism spectrum disorder (ASD) are born with a deficit in invariance detection, which is a learning process whereby people and animals come to attend the relatively stable patterns or structural regularities in the changing stimulus array. This paper synthesizes a substantial body of research which suggests that a deficit in the domain-general perceptual learning process of invariant detection in ASD can lead to a cascade of consequences in different developmental domains. We will (...) outline how this deficit in invariant detection can cause uncertainty, unpredictability, and a lack of control for individuals with ASD and how varying degrees of impairments in this learning process can account for the heterogeneity of the ASD phenotype. We also describe how differences in neural plasticity in ASD underlie the impairments in perceptual learning. The present account offers an alternative to prior theories and contributes to the challenge of understanding the developmental trajectories that result in the variety of autistic behaviors. (shrink)

An important topic in the evolution of language is the kinds of grammars that can be computed by humans and other animals. Fitch and Hauser () approached this question by assessing the ability of different species to learn 2 grammars, (AB)n and An Bn. An Bn was taken to indicate a phrase structure grammar, eliciting a center‐embedded pattern. (AB)n indicates a grammar whose strings entail only local relations between the categories of constituents. F&H's data suggest that humans, but not tamarin (...) monkeys, learn an An Bn grammar, whereas both learn a simpler (AB)n grammar (). In their experiments, the A constituents were syllables pronounced by a female voice, whereas the B constituents were syllables pronounced by a male voice. This study proposes that what characterizes the An Bn exemplars is the distributional regularities of the syllables pronounced by either a male or a female rather than the underlying, more abstract patterns. This article replicates F&H's data and reports new controls using either categories similar to those in F&H or less salient ones. This article shows that distributional regularities explain the data better than grammar learning. Indeed, when familiarized with An Bn exemplars, participants failed to discriminate A3 B2 and A2 B3 from An Bn items, missing the crucial feature that the number of As must equal the number of Bs. Therefore, contrary to F&H, this study concludes that no syntactic rules implementing embedded nonadjacent dependencies were learned in these experiments. The difference between human linguistic abilities and the putative precursors in monkeys deserves further exploration. (shrink)

In typical statistical learning studies, researchers define sequences in terms of the probability of the next item in the sequence given the current item (or items), and they show that high probability sequences are treated as more familiar than low probability sequences. Existing accounts of these phenomena all assume that participants represent statistical regularities more or less as they are defined by the experimenters—as sequential probabilities of symbols in a string. Here we offer an alternative, or possibly supplementary, hypothesis. Specifically, (...) rather than identifying or labeling individual stimuli discretely in order to predict the next item in a sequence, we need only assume that the participant is able to represent the stimuli as evincing particular similarity relations to one another, with sequences represented as trajectories through this similarity space. We present experiments in which this hypothesis makes sharply different predictions from hypotheses based on the assumption that sequences are learned over discrete, labeled stimuli. We also present a series of simulation models that encode stimuli as positions in a continuous two‐dimensional space, and predict the next location from the current location. Although no model captures all of the data presented here, the results of three critical experiments are more consistent with the view that participants represent trajectories through similarity space rather than sequences of discrete labels under particular conditions. (shrink)

Why does symbolic communication in humans develop primarily in an oral medium, and how do theories of language origin explain this? Non-human primates, despite their ability to learn and use symbolic signs, do not develop symbols as in oral language. This partly owes to the lack of a direct cortico-motoneuron control of vocalizations in these species compared to humans. Yet such modality-related factors that can impinge on the rise of symbolic language are interpreted differently in two types of evolutionary storylines. (...) 1) Some theories posit that symbolic language originated in a gestural modality, as in “sign languages”. However, this overlooks work on emerging sign and spoken language showing that gestures and speech shape signs differently. 2) In modality-dependent theories, some emphasize the role of iconic sounds, though these lack the efficiency of arbitrary symbols. Other theorists suggest that ontogenesis serves to identify human-specific mechanisms underlying an evolutionary shift from pitch varying to orally-modulated vocalizations (babble). This shift creates numerous oral features that can support efficient symbolic associations. We illustrate this principle using a sound-picture association task with 40 learners who hear words in an unfamiliar language (Mandarin) with and without a filtering of oral features. Symbolic associations arise more rapidly and accurately for sounds containing oral features compared to sounds bearing only pitch features, an effect also reported in experiments with infants. The results imply that, beyond a competence to learn and use symbols, the rise of symbolic language rests on the types of signs that a modality of expression affords. (shrink)

The aim of this dissertation is to create a naturalistic philosophical picture of creative capacities that are specific to our species, focusing on artistic ability, religious reflection, and scientific study. By integrating data from diverse domains within a philosophical anthropological framework, I have presented a cognitive and evolutionary approach to the question of why humans, but not other animals engage in such activities. Through an application of cognitive and evolutionary perspectives to the study of these behaviors, I have sought to (...) provide a more solid footing for philosophical anthropological discussions of uniquely human behavior. In particular, I have argued that art, religion and science, which are usually seen as achievements that are quite remote from ordinary modes of reasoning, are subserved by evolved cognitive processes that serve functions in everyday cognitive tasks, that arise early and spontaneously in cognitive development, that are shared cross-culturally, and that have evolved in response to selective pressures in our ancestral past. These mundane cognitive processes provide a measuring rod with which we can assess a diversity of cultural phenomena; they form a unified explanatory framework to approach human culture. I have argued that we can explain uncommon thoughts in terms of interactions between common minds. This dissertation is subdivided into four parts. Part I outlines the problem of human uniqueness, examining theories on how humans conceptualize the world, and what their mental tool box looks like. Part II discusses the evolutionary and cognitive origins of human artistic behavior. Part III focuses on the cognitive science of religion, especially on how it can be applied to the reasoning of theologians and philosophers of religion. Part IV considers the cognitive basis of scientific practice. (shrink)

Artificial grammar learning (AGL) is used to study how human adults, infants, animals or machines learn various sorts of rules defined over sounds or visual items. Ten Cate et al. introduce the topic and provide a critical synthesis of this important interdisciplinary area of research. They identify the questions that remain open and the challenges that lie ahead, and argue that the limits of human, animal and machine learning abilities have yet to be found.

One important difference between existing accounts of protolanguage lies in their assumptions on the semantic complexity of protolinguistic utterances. I bring evidence about the nature of linguistic communication to bear on the plausibility of these assumptions, and show that communication is fundamentally inferential and characterised by semantic uncertainty. This not only allows individuals to maintain variation in linguistic representation, but also imposes a selection pressure that meanings be reconstructible from context. I argue that protolanguage utterances had varying degrees of semantic (...) complexity, and developed into complex language gradually, through the same processes of re-analysis and analogy which still underpin continual change in modern languages. (shrink)