Studies of word predictability in context show that words in English tend to be shorter if they are predictable from the next word, and to a lesser extent, if they are predictable from the previous word. Some studies distinguish function and content words, but otherwise have not considered grammatical factors, treating all two-word sequences as comparable. Because function words are highly frequent, words occurring with them have low predictability. Highest predictability occurs within bigrams with two content words. Using the Buckeye (...) corpus, we show that content word bigrams from different constructions vary widely in predictability, with adjective–noun and noun–noun sequences (content words within a noun phrase) having the highest scores. It is known that in adjective–noun sequences, the vowel of the adjective is shorter than in other positions. We study noun–noun sequences within the noun phrase and show that the first noun is shorter than in other contexts. It follows that the shorter duration of the first word when it is predictable from the second in many cases is due to the noun phrase construction and not necessarily the regulation of duration corresponding to predictable versus unpredictable information. We conclude that predictability studies must consider the constructions words occur in. (shrink)

Journal Name: Cognitive Linguistics Issue: Ahead of print.

How do cognitive pressures shape the lexicons of natural languages? Here, we reframe George Kingsley Zipf's proposed “law of abbreviation” within a more general framework that relates it to cognitive pressures that affect speakers and listeners. In this new framework, speakers' drive to reduce effort (Zipf's proposal) is counteracted by the need for low‐frequency words to have word forms that are sufficiently distinctive to allow for accurate recognition by listeners. To support this framework, we replicate and extend recent work using (...) the prevalence of subword phonemic sequences (phonotactic probability) to measure speakers' production effort in place of Zipf's measure of length. Across languages and corpora, phonotactic probability is more strongly correlated with word frequency than word length. We also show this measure of ease of speech production (phonotactic probability) is strongly correlated with a measure of perceptual difficulty that indexes the degree of competition from alternative interpretations in word recognition. This is consistent with the claim that there must be trade‐offs between these two factors, and is inconsistent with a recent proposal that phonotactic probability facilitates both perception and production. To our knowledge, this is the first work to offer an explanation why long, phonotactically improbable word forms remain in the lexicons of natural languages. (shrink)

Language research has come to rely heavily on large‐scale, web‐based datasets. These datasets can present significant methodological challenges, requiring researchers to make a number of decisions about how they are collected, represented, and analyzed. These decisions often concern long‐standing challenges in corpus‐based language research, including determining what counts as a word, deciding which words should be analyzed, and matching sets of words across languages. We illustrate these challenges by revisiting “Word lengths are optimized for efficient communication” (Piantadosi, Tily, & Gibson, (...) 2011), which found that word lengths in 11 languages are more strongly correlated with their average predictability (or average information content) than their frequency. Using what we argue to be best practices for large‐scale corpus analyses, we find significantly attenuated support for this result and demonstrate that a stronger relationship obtains between word frequency and length for a majority of the languages in the sample. We consider the implications of the results for language research more broadly and provide several recommendations to researchers regarding best practices. (shrink)

Cross-linguistic studies focus on inverse correlations (trade-offs) between linguistic variables that reflect different cues to linguistic meanings. For example, if a language has no case marking, it is likely to rely on word order as a cue for identification of grammatical roles. Such inverse correlations are interpreted as manifestations of language users’ tendency to use language efficiently. The present study argues that this interpretation is problematic. Linguistic variables, such as the presence of case, or flexibility of word order, are aggregate (...) properties, which do not represent the use of linguistic cues in context directly. Still, such variables can be useful for circumscribing the potential role of communicative efficiency in language evolution, if we move from cross-linguistic trade-offs to multivariate causal networks. This idea is illustrated by a case study of linguistic variables related to four types of Subject and Object cues: case marking, rigid word order of Subject and Object, tight semantics and verb-medial order. The variables are obtained from online language corpora in thirty languages, annotated with the Universal Dependencies. The causal model suggests that the relationships between the variables can be explained predominantly by sociolinguistic factors, leaving little space for a potential impact of efficient linguistic behavior. (shrink)

This paper synthesizes a wide range of literature from sociolinguistics and cognitive psychology, to argue for a central role for the “word” as a vehicle of language variation and change. Three crucially interlinked strands of research are reviewed—the role of context in associative learning, the word-level storage of phonetic and contextual detail, and the phonetic consequences of skewed distributions of words across different contexts. I argue that the human capacity for associative learning, combined with attention to fine-phonetic detail at the (...) level of the word, plays a significant role in predicting a range of subtle but systematically robust observed socioindexical patterns in speech production and perception. (shrink)