In this study, we apply MOSAIC (model of syntax acquisition in children) to the simulation of the developmental patterning of children's optional infinitive (OI) errors in 4 languages: English, Dutch, German, and Spanish. MOSAIC, which has already simulated this phenomenon in Dutch and English, now implements a learning mechanism that better reflects the theoretical assumptions underlying it, as well as a chunking mechanism that results in frequent phrases being treated as 1 unit. Using 1, identical model that learns from child‐directed (...) speech, we obtain a close quantitative fit to the data from all 4 languages despite there being considerable cross‐linguistic and developmental variation in the OI phenomenon. MOSAIC successfully simulates the difference between Spanish (a pro‐drop language in which OI errors are virtually absent) and obligatory subject languages that do display the OI phenomenon. It also highlights differences in the OI phenomenon across German and Dutch, 2 closely related languages whose grammar is virtually identical with respect to the relation between finiteness and verb placement. Taken together, these results suggest that (a) cross‐linguistic differences in the rates at which children produce OIs are graded, quantitative differences that closely reflect the statistical properties of the input they are exposed to and (b) theories of syntax acquisition need to consider more closely the role of input characteristics as determinants of quantitative differences in the cross‐linguistic patterning of phenomena in language acquisition. (shrink)

The vast expressive power of language is made possible by two principles: the arbitrary soundmeaning pairing underlying words, and the discrete combinatorial system underlying grammar. These principles implicate distinct cognitive mechanisms: associative memory and symbolmanipulating rules. The distinction may be seen in the difference between regular inflection (e.g., walk-walked), which is productive and open-ended and hence implicates a rule, and irregular inflection (e.g., come-came, which is idiosyncratic and closed and hence implicates individually memorized words. Nonetheless, two very different theories have (...) attempted to collapse the distinction; generative phonology invokes minor rules to generate irregular as well as regular forms, and connectionism invokes a pattern associator memory to store and retrieve regular as well as irregular forms. I present evidence from three disciplines that supports the traditional word/rule distinction, though with an enriched conception of lexical memory with some of the properties of a pattern-associator. Rules, nonetheless, are distinct from patternassociation, because a rule concatenates a suffix to a symbol for verbs, so it does not require access to memorized verbs or their sound patterns, but applies as the "default," whenever memory access fails. I present a dozen such circumstances, including novel, unusual-sounding, and rootless and headless derived words, in which people inflect the words regularly (explaining quirks like flied out, low-lifes, and Walkmans). A comparison of English to other languages shows that contrary to the connectionist account, default suffixation is not due to numerous regular words reinforcing a pattern in associative memory, but to a memory-independent, symbol-concatenating mental operation. (shrink)

Statistical approaches to processing natural language text have become dominant in recent years. This foundational text is the first comprehensive introduction to statistical natural language processing to appear. The book contains all the theory and algorithms needed for building NLP tools. It provides broad but rigorous coverage of mathematical and linguistic foundations, as well as detailed discussion of statistical methods, allowing students and researchers to construct their own implementations. The book covers collocation finding, word sense disambiguation, probabilistic parsing, information retrieval, (...) and other applications. (shrink)