We describe a pattern acquisition algorithm that learns, in an unsupervised fashion, a streamlined representation of linguistic structures from a plain natural-language corpus. This paper addresses the issues of learning structured knowledge from a large-scale natural language data set, and of generalization to unseen text. The implemented algorithm represents sentences as paths on a graph whose vertices are words. Significant patterns, determined by recursive context-sensitive statistical inference, form new vertices. Linguistic constructions are represented by trees composed of significant patterns and (...) their associated equivalence classes. An input module allows the algorithm to be subjected to a standard test of English as a Second Language profi- ciency. The results are encouraging: the model attains a level of performance considered to be “intermediate” for 9th-grade students, despite having been trained on a corpus containing transcribed speech of parents directed to small children. (shrink)

The child directed speech of twelve English‐speaking motherswas analyzed in terms of utterance‐level constructions. First, the mothers' utterances were categorized in terms of general constructional categories such as Wh‐questions, copulas and transitives. Second, mothers' utterances within these categories were further specified in terms of the initial words that framed the utterance, item‐based phrases such as Are you …, I'll …, It's …, Let's …, What did … The findings were: (i) overall, only about 15% of all maternal utterances had SVO (...) form (most were questions, imperatives, copulas, and fragments); (ii) 51% of all maternal utterances began with one of 52 item‐based phrases, mostly consisting of two words or morphemes (45% began with one of just 17 words); and (iii) children used many of these same item‐based phrases, in some cases at a rate that correlated highly with their own mother's frequency of use. We suggest that analyses of adult–child linguistic interaction should take into account not just general constructional categories, but also the item‐based constructions that adults and children use and the frequency with which they use them. (shrink)

This paper presents a novel approach to the unsupervised learning of syntactic analyses of natural language text. Most previous work has focused on maximizing likelihood according to generative PCFG models. In contrast, we employ a simpler probabilistic model over trees based directly on constituent identity and linear context, and use an EM-like iterative procedure to induce structure. This method produces much higher quality analyses, giving the best published results on the ATIS dataset.