Hokkaido University Collection of Scholarly and Academic Papers (Hokkaido University) · 2011 · 24 citations · 15 references
Open access
ComputingComputer ScienceLinguisticsComputational LinguisticsCorpus LinguisticsNatural Language ProcessingGrammarInformation ExtractionLanguage ModelingLanguage ModelsSentence StructureSyntactic AnalysisGrammatical Pattern AnalysisLinguistic Pattern MiningPattern ExtractionSentence Patterns
A “sentence pattern” in modern Natural Language Processing is often considered as a subsequent string of words (n-grams). However, in many branches of linguistics, like Pragmatics or Corpus Linguistics, it has been noticed that simple n-gram patterns are not sufficient to reveal the whole sophistication of grammar patterns. We present a language independent architecture for extracting from sentences more sophisticated patterns than n-grams. In this architecture a “sentence pattern” is considered as n-element ordered combination of sentence elements. Experiments showed that the method extracts significantly more frequent patterns than the usual n-gram approach.
15
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Bo Pang, Lillian Lee, Shivakumar Vaithyanathan · 2002 · 7K citations · Full text
Class-based n -gram models of natural language
Peter F. Brown, P.V. deSouza, Robert L. Mercer et al. · 1992 · 2.9K citations
Language Studies, Computer Science, Computational Linguistics +15