Entropy · 2020 · 15 citations · 44 references
Language StudiesCommunicationLinguisticsCorpus LinguisticsMorphologyNatural Language ProcessingContext DependenceLanguage VariationLexical VariationSociolinguistic VariationSpoken CorporaSyntactic VariationHuman CommunicationSpeech Signal AnalysisSpeech Signal ProcessingSyntactic Variety
Does systematic covariation in the usage patterns of forms shape the sublexical variance observed in conversational speech? We address this question in terms of a recently proposed discriminative theory of human communication that argues that the distribution of events in communicative contexts should maintain mutual predictability between language users, present evidence that the distributions of words in the empirical contexts in which they are learned and used are geometric, and thus support this. Here, we extend this analysis to a corpus of conversational English, showing that the distribution of grammatical regularities and the sub-distributions of tokens discriminated by them are also geometric. Further analyses reveal a range of structural differences in the distribution of types in parts of speech categories that further support the suggestion that linguistic distributions (and codes) are subcategorized by context at multiple levels of abstraction. Finally, a series of analyses of the variation in spoken language reveals that quantifiable differences in the structure of lexical subcategories appears in turn to systematically shape sublexical variation in speech signal.
44
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Power laws, Pareto distributions and Zipf's law
MEJ Newman · Contemporary Physics · 2005 · 5.8K citations · Full text
Discriminative training methods for hidden Markov models
Michael Collins · 2002 · 1.9K citations · Full text
Transmission of Information<sup>1</sup>
R. V. L. Hartley · Bell System Technical Journal · 1928 · 1.8K citations