2011 · 282 citations · 25 references
EngineeringCommunicationComputer ScienceCommunication TheoryInformation TheorySemanticsChannel CodingData CompressionInformation MeasuresLossy Data CompressionMutual InformationSource CodingChannel Coding TheoremsInformation EntropySemantic CompressionSemantic InformationShannon EntropyShannon Source CodingShannon Source Coding TheoremSource Coding Theorem
This paper studies methods of quantitatively measuring semantic information in communication. We review existing work on quantifying semantic information, then investigate a model-theoretical approach for semantic data compression and reliable semantic communication. We relate our approach to the statistical measurement of information by Shannon, and show that Shannon's source and channel coding theorems have semantic counterparts.
25
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Mathematical Theory of Communication
Marc D. Binder, Nobutaka Hirokawa, Uwe Windhorst · 2008 · 2.3K citations