IEEE Transactions on Information Theory · 2003 · 557 citations · 14 references
EngineeringComputer ScienceElectrical EngineeringInformation TheoryOptimizationWireless CommunicationsBroadcast CommunicationChannel CodingCoding TheoryRate-distortion TheorySource CodingSource-channel SeparationBroadcast ChannelsLossless Source CodingLossy Source CodingMultiuser CommunicationProbabilistic MatchingRate-distortion TradeoffSeparation-based CodingSource-channel Coding
What makes a source-channel communication system optimal? It is shown that in order to achieve an optimal cost-distortion tradeoff, the source and the channel have to be matched in a probabilistic sense. The match (or lack of it) involves the source distribution, the distortion measure, the channel conditional distribution, and the channel input cost function. Closed-form necessary and sufficient expressions relating the above entities are given. This generalizes both the separation-based approach as well as the two well-known examples of optimal uncoded communication. The condition of probabilistic matching is extended to certain nonergodic and multiuser scenarios. This leads to a result on optimal single-source broadcast communication.
14
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Information Theory and Reliable Communication
David A. Bell · Electronics and Power · 1969 · 4K citations
Successive refinement of information
W. Equitz, Thomas M. Cover · IEEE Transactions on Information Theory · 1991 · 544 citations