IEEE Transactions on Information Theory · 2006 · 192 citations · 19 references
EngineeringComputer ScienceElectrical EngineeringDigital CommunicationInformation TheoryWireless CommunicationsBroadcast CommunicationChannel CapacityChannel CodingCoding TheorySource CodingSource-channel SeparationBroadcast Channel CapacityBroadcast Channel CodingBroadcast ChannelsCapacity Region AnalysisDiscrete Memoryless ChannelsJoint Source-channel CodingSlepian-wolf CodingSource-channel Coding
The paper studies reliable transmission of a discrete memoryless source over a broadcast channel with side information at receivers, contrasting with prior multiterminal results and showing that optimal schemes achieve operational separation. For two receivers, optimal coding uses two independent binning structures and degraded message sets, while for any number of receivers joint source‑channel coding with no explicit binning provides a simpler single‑letter characterization of achievable rates. The study shows that separate source‑channel coding with binning is optimal for two receivers but fails for more than two, whereas joint coding yields a simple single‑letter characterization for any number of receivers and is strictly better than separate coding, demonstrating that informational separation does not hold.
We discuss reliable transmission of a discrete memoryless source over a discrete memoryless broadcast channel, where each receiver has side information (of arbitrary quality) about the source unknown to the sender. When there are K=2 receivers, the optimum coding strategy using separate and stand-alone source and channel codes is to build two independent binning structures and send bin indices using degraded message sets through the channel, yielding a full characterization of achievable rates. However, as we show with an example, generalization of this technique to multiple binning schemes does not fully resolve the K>2 case. Joint source-channel coding, on the other hand, allows for a much simpler strategy (i.e., with no explicit binning) yielding a successful single-letter characterization of achievable rates for any Kges2. This characterization, which utilizes a trivial outer bound to the capacity region of general broadcast channels, is in terms of marginal source and channel distributions rather than a joint source-channel distribution. This contrasts with existing results for other multiterminal scenarios and implies that optimal schemes achieve "operational separation." "On the other hand, it is shown with an example that an optimal joint source-channel coding strategy is strictly advantageous over the combination of stand-alone source and channel codes, and thus "informational separation" does not hold
19
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Thomas M. Cover · IEEE Transactions on Information Theory · 1972 · 1.7K citations