IEEE Transactions on Information Theory · 2006 · 75 citations · 46 references
EngineeringCommunicationComputer ScienceDigital CommunicationFault-tolerant ComputingInformation TheoryChannel CapacityChannel CodingCoding TheoryError Control CodingError-correcting CodesSource CodingChannel Coding TheoremsDiscrete Memoryless ChannelsError Exponent AnalysisError ExponentsJoint Source-channel CodingSource-channel CodingSymmetry Laws
We investigate the computation of Csisza/spl acute/r's bounds for the joint source-channel coding (JSCC) error exponent E/sub J/ of a communication system consisting of a discrete memoryless source and a discrete memoryless channel. We provide equivalent expressions for these bounds and derive explicit formulas for the rates where the bounds are attained. These equivalent representations can be readily computed for arbitrary source-channel pairs via Arimoto's algorithm. When the channel's distribution satisfies a symmetry property, the bounds admit closed-form parametric expressions. We then use our results to provide a systematic comparison between the JSCC error exponent E/sub J/ and the tandem coding error exponent E/sub T/, which applies if the source and channel are separately coded. It is shown that E/sub T//spl les/E/sub J//spl les/2E/sub T/. We establish conditions for which E/sub J/>E/sub T/ and for which E/sub J/=2E/sub T/. Numerical examples indicate that E/sub J/ is close to 2E/sub T/ for many source-channel pairs. This gain translates into a power saving larger than 2 dB for a binary source transmitted over additive white Gaussian noise (AWGN) channels and Rayleigh-fading channels with finite output quantization. Finally, we study the computation of the lossy JSCC error exponent under the Hamming distortion measure.
46
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
Optimization by Vector Space Methods
Students Quarterly Journal · 1970 · 6.1K citations
Natural Sciences, Industrial Engineering, Design Optimization +6
Information Theory and Reliable Communication
David A. Bell · Electronics and Power · 1969 · 4K citations