2008 · 42 citations · 12 references
EngineeringComputer ScienceElectrical EngineeringDigital CommunicationInformation TheoryOptimizationChannel CapacityChannel CodingCoding TheoryDigital Signal ProcessingAdditive NoiseAdditive White Gaussian Noise ChannelCapacity-achieving Input DistributionChannel Capacity ApproximationsChannel Coding TheoremsGaussian Channel CapacityQuantizationQuantized Communication
We investigate the limits of communication over the discrete-time additive white Gaussian noise (AWGN) channel, when the channel output is quantized using a small number of bits. We first provide a proof of our recent conjecture on the optimality of a discrete input distribution in this scenario. Specifically, we show that for any given output quantizer choice with K quantization bins (i.e., a precision of log <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sub> K bits), the input distribution, under an average power constraint, need not have any more than K + 1 mass points to achieve the channel capacity. The cutting-plane algorithm is employed to compute this capacity and to generate optimum input distributions. Numerical optimization over the choice of the quantizer is then performed (for 2-bit and 3-bit symmetric quantization), and the results we obtain show that the loss due to low-precision output quantization, which is small at low signal-to-noise ratio (SNR) as expected, can be quite acceptable even for moderate to high SNR values. For example, at SNRs up to 20 dB, 2-3 bit quantization achieves 80-90% of the capacity achievable using infinite-precision quantization.
12
Information Theory and Reliable Communication
David A. Bell · Electronics and Power · 1969 · 4K citations
C.H. Doan, Sohrab Emami, Ali M. Niknejad et al. · IEEE Journal of Solid-State Circuits · 2005 · 710 citations