2017 · 10 citations · 12 references
EngineeringComputer ScienceAlgorithmsInformation TheoryMachine LearningCoding TheoryError-correcting CodesRate-distortion TheorySource CodingInformation BottleneckInformation Bottleneck AnalysisLossy Source CodingMulti-terminal Source CodingMultiterminal Source CodingRate-distortion FunctionRate-distortion RegionRate-distortion Tradeoff
In this paper, we present iterative algorithms that numerically compute the rate-distortion regions of two problems: the two-encoder multiterminal source coding problem and the Chief Executive Officer (CEO) problem, both under logarithmic loss distortion measure. With the clear connection of these models with the distributed information bottleneck method, the proposed algorithms may find usefulness in a variety of applications, such as clustering, pattern recognition and learning. We illustrate the efficiency of our algorithms through some numerical examples.
12