IEEE Transactions on Information Theory · 1983 · 64 citations · 3 references
EngineeringComputer ScienceMathematicsDigital CommunicationInformation TheoryProbability TheoryChannel CodingCoding TheoryError-correcting CodesMarkov ChainsSource CodingUniversal CodingBlock CodingLower BoundsMarkov StatesState Transition ProbabilitiesTransition ProbabilitiesUniversal Coding For Finite-state SourcesUniversal Coding For Markov SourcesUpper Bound Computation
Upper and lower bounds are presented on the minimax redundancy for Markov source noiseless block-to-variable universal coding. The number of states, block size, and Markov order are arbitrary but finite. Unlike earlier results, the upper and lower bounds are absolute, that is, not merely asymptotic. The upper bound is established by combinatorial bounds. The lower bound is established by a bound on the average redundancy for an arbitrary distribution on the transition probabilities. The bound can be optimized across the choice of distribution.
3
L. Davisson · IEEE Transactions on Information Theory · 1973 · 374 citations