IEEE Transactions on Information Theory · 2005 · 130 citations · 20 references
EngineeringCommunicationElectrical EngineeringCommunication TheoryDigital CommunicationInformation TheoryChannel CapacityChannel CodingCoding TheoryMarkov ProcessesMutual InformationChannel Coding TheoremsConditional Mutual InformationDirected InformationMarkov State ModelsMaximum Mutual InformationStrong Converse Theorem
We consider a class of finite-state Markov channels with feedback. We first introduce a simplified equivalent channel model, and then construct the optimal stationary and nonstationary input processes that maximize the long-term directed mutual information. Furthermore, we give a sufficient condition under which the channel's Shannon capacity can be achieved by a stationary input process. The corresponding converse coding theorem and direct coding theorem are proved.
20
Information Theory and Reliable Communication
David A. Bell · Electronics and Power · 1969 · 4K citations