2021 IEEE Global Communications Conference (GLOBECOM) · 2021 · 41 citations · 16 references
BusinessMathematicsInformation TheoryMarkov Decision ProcessesOptimizationConstrained Markov Decision ProcessesStochastic ControlStochastic OptimizationValue IterationCommunication ReliabilityCommunications ReliabilityMarkov Decision ModelsMixing CoefficientRelative Value IterationThreshold FunctionsThreshold Policy Analysis
Age of Incorrect Information (AoII) is a newly introduced performance metric that considers communication goals. Therefore, comparing with traditional performance metrics and the recently introduced metric - Age of Information (AoI), AoII achieves better performance in many real-life applications. However, the fundamental nature of AoII has been elusive so far. In this paper, we consider the AoII in a system where a transmitter sends updates about a multi-state Markovian source to a remote receiver through an unreliable channel. The communication goal is to minimize AoII subject to a power constraint. We cast the problem into a Constrained Markov Decision Process (CMDP) and prove that the optimal policy is a mixture of two deterministic threshold policies. Afterward, by leveraging the notion of Relative Value Iteration (RVI) and the structural properties of threshold policy, we propose an efficient algorithm to find the threshold policies as well as the mixing coefficient. Lastly, numerical results are laid out to highlight the performance of AoII-optimal policy.
16
Artificial intelligence: a modern approach
Choice Reviews Online · 1995 · 22.2K citations · Full text
Real-time status: How often should one update?
Sanjit K. Kaul, Roy D. Yates, Marco Gruteser · 2012 · 2.4K citations
Two Freshness Metrics for Local Cache Refresh
Jing Zhong, Roy D. Yates, Emina Soljanin · 2018 · 174 citations