ComputingComputer ScienceInformation TechnologyEdge ComputingInternet Of ThingsMachine LearningCachingCaching StrategiesEdge Resource ManagementIot Edge ComputingIot NetworkingReinforcement LearningCommunication Cost AnalysisData CachingData Caching PoliciesDeep Learning For IotDeep Reinforcement LearningEdge CachingEdge Reinforcement Learning
Connected devices in Internet-of-Things (IoT) continuously generate enormous amount of data, which is transient and would be requested by IoT application users, such as autonomous vehicles. Transmitting IoT data through wireless networks would lead to congestions and long delays, which can be tackled by caching IoT data at the network edge. However, it is challenging to jointly consider IoT data-transiency and dynamic context characteristics. In this paper, we advocate the use of deep reinforcement learning (DRL) to solve the problem of caching IoT data at the edge without knowing future IoT data popularity, user request pattern, and other context characteristics. By defining data freshness metrics, the aim of determining IoT data caching policy is to strike a balance between the communication cost and the loss of data freshness. Extensive simulation results corroborate that the proposed DRL-based IoT data caching policy outperforms other baseline policies.
24
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Deep Reinforcement Learning: A Brief Survey
Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage et al. · IEEE Signal Processing Magazine · 2017 · 4.3K citations
Fog and IoT: An Overview of Research Opportunities
Mung Chiang, Tao Zhang · IEEE Internet of Things Journal · 2016 · 2.3K citations