IEEE Transactions on Green Communications and Networking · 2022 · 34 citations · 19 references
ComputingAgricultural EngineeringComputer ScienceArtificial IntelligenceInternet Of ThingsSchedulingAgricultural ApplicationsAgricultural Internet Of ThingsReinforcement LearningTask OffloadingAerial Base StationsHeuristicsMixed-integer OptimizationMixed-integer ProgrammingQ-learningReinforcement Learning For OffloadingRisk-aware SchedulingRisk-sensitive Reinforcement Learning
Aerial base stations (ABSs) allow smart farms to offload processing responsibility of complex tasks from Internet of things (IoT) devices to ABSs. IoT devices have limited energy and computing resources, thus it is required to provide an advanced solution for a system that requires the support of ABSs. This paper introduces a novel multi-actor-based risk-sensitive reinforcement learning approach for ABS task scheduling for smart agriculture. The problem is defined as task offloading with a strict condition on completing the IoT tasks before their deadlines. Moreover, the algorithm must also consider the limited energy capacity of the ABSs. The results show that our proposed approach outperforms several heuristics and the classic Q-Learning approach. Furthermore, we provide a mixed integer linear programming solution to determine a lower bound on the performance, and clarify the gap between our risk-sensitive solution and the optimal solution, as well. The comparison proves our extensive simulation results demonstrate that our method is a promising approach for providing a guaranteed task processing services for the IoT tasks in a smart farm, while increasing the hovering time of the ABSs in this farm.
19
Is Q-learning Provably Efficient?
Chi Jin, Zeyuan Allen-Zhu, Sébastien Bubeck et al. · arXiv (Cornell University) · 2018 · 338 citations · Full text
Simu5G–An OMNeT++ Library for End-to-End Performance Evaluation of 5G Networks
Giovanni Nardini, Dario Sabella, Giovanni Stea et al. · IEEE Access · 2020 · 281 citations · Full text