IEEE Transactions on Vehicular Technology · 2023 · 10 citations · 40 references
ComputingAerospace EngineeringEdge ComputingMarkov Decision ProcessesSchedulingEdge InfrastructureEdge NetworkingEdge Resource ManagementMobile Edge ComputingTask OffloadingTrajectory OptimizationCollaborative AnalyticsEdge Computing OffloadingEdge Task OffloadingEnergy-aware Task OffloadingMarkov Decision ModelsOverhead ReductionPerformance OverheadTrajectory Planning
Researchers have designed UAV-enabled edge servers (UES) to assist smart cameras (ECs) and optimize video analytics performance. However, most prior research neglects the impact of ECs' battery constraint on the system performance, especially in disaster scenarios. In this study, we introduce a novel time-slot-based UES-assisted system that aims to conserve energy and extend the overall lifetime of EC networks. Our proposed system operates in discrete time slots, wherein the UES alternates between hovering and serving ECs, or flying to a new position within its coverage area to provide better assistance. To minimize the computational overhead of ECs during hovering and serving within a time slot, we present a new task offloading scheme based on the differential evolutionary algorithm. For optimizing the UES's flying trajectory, we formulate the UES movement as a Markov decision process, taking into account system state changes. Subsequently, we design an efficient UES trajectory planning algorithm using double deep Q-learning. This algorithm optimizes energy consumption, feedback reward, and the overall system overhead, resulting in a doubling of the system's lifetime. Simulation results demonstrate that our proposed task offloading algorithm exhibits high accuracy and fast convergence compared to four other state-of-the-art strategies. Moreover, the UES trajectory planning algorithm doubles the system's lifetime while reducing energy consumption and total system overhead
40
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Deep Reinforcement Learning with Double Q-Learning
Hado van Hasselt, Arthur Guez, David Silver · 2016 · 6K citations · Full text
Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing
Xu Chen, Lei Jiao, Wenzhong Li et al. · IEEE/ACM Transactions on Networking · 2015 · 2.6K citations