IEEE Transactions on Mobile Computing · 2024 · 29 citations · 32 references
ComputingAutomotive EngineeringCommunicationAutonomous VehiclesEdge ComputingQueuing TheoryLatency OptimizationMobile Edge ComputingTask OffloadingVehicle Communication NetworksVehicle-to-everything CommunicationCommunication QualityEdge Computing For Vehicular NetworksEnergy ConsumptionOptimization-based OffloadingQueue StabilitySensingVehicular Edge ComputingVehicular Task Offloading
Due to numerous computation-intensive and delay-sensitive tasks in the Internet of Vehicles (IoV), Vehicular Edge Computing (VEC) is increasingly playing a crucial role as a key solution in the IoV. However, how to concurrently enhance communication quality and reduce the cost of latency and energy has emerged as a critical challenge in VEC. To tackle the above problem, we propose a Lyapunov-guided offloading based on the Soft Actor-Critic (SAC) algorithm, named LySAC, to minimize the average cost of the Integrated Sensing and Communications (ISAC) technology-aided IoV, where ISAC technology can effectively improve the communication quality by harnessing high-frequency waveforms to seamlessly integrate communication and sensing functionalities. First, we model the offloading process of ISAC-Aided IoV as an optimization problem of the joint cost of delay and energy with long-term energy consumption and queue stability. Then we formulate the optimization problem as a Lyapunov optimization and utilize the SAC method to find the optimal offloading decisions. Finally, we conduct extensive experiments and the results demonstrate the effectiveness and superiority of the proposed LySAC in minimizing total cost while maintaining queue stability and meeting long-term energy requirements compared with other several baseline schemes.
32
Soft Actor-Critic Algorithms and Applications
Tuomas Haarnoja, Aurick Zhou, Kristian Hartikainen et al. · arXiv (Cornell University) · 2018 · 2K citations · Full text