ICT Express · 2022 · 48 citations · 8 references
ComputingAutonomous SystemsComputer ScienceAerial RoboticsArtificial IntelligencePath PlanningExploration-exploitation TradeoffPolicy ImprovementPolicy LearningReinforcement LearningTrajectory OptimizationAutonomous Collision AvoidanceCollision Avoidance LearningCollision Avoidance ManeuversCollision Avoidance SystemsDeep Reinforcement LearningExperience ReplayReinforcement Learning For RoboticsReplay
In this paper, we propose a soft actor–critic (SAC) algorithm with hindsight experience replay (HER), called SACHER, which is a class of deep reinforcement learning (DRL) algorithm. SAC is an off-policy model-free DRL algorithm that outperforms earlier DRL algorithms in terms of exploration and robustness. However, in SAC, maximizing the entropy-augmented objective degrades the optimality of learning outcomes. We propose SACHER to improve the learning performance of SAC. We apply SACHER to the path planning and collision avoidance control of unmanned aerial vehicles (UAVs). We demonstrate the effectiveness of SACHER in terms of the success rate, learning speed, and collision avoidance performance of UAV operation.
8
Soft Actor-Critic Algorithms and Applications
Tuomas Haarnoja, Aurick Zhou, Kristian Hartikainen et al. · arXiv (Cornell University) · 2018 · 2K citations · Full text