Journal of Marine Science and Engineering · 2023 · 14 citations · 23 references
EngineeringOcean EngineeringRobotics EngineeringMarine RoboticsPath PlanningUnderwater RoboticsAutonomous Underwater VehiclesCollision AvoidanceCollision Avoidance ControlObstacle AvoidanceReinforcement LearningUnderwater Robot KinematicsAutonomous Collision AvoidanceControl AlgorithmsDynamic Window ApproachForward-looking SonarKinematic Constraints In Collision AvoidancePath Planning For Collision AvoidanceProximal Policy OptimizationUnderwater Path Planning
A UUV can perform tasks such as underwater surveillance, reconnaissance, surveillance, and tracking by being equipped with sensors and different task modules. Due to the complex underwater environment, the UUV must have good collision avoidance planning algorithms to avoid various underwater obstacles when performing tasks. The existing path planning algorithms take a long time to plan and have poor adaptability to the environment. Some collision-avoidance planning algorithms do not take into account the kinematic limitations of the UUV, thus placing high demands on the performance and control algorithms of UUV. This article proposes a PPO−DWA collision avoidance planning algorithm for the UUV under static unknown obstacles, which is based on the proximal policy optimization (PPO) algorithm and the dynamic window approach (DWA). This algorithm acquires the obstacle information from forward-looking sonar as input and outputs the corresponding continuous actions. The PPO−DWA collision avoidance planning algorithm consists of the PPO algorithm and the modified DWA. The PPO collision avoidance planning algorithm is only responsible for outputting the continuous angular velocity, aiming to reduce the difficulty of training neural networks. The modified DWA acquires obstacle information and the optimal angular velocity from the PPO algorithm as input, and outputs of the linear velocity. The collision avoidance actions output by this algorithm meet the kinematic constraints of UUV, and the algorithm execution time is relatively short. The experimental data demonstrates that the PPO−DWA algorithm can effectively plan smooth collision-free paths in complex obstacle environments, and the execution time of the algorithm is acceptable.
23
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
Path planning techniques for mobile robots: Review and prospect
Lixing Liu, Xu Wang, Hongjie Liu et al. · Expert Systems with Applications · 2023 · 619 citations · Full text