Sensors · 2023 · 13 citations · 24 references
ComputingAutonomous SystemsComputer ScienceArtificial IntelligenceAutonomous VehiclesPath PlanningDeep LearningMarine Robot ControlMarine Robot PerceptionPolicy LearningReinforcement LearningConvolutional Neural NetworksDeep Reinforcement LearningDynamic Obstacle AvoidancePolicy OptimizationProximal AlgorithmsProximal Policy OptimizationRadar PerceptionReward Models
To solve the problems of path planning and dynamic obstacle avoidance for an unmanned surface vehicle (USV) in a locally observable non-dynamic ocean environment, a visual perception and decision-making method based on deep reinforcement learning is proposed. This method replaces the full connection layer in the Proximal Policy Optimization (PPO) neural network structure with a convolutional neural network (CNN). In this way, the degree of memorization and forgetting of sample information is controlled. Moreover, this method accumulates reward models faster by preferentially learning samples with high reward values. From the USV-centered radar perception input of the local environment, the output of the action is realized through an end-to-end learning model, and the environment perception and decision are formed as a closed loop. Thus, the proposed algorithm has good adaptability in different marine environments. The simulation results show that, compared with the PPO algorithm, Soft Actor-Critic (SAC) algorithm, and Deep Q Network (DQN) algorithm, the proposed algorithm can accelerate the model convergence speed and improve the path planning performances in partly or fully unknown ocean fields.
24
A review: On path planning strategies for navigation of mobile robot
B. K. Patle, Ganesh Babu L, Anish Pandey et al. · Defence Technology · 2019 · 887 citations · Full text
Convolutional Neural Networks: A Survey
Moez Krichen · Computers · 2023 · 552 citations · Full text
Ship collision avoidance methods: State-of-the-art
Yamin Huang, Linying Chen, Pengfei Chen et al. · Safety Science · 2019 · 415 citations