ObjectivesTo enhance the safety and efficiency of maritime traffic, this paper proposes an autonomous collision avoidance decision-making method for unmanned ships based on an enhanced Deep Deterministic Policy Gradient (DDPG) algorithm. Methods In order to address the issues of low data utilization and poor convergence in traditional DDPG algorithms, we employ Priority Experience Replay (PER) to dynamically adjust experience priority, reduce sample correlation, and utilize the Long Short-Term Memory (LSTM) network to improve the algorithm convergence. Based on the domain knowledge of ships and adhering to the International Regulations for Preventing Collisions at Sea (COLREGs), a model for determining meeting situations and a novel set of reward functions that consider urgent scenarios when other ships fail to comply with the COLREGs are introduced. Generalization experiments are conducted involving two-ship and multi-ship encounters to validate the effectiveness of the proposed method.Results As the experimental results demonstrate, compared to traditional DDPG algorithms, our improved approach enhances the convergence speed by approximately 28.8%. Conclusions The trained model enables autonomous decision-making and navigation while ensuring compliance with the COLREGs, thereby providing valuable insights for intelligent decision-making in the field of maritime transportation.
Autonomous decision-making method of unmanned ship based on improved DDPG algorithm
2025
Article (Journal)
Electronic Resource
Unknown
unmanned vehicles , deep deterministic policy gradient (ddpg) algorithm , autonomous collision avoidance decision-making , priorit-ized experience replay (per) , international regulations forprevent-ing collisions at sea (colregs) , collision avoidance , Naval architecture. Shipbuilding. Marine engineering , VM1-989
Metadata by DOAJ is licensed under CC BY-SA 1.0
Intelligent Ship Decision System Based on DDPG Algorithm
IEEE | 2022
|Vehicle following behavior decision-making method based on improved DDPG algorithm
European Patent Office | 2024
|Research on Decision-Making Method of Unmanned Tractor-Trailer Based on T-DDPG
British Library Conference Proceedings | 2022
|A decision-making of autonomous driving method based on DDPG with pretraining
SAGE Publications | 2025
|