ObjectivesTo enhance the safety and efficiency of maritime traffic, this paper proposes an autonomous collision avoidance decision-making method for unmanned ships based on an enhanced Deep Deterministic Policy Gradient (DDPG) algorithm. Methods In order to address the issues of low data utilization and poor convergence in traditional DDPG algorithms, we employ Priority Experience Replay (PER) to dynamically adjust experience priority, reduce sample correlation, and utilize the Long Short-Term Memory (LSTM) network to improve the algorithm convergence. Based on the domain knowledge of ships and adhering to the International Regulations for Preventing Collisions at Sea (COLREGs), a model for determining meeting situations and a novel set of reward functions that consider urgent scenarios when other ships fail to comply with the COLREGs are introduced. Generalization experiments are conducted involving two-ship and multi-ship encounters to validate the effectiveness of the proposed method.Results As the experimental results demonstrate, compared to traditional DDPG algorithms, our improved approach enhances the convergence speed by approximately 28.8%. Conclusions The trained model enables autonomous decision-making and navigation while ensuring compliance with the COLREGs, thereby providing valuable insights for intelligent decision-making in the field of maritime transportation.


    Access

    Download


    Export, share and cite



    Title :

    Autonomous decision-making method of unmanned ship based on improved DDPG algorithm


    Contributors:
    Wei GUAN (author) / Shuhui HAO (author) / Zhewen CUI (author) / Miaomiao WANG (author)


    Publication date :

    2025




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Intelligent Ship Decision System Based on DDPG Algorithm

    Cui, Zhewen / Guan, Wei / Luo, Wenzhe | IEEE | 2022


    Vehicle following behavior decision-making method based on improved DDPG algorithm

    RAN CHUAN / XIE ZHIJUN / XIE JIAHAO et al. | European Patent Office | 2024

    Free access

    Research on Decision-Making Method of Unmanned Tractor-Trailer Based on T-DDPG

    Wang, Jian / Liang, Huawei / Zhao, Pan et al. | British Library Conference Proceedings | 2022


    A decision-making of autonomous driving method based on DDPG with pretraining

    Ma, Jinlin / Zhang, Mingyu / Ma, Kaiping et al. | SAGE Publications | 2025


    Research on missile avoidance decision training based on improved DDPG algorithm

    Fan, Xin-Lei / Zou, Jie / Wang, Peng-fei et al. | SPIE | 2021