his research focuses on the adaptive navigation of maritime autonomous surface ships (MASSs) in an uncertain environment. To achieve intelligent obstacle avoidance of MASSs in a port, an autonomous navigation decision-making model based on hierarchical deep reinforcement learning is proposed. The model is mainly composed of two layers: the scene division layer and an autonomous navigation decision-making layer. The scene division layer mainly quantifies the sub-scenarios according to the International Regulations for Preventing Collisions at Sea (COLREG). This research divides the navigational situation of a ship into entities and attributes based on the ontology model and Protégé language. In the decision-making layer, we designed a deep Q-learning algorithm utilizing the environmental model, ship motion space, reward function, and search strategy to learn the environmental state in a quantized sub-scenario to train the navigation strategy. Finally, two sets of verification experiments of the deep reinforcement learning (DRL) and improved DRL algorithms were designed with Rizhao port as a study case. Moreover, the experimental data were analyzed in terms of the convergence trend, iterative path, and collision avoidance effect. The results indicate that the improved DRL algorithm could effectively improve the navigation safety and collision avoidance.


    Access

    Download


    Export, share and cite



    Title :

    Decision-Making for the Autonomous Navigation of Maritime Autonomous Surface Ships Based on Scene Division and Deep Reinforcement Learning


    Contributors:
    Zhang, X (author) / Wang, C (author) / Liu, Y (author) / Chen, X (author)

    Publication date :

    2019-09-19


    Remarks:

    Sensors , 19 (18) , Article 4055. (2019)


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Maritime Autonomous Surface Ships

    GWLB - Gottfried Wilhelm Leibniz Bibliothek | 2024

    Free access

    Maritime Autonomous Surface Ships

    TIBKAT | 2024

    Free access


    Survey on Collision-Avoidance Navigation of Maritime Autonomous Surface Ships

    Wang, Chengbo / Wang, Ning / Xie, Guangming et al. | Springer Verlag | 2021


    Operations of Maritime Autonomous Surface Ships

    Zbigniew Pietrzykowski / Jerzy Hajduk | DOAJ | 2019

    Free access