With the growing demands for Autonomous Surface Vehicles (ASVs) in recent years, the number of ASVs being deployed for various maritime missions is expected to increase rapidly in the near future. However, it is still challenging for ASVs to perform sensor-based autonomous navigation in obstacle-filled and congested waterways, where perception errors, closely gathered vehicles and limited maneuvering space near buoys may cause difficulties in following the Convention on the International Regulations for Preventing Collisions at Sea (COLREGs). To address these issues, we propose a novel Distributional Reinforcement Learning based navigation system that can work with onboard LiDAR and odometry sensors to generate arbitrary thrust commands in continuous action space. Comprehensive evaluations of the proposed system in high-fidelity Gazebo simulations show its ability to decide whether to follow COLREGs or take other beneficial actions based on the scenarios encountered, offering superior performance in navigation safety and efficiency compared to systems using state-of-the-art Distributional RL, non-Distributional RL and classical methods.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Distributional Reinforcement Learning based Integrated Decision Making and Control for Autonomous Surface Vehicles


    Beteiligte:
    Lin, Xi (Autor:in) / Szenher, Paul (Autor:in) / Huang, Yewei (Autor:in) / Englot, Brendan (Autor:in)

    Erscheinungsdatum :

    2024


    Anmerkungen:

    IEEE Robotics and Automation Letters (RA-L)


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Navigating autonomous vehicles in uncertain environments with distributional reinforcement learning

    Xu, Shuyuan / Hao, Jiachen / Chen, Xuemei et al. | SAGE Publications | 2024


    Reinforcement Learning-Based On-Ramp Merging Decision-Making for Autonomous Vehicles

    Ma, Ning / Zhang, Ying / Cai, Wangze et al. | IEEE | 2023


    Heuristics‐oriented overtaking decision making for autonomous vehicles using reinforcement learning

    Liu, Teng / Huang, Bing / Deng, Zejian et al. | Wiley | 2020

    Freier Zugriff

    Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning

    Liu, Teng / Huang, Bing / Deng, Zejian et al. | IET | 2020

    Freier Zugriff

    Heterogeneous Information Fusion-Based Distributional Reinforcement Learning for Autonomous Driving

    Yin, Jianwen / Jiang, Zhengmin / Liang, Qingyi et al. | IEEE | 2024