The collision avoidance in real-time is crucial for unmanned surface vehicles (USVs) in a complex environment. Traditional methods make it hard to ensure the balance of control decisions. To balance safety and practicality, a collision avoidance algorithm based on deep reinforcement learning (DRL) and a two-level incentive reward based on the principle of complementarity is proposed. To address the vital sparse reward problem of Deep Deterministic Policy Gradient (DDPG), the trajectory evaluation function of the dynamic window algorithm (DWA) is referred to construct the primary reward strategy, and a secondary incentive reward is constructed based on velocity obstacle (VO) to eliminate potential collision risks. To improve the efficiency of training, the electronic chart (EC) and Unity3D are used to build an immersive simulation platform. Based on it, simulations are made to verify the performance. In addition, field experiments are first conducted in various encounter scenarios to verify the effectiveness. The results show that it can take safe collision avoidance actions and get practical paths in various situations.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Balanced Collision Avoidance Algorithm for USVs in Complex Environment: A Deep Reinforcement Learning Approach


    Beteiligte:
    Lou, Mengmeng (Autor:in) / Yang, Xiaofei (Autor:in) / Hu, Jiabao (Autor:in) / Zhu, Zhiyu (Autor:in) / Shen, Hao (Autor:in) / Xiang, Zhengrong (Autor:in) / Zhang, Bin (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.12.2024


    Format / Umfang :

    5266152 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch







    Pedestrian Collision Avoidance Using Deep Reinforcement Learning

    Rafiei, Alireza / Fasakhodi, Amirhossein Oliaei / Hajati, Farshid | Springer Verlag | 2022