Under the demand of urban terminal "Last Mile Delivery" scenario, finding a safe and efficient UAV path planning method is a crucial issue of current research. Nowadays, reinforcement learning is widely used in UAV path planning, but it is difficult to ensure the safety of the learning or execution phases due to the lack of hard constraints. Aiming at the constraints above, this paper studies how to combine safety properties with RL algorithm to find a safe path and proposes a safe reinforcement learning method called Shield-DDPG for UAV path planning. In the method, a protection mechanism Shield is mainly introduced to prevent the algorithm from outputting unsafe actions. Further, the state space, action space, and reward function are specifically improved for efficiency and safety. Then we compare the Shield-DDPG algorithm with the DDPG and RRT algorithm in some different scenarios, and the results show that the proposed algorithm has a better performance. With the proposed path planning method, UAV can learn well to efficiently and safely reach the destination via calling the trained policy. This research is of great importance to UAV operations and practical applications in complex urban airspace.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A UAV Path Planning Method in Three-Dimensional Urban Airspace based on Safe Reinforcement Learning


    Beteiligte:
    Li, Yan (Autor:in) / Zhang, Xuejun (Autor:in) / Zhu, Yuanjun (Autor:in) / Gao, Ziang (Autor:in)


    Erscheinungsdatum :

    01.10.2023


    Format / Umfang :

    2666301 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Planning of Safe Trajectories in Urban Airspace

    Layer-Reiss, Samuel / Kunz, Johanna / Bittner, Matthias et al. | AIAA | 2024


    Automatic Safe Area Detection In Three-Dimensional Airspace

    Seiferth, David / Landkammer, Michael / Heller, Matthias et al. | AIAA | 2019


    Research on Particle Swarm Optimization-Based UAV Path Planning Technology in Urban Airspace

    Qing Cheng / Zhengyuan Zhang / Yunfei Du et al. | DOAJ | 2024

    Freier Zugriff


    The Trajectory Planning Method for UAV in Large Airspace Based on Deep Reinforcement Learning

    Hu, Weijun / Quan, Jiale / Ma, Xianlong et al. | British Library Conference Proceedings | 2022