Under the demand of urban terminal "Last Mile Delivery" scenario, finding a safe and efficient UAV path planning method is a crucial issue of current research. Nowadays, reinforcement learning is widely used in UAV path planning, but it is difficult to ensure the safety of the learning or execution phases due to the lack of hard constraints. Aiming at the constraints above, this paper studies how to combine safety properties with RL algorithm to find a safe path and proposes a safe reinforcement learning method called Shield-DDPG for UAV path planning. In the method, a protection mechanism Shield is mainly introduced to prevent the algorithm from outputting unsafe actions. Further, the state space, action space, and reward function are specifically improved for efficiency and safety. Then we compare the Shield-DDPG algorithm with the DDPG and RRT algorithm in some different scenarios, and the results show that the proposed algorithm has a better performance. With the proposed path planning method, UAV can learn well to efficiently and safely reach the destination via calling the trained policy. This research is of great importance to UAV operations and practical applications in complex urban airspace.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A UAV Path Planning Method in Three-Dimensional Urban Airspace based on Safe Reinforcement Learning


    Contributors:
    Li, Yan (author) / Zhang, Xuejun (author) / Zhu, Yuanjun (author) / Gao, Ziang (author)


    Publication date :

    2023-10-01


    Size :

    2666301 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Planning of Safe Trajectories in Urban Airspace

    Layer-Reiss, Samuel / Kunz, Johanna / Bittner, Matthias et al. | AIAA | 2024


    Automatic Safe Area Detection In Three-Dimensional Airspace

    Seiferth, David / Landkammer, Michael / Heller, Matthias et al. | AIAA | 2019


    Research on Particle Swarm Optimization-Based UAV Path Planning Technology in Urban Airspace

    Qing Cheng / Zhengyuan Zhang / Yunfei Du et al. | DOAJ | 2024

    Free access

    The Trajectory Planning Method for UAV in Large Airspace Based on Deep Reinforcement Learning

    Hu, Weijun / Quan, Jiale / Ma, Xianlong et al. | British Library Conference Proceedings | 2022


    AIAA-2019-3314: Automatic Safe Area Detection In Three-Dimensional Airspace

    Seiferth, David / Landkammer, Michael / Heller, Matthias et al. | British Library Conference Proceedings | 2019