To address the issue of limited application scenarios associated with connectivity assurance based on two-dimensional (2D) trajectory planning, this paper proposes an improved deep reinforcement learning (DRL) -based three-dimensional (3D) trajectory planning method for cellular unmanned aerial vehicles (UAVs) communication. By considering the 3D space environment and integrating factors such as UAV mission completion time and connectivity, we develop an objective function for path optimization and utilize the advanced dueling double deep Q network (D3QN) to optimize it. Additionally, we introduce the prioritized experience replay (PER) mechanism to enhance learning efficiency and expedite convergence. In order to further aid in trajectory planning, our method incorporates a simultaneous navigation and radio mapping (SNARM) framework that generates simulated 3D radio maps and simulates flight processes by utilizing measurement signals from the UAV during flight, thereby reducing actual flight costs. The simulation results demonstrate that the proposed approach effectively enable UAVs to avoid weak coverage regions in space, thereby reducing the weighted sum of flight time and expected interruption time.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV


    Beteiligte:
    Xiang Liu (Autor:in) / Weizhi Zhong (Autor:in) / Xin Wang (Autor:in) / Hongtao Duan (Autor:in) / Zhenxiong Fan (Autor:in) / Haowen Jin (Autor:in) / Yang Huang (Autor:in) / Zhipeng Lin (Autor:in)


    Erscheinungsdatum :

    2024




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt





    Crossroad lighthouse trajectory planning method based on deep reinforcement learning

    LI BOQI / ZHANG WEIWEI / CHEN JIANG et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Trajectory Planning for Automated Parking Systems Using Deep Reinforcement Learning

    Du, Zhuo / Miao, Qiheng / Zong, Changfu | Springer Verlag | 2020


    Deep reinforcement learning based trajectory real-time planning for hypersonic gliding vehicles

    Li, Jianfeng / Song, Shenmin / Shi, Xiaoping | SAGE Publications | 2024