Unmanned aircraft systems (UASs) with autonomous maneuvering decision capabilities are expected to play a key role in future unmanned systems applications. While reinforcement learning has proven successful in solving UAS path planning problems in simple urban environments, it remains under-researched for some complex mountain environments. In this paper, the path planning of UAS swarm for the low-altitude rapid traverse in diverse environments is studied when facing the threats of complex terrain, radars and swarm failure. First, a UAS swarm radar detection probability is built up for evaluating the radar detection threat by a networked radar system, where the detection probability of a UAS swarm is equated to a single UAS with appropriate position and radar cross section named as the swarm virtual leader. Second, a reinforcement learning based path planning method is proposed to seek the optimal path for the swarm virtual leader which balances instantaneous reward, including detection probability and path constraints with terminal reward, including normal rate. Third, a formation optimization strategy is designed to further reduce the threat of radar detection through dynamically adjusting the formation geometry. Final, simulations in the complex environment have been carried out to evaluate the performance of the proposed method, where the path quality, task success rate and normal rate are counted as the performance indicators.


    Access

    Download


    Export, share and cite



    Title :

    Reinforcement Learning-Based Low-Altitude Path Planning for UAS Swarm in Diverse Threat Environments


    Contributors:
    Jinwen Hu (author) / Liyuan Fan (author) / Yifei Lei (author) / Zhao Xu (author) / Wenxing Fu (author) / Gang Xu (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    UAV Swarm Path Planning with Reinforcement Learning for Field prospecting

    Puente-Castro, Alejandro / Rivero, Daniel / Pazos, Alejandro et al. | ArXiv | 2021

    Free access

    Large-scale UAV swarm path planning based on mean-field reinforcement learning

    ZHANG, Yaozhong / DING, Meiyan / YUAN, Yao et al. | Elsevier | 2025

    Free access



    Threat-aware Path Planning in Uncertain Urban Environments [Attached Video]

    Aoude, Georges S. / Luders, Brandon D. / Levine, Daniel S. et al. | DSpace@MIT | 2010

    Free access