Autonomous maneuvering decision-making in unmanned serial vehicles (UAVs) is crucial for executing complex missions involving both individual and swarm UAV operations. Leveraging the successful deployment of recommendation systems in commerce and online applications, this paper pioneers a framework tailored for UAV maneuvering decisions. This novel approach harnesses recommendation systems to enhance decision-making in UAV maneuvers. Our framework incorporates a comprehensive six-degree-of-freedom dynamics model that integrates gravitational effects and defines mission success criteria. We developed an integrated learning recommendation system capable of simulating varied mission scenarios, facilitating the acquisition of optimal strategies from a blend of expert human input and algorithmic outputs. The system supports extensive simulation capabilities, including various control modes (manual, autonomous, and hybrid) and both continuous and discrete maneuver actions. Through rigorous computer-based testing, we validated the effectiveness of established recommendation algorithms within our framework. Notably, the prioritized experience replay deep deterministic policy gradient (PER-DDPG) algorithm, employing dense rewards and continuous actions, demonstrated superior performance, achieving a 69% success rate in confrontational scenarios against a versatile expert algorithm after 1000 training iterations, marking an 80% reduction in training time compared to conventional reinforcement learning methods. This framework not only streamlines the comparison of different maneuvering algorithms but also promotes the integration of multi-source expert knowledge and sophisticated algorithms, paving the way for advanced UAV applications in complex operational environments.


    Access

    Download


    Export, share and cite



    Title :

    A Framework of Recommendation System for Unmanned Aerial Vehicle Autonomous Maneuver Decision


    Contributors:
    Qinzhi Hao (author) / Tengyu Jing (author) / Yao Sun (author) / Zhuolin Yang (author) / Jiali Zhang (author) / Jiapeng Wang (author) / Wei Wang (author)


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown





    Unmanned aerial vehicle perching maneuver

    FROLOFF WALT | European Patent Office | 2016

    Free access

    Autonomous Unmanned Aerial Vehicle Decision-Making

    MCGREW JAMES STATELAR / VIAN JOHN LYLE | European Patent Office | 2016

    Free access

    Autonomous unmanned aerial vehicle decision-making

    MCGREW JAMES STATELAR / VIAN JOHN LYLE | European Patent Office | 2017

    Free access

    AUTONOMOUS UNMANNED AERIAL VEHICLE DECISION-MAKING

    MCGREW JAMES STATELAR / VIAN JOHN LYLE | European Patent Office | 2022

    Free access