The proliferation of small uncrewed aerial systems (UAS) poses many threats to airspace systems and critical infrastructures. In this paper, we apply deep reinforcement learning (DRL) to intercept rogue UAS in urban airspaces. We train a group of homogeneous friendly UAS, in this paper referred to as agents, to pursue and intercept a faster UAS evading capture while navigating through crowded airspace with several moving non-cooperating interacting entities (NCIEs). The problem is formulated as a multi-agent Markov Decision Process, and we develop the Proximal Policy Optimization based Advantage Actor-Critic (PPO-A2C) method to solve it, where the actor and critic networks are trained in a centralized server and the derived actor network is distributed to the agents to generate the optimal action based their observations. The simulation results show that, as compared to the traditional method, PPO-A2C fosters collaborations among agents to achieve the highest probability of capturing the evader and maintain the collision rate with other agents and NCIEs in the environment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-agent Deep Reinforcement Learning for Countering Uncrewed Aerial Systems


    Additional title:

    Springer Proceedings in Advanced Robotics


    Contributors:

    Conference:

    International Symposium on Distributed Autonomous Robotic Systems ; 2022 ; Montbéliard, France November 28, 2022 - November 30, 2022



    Publication date :

    2024-02-01


    Size :

    14 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    ERGONOMIC UNCREWED AERIAL VEHICLE

    TURNER STEVEN / GOODSON JOHN / MORONITI DAVID | European Patent Office | 2024

    Free access

    UNCREWED AERIAL FREIGHTER SYSTEM

    VAN MERKENSTEIJN JAN | European Patent Office | 2020

    Free access

    ERGONOMIC UNCREWED AERIAL VEHICLE

    TURNER STEVEN / GOODSON JOHN / MORONITI DAVID | European Patent Office | 2024

    Free access

    UNCREWED AERIAL FREIGHTER(TM) SYSTEM

    VAN MERKENSTEIJN IV JAN HENRI | European Patent Office | 2019

    Free access

    UNCREWED AERIAL SYSTEM SERVICE SUPPLIER UNCREWED AERIAL VEHICLE AUTHORIZATION AND AUTHENTICATION EVENT SUBSCRIPTION

    ATARIUS ROOZBEH / BASKARAN SHEEBA BACKIA MARY / KARAMPATSIS DIMITRIOS | European Patent Office | 2023

    Free access