In recent years, significant progress has been made in the multi-target tracking (MTT) of unmanned aerial vehicle (UAV) swarms. Most existing MTT approaches rely on the ideal assumption of a pre-set target trajectory. However, in practice, the trajectory of a moving target cannot be known by the UAV in advance, which poses a great challenge for realizing real-time tracking. Meanwhile, state-of-the-art multi-agent value-based methods have achieved significant progress for cooperative tasks. In contrast, multi-agent actor-critic (MAAC) methods face high variance and credit assignment issues. To address the aforementioned issues, this paper proposes a learning-based factored multi-agent soft actor-critic (FMASAC) scheme under the maximum entropy framework, where the UAV swarm is able to learn cooperative MTT in an unknown environment. This method introduces the idea of value decomposition into the MAAC setting to reduce the variance in policy updates and learn efficient credit assignment. Moreover, to further increase the detection tracking coverage of a UAV swarm, a spatial entropy reward (SER), inspired by the spatial entropy concept, is proposed in this scheme. Experiments demonstrated that the FMASAC can significantly improve the cooperative MTT performance of a UAV swarm, and it outperforms existing baselines in terms of the mean reward and tracking success rates. Additionally, the proposed scheme scales more successfully as the number of UAVs and targets increases.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Factored Multi-Agent Soft Actor-Critic for Cooperative Multi-Target Tracking of UAV Swarms


    Beteiligte:
    Longfei Yue (Autor:in) / Rennong Yang (Autor:in) / Jialiang Zuo (Autor:in) / Mengda Yan (Autor:in) / Xiaoru Zhao (Autor:in) / Maolong Lv (Autor:in)


    Erscheinungsdatum :

    2023




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt





    Altruistic Maneuver Planning for Cooperative Autonomous Vehicles Using Multi-agent Advantage Actor-Critic

    Toghi, Behrad / Valiente, Rodolfo / Sadigh, Dorsa et al. | ArXiv | 2021

    Freier Zugriff


    Actor-Critic Policy Learning in Cooperative Planning

    Redding, Joshua / Geramifard, Alborz / Choi, Han-Lim et al. | AIAA | 2010


    Multi-agent Actor-Critic traffic signal cooperative control method based on centralized training and decentralized execution

    ZHANG YONGNAN / PENG SIRUI / LI YUNXUAN et al. | Europäisches Patentamt | 2024

    Freier Zugriff