Unmanned aerial vehicles (UAVs) have emerged as a promising solution for collaborative search missions in complex environments. However, in the presence of interference, communication disruptions between UAVs and ground control stations can severely degrade coordination efficiency, leading to prolonged search times and reduced mission success rates. To address these challenges, this paper proposes a novel multi-agent deep reinforcement learning (MADRL) framework for joint spectrum and search collaboration in multi-UAV systems. The core problem is formulated as a combinatorial optimization task that simultaneously optimizes channel selection and heading angles to minimize the total search time under dynamic interference conditions. Due to the NP-hard nature of this problem, we decompose it into two interconnected Markov decision processes (MDPs): a spectrum collaboration subproblem solved using a received signal strength indicator (RSSI)-aware multi-agent proximal policy optimization (MAPPO) algorithm and a search collaboration subproblem addressed through a target probability map (TPM)-guided MAPPO approach with an innovative action-masking mechanism. Extensive simulations demonstrate superior performance compared to baseline methods (IPPO, QMIX, and IQL). Extensive experimental results demonstrate significant performance advantages, including 68.7% and 146.2% higher throughput compared to QMIX and IQL, respectively, along with 16.7–48.3% reduction in search completion steps versus baseline methods, while maintaining robust operations under dynamic interference conditions. The framework exhibits strong resilience to communication disruptions while maintaining stable search performance, validating its practical applicability in real-world interference scenarios.


    Access

    Download


    Export, share and cite



    Title :

    Collaborative Search Algorithm for Multi-UAVs Under Interference Conditions: A Multi-Agent Deep Reinforcement Learning Approach


    Contributors:
    Wei Wang (author) / Yong Chen (author) / Yu Zhang (author) / Yihang Du (author)


    Publication date :

    2025




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Graph-based multi-agent reinforcement learning for collaborative search and tracking of multiple UAVs

    ZHAO, Bocheng / HUO, Mingying / LI, Zheng et al. | Elsevier | 2025

    Free access


    Supporting UAVs Swarm Missions by Multi-Agent Reinforcement Learning

    Fusco, P. / Porcelli, L. / Palmieri, F. et al. | IEEE | 2025



    Scaling Collaborative Space Networks with Deep Multi-Agent Reinforcement Learning

    Ma, Ricky / Hernandez, Gabe / Hernandez, Carrie | IEEE | 2023