In this paper, we develop a distributed mechanism for spectrum sharing among a network of unmanned aerial vehicles (UAV) and licensed terrestrial networks. This method can provide a practical solution for situations where the UAV network may need external spectrum when dealing with congested spectrum or need to change its operating frequency due to security threats. Here we study a scenario where the UAV network performs a remote sensing mission. In this model, the UAVs are categorized into two clusters of relaying and sensing UAVs. The relay UAVs provide a relaying service for a licensed network to obtain spectrum access for the rest of UAVs that perform the sensing task. We develop a distributed mechanism in which the UAVs locally decide whether they need to participate in relaying or sensing considering the fact that communications among UAVs may not be feasible or reliable. The UAVs learn the optimal task allocation using a distributed reinforcement learning algorithm. Convergence of the algorithm is discussed and simulation results are presented for different scenarios to verify the convergence.


    Access

    Download


    Export, share and cite



    Title :

    Distributed Cooperative Spectrum Sharing in UAV Networks Using Multi-Agent Reinforcement Learning


    Contributors:

    Publication date :

    2018


    Remarks:

    16 Pages, 8 Figures


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Cooperative perception in vehicular networks using multi-agent reinforcement learning

    Abdel-Aziz, M. K. (Mohamed K.) / Samarakoon, S. (Sumudu) / Perfecto, C. (Cristina) et al. | BASE | 2021

    Free access

    Multi-agent Cooperative Search based on Reinforcement Learning

    Sun, Yinjiang / Zhang, Rui / Liang, Wenbao et al. | IEEE | 2020


    Heterogeneous Multi-Agent Deep Reinforcement Learning for Cluster-Based Spectrum Sharing in UAV Swarms

    Xiaomin Liao / Yulai Wang / Yang Han et al. | DOAJ | 2025

    Free access


    Cooperative edge caching via multi agent reinforcement learning in fog radio access networks

    Chang, Q. (Qi) / Jiang, Y. (Yanxiang) / Zheng, F.-C. (Fu-Chun) et al. | BASE | 2022

    Free access