Cognitive radio (CR) provides an effective solution to meet the huge bandwidth requirements in intelligent transportation systems (ITS), which enables secondary users (SUs) to access the idle spectrum of the primary users (PUs). However, the high mobility of users and real-time service requirements result in the additional transmission collisions and interference, which degrades the spectrum access rate and the quality of service (QoS) of users in ITS. This paper proposes a spectrum access algorithm (Feilin) based on federated deep reinforcement learning (FDRL) to improve spectrum access rate, which maximizes the QoS reward function with considering the hybrid benefits of delay, transmission power and utility of SUs. To guarantee the utility of SUs, the warranty contract is designed for SUs to obtain compensation for data transmission failure, which promotes SUs to compete for more spectrum resources. To meet the real-time requirements and improve QoS in ITS, a spectrum access model called FDQN-W is proposed based on federated deep Q-network (DQN), which adopts the asynchronous federated weighted learning algorithm (AFWLA) to share and update the weights of DQN in multiple agents to decrease time cost and accelerate the convergence. Detailed simulation results show that, in the multiuser scenario, compared with the existing methods, the proposed algorithm Feilin increases the spectrum access success rate by 15.1%, and reduces the collision rate with SUs and the collision rate with PUs by 46.4% and 6.8%, respectively.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Federated Deep Reinforcement Learning-Based Spectrum Access Algorithm With Warranty Contract in Intelligent Transportation Systems


    Contributors:
    Zhu, Rongbo (author) / Li, Mengyao (author) / Liu, Hao (author) / Liu, Lu (author) / Ma, Maode (author)


    Publication date :

    2023-01-01


    Size :

    2264940 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Enhancing WiFi Multiple Access Performance with Federated Deep Reinforcement Learning

    Zhang, Lyutianyang / Yin, Hao / Zhou, Zhanke et al. | IEEE | 2020



    Joint Air-Ground Distributed Federated Learning for Intelligent Transportation Systems

    Shinde, Swapnil Sadashiv / Tarchi, Daniele | IEEE | 2023

    Free access


    Reinforcement learning in intelligent transportation systems: recent developments

    Yu, Ye / Wang, Quanquan / Wang, Yukai et al. | British Library Conference Proceedings | 2021