Partial-band noise jamming is an important countermeasure against frequency-hopping spread spectrum technology in wireless sensor networks, and the jamming resource allocation (JRA) problem involved is a high-dimensional combinatorial optimization and also an NP-hard problem. Moreover, the users can dynamically alter their communication status, such as changing the channel spectrum distributions of hopping sets, posing additional difficulties for JRA. This article develops two methods to address the aforementioned challenges. First, a deep reinforcement learning (DRL)-based method is proposed for efficient JRA optimization, with the jamming scheme of each jamming node decided sequentially by the policy neural network, and its parameters are updated through trust region policy optimization (TRPO) within a trust region to ensure stable and fast convergence. Second, we propose a meta-TRPO-based method to improve the generalization capability of the policy network. After the meta-training process, it can update the meta-policy network with just a few fine-tuning steps and quickly obtain a task-specific policy for the fresh task. Extensive simulation results show that the proposed DRL-based method converges faster than other DRL methods. In addition, the proposed meta-TRPO-based method can rapidly adapt to unseen jamming tasks with only a small quantity of training trajectories.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Fast Adaptive Jamming Resource Allocation Against Frequency-Hopping Spread Spectrum in Wireless Sensor Networks via Meta-Deep-Reinforcement-Learning


    Contributors:
    Rao, Ning (author) / Xu, Hua (author) / Qi, Zisen (author) / Wang, Dan (author) / Zhang, Yue (author)


    Publication date :

    2024-12-01


    Size :

    4686001 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    PDI receiver for fast frequency hopping spread spectrum system

    Murata,Y. / Takakusaki,K. / Esmailzadeh,R. et al. | Automotive engineering | 1993


    A coherent demodulator for fast-frequency-hopping-spread-spectrum signal employing an adaptive algorithm

    Takakusaki,K. / Nakagawa,M. / Keio.gijuku Univ.,JP | Automotive engineering | 1993


    Bandwidth-Efficient Frequency Hopping based Anti-Jamming Game for Cognitive Radio assisted Wireless Sensor Networks

    Ibrahim, Khalid / Qureshi, Ijaz Mansoor / Naveed Malik, Adqas et al. | IEEE | 2021


    Coding for fast frequency hopped noncoherent MFSK spread spectrum communications under worst case jamming

    Wang, Q. / Gulliver, T.A. / Bhargava, V.K. et al. | Tema Archive | 1988


    Resource Allocation in UAV-Assisted Wireless Networks Using Reinforcement Learning

    Luong, Phuong / Gagnon, Francois / Labeau, Fabrice | IEEE | 2020