Reducing energy consumption while maintaining tracking accuracy is a significant challenge in the context of underwater target tracking using wireless sensor networks. The allocation of digitalizing bits for each sensor node is pivotal in influencing both tracking accuracy and energy efficiency. However, traditional optimization methods for bit allocation in sensing quantization are constrained by environmental dependencies, inflexibility, and prolonged computation times. To address these issues, we propose an innovative bit allocation algorithm based on deep reinforcement learning (DRL) for target tracking in underwater sensor networks. This algorithm focuses on adaptively quantizing and transmitting sensor data to optimize energy usage. Initially, we establish a quantitative relationship between bit allocation, tracking accuracy, and energy consumption within these sensor nodes. Building on this foundation, we develop a bit allocation model to minimize energy consumption while adhering to accuracy constraints. We present a novel transformer-based DRL network, the transformer-double dueling deep Q-network, to optimize bit allocation strategies. This network facilitates the offline-trained reinforcement learning agent to derive optimal sensor quantization bit allocations in real time. Our experimental results demonstrate that the proposed algorithm effectively achieves a balance between target tracking precision and digital bit consumption, significantly enhancing real-time computational efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    T-D3QN: Deep Reinforcement Learning Based Digitalizing Bit Allocation for Target Tracking in Underwater Wireless Sensor Networks


    Contributors:
    Jin, Biao (author) / Liu, Chao (author) / Zhang, Zhenkai (author) / Lian, Zhuxian (author) / Wang, Biao (author) / Zhang, Xiangqun (author) / Du, Genyuan (author)


    Publication date :

    2025-08-01


    Size :

    4361232 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    D3QN-Based IAB Resource Allocation and Tethered UAV Positioning for IoT Networks

    Lee, Yerin / Yu, Heejung / Lee, Howon et al. | IEEE | 2025


    D3QN-based Elevator Scheduling Algorithm for Robots

    Ke, Yan-Yin / Yu, Yun-Shuai / Sun, Cheng-Tung et al. | IEEE | 2022



    Multi-Underwater Target Interception Strategy Based on Deep Reinforcement Learning

    Wenhao GAN / Yunfei PENG / Lei QIAO | DOAJ | 2025

    Free access

    Deep Reinforcement Learning-Based Channel Allocation for Wireless LANs with Graph Convolutional Networks

    Nakashima, Kota / Kamiya, Shotaro / Ohtsu, Kazuki et al. | IEEE | 2019