In the era of Information and Communication, big data is rapidly generated due to the increasing data-driven applications in Internet of Things (IoT). Effectively processing such data, e.g., knowledge learning, on resource-limited IoT becomes a challenge. In this paper, we introduce a digital twin-enabled IoT, in order to achieve hyper-connected experience, green communication, and sustainable computing. Although knowledge learning benefits from the proposed system, system latency and energy consumption are still our focus in the distributed learning architecture. To this end, we leverage Deep Reinforcement Learning (DRL) to present the deep deterministic policy gradient with double actors and double critics (D4PG) to manage the multi-dimensional resources, i.e., CPU cycles, DT models, and communication bandwidths, enhancing the exploration ability and improving the inaccurate value estimation of agents in continuous action spaces. Extensive experimental results prove that the proposed architecture can efficiently conduct knowledge learning, and our intelligent scheme can effectively improve the system efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Green Resource Allocation with DDPG for Knowledge Learning in Digital Twin-enabled Edges


    Contributors:
    He, Xiaoming (author) / Mao, Yingchi (author) / Liu, Yinqiu (author) / Zhang, Benteng (author) / Jiang, Yunzhe (author) / Hong, Yan (author)


    Publication date :

    2023-10-10


    Size :

    2844878 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Improvement of the DDPG algorithm via twin delayed DDPG (TD3) on vertical rocket landing control system

    Maz, Faisal Amir / Prajitno, Prawito / Andiarti, Rika et al. | American Institute of Physics | 2023


    Towards Safe and Efficient Modular Path Planning using Twin Delayed DDPG

    Hebaish, Marawan Azmy / Hussein, Ahmed / El-Mougy, Amr | IEEE | 2022


    DDPG-based Resource Management for MEC/UAV-Assisted Vehicular Networks

    Peng, Haixia / Shen, Xuemin | ArXiv | 2020

    Free access