With the rapid development of mobile communications services and applications, deep edge networks (DENs) have become a new paradigm for addressing data traffic and network delay by combining mobile edge computing (MEC) and artificial intelligence (AI). In this network, edge caching can provide low-latency and reliable services in resource-constrained scenarios by caching content in the wireless access points (APs). In this paper, we propose a joint cooperative caching replacement and resource allocation algorithm based on a multi-agent deep deterministic policy gradient (MADDPG), which aims to minimize the average content download delay. The proposed algorithm regards each AP as a reinforcement learning agent that receives diverse state information (e.g., user request behaviors, cache status updates, content popularity information, and network conditions) to learn the caching replacement and bandwidth resource allocation strategy to maximize system rewards. Simulation results show that the proposed algorithm can efficiently decrease global content download delay, improve network efficiency, and enhance the user experience when compared to the benchmark algorithm.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Adaptive MARL-based Joint Cooperative Caching and Resource Allocation for Deep Edge Networks


    Contributors:
    Liu, Qian (author) / Xiao, Guangbin (author) / Liu, Qilie (author)


    Publication date :

    2023-10-10


    Size :

    1816512 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Cooperative MARL for Resource Allocation in High Mobility NGMA-enabled HetNets

    Yang, Leyou / Jia, Jie / Chen, Jian et al. | IEEE | 2022


    Cooperative Edge Caching via Federated Deep Reinforcement Learning in Fog-RANs

    Zhang, M. (Min) / Jiang, Y. (Yanxiang) / Zheng, F.-C. (Fu-Chun) et al. | BASE | 2021

    Free access



    Joint Power and Time Allocation in NOMA-SWIPT Enabled Wireless Caching Networks

    Ren, Yuan / Qian, Kaiyue / Zhang, Xuewei et al. | IEEE | 2022