Simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) provides a promising way to expand coverage in wireless communications. However, limitation of single STAR-RIS inspire us to integrate the concept of multi-hop transmissions, as focused on RIS in existing research. Therefore, we propose the novel architecture of multi-hop STAR-RISs to achieve a wider range of full-plane service coverage. In this paper, we intend to solve active beamforming of the base station and passive beamforming of STAR-RISs, aiming for maximizing the energy efficiency constrained by hardware limitation of STAR-RISs. Furthermore, we investigate the impact of the on-off state of STAR-RIS elements on energy efficiency. To tackle the complex problem, a Multi-Agent Global and locAl deep Reinforcement learning (MAGAR) algorithm is designed. The global agent elevates the collaboration among local agents, which focus on individual learning. In numerical results, we observe the significant improvement of MAGAR compared to the other benchmarks, including Q-learning, multi-agent deep Q network (DQN) with golbal reward, and multi-agent DQN with local rewards. Moreover, the proposed architecture of multi-hop STAR-RISs achieves the highest energy efficiency compared to mode switching based STAR-RISs, conventional RISs and deployment without RISs or STAR-RISs.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-Agent Deep Reinforcement Learning for Energy Efficient Multi-Hop STAR-RIS-Assisted Transmissions


    Contributors:


    Publication date :

    2024-10-07


    Size :

    1836766 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    UAV-Assisted Relay Communication: A Multi-Agent Deep Reinforcement Learning Approach

    Huang, Longqian / Sun, Hongguang / Gao, Yinjie et al. | IEEE | 2024


    Multi-Agent Deep Reinforcement Learning in Vehicular OCC

    Islam, Amirul / Musavian, Leila / Thomos, Nikolaos | IEEE | 2022


    Communication-efficient and federated multi-agent reinforcement learning

    Krouka, M. (Mounssif) / Elgabli, A. (Anis) / Issaid, C. B. (Chaouki Ben) et al. | BASE | 2022

    Free access


    Multi-Agent Deep Reinforcement Learning for Efficient Passenger Delivery in Urban Air Mobility

    Park, Chanyoung / Park, Soohyun / Kim, Gyu Seon et al. | ArXiv | 2022

    Free access