Reinforcement learning has been widely used to train a sequential power control policy from simulation environment in Internet of Vehicles. However, disturbance is usually inevitably introduced when the agent getting into the practical environment from the simulation environment, which leads to a critical challenge when multiple links share a common spectrum. This paper is dedicated to addressing this issue in a two-pronged way. On one hand, we set the aim of policy learning as minimizing the network transmission outage probability from a risk-sensitive perspective. On the other hand, we propose a meta soft actor-critic based power control scheme, where the key hyperparameter is auto-adjusted to adapt to environment variations and L2 regulation is taken in the loss function of critic network to avoid overfitting to the simulation environment. Simulation results show that, the proposed algorithm achieves a higher successful transmission probability under the same conditions and is more robust under disturbed environment, than the baseline schemes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Meta Soft Actor-Critic Based Robust Sequential Power Control in Vehicular Networks


    Contributors:
    Liu, Zhihua (author) / Guo, Chongtao (author) / Guo, Cheng (author) / Liu, Zhaoyang (author) / Wang, Xijun (author)


    Publication date :

    2023-10-10


    Size :

    1116984 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Stepwise Soft Actor–Critic for UAV Autonomous Flight Control

    Ha Jun Hwang / Jaeyeon Jang / Jongkwan Choi et al. | DOAJ | 2023

    Free access

    Multiagent Soft Actor–Critic for Traffic Light Timing

    Wu, Lan / Wu, Yuanming / Qiao, Cong et al. | ASCE | 2023



    Soft Actor-Critic with Inhibitory Networks for Retraining UAV Controllers Faster

    Choi, Minkyu / Filter, Max / Alcedo, Kevin et al. | IEEE | 2022


    Soft Actor-Critic Deep Reinforcement Learning for Fault Tolerant Flight Control

    Dally, Killian / Kampen, Erik-Jan Van | TIBKAT | 2022