Reinforcement learning has been widely used to train a sequential power control policy from simulation environment in Internet of Vehicles. However, disturbance is usually inevitably introduced when the agent getting into the practical environment from the simulation environment, which leads to a critical challenge when multiple links share a common spectrum. This paper is dedicated to addressing this issue in a two-pronged way. On one hand, we set the aim of policy learning as minimizing the network transmission outage probability from a risk-sensitive perspective. On the other hand, we propose a meta soft actor-critic based power control scheme, where the key hyperparameter is auto-adjusted to adapt to environment variations and L2 regulation is taken in the loss function of critic network to avoid overfitting to the simulation environment. Simulation results show that, the proposed algorithm achieves a higher successful transmission probability under the same conditions and is more robust under disturbed environment, than the baseline schemes.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Meta Soft Actor-Critic Based Robust Sequential Power Control in Vehicular Networks


    Beteiligte:
    Liu, Zhihua (Autor:in) / Guo, Chongtao (Autor:in) / Guo, Cheng (Autor:in) / Liu, Zhaoyang (Autor:in) / Wang, Xijun (Autor:in)


    Erscheinungsdatum :

    10.10.2023


    Format / Umfang :

    1116984 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Stepwise Soft Actor–Critic for UAV Autonomous Flight Control

    Ha Jun Hwang / Jaeyeon Jang / Jongkwan Choi et al. | DOAJ | 2023

    Freier Zugriff

    Multiagent Soft Actor–Critic for Traffic Light Timing

    Wu, Lan / Wu, Yuanming / Qiao, Cong et al. | ASCE | 2023



    Soft Actor-Critic with Inhibitory Networks for Retraining UAV Controllers Faster

    Choi, Minkyu / Filter, Max / Alcedo, Kevin et al. | IEEE | 2022


    Soft Actor-Critic Deep Reinforcement Learning for Fault Tolerant Flight Control

    Dally, Killian / Kampen, Erik-Jan Van | TIBKAT | 2022