In this paper, we investigate the resource allocation problem in a dynamic vehicular environment, where multiple vehicle-to-vehicle links attempt to reuse the spectrum of vehicle-to-infrastructure links. It is modeled as a deep reinforcement learning problem that is subject to proximal policy optimization. Training a well-performing policy usually requires a massive amount of interactions with the environment for a long time and thus is typically performed on a simulator. However, an agent well trained in a simulated environment may still fail when deployed in a live network, due to inevitable difference between the two environments, termed reality gap. We make preliminary efforts to address this issue by leveraging meta reinforcement learning that allows the learning agent to quickly adapt to a new environment with minimal interactions after being trained across a variety of similar tasks. We demonstrate that only a few episodes are required for the meta trained policy to adapt to a new environment and the proposed method is shown to achieve near-optimal performance and exhibit rapid convergence.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Fast Spectrum Sharing in Vehicular Networks: A Meta Reinforcement Learning Approach


    Beteiligte:
    Huang, Kai (Autor:in) / Luo, Zezhou (Autor:in) / Liang, Le (Autor:in) / Jin, Shi (Autor:in)


    Erscheinungsdatum :

    01.09.2022


    Format / Umfang :

    737482 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Power Optimization for Spectrum Sharing in Vehicular Networks

    L. Thulasimani / A. Antinita Shilpha Daly | BASE | 2021

    Freier Zugriff

    An approach to implement Reinforcement Learning for Heterogeneous Vehicular Networks

    Peshavaria, Bhavya / Kavaiya, Sagar / Patel, Dhaval K. | ArXiv | 2022

    Freier Zugriff

    Distributed Cooperative Spectrum Sharing in UAV Networks Using Multi-Agent Reinforcement Learning

    Shamsoshoara, Alireza / Khaledi, Mehrdad / Afghah, Fatemeh et al. | ArXiv | 2018

    Freier Zugriff


    Software-Defined Vehicular Networks With Trust Management: A Deep Reinforcement Learning Approach

    Zhang, Dajun / Yu, F. Richard / Yang, Ruizhe et al. | IEEE | 2022