The emergence of technologies such as 5G and mobile edge computing has enabled provisioning of different types of services with different resource and service requirements to the vehicles in a vehicular network. The growing complexity of traffic mobility patterns and dynamics in the requests for different types of services has made service placement a challenging task. A typical static placement solution is not effective as it does not consider the traffic mobility and service dynamics. In this paper, we propose a reinforcement learning-based dynamic (RL-Dynamic) service placement framework to find the optimal placement of services at the edge servers while considering the vehicle’s mobility and dynamics in the requests for different types of services. We use SUMO and MATLAB to carry out simulation experiments. In our learning framework, for the decision module, we consider two alternative objective functions - minimizing delay and minimizing edge server utilization. We developed an integer linear programming (ILP) based problem formulation for the two objective functions. The experimental results show that 1) compared to static service placement, RL-based dynamic service placement achieves fair utilization of edge server resources and low service delay; and 2) compared to delay-optimized placement, server utilization-optimized placement utilizes resources more effectively, achieving higher fairness with lower edge-server utilization.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement Learning-based Dynamic Service Placement in Vehicular Networks


    Beteiligte:
    Talpur, Anum (Autor:in) / Gurusamy, Mohan (Autor:in)


    Erscheinungsdatum :

    01.04.2021


    Format / Umfang :

    6375836 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Edge Service Migration for Vehicular Networks Based on Multi-agent Deep Reinforcement Learning

    Zhang, Haohan / Li, Jinglin / Yuan, Quan | British Library Conference Proceedings | 2020


    AoI-Aware Dynamic User Scheduling in Vehicular Networks Based on Soft Reinforcement Learning

    Huang, Zhisen / Guo, Chongtao / Chen, Jiayi et al. | IEEE | 2023


    Context-Aware Service Placement at the Edge in Vehicular Networks

    Zhang, Wanlu / Tao, Chenhui / Luo, Jingjing et al. | IEEE | 2023


    Deep Reinforcement Learning based Adaptive Transmission Control in Vehicular Networks

    Liu, Mingyuan / Quan, Wei / Yu, Chengxiao et al. | IEEE | 2021


    Preserving Location-Privacy in Vehicular Networks via Reinforcement Learning

    Berri, Sara / Zhang, Jun / Bensaou, Brahim et al. | IEEE | 2022