To address the vehicle trajectory planning and tracking control problem in vehicular platoon control, we propose a two-layered hierarchical control framework based on deep deterministic policy gradient (DDPG) combined with incremental PID with switching function, considering the communication abnormal (packet-dropout, time delay, interruption) during the following process. Firstly, the vehicle dynamics model is constructed based on vehicle theory, secondly, the state space, action space, and multi-objective reward function are designed based on reinforcement learning theory for the decision-making of the RL-Agent, and finally, the effectiveness of the designed controller was validated through experimental simulations. The results show that: the controller designed in this paper, not only can realize the vehicle speed error, and vehicle space error quickly converge to zero, but also the communication time delay, the following vehicle can still smoothly follow the preceding vehicle, acceleration, and speed.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Reinforcement Learning-Based Trajectory Planning and Tracking Control for Connected Vehicles Subject to Communication Delay


    Contributors:
    Li, Jinxi (author) / Wen, Shixi (author) / Zhao, Yuan (author) / Li, Chi (author)


    Publication date :

    2023-10-27


    Size :

    5985694 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

    Xiang Liu / Weizhi Zhong / Xin Wang et al. | DOAJ | 2024

    Free access

    Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning

    Naveed, Kaleb Ben / Qiao, Zhiqian / Dolan, John M. | IEEE | 2021


    Deep reinforcement learning based trajectory real-time planning for hypersonic gliding vehicles

    Li, Jianfeng / Song, Shenmin / Shi, Xiaoping | SAGE Publications | 2024


    Trajectory Tracking and Navigation Model for Autonomous Vehicles Using Reinforcement Learning

    Ramani, G. / Karthik, C. / Pranay, B. et al. | Springer Verlag | 2024