In autonomous vehicle platooning, Vehicle-to-Everything (V2X) communications are leveraged in cooperative adaptive cruise control (CACC) to improve control performance. Since exchanging information at all times incurs significant communication overhead in vehicular networks, it is important to determine when V2X communication is necessary. To solve this problem, we propose a Deep Reinforcement Learning (DRL)-based algorithm named Attention-DDPG, which learns platoon control with Deep Deterministic Policy Gradient (DDPG), and learns when to communicate with an attention network. Specifically, each preceding vehicle is equipped with a deep neural network (DNN), which takes as input its local state and platoon control action and determines whether to transmit its acceleration or not to the following vehicle at each time step. The attention network of a preceding vehicle is trained using the feedback from the following vehicle on the value of V2X information in the form of an advantage function. In order to evaluate Attention-DDPG, simulations are performed using real driving data, and performance is compared with those of two baselines that communicate and do not communicate at all times, respectively. The results demonstrate that Attention-DDPG strikes a competitive tradeoff between control performance and communication overhead while ensuring platoon string stability.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Jointly Learning V2X Communication and Platoon Control with Deep Reinforcement Learning


    Beteiligte:
    Liu, Tong (Autor:in) / Lei, Lei (Autor:in) / Liu, Zhiming (Autor:in) / Zheng, Kan (Autor:in)


    Erscheinungsdatum :

    05.09.2023


    Format / Umfang :

    2485211 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Safe Reinforcement Learning for Mixed-Autonomy Platoon Control

    Zhou, Jingyuan / Yan, Longhao / Yang, Kaidi | IEEE | 2023


    AVDDPG: Federated reinforcement learning applied to autonomous platoon control

    Boin, Christian / Lei, Lei / Yang, Simon X. | ArXiv | 2022

    Freier Zugriff


    Altruistic cooperative adaptive cruise control of mixed traffic platoon based on deep reinforcement learning

    Lu, Sikai / Cai, Yingfeng / Chen, Long et al. | Wiley | 2023

    Freier Zugriff