Platooning technology is renowned for its precise vehicle control, traffic flow optimization, and energy efficiency enhancement. However, in large-scale mixed platoons, vehicle heterogeneity and unpredictable traffic conditions lead to virtual bottlenecks. These bottlenecks result in reduced traffic throughput and increased energy consumption within the platoon. To address these challenges, we introduce a decision-making strategy based on nested graph reinforcement learning. This strategy improves collaborative decision-making, ensuring energy efficiency and alleviating congestion. We propose a theory of nested traffic graph representation that maps dynamic interactions between vehicles and platoons in non-Euclidean spaces. By incorporating spatio-temporal weighted graph into a multi-head attention mechanism, we further enhance the model's capacity to process both local and global data. Additionally, we have developed a nested graph reinforcement learning framework to enhance the self-iterative learning capabilities of platooning. Using the I-24 dataset, we designed and conducted comparative algorithm experiments, generalizability testing, and permeability ablation experiments, thereby validating the proposed strategy's effectiveness. Compared to the baseline, our strategy increases throughput by 10% and decreases energy use by 9%. Specifically, increasing the penetration rate of CAVs significantly enhances traffic throughput, though it also increases energy consumption.


    Access

    Download


    Export, share and cite



    Title :

    A Nested Graph Reinforcement Learning-based Decision-making Strategy for Eco-platooning


    Contributors:
    Gao, Xin (author) / Li, Xueyuan (author) / Liu, Hao (author) / Li, Ao (author) / Ma, Zhaoyang (author) / Li, Zirui (author)

    Publication date :

    2024


    Remarks:

    14 pages, 18 figures


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Networked vehicle formation decision-making method based on nested graph reinforcement learning

    LI XUEYUAN / GAO XIN / LIU HAO et al. | European Patent Office | 2024

    Free access


    Highway On-Ramp Truck Platooning Based on Deep Reinforcement Learning

    Wang, An / Qi, Liang / Luan, Wenjing et al. | Transportation Research Record | 2024


    Fuzzy Logic Based Decision-Making for Urban Platooning on Urban Roundabout Scenarios

    Arizala, Asier / Alonso, Gorka / Pérez, Joshué et al. | Springer Verlag | 2024