Ramp merging areas on highways often serve as bottleneck areas, leading to frequent interactions and accidents between vehicles on the ramp and the arterial road. This results in severe congestion and reduced traffic performance. The emergence of Connected Autonomous Vehicles (CAVs) offers advanced solutions to address these issues and improve traffic operations at ramp merging areas. While previous studies have explored CAV decision-making approaches such as optimization control, model predictive control, and reinforcement learning, they face difficulties in accurately modeling the complex and dynamic scenarios of ramp merging. To overcome these challenges, this paper proposes a collaborative decision-making and control model based on Multi-agent Reinforcement Learning (MARL) for mixed vehicles (CAV-HDV) in multi-lane ramp merging scenarios on arterial roads. The paper introduces three novel MARL algorithms and conducts simulations in six different scenarios to evaluate traffic performance under various lane numbers and traffic densities. The results demonstrate the effectiveness of the proposed collaborative model for ramp merging vehicles. The proposed algorithms significantly reduce collision rates and improve traffic efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-agent Reinforcement Learning for Cooperative On-Ramp Merging of Connected Automated Vehicles


    Additional title:

    Lect.Notes Social.Inform.


    Contributors:
    Chen, Xiang (editor) / Wang, Xijun (editor) / Lin, Shangjing (editor) / Liu, Jing (editor) / Zhao, Boyuan (author) / Cui, Jianxun (author)

    Conference:

    International Conference on Internet of Things as a Service ; 2023 ; Nanjing, China October 27, 2023 - October 28, 2023



    Publication date :

    2024-10-29


    Size :

    22 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English





    Cooperative Ramp Merging Control for Connected and Automated Vehicles

    Manjiang, Hu / Jin, Huang / Tianchuang, Meng et al. | SAE Technical Papers | 2020


    Cooperative Ramp Merging Control for Connected and Automated Vehicles

    Tianchuang, Meng / Biao, Xu / Xiaohui, Qin et al. | British Library Conference Proceedings | 2020


    Penetration effect of connected and automated vehicles on cooperative on-ramp merging

    Ding, Jishiyu / Peng, Huei / Zhang, Yi et al. | IET | 2019

    Free access

    Penetration effect of connected and automated vehicles on cooperative on‐ramp merging

    Ding, Jishiyu / Peng, Huei / Zhang, Yi et al. | Wiley | 2020

    Free access