The invention discloses an entrance ramp fleet confluence method based on reinforcement learning, and the method comprises the steps: carrying out the scene modeling according to an actual scene, and designing a plurality of fleet scales and vehicle speeds; vehicle acceleration and deceleration are designed as action selection, and the running speeds of main road vehicles and ramp vehicles are changed, so that the ramp vehicles select proper confluence opportunities; the change of the total travel time reflects the motorcade afflux efficiency, a reward function is established according to the change of the vehicle speed, the change of the time headway and the queuing waiting time of a ramp vehicle on an acceleration lane, an action mask is designed to improve the training efficiency, an intelligent agent is trained by using a PPO algorithm, and a trained deep reinforcement model is taken as a vehicle afflux model. The method gives consideration to the better passing efficiency of the main line and the shorter queuing waiting time of the vehicles on the ramp, enables the passing of the main line to be smoother, reduces the waiting time of the vehicles on the ramp as much as possible, and reduces the interference on the main line caused by the convergence of the vehicles on the ramp.

    本发明公开了一种基于强化学习的入口匝道车队汇入方法,包括根据实际场景进行场景建模,设计多种车队规模和车辆速度;设计车辆加减速作为动作选择,改变主路车辆和匝道车辆的运行速度,使匝道车辆选择合适的汇入时机;以总行程时间的变化反映车队汇入效率,根据车辆速度变化、车头时距变化和匝道车辆在加速车道的排队等待时间建立奖励函数,设计动作掩码提高训练效率,使用PPO算法对智能体进行训练,取训练后的深度强化模型作为车辆汇入模型。本发明兼顾主线通行效率较优和匝道车辆排队等待时间较小,使主线通行更加顺畅的同时尽可能减少匝道车辆等待时间,减少匝道车辆汇入对主线造成的干扰。


    Access

    Download


    Export, share and cite



    Title :

    Entrance ramp motorcade afflux method based on reinforcement learning


    Additional title:

    一种基于强化学习的入口匝道车队汇入方法


    Contributors:
    LI HAIJIAN (author) / LI ZONGDIAN (author) / YANG YUBING (author) / LI CHENGQIAN (author) / BING HAO (author)

    Publication date :

    2025-04-11


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06Q Datenverarbeitungssysteme oder -verfahren, besonders angepasst an verwaltungstechnische, geschäftliche, finanzielle oder betriebswirtschaftliche Zwecke, sowie an geschäftsbezogene Überwachungs- oder Voraussagezwecke , DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Intelligent motorcade collaborative afflux method and device and electronic equipment

    GAO HUAN / CEN YANQING / LIU BO et al. | European Patent Office | 2023

    Free access

    Intelligent motorcade collaborative afflux method and device for confluence area

    YANG ZHIFA / WANG LONG / YU ZHUO | European Patent Office | 2024

    Free access

    Ramp afflux-in and afflux-out early warning system

    YANG LEI / HONG TAO / WANG HENGDA et al. | European Patent Office | 2021

    Free access

    Vehicle ramp afflux-in and afflux-out cooperative control method

    SHAN PING | European Patent Office | 2022

    Free access

    Automatic driving vehicle high-speed ramp intelligent afflux method based on reinforcement learning

    HU XIAOSONG / XIAO WENXUAN / YANG YUYOU et al. | European Patent Office | 2023

    Free access