The invention relates to the technical field of vehicle behavior decision making, in particular to a vehicle following behavior decision making method based on an improved DDPG algorithm, which comprises the following steps: screening out vehicle following event data meeting conditions according to an original natural data set; the method comprises the following steps of: screening out vehicle following events, selecting proper driving behavior data characteristics in a data set, establishing a vehicle following model based on an improved DDPG algorithm, setting a state space, setting an action space and a reward function R, comprehensively considering three factors, and ending a training process when training and strategy convergence or a preset training round number is reached; according to the method, storage and reuse of historical empirical data are facilitated through dual empirical playback pools, two independent playback pools are introduced, delayed interval random sampling is carried out to carry out data acquisition, decision making efficiency is planned to be improved, a reward function comprehensively considers three aspects, namely safety, efficiency and comfort, so that an intelligent agent can consider comprehensive performance of a current time step, and decision making efficiency is improved. Therefore, the high-precision vehicle following behavior decision is achieved.

    本发明涉及车辆行为决策的技术领域,特别是涉及一种基于改进DDPG算法的车辆跟驰行为决策方法,包括:根据原始自然数据集,筛选出符合条件的跟车事件数据,筛选出的跟车事件、选取数据集中合适的驾驶行为数据特征、建立基于改进DDPG算法的车辆跟驰模型、设置状态空间、设置动作空间、奖励函数R综合考虑了三方面因素、训练和策略收敛或达到预设的训练轮数时,终止训练过程;其通过双重经验回放池帮助存储和重用历史经验数据,引入两个独立回放池和进行延迟的间隔随机采样进行数据获取拟提高决策的效率,奖励函数综合考虑了三方面,安全性、效率性和舒适性,使得智能体能考虑到当前时间步的综合表现,从而达到精度较高的车辆跟驰行为决策的。


    Access

    Download


    Export, share and cite



    Title :

    Vehicle following behavior decision-making method based on improved DDPG algorithm


    Additional title:

    一种基于改进DDPG算法的车辆跟驰行为决策方法


    Contributors:
    RAN CHUAN (author) / XIE ZHIJUN (author) / XIE JIAHAO (author) / YIN YANG (author)

    Publication date :

    2024-11-12


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Autonomous decision-making method of unmanned ship based on improved DDPG algorithm

    Wei GUAN / Shuhui HAO / Zhewen CUI et al. | DOAJ | 2025

    Free access

    Research on missile avoidance decision training based on improved DDPG algorithm

    Fan, Xin-Lei / Zou, Jie / Wang, Peng-fei et al. | SPIE | 2021


    Intelligent Ship Decision System Based on DDPG Algorithm

    Cui, Zhewen / Guan, Wei / Luo, Wenzhe | IEEE | 2022


    Autopilot Strategy Based on Improved DDPG Algorithm

    Zuo, Xiaochao / Li, Xiaoning / Tian, Zhewen | SAE Technical Papers | 2019


    Intelligent Decision-Making of MAV/UAV in Air Combat Based on DDPG Algorithm

    Li, Yue / Han, Wei / Zhong, Weiguo et al. | Springer Verlag | 2021