Present the DDPGwP (DDPG with Pretraining) model, grounded in the framework of deep reinforcement learning, designed for autonomous driving decision-making. The model incorporates imitation learning by utilizing expert experience for supervised learning during initial training and weight preservation. A novel loss function is devised, enabling the expert experience to jointly guide the Actor network’s update alongside the Critic network while also participating in the Critic network’s updates. This approach allows imitation learning to dominate the early stages of training, with reinforcement learning taking the lead in later stages. Employing experience replay buffer separation techniques, we categorize and store collected superior, ordinary, and expert experiences. We select sensor inputs from the TORCS (The Open Racing Car Simulator) simulation platform and conduct experimental validation, comparing the results with the original DDPG, A2C, and PPO algorithms. Experimental outcomes reveal that incorporating imitation learning significantly accelerates early-stage training, reduces blind trial-and-error during initial exploration, and enhances algorithm stability and safety. The experience replay buffer separation technique improves sampling efficiency and mitigates algorithm overfitting. In addition to expediting algorithm training rates, our approach enables the simulated vehicle to learn superior strategies, garnering higher reward values. This demonstrates the superior stability, safety, and policy-making capabilities of the proposed algorithm, as well as accelerated network convergence.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A decision-making of autonomous driving method based on DDPG with pretraining


    Beteiligte:
    Ma, Jinlin (Autor:in) / Zhang, Mingyu (Autor:in) / Ma, Kaiping (Autor:in) / Zhang, Houzhong (Autor:in) / Geng, Guoqing (Autor:in)


    Erscheinungsdatum :

    01.04.2025




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Autonomous decision-making method of unmanned ship based on improved DDPG algorithm

    Wei GUAN / Shuhui HAO / Zhewen CUI et al. | DOAJ | 2025

    Freier Zugriff

    Vehicle following behavior decision-making method based on improved DDPG algorithm

    RAN CHUAN / XIE ZHIJUN / XIE JIAHAO et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Research on Decision-Making Method of Unmanned Tractor-Trailer Based on T-DDPG

    Wang, Jian / Liang, Huawei / Zhao, Pan et al. | British Library Conference Proceedings | 2022


    Intelligent Ship Decision System Based on DDPG Algorithm

    Cui, Zhewen / Guan, Wei / Luo, Wenzhe | IEEE | 2022


    Intelligent Decision-Making of MAV/UAV in Air Combat Based on DDPG Algorithm

    Li, Yue / Han, Wei / Zhong, Weiguo et al. | Springer Verlag | 2021