Deep Deterministic Policy Gradient (DDPG) is one of the Deep Reinforcement Learning algorithms. Because of the well perform in continuous motion control, DDPG algorithm is applied in the field of self-driving. Regarding the problems of the instability of DDPG algorithm during training and low training efficiency and slow convergence rate. An improved DDPG algorithm based on segmented experience replay is presented. On the basis of the DDPG algorithm, the segmented experience replay select the training experience by the importance according to the training progress to improve the training efficiency and stability of the training model. The algorithm was tested in an open source 3D car racing simulator called TORCS. The simulation results demonstrate the training stability is significantly improved compared with the DDPG algorithm and the DQN algorithm, and the average return is about 46% higher than the DDPG algorithm and about 55% higher than the DQN algorithm.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Autopilot Strategy Based on Improved DDPG Algorithm


    Weitere Titelangaben:

    Sae Technical Papers


    Beteiligte:
    Zuo, Xiaochao (Autor:in) / Li, Xiaoning (Autor:in) / Tian, Zhewen (Autor:in)

    Kongress:

    New Energy & Intelligent Connected Vehicle Technology Conference ; 2019



    Erscheinungsdatum :

    04.11.2019




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    Research on missile avoidance decision training based on improved DDPG algorithm

    Fan, Xin-Lei / Zou, Jie / Wang, Peng-fei et al. | SPIE | 2021


    Vehicle following behavior decision-making method based on improved DDPG algorithm

    RAN CHUAN / XIE ZHIJUN / XIE JIAHAO et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Intelligent Ship Decision System Based on DDPG Algorithm

    Cui, Zhewen / Guan, Wei / Luo, Wenzhe | IEEE | 2022


    Autonomous decision-making method of unmanned ship based on improved DDPG algorithm

    Wei GUAN / Shuhui HAO / Zhewen CUI et al. | DOAJ | 2025

    Freier Zugriff

    Autonomous maneuver strategy of swarm air combat based on DDPG

    Wang, Luhe / Hu, Jinwen / Xu, Zhao et al. | Springer Verlag | 2021

    Freier Zugriff