Advanced vehicle control is a fundamental building block in the development of autonomous driving systems. Reinforcement learning (RL) promises to achieve control performance superior to classical approaches while keeping computational demands low during deployment. However, standard RL approaches like soft-actor critic (SAC) require extensive amounts of training data to be collected and are thus impractical for real-world application. To address this issue, we apply recently developed data-efficient deep RL methods to vehicle trajectory control. Our investigation focuses on three methods, so far unexplored for vehicle control: randomized ensemble double Q-learning (REDQ), probabilistic ensembles with trajectory sampling and model predictive path integral optimizer (PETS-MPPI), and model-based policy optimization (MBPO). We find that in the case of trajectory control, the standard model-based RL formulation used in approaches like PETS-MPPI and MBPO is not suitable. We, therefore, propose a new formulation that splits dynamics prediction and vehicle localization. Our benchmark study on the CARLA simulator reveals that the three identified data-efficient deep RL approaches learn control strategies on a par with or better than SAC, yet reduce the required number of environment interactions by more than one order of magnitude.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Control


    Beteiligte:


    Erscheinungsdatum :

    24.09.2023


    Format / Umfang :

    2905965 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    A sharing deep reinforcement learning method for efficient vehicle platooning control

    Sikai Lu / Yingfeng Cai / Long Chen et al. | DOAJ | 2022

    Freier Zugriff


    A sharing deep reinforcement learning method for efficient vehicle platooning control

    Lu, Sikai / Cai, Yingfeng / Chen, Long et al. | Wiley | 2022

    Freier Zugriff

    DEEP REINFORCEMENT LEARNING BASED AGGRESSIVE FLIGHT TRAJECTORY TRACKER

    Shadeed, Omar / Hasanzade, Mehmet / Koyuncu, Emre | TIBKAT | 2021