Deep reinforcement learning has achieved great progress recently in domains such as learning to play Atari games from raw pixel input. The model-free characteristics of reinforcement learning free us from hand-encoding complex policies. However, for real world tasks such as autonomous driving, there are some complex sequential decision making processes that contain distinct behaviors. Due to the delayed rewards and the averaged gradient, it is pretty difficult for a flat deep reinforcement learning algorithm to learn a good policy. In this paper, we design a hierarchical neural network policy and propose a hierarchical policy gradient method to train the network with the semi markov decision process (SMDP) temporal abstraction formulation. We apply this method to a traffic light passing scenario in autonomous driving, where the vehicle has two distinct behaviors (e.g., pass and stop) and its primitive actions (e.g., acceleration) should follow the corresponding behavior. We show via simulation that our method is able to select correct decision and acts appropriately when the traffic light turns yellow. On the contrary, the flat reinforcement learning algorithm is not able to achieve a good performance and exhibits a large variance. Furthermore, the trained neural network modules are reusable in the future to cover more scenarios.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Deep Hierarchical Reinforcement Learning for Autonomous Driving with Distinct Behaviors


    Beteiligte:
    Chen, Jianyu (Autor:in) / Wang, Zining (Autor:in) / Tomizuka, Masayoshi (Autor:in)


    Erscheinungsdatum :

    01.06.2018


    Format / Umfang :

    4834644 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    DEEP HIERARCHICAL REINFORCEMENT LEARNING FOR AUTONOMOUS DRIVING WITH DISTINCT BEHAVIORS

    Chen, Jianyu / Wang, Zining / Tomizuka, Masayoshi | British Library Conference Proceedings | 2018


    Autonomous Driving with Deep Reinforcement Learning

    Zhu, Yuhua / Technische Universität Dresden | SLUB | 2023



    Deep Reinforcement Learning with Intervention Module for Autonomous Driving

    Chi, Huicong / Wang, Ping / Wang, Chao et al. | IEEE | 2022


    Deep Reinforcement Learning for Autonomous Driving: A Survey

    Kiran, B Ravi / Sobh, Ibrahim / Talpaert, Victor et al. | IEEE | 2022