Deep reinforcement learning has achieved great progress recently in domains such as learning to play Atari games from raw pixel input. The model-free characteristics of reinforcement learning free us from hand-encoding complex policies. However, for real world tasks such as autonomous driving, there are some complex sequential decision making processes that contain distinct behaviors. Due to the delayed rewards and the averaged gradient, it is pretty difficult for a flat deep reinforcement learning algorithm to learn a good policy. In this paper, we design a hierarchical neural network policy and propose a hierarchical policy gradient method to train the network with the semi markov decision process (SMDP) temporal abstraction formulation. We apply this method to a traffic light passing scenario in autonomous driving, where the vehicle has two distinct behaviors (e.g., pass and stop) and its primitive actions (e.g., acceleration) should follow the corresponding behavior. We show via simulation that our method is able to select correct decision and acts appropriately when the traffic light turns yellow. On the contrary, the flat reinforcement learning algorithm is not able to achieve a good performance and exhibits a large variance. Furthermore, the trained neural network modules are reusable in the future to cover more scenarios.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Hierarchical Reinforcement Learning for Autonomous Driving with Distinct Behaviors


    Contributors:


    Publication date :

    2018-06-01


    Size :

    4834644 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    DEEP HIERARCHICAL REINFORCEMENT LEARNING FOR AUTONOMOUS DRIVING WITH DISTINCT BEHAVIORS

    Chen, Jianyu / Wang, Zining / Tomizuka, Masayoshi | British Library Conference Proceedings | 2018


    Autonomous Driving with Deep Reinforcement Learning

    Zhu, Yuhua / Technische Universität Dresden | SLUB | 2023



    Deep Reinforcement Learning for Autonomous Driving: A Survey

    Kiran, B Ravi / Sobh, Ibrahim / Talpaert, Victor et al. | IEEE | 2022


    Deep Reinforcement Learning with Intervention Module for Autonomous Driving

    Chi, Huicong / Wang, Ping / Wang, Chao et al. | IEEE | 2022