Unlike popular modularized framework, end-to-end autonomous driving seeks to solve the perception, decision and control problems in an integrated way, which can be more adapting to new scenarios and easier to generalize at scale. However, existing end-to-end approaches are often lack of interpretability, and can only deal with simple driving tasks like lane keeping. In this article, we propose an interpretable deep reinforcement learning method for end-to-end autonomous driving, which is able to handle complex urban scenarios. A sequential latent environment model is introduced and learned jointly with the reinforcement learning process. With this latent model, a semantic birdeye mask can be generated, which is enforced to connect with certain intermediate properties in today’s modularized framework for the purpose of explaining the behaviors of learned policy. The latent space also significantly reduces the sample complexity of reinforcement learning. Comparison tests in a realistic driving simulator show that the performance of our method in urban scenarios with crowded surrounding vehicles dominates many baselines including DQN, DDPG, TD3 and SAC. Moreover, through masked outputs, the learned model is able to provide a better explanation of how the car reasons about the driving environment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Interpretable End-to-End Urban Autonomous Driving With Latent Deep Reinforcement Learning


    Contributors:


    Publication date :

    2022-06-01


    Size :

    2954432 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Interpretable Autonomous Driving Model Based on Cognitive Reinforcement Learning

    Li, Yijia / Qi, Hao / Zhu, Fenghua et al. | IEEE | 2024


    Autonomous Driving using Deep Reinforcement Learning in Urban Environment

    Hashim Shakil Ansari / Goutam R | BASE | 2019

    Free access

    Model-free Deep Reinforcement Learning for Urban Autonomous Driving

    Chen, Jianyu / Yuan, Bodi / Tomizuka, Masayoshi | IEEE | 2019


    Autonomous Driving with Deep Reinforcement Learning

    Zhu, Yuhua / Technische Universität Dresden | SLUB | 2023