Deep reinforcement learning (deep RL) has achieved superior performance in complex sequential tasks by learning directly from image input. A deep neural network is used as a function approximator and requires no specific state information. However, one drawback of using only images as input is that this approach requires a prohibitively large amount of training time and data for the model to learn the state feature representation and approach reasonable performance. This is not feasible in real-world applications, especially when the data are expansive and training phase could introduce disasters that affect human safety. In this work, we use a human demonstration approach to speed up training for learning features and use the resulting pre-trained model to replace the neural network in the deep RL Deep Q-Network (DQN), followed by human interaction to further refine the model. We empirically evaluate our approach by using only a human demonstration model and modified DQN with human demonstration model included in the Microsoft AirSim car simulator. Our results show that (1) pre-training with human demonstration in a supervised learning approach is better and much faster at discovering features than DQN alone; (2) initializing the DQN with a pre-trained model provides a significant improvement in training time and performance even with limited human demonstration; and (3) providing the ability for humans to supply suggestions during DQN training can speed up the network's convergence on an optimal policy, as well as allow it to learn more complex policies that are harder to discover by random exploration.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Parallelized Interactive Machine Learning on Autonomous Vehicles


    Contributors:
    Chen, Xi (author) / Hickey, Caylin (author)


    Publication date :

    2018-07-01


    Size :

    2903044 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Parallelized and Randomized Adversarial Imitation Learning for Safety-Critical Self-Driving Vehicles

    Yun, Won Joon / Shin, MyungJae / Jung, Soyi et al. | ArXiv | 2021

    Free access

    UNIFIED BOUNDARY MACHINE LEARNING MODEL FOR AUTONOMOUS VEHICLES

    CHAABANE MOHAMED / KAPLAN BENJAMIN / LITVIN YEVGENI et al. | European Patent Office | 2025

    Free access

    UNIFIED BOUNDARY MACHINE LEARNING MODEL FOR AUTONOMOUS VEHICLES

    CHAABANE MOHAMED / KAPLAN BENJAMIN / LITVIN YEVGENI et al. | European Patent Office | 2025

    Free access

    UNIFIED BOUNDARY MACHINE LEARNING MODEL FOR AUTONOMOUS VEHICLES

    CHAABANE MOHAMED / KAPLAN BENJAMIN / LITVIN YEVGENI et al. | European Patent Office | 2025

    Free access

    Interactive Safety Analysis Framework of Autonomous Intelligent Vehicles

    Cui You Xiang / Sun Lei / Sui Li Hui et al. | DOAJ | 2016

    Free access