Navigating through unsignalized intersections is one of the most challenging problems in urban environments for autonomous vehicles. Existing methods need to train specific policy models to deal with different tasks including going straight, turning left and turning right. In this paper we formulate intersection navigation as a multi-task reinforcement learning problem and propose a unified learning framework for all three navigation tasks at the intersections. We propose to represent multiple tasks with a unified four-dimensional vector, which elements mean a common sub-task and three specific target sub-tasks respectively. Meanwhile, we design a vectorized reward function combining with deep Q-networks (DQN) to learn to handle multiple intersection navigation tasks concurrently. We train the agent to navigate through intersections by adjusting the speed of the ego vehicle under given route. Experimental results in both simulation and realworld vehicle test demonstrate that the proposed multi-task DQN algorithm outperforms baselines for all three navigation tasks in several different intersection scenarios.
A Multi-Task Reinforcement Learning Approach for Navigating Unsignalized Intersections
2020 IEEE Intelligent Vehicles Symposium (IV) ; 1583-1588
2020-10-19
1571021 byte
Conference paper
Electronic Resource
English
A MULTI-TASK REINFORCEMENT LEARNING APPROACH FOR NAVIGATING UNSIGNALIZED INTERSECTIONS
British Library Conference Proceedings | 2020
|Springer Verlag | 2020
|Springer Verlag | 2013
|Unsignalized Intersections: Roundabouts
Springer Verlag | 2020
|