Competent multi-lane cruising requires using lane changes and within-lane maneuvers to achieve good speed and maintain safety. This paper proposes a design for autonomous multi-lane cruising by combining a hierarchical reinforcement learning framework with a novel state-action space abstraction. While the proposed solution follows the classical hierarchy of behavior decision, motion planning and control, it introduces a key intermediate abstraction within the motion planner to discretize the state-action space according to high level behavioral decisions. We argue that this design allows principled modular extension of motion planning, in contrast to using either monolithic behavior cloning or a large set of handwritten rules. Moreover, we demonstrate that our state-action space abstraction allows transferring of the trained models without retraining from a simulated environment with virtually no dynamics to one with significantly more realistic dynamics. Together, these results suggest that our proposed hierarchical architecture is a promising way to allow reinforcement learning to be applied to complex multi-lane cruising in the real world.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-lane Cruising Using Hierarchical Planning and Reinforcement Learning




    Publication date :

    2019-10-01


    Size :

    1563238 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Swimming lane cruising lifesaving device

    WANG WEI / KOU CHENG / LI YANG et al. | European Patent Office | 2022

    Free access

    Cruising lane recognition in a tunnel

    SUZUKI SHUNSUKE | European Patent Office | 2017

    Free access

    Trajectory Planning for Connected and Automated Vehicles: Cruising, Lane Changing, and Platooning

    Zhao, Guangchen / Masoud, Neda / Zhu, Qi et al. | SAE Technical Papers | 2021


    Trajectory Planning for Connected and Automated Vehicles: Cruising, Lane Changing, and Platooning

    Liu, Xiangguo / Zhao, Guangchen / Masoud, Neda et al. | ArXiv | 2020

    Free access

    Lane recognition vehicle cruising device with GPS signals

    LI JUNJIAO / WU DI / LI DONGCHEN | European Patent Office | 2016

    Free access