Traffic signal control is a critical component for ensuring smooth traffic flows in city corridors. To this end, deep reinforcement learning (RL) agents have recently been proposed. These learned black-box policies may out-perform manually tuned policies on average, but they remain imperfect and come at a cost of how easy they are to interpret and supervise. These challenges hinder their adoption in real-world systems. To address the first challenge, this paper devises naturally interpretable decision tree policies that imitate expert deep neural network policies. To address supervision, we define a new formalization called Mixed Autonomous Supervision (MAS), which concerns integrating an imperfect policy into an existing supervision system. We propose a two-part supervision model with online automated supervision and offline human supervision to implement MAS. We present a novel blind spot detection algorithm for decision tree policies to encourage the safe transfer of control to an automated fail-safe policy (online supervision) and an interactive dashboard DTLight for offline human supervision. We show the decision tree policies are just as performant as the RL policies, and the proposed supervision model has a significant benefit in scenarios derived from real traffic situations.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Mixed Autonomous Supervision in Traffic Signal Control


    Contributors:


    Publication date :

    2021-09-19


    Size :

    1709075 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Traffic signal lamp control method based on field of Internet supervision

    SUN PENG / LUAN LILI / ZHANG LEI | European Patent Office | 2021

    Free access

    Freight traffic supervision

    Railway, Caledonian | Engineering Index Backfile | 1922


    SUPERVISION AND CONTROL OF HETEROGENEOUS AUTONOMOUS OPERATIONS

    JANG JUNG SOON / VIAN JOHN LYLE / CLARK GREGORY JOHN et al. | European Patent Office | 2018

    Free access

    Smoothing Nonlinear Mixed Traffic with Autonomous Vehicles: Control Design

    Wang, Shian / Shang, Mingfeng / Levin, Michael W. et al. | IEEE | 2022