We propose, for the first time, a reinforcement learning (RL) algorithm with function approximation for traffic signal control. Our algorithm incorporates state-action features and is easily implementable in high-dimensional settings. Prior work, e.g., the work of Abdulhai , on the application of RL to traffic signal control requires full-state representations and cannot be implemented, even in moderate-sized road networks, because the computational complexity exponentially grows in the numbers of lanes and junctions. We tackle this problem of the curse of dimensionality by effectively using feature-based state representations that use a broad characterization of the level of congestion as low, medium, or high. One advantage of our algorithm is that, unlike prior work based on RL, it does not require precise information on queue lengths and elapsed times at each lane but instead works with the aforementioned described features. The number of features that our algorithm requires is linear to the number of signaled lanes, thereby leading to several orders of magnitude reduction in the computational complexity. We perform implementations of our algorithm on various settings and show performance comparisons with other algorithms in the literature, including the works of Abdulhai and Cools , as well as the fixed-timing and the longest queue algorithms. For comparison, we also develop an RL algorithm that uses full-state representation and incorporates prioritization of traffic, unlike the work of Abdulhai We observe that our algorithm outperforms all the other algorithms on all the road network settings that we consider.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement Learning With Function Approximation for Traffic Signal Control


    Beteiligte:


    Erscheinungsdatum :

    01.06.2011


    Format / Umfang :

    413709 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    A Reinforcement Learning Approach with Fourier Basis Linear Function Approximation for Traffic Signal Control

    Ziemke, Theresa / Alegre, Lucas N. / Bazzan, Ana L. C. | TIBKAT | 2020

    Freier Zugriff

    Reinforcement learning-based traffic signal control

    Sheng, Liu Tian / Azman, Afizan Bin / Khan, Navid Ali et al. | IEEE | 2024


    Reinforcement Learning with Explainability for Traffic Signal Control

    Rizzo, Stefano Giovanni / Vantini, Giovanna / Chawla, Sanjay | IEEE | 2019


    Deep Reinforcement Learning-based Traffic Signal Control

    Ruan, Junyun / Tang, Jinzhuo / Gao, Ge et al. | IEEE | 2023