Reinforcement learning (RL) methods have been used in traffic signal control for decades. Traditional RL controller with model-free design treat traffic states as a Markov Process (MP) to approximate future benefit of control strategy and improve its policy with discretized action space. In such treatment, the statistical connection between traffic state and RL produced action might mismatch with theoretical understanding. The mismatching can lead to a invalid control when traffic under control differing from statistical assumption. To enhance inference processes of RL controller with traffic engineering knowledge, a knowledge-combined RL controller, QueueLearner, is proposed for the isolated intersection control problem. The estimated queue is first introduced to teach queuing evolution with realistic detection to a Deep Q-Network (DQN) controller. Furthermore, a changeable phase duration is employed to address the DQN limitation of discrete action. The proposed QueueLearner outperforms traffic engineering and RL methods in a diverse simulation experiment with the same data conditions.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    QueueLearner: A Knowledge-Combined Reinforcement Learning to Understand Queuing Evolution in Isolated Traffic Signal Control


    Beteiligte:
    Han, Tianyang (Autor:in) / Oguchi, Takashi (Autor:in) / Lyu, Suxing (Autor:in)


    Erscheinungsdatum :

    08.10.2022


    Format / Umfang :

    1015734 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Reinforcement learning-based traffic signal control

    Sheng, Liu Tian / Azman, Afizan Bin / Khan, Navid Ali et al. | IEEE | 2024


    Queuing Models for Analysis of Traffic Adaptive Signal Control

    Mirchandani, P. B. / Zou, N. | British Library Conference Proceedings | 2007


    Queuing Models for Analysis of Traffic Adaptive Signal Control

    Mirchandani, P.B. / Ning Zou, | IEEE | 2007


    Queuing models for analysis of traffic adaptive signal control

    Mirchandani, P.B. / Zou, Ning | Tema Archiv | 2007