Reinforcement learning (RL) methods have been used in traffic signal control for decades. Traditional RL controller with model-free design treat traffic states as a Markov Process (MP) to approximate future benefit of control strategy and improve its policy with discretized action space. In such treatment, the statistical connection between traffic state and RL produced action might mismatch with theoretical understanding. The mismatching can lead to a invalid control when traffic under control differing from statistical assumption. To enhance inference processes of RL controller with traffic engineering knowledge, a knowledge-combined RL controller, QueueLearner, is proposed for the isolated intersection control problem. The estimated queue is first introduced to teach queuing evolution with realistic detection to a Deep Q-Network (DQN) controller. Furthermore, a changeable phase duration is employed to address the DQN limitation of discrete action. The proposed QueueLearner outperforms traffic engineering and RL methods in a diverse simulation experiment with the same data conditions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    QueueLearner: A Knowledge-Combined Reinforcement Learning to Understand Queuing Evolution in Isolated Traffic Signal Control


    Contributors:


    Publication date :

    2022-10-08


    Size :

    1015734 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Reinforcement learning-based traffic signal control

    Sheng, Liu Tian / Azman, Afizan Bin / Khan, Navid Ali et al. | IEEE | 2024


    Queuing Models for Analysis of Traffic Adaptive Signal Control

    Mirchandani, P. B. / Zou, N. | British Library Conference Proceedings | 2007


    Queuing Models for Analysis of Traffic Adaptive Signal Control

    Mirchandani, P.B. / Ning Zou, | IEEE | 2007


    Queuing models for analysis of traffic adaptive signal control

    Mirchandani, P.B. / Zou, Ning | Tema Archive | 2007