Effective management of multi-intersection traffic signal control (MTSC) is vital for intelligent transportation systems. Multi-agent reinforcement learning (MARL) has shown promise in achieving MTSC. However, existing MARL-based MTSC algorithms have primarily focused on capturing the spatial relationship between multi-intersection traffic signals but have overlooking the importance of the temporally stable traffic pattern. This pattern refers to the fixed positions and relatively stable traffic flow between intersections over short periods in real-world MTSC scenarios, which indicates that the learned spatial relationships between traffic signals should co-evolve over time. To this end, we propose a novel algorithm called Coevolutionary Multi-Agent Reinforcement Learning (CoevoMARL). CoevoMARL employs a graph neural network to capture the complex spatial interaction network among traffic signals. Furthermore, we propose a relationship-driven progressive LSTM (RDP-LSTM) that dynamically evolves the learned spatial interaction network over time by leveraging insights from the temporally stable traffic pattern. To accelerate convergence, we also propose the mutual information reward optimization (MIRO) technique, which strengthens the correlation between policy learning and high-performance samples by using a mutual information-based intrinsic reward. Experimental results on both synthetic and realistic datasets demonstrate the superiority of CoevoMARL over existing MTSC algorithms, providing valuable insights into incorporating the temporally stable traffic pattern.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Learning Multi-Intersection Traffic Signal Control via Coevolutionary Multi-Agent Reinforcement Learning


    Beteiligte:
    Chen, Wubing (Autor:in) / Yang, Shangdong (Autor:in) / Li, Wenbin (Autor:in) / Hu, Yujing (Autor:in) / Liu, Xiao (Autor:in) / Gao, Yang (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.11.2024


    Format / Umfang :

    3176596 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Multi-agent reinforcement learning traffic signal cooperative control method considering intersection heterogeneity

    BIE YIMING / JI YUTING / JI JINHUA et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Multi-intersection traffic signal lamp fair control method based on multi-agent reinforcement learning

    DU XINQI / CHEN HECHANG / CHANG YI et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Traffic signal control method based on multi-agent reinforcement learning and intersection importance

    ZHANG CHENGWEI / LIU WANTING / WANG QICHAO et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    Multi-intersection traffic signal control method based on deep reinforcement learning

    DENG HENG / WANG YULONG / GAO YANG et al. | Europäisches Patentamt | 2024

    Freier Zugriff