Traffic prediction is a crucial task in intelligent transportation systems, which can help achieve effective management and optimization of traffic congestion. However, due to the complexity and uncertainty of traffic systems, accurate traffic prediction has always been a challenging problem. The specific challenge of this task is how to model traffic dynamics along the dimensions of temporal and spatial in a reasonable manner while respecting and utilizing the spatial and temporal heterogeneity of traffic data. To address the aforementioned challenges, this paper proposes a new Transformer-based approach for traffic prediction. Specifically, to accurately model complex spatial correlations, we design a spatial Transformer layer combined with clustering, which reduces computational complexity and mitigates the risk of over-fitting. To model dynamic nonlinear temporal correlations, we introduce dilated attention, which benefits from a global receptive field conducive to long-term predictions. To validate the effectiveness of our proposed model, we conduct experiments on four real-world traffic datasets. The experimental results demonstrate that our model outperforms state-of-the-art baselines. Furthermore, we conduct comparative experiments to demonstrate that both the spatial clustering and dilated attention modules contribute to the overall improvement of the model's performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Spatio-Temporal Transformer with Clustering and Dilated Attention for Traffic Prediction


    Contributors:
    Xu, Baowen (author) / Wang, Xuelei (author) / Liu, Chengbao (author) / Li, Shuo (author) / Li, Jingwei (author)


    Publication date :

    2023-09-24


    Size :

    790439 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Automated Dilated Spatio-Temporal Synchronous Graph Modeling for Traffic Prediction

    Jin, Guangyin / Li, Fuxian / Zhang, Jinlei et al. | IEEE | 2023


    Spatio-temporal graph attention networks for traffic prediction

    Ma, Chuang / Yan, Li / Xu, Guangxia | Taylor & Francis Verlag | 2024



    Spatio-Temporal Multi-Factor Network Based on Attention Mechanism for Traffic Prediction

    Li, Yutong / Sun, Zhonghua / Jia, Kebin et al. | IEEE | 2024


    Track Prediction Based on Spatio-Temporal Attention

    Wang, Peng / Zhang, Junyi / Zhang, Lu et al. | Springer Verlag | 2022