Smart City Gnosys

Smart city article details

Title Multi-Scale Spatial-Temporal Aware Transformer For Traffic Prediction
ID_Doc 38390
Authors Tian R.; Wang C.; Hu J.; Ma Z.
Year 2023
Published Information Sciences, 648
DOI http://dx.doi.org/10.1016/j.ins.2023.119557
Abstract Traffic prediction is an important part of smart city management. Accurate traffic prediction can be deployed in urban applications such as congestion alerting and route planning, thus providing sustainable services to the public or relevant departments. Although some improvements have been made in existing traffic prediction methods, there are challenges due to the following: (1) Time series has multi-scale nature, that is, from different scale time ranges, traffic flow changes show different trends; (2) Spatial heterogeneity, meaning that traffic conditions in similar functional areas are usually similar. This task remains difficult. To address the above challenges, we propose a new spatial-temporal prediction method, namely Multi-Scale Spatial-Temporal Aware Transformer (MSSTAT), which is a Transformer architecture with multi-scale characteristics. Specifically, compared to the input of encoder, the input of different decoder layers has different scale information, MSSTAT synchronizes model the connection between time steps and scale information by a kind of Parallel Cross Multi-Head Attention, which gives each time step several times the perceived field while also being able to weaken the impact brought by anomaly point. In addition, to add connections between regions with similar functions, we map the traffic data of each node as a probability distribution and then measure the similarity between the nodes by the Wasserstein Distance, which leads to our proposed spatial-temporal aware adjacency matrix. Experimental results on four traffic flow datasets show that MSSTAT outperforms the state-of-the-art baseline. © 2023 Elsevier Inc.
Author Keywords Multi-scale; Spatial heterogeneity; Traffic prediction; Transformer


Similar Articles


Id Similarity Authors Title Published
38040 View0.944Li W.; Chen J.; Zhang Y.; Sun R.; Xia S.; Pan Z.; Luo J.Msgformer: Revolutionizing Traffic Flow Prediction With Multiscale And Gated Transformer ArchitectureIEEE Internet of Things Journal, 12, 2 (2025)
36944 View0.914Tian R.; Wang C.; Hu J.; Ma Z.Mfstgn: A Multi-Scale Spatial-Temporal Fusion Graph Network For Traffic PredictionApplied Intelligence, 53, 19 (2023)
4883 View0.909Cao S.; Wu L.; Wu J.; Wu D.; Li Q.A Spatio-Temporal Sequence-To-Sequence Network For Traffic Flow PredictionInformation Sciences, 610 (2022)
36400 View0.905Wang B.; Cai C.; Zhang X.; Zhao C.; Zhang C.; Zhang Y.Mapstsf: Efficient Traffic Prediction Via Hybrid Mamba 2-Transformer Spatiotemporal Modeling And Cross Adaptive Periodic Sparse ForecastingJournal of Supercomputing, 81, 7 (2025)
20800 View0.903Diao Z.; Wang X.; Zhang D.; Xie G.; Chen J.; Pei C.; Meng X.; Xie K.; Zhang G.Dmstg: Dynamic Multiview Spatio-Temporal Networks For Traffic ForecastingIEEE Transactions on Mobile Computing, 23, 6 (2024)
37214 View0.901Yu W.; Wu S.; Huang M.Mmgfra: A Multiscale Multigraph Learning Framework For Traffic Prediction In Smart CitiesEarth Science Informatics, 16, 3 (2023)
38047 View0.901Yang S.; Wu Q.; Wang Y.; Zhou Z.Mstdfgrn: A Multi-View Spatio-Temporal Dynamic Fusion Graph Recurrent Network For Traffic Flow PredictionComputers and Electrical Engineering, 123 (2025)
58803 View0.901Yan F.; Chen Q.Transformer-Based Spatial-Temporal Graph Attention Network For Traffic Flow PredictionProceedings - 2023 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery, CyberC 2023 (2023)
21408 View0.901Zhang H.; Xie Q.; Shou Z.; Gao Y.Dynamic Spatial-Temporal Memory Augmentation Network For Traffic PredictionSensors, 24, 20 (2024)
23509 View0.899Ali A.; Ullah I.; Singh S.K.; Sharafian A.; Jiang W.; I. Sherazi H.; Bai X.Energy-Efficient Resource Allocation For Urban Traffic Flow Prediction In Edge-Cloud ComputingInternational Journal of Intelligent Systems, 2025, 1 (2025)