Smart City Gnosys

Smart city article details

Title Msgformer: Revolutionizing Traffic Flow Prediction With Multiscale And Gated Transformer Architecture
ID_Doc 38040
Authors Li W.; Chen J.; Zhang Y.; Sun R.; Xia S.; Pan Z.; Luo J.
Year 2025
Published IEEE Internet of Things Journal, 12, 2
DOI http://dx.doi.org/10.1109/JIOT.2024.3465559
Abstract Traffic flow prediction has emerged as a critical component in advancing smart cities. Nevertheless, precisely forecasting traffic flow remains a formidable challenge, attributable to the intricate and dynamic spatiotemporal interdependencies inherent within traffic data. Contemporary methodologies often overlook the different impacts exerted at each timestamp and treat temporal correlations, rendering them incapable of extracting temporal patterns at multiple scales. Furthermore, these approaches fail to account for the neighboring and functional relationships among nodes within the spatial module. In this work, we introduce an innovative Multiscale and Gated transFormer (MSGFormer) architecture, MSGFormer, to overcome the inherent limitations for accurate traffic flow estimation. We have introduced a multiscale sampling strategy wherein we sample from the original data at three scales: 1) recent; 2) daily; and 3) weekly. This approach enables the generation of corresponding subsequences that encapsulate temporal information across different granularities. Subsequently, each generated subsequence is projected into a latent space and systematically combined with positional, temporal, and spatial embeddings. The positional embedding comprises relative positional embedding and time stamp embedding corresponding to days and weeks, aiming at capturing the sequential and cyclical characteristics of the data. Furthermore, at the inception of the transformer encoder, a gated unit, composed of a neighboring mask and a functioning mask, is employed to capture both static and dynamic spatial correlations effectively. Comprehensive experiments have been conducted on four real-world traffic data sets. The experimental results robustly validate that our model attains significantly higher predictive accuracy in comparison to other baseline models. © 2014 IEEE.
Author Keywords Data mining; gated mechanism; spatiotemporal sequence; traffic flow prediction; transformer


Similar Articles


Id Similarity Authors Title Published
38390 View0.944Tian R.; Wang C.; Hu J.; Ma Z.Multi-Scale Spatial-Temporal Aware Transformer For Traffic PredictionInformation Sciences, 648 (2023)
4883 View0.919Cao S.; Wu L.; Wu J.; Wu D.; Li Q.A Spatio-Temporal Sequence-To-Sequence Network For Traffic Flow PredictionInformation Sciences, 610 (2022)
36400 View0.909Wang B.; Cai C.; Zhang X.; Zhao C.; Zhang C.; Zhang Y.Mapstsf: Efficient Traffic Prediction Via Hybrid Mamba 2-Transformer Spatiotemporal Modeling And Cross Adaptive Periodic Sparse ForecastingJournal of Supercomputing, 81, 7 (2025)
21408 View0.906Zhang H.; Xie Q.; Shou Z.; Gao Y.Dynamic Spatial-Temporal Memory Augmentation Network For Traffic PredictionSensors, 24, 20 (2024)
38047 View0.906Yang S.; Wu Q.; Wang Y.; Zhou Z.Mstdfgrn: A Multi-View Spatio-Temporal Dynamic Fusion Graph Recurrent Network For Traffic Flow PredictionComputers and Electrical Engineering, 123 (2025)
36944 View0.903Tian R.; Wang C.; Hu J.; Ma Z.Mfstgn: A Multi-Scale Spatial-Temporal Fusion Graph Network For Traffic PredictionApplied Intelligence, 53, 19 (2023)
37214 View0.901Yu W.; Wu S.; Huang M.Mmgfra: A Multiscale Multigraph Learning Framework For Traffic Prediction In Smart CitiesEarth Science Informatics, 16, 3 (2023)
23509 View0.898Ali A.; Ullah I.; Singh S.K.; Sharafian A.; Jiang W.; I. Sherazi H.; Bai X.Energy-Efficient Resource Allocation For Urban Traffic Flow Prediction In Edge-Cloud ComputingInternational Journal of Intelligent Systems, 2025, 1 (2025)
20800 View0.895Diao Z.; Wang X.; Zhang D.; Xie G.; Chen J.; Pei C.; Meng X.; Xie K.; Zhang G.Dmstg: Dynamic Multiview Spatio-Temporal Networks For Traffic ForecastingIEEE Transactions on Mobile Computing, 23, 6 (2024)
52834 View0.894Dai F.; Huang P.; Mo Q.; Xu X.; Bilal M.; Song H.St-Innet: Deep Spatio-Temporal Inception Networks For Traffic Flow Prediction In Smart CitiesIEEE Transactions on Intelligent Transportation Systems, 23, 10 (2022)