Smart City Gnosys

Smart city article details

Title	Long-Term Sequence Dependency Capture For Spatiotemporal Graph Modeling
ID_Doc	35587
Authors	Huang L.; Huang J.; Chen P.; Li H.; Cui J.
Year	2023
Published	Knowledge-Based Systems, 278
DOI	http://dx.doi.org/10.1016/j.knosys.2023.110818
Abstract	Long term dependency capture is essentially important for time series prediction and spatial–temporal forecasting. In recent years, many deep learning-based forecasting methods have been proposed, leading to rapid development in this area. We systematically reviewed long-term dependency capture methods, including temporal dependency in sequence (named intra-sequence temporal dependency), temporal dependency out of sequence (named inter-sequence temporal dependency, in this scenario the long-term dependencies are split by many subsequences). Because the batch technique is widely adopted in machine learning and deep learning, the range of temporal capturing ability for many proposed methods is intra-sequence temporal dependency, which limits the capacity of long-term dependency capture. Aiming at the above problems, we designed three type memory mechanisms (i.e., a temporal encoding memory mechanism, a cross-sequence memory mechanism and a query-key based memory mechanism) to solve those long term dependency problems. Moreover, based on the cross-sequence memory mechanism and query-key architecture, an Attention-based Long-Term Dependency Capture model (ALTDC) is proposed for long-term dependency modeling and further solves the temporal dependency coherence problem. ALTDC includes temporal Transformer and spatial Transformer. The temporal Transformer adopts multi-head attention mechanism in temporal dimension and takes into consideration the relative position encoding. The spatial Transformer leverages attention mechanism in spatial dimension, and utilizes learnable position encoding and graph convolution to capture spatial relationships. Experiments demonstrate that the proposed model outperforms the state-of-art baselines on real world time-series datasets and spatial–temporal datasets. © 2023 Elsevier B.V.
Author Keywords	Long-term dependency; Smart city; Spatial temporal forecasting

Similar Articles

Id	Similarity	Authors	Title	Published
19926	0.897	Yin X.; Wu L.; Zhang Y.; Han Y.; Zhai K.	Diffusion Convolution Graph Attention Network For Spatial-Temporal Prediction	Lecture Notes in Electrical Engineering, 996 LNEE (2023)
35807	0.893	Huang L.; Huang J.; Li H.; Cui J.	Lstgcn: Inductive Spatial Temporal Imputation Using Long Short-Term Dependencies	ACM Transactions on Knowledge Discovery from Data, 18, 9 (2024)
20803	0.877	Wang S.; Chen Y.; Xu H.; Hu J.; Zeng P.; Hu Z.	Dngnn: Efficient Deep Noisy Graph Neural Network For Spatio-Temporal Series Forecasting	2025 2nd International Conference on Algorithms, Software Engineering and Network Security, ASENS 2025 (2025)
59603	0.872	Li Y.; Lin Y.; Gao Y.; Khan L.	Unified Spatio-Temporal Graph Neural Networks: Data-Driven Modeling For Social Science	Proceedings of the International Joint Conference on Neural Networks, 2022-July (2022)
52507	0.864	Liu S.; Zhu J.; Lei W.; Zhang P.	Spatial-Temporal Attention Graph Wavenet For Traffic Forecasting	2023 5th International Conference on Data-Driven Optimization of Complex Systems, DOCS 2023 (2023)
35590	0.855	Remmouche B.; Boukraa D.; Zakharova A.; Bouwmans T.; Taffar M.	Long-Term Spatio-Temporal Graph Attention Network For Traffic Forecasting	Expert Systems with Applications, 288 (2025)
46173	0.853	Ma Q.; Zhang Z.; Zhao X.; Li H.; Zhao H.; Wang Y.; Liu Z.; Wang W.	Rethinking Sensors Modeling: Hierarchical Information Enhanced Traffic Forecasting	International Conference on Information and Knowledge Management, Proceedings (2023)
17754	0.853	Hu J.; Liang Y.; Fan Z.; Liu L.; Yin Y.; Zimmermann R.	Decoupling Long- And Short-Term Patterns In Spatiotemporal Inference	IEEE Transactions on Neural Networks and Learning Systems, 35, 11 (2024)
38047	0.853	Yang S.; Wu Q.; Wang Y.; Zhou Z.	Mstdfgrn: A Multi-View Spatio-Temporal Dynamic Fusion Graph Recurrent Network For Traffic Flow Prediction	Computers and Electrical Engineering, 123 (2025)
37180	0.853	Liang Y.; Ouyang K.; Wang Y.; Pan Z.; Yin Y.; Chen H.; Zhang J.; Zheng Y.; Rosenblum D.S.; Zimmermann R.	Mixed-Order Relation-Aware Recurrent Neural Networks For Spatio-Temporal Forecasting	IEEE Transactions on Knowledge and Data Engineering, 35, 9 (2023)