Smart City Gnosys

Smart city article details

Title Causal Intervention Is What Large Language Models Need For Spatio-Temporal Forecasting
ID_Doc 13501
Authors Li S.; Li H.; Li X.; Xu Y.; Lin Z.; Jiang H.
Year 2025
Published IEEE Transactions on Cybernetics
DOI http://dx.doi.org/10.1109/TCYB.2025.3569333
Abstract Spatio-temporal forecasting plays a crucial role in the dynamic perception of smart cities, such as traffic flow prediction, renewable energy forecasting, and load prediction. Its objective is to understand the patterns of spatio-temporal changes under the interaction of various factors. Accurate spatio-temporal forecasting relies on sufficient high-quality data and powerful models. However, in reality, data is often sparse. In such cases, while adaptive graphs and large language models (LLMs) can maintain performance, they face issues of spatial spurious associations and hallucinations, respectively. These issues hinder the ability of the model to learn and infer cross spatio-temporal and cross-scale features effectively. To address this, we propose a novel model termed spatio-temporal causal intervention large language model (STCInterLLM). This model employs a newly designed causal intervention encoder to update spatial spurious correlations in the spatio-temporal adaptive graph. Subsequently, the novel chain-of-action prompting text is utilized to enforce the decomposition of the prediction process, thereby enhancing the causal representation of features while mitigating hallucinations in LLMs. Finally, a lightweight marker alignment module ensures the consistency between the encoder, prompting text, and LLM, enabling accurate forecasting of distinct scale spatio-temporal evolution patterns. Extensive experiments conducted on power distribution systems integrated with renewable energy sources and transportation systems encompassing diverse types of data, demonstrate that the proposed STCInterLLM consistently achieves state-of-the-art performance across significantly varied scenarios. © 2013 IEEE.
Author Keywords Causal inference; large language model (LLM); prompt instruction; smart cities; spatio-temporal


Similar Articles


Id Similarity Authors Title Published
60280 View0.888Li Z.; Xia L.; Tang J.; Xu Y.; Shi L.; Xia L.; Yin D.; Huang C.Urbangpt: Spatio-Temporal Large Language ModelsProceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2024)
46173 View0.878Ma Q.; Zhang Z.; Zhao X.; Li H.; Zhao H.; Wang Y.; Liu Z.; Wang W.Rethinking Sensors Modeling: Hierarchical Information Enhanced Traffic ForecastingInternational Conference on Information and Knowledge Management, Proceedings (2023)
52516 View0.874Dao M.-S.; Zetsu K.; Hoang D.-T.Spatial-Temporal Graph Transformer Network For Spatial-Temporal ForecastingProceedings - 2024 IEEE International Conference on Big Data, BigData 2024 (2024)
53039 View0.874Hong Y.; Chen L.; Wang L.; Xie X.; Luo G.; Wang C.; Chen L.Stkopt: Automated Spatio-Temporal Knowledge Optimization For Traffic PredictionWWW 2025 - Proceedings of the ACM Web Conference (2025)
26541 View0.872Liang Y.; Ouyang K.; Sun J.; Wang Y.; Zhang J.; Zheng Y.; Rosenblum D.; Zimmermann R.Fine-Grained Urban Flow PredictionThe Web Conference 2021 - Proceedings of the World Wide Web Conference, WWW 2021 (2021)
47493 View0.872Yang S.; Wu Q.Sdsinet: A Spatiotemporal Dual-Scale Interaction Network For Traffic PredictionApplied Soft Computing, 173 (2025)
4883 View0.871Cao S.; Wu L.; Wu J.; Wu D.; Li Q.A Spatio-Temporal Sequence-To-Sequence Network For Traffic Flow PredictionInformation Sciences, 610 (2022)
43638 View0.871Yang S.; Wu Q.; Li Z.; Wang K.Pstcgcn: Principal Spatio-Temporal Causal Graph Convolutional Network For Traffic Flow PredictionNeural Computing and Applications, 37, 20 (2025)
17754 View0.87Hu J.; Liang Y.; Fan Z.; Liu L.; Yin Y.; Zimmermann R.Decoupling Long- And Short-Term Patterns In Spatiotemporal InferenceIEEE Transactions on Neural Networks and Learning Systems, 35, 11 (2024)
52567 View0.87Jin G.; Liang Y.; Fang Y.; Shao Z.; Huang J.; Zhang J.; Zheng Y.Spatio-Temporal Graph Neural Networks For Predictive Learning In Urban Computing: A SurveyIEEE Transactions on Knowledge and Data Engineering, 36, 10 (2024)