Smart City Gnosys
Smart city article details
| Title | Urbangpt: Spatio-Temporal Large Language Models |
|---|---|
| ID_Doc | 60280 |
| Authors | Li Z.; Xia L.; Tang J.; Xu Y.; Shi L.; Xia L.; Yin D.; Huang C. |
| Year | 2024 |
| Published | Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining |
| DOI | http://dx.doi.org/10.1145/3637528.3671578 |
| Abstract | Spatio-temporal prediction aims to forecast and gain insights into the ever-changing dynamics of urban environments across both time and space. Its purpose is to anticipate future patterns, trends, and events in diverse facets of urban life, including transportation, population movement, and crime rates. Although numerous efforts have been dedicated to developing neural network techniques for accurate predictions on spatio-temporal data, it is important to note that many of these methods heavily depend on having sufficient labeled data to generate precise spatio-temporal representations. Unfortunately, the issue of data scarcity is pervasive in practical urban sensing scenarios. In certain cases, it becomes challenging to collect any labeled data from downstream scenarios, intensifying the problem further. Consequently, it becomes necessary to build a spatio-temporal model that can exhibit strong generalization capabilities across diverse spatio-temporal learning scenarios. Taking inspiration from the remarkable achievements of large language models (LLMs), our objective is to create a spatio-temporal LLM that can exhibit exceptional generalization capabilities across a wide range of downstream urban tasks. To achieve this objective, we present the UrbanGPT, which seamlessly integrates a spatio-temporal dependency encoder with the instruction-tuning paradigm. This integration enables LLMs to comprehend the complex inter-dependencies across time and space, facilitating more comprehensive and accurate predictions under data scarcity. To validate the effectiveness of our approach, we conduct extensive experiments on various public datasets, covering different spatio-temporal prediction tasks. The results consistently demonstrate that our UrbanGPT, with its carefully designed architecture, consistently outperforms state-of-the-art baselines. These findings highlight the potential of building large language models for spatio-temporal learning, particularly in zero-shot scenarios where labeled data is scarce. The code and data are available at: https://github.com/HKUDS/UrbanGPT. © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM. |
| Author Keywords | generative ai; large language models; smart cities; spatial-temporal data mining; urban computing |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
43449  | 0.898 | Zhang Z.; Zhao X.; Liu Q.; Zhang C.; Ma Q.; Wang W.; Zhao H.; Wang Y.; Liu Z. | Promptst: Prompt-Enhanced Spatio-Temporal Multi-Attribute Prediction | International Conference on Information and Knowledge Management, Proceedings (2023) |
| 44815 | 0.897 | Chen J.; Liu T.; Li R. | Region Profile Enhanced Urban Spatio-Temporal Prediction Via Adaptive Meta-Learning | International Conference on Information and Knowledge Management, Proceedings (2023) |
| 52567 | 0.889 | Jin G.; Liang Y.; Fang Y.; Shao Z.; Huang J.; Zhang J.; Zheng Y. | Spatio-Temporal Graph Neural Networks For Predictive Learning In Urban Computing: A Survey | IEEE Transactions on Knowledge and Data Engineering, 36, 10 (2024) |
| 46173 | 0.889 | Ma Q.; Zhang Z.; Zhao X.; Li H.; Zhao H.; Wang Y.; Liu Z.; Wang W. | Rethinking Sensors Modeling: Hierarchical Information Enhanced Traffic Forecasting | International Conference on Information and Knowledge Management, Proceedings (2023) |
| 52833 | 0.888 | Zhao L.; Gao M.; Wang Z. | St-Gsp: Spatial-Temporal Global Semantic Representation Learning For Urban Flow Prediction | WSDM 2022 - Proceedings of the 15th ACM International Conference on Web Search and Data Mining (2022) |
| 13501 | 0.888 | Li S.; Li H.; Li X.; Xu Y.; Lin Z.; Jiang H. | Causal Intervention Is What Large Language Models Need For Spatio-Temporal Forecasting | IEEE Transactions on Cybernetics (2025) |
| 59603 | 0.885 | Li Y.; Lin Y.; Gao Y.; Khan L. | Unified Spatio-Temporal Graph Neural Networks: Data-Driven Modeling For Social Science | Proceedings of the International Joint Conference on Neural Networks, 2022-July (2022) |
| 15460 | 0.884 | Zhou Z.; Huang Q.; Wang B.; Hou J.; Yang K.; Liang Y.; Zheng Y.; Wang Y. | Coms2T: A Complementary Spatiotemporal Learning System For Data-Adaptive Model Evolution | IEEE Transactions on Pattern Analysis and Machine Intelligence (2025) |
| 26541 | 0.883 | Liang Y.; Ouyang K.; Sun J.; Wang Y.; Zhang J.; Zheng Y.; Rosenblum D.; Zimmermann R. | Fine-Grained Urban Flow Prediction | The Web Conference 2021 - Proceedings of the World Wide Web Conference, WWW 2021 (2021) |
| 17754 | 0.882 | Hu J.; Liang Y.; Fan Z.; Liu L.; Yin Y.; Zimmermann R. | Decoupling Long- And Short-Term Patterns In Spatiotemporal Inference | IEEE Transactions on Neural Networks and Learning Systems, 35, 11 (2024) |