Smart City Gnosys

Smart city article details

Title Towards Effective Fusion And Forecasting Of Multimodal Spatio-Temporal Data For Smart Mobility
ID_Doc 58110
Authors Wang C.
Year 2024
Published International Conference on Information and Knowledge Management, Proceedings
DOI http://dx.doi.org/10.1145/3627673.3680261
Abstract With the rapid development of location based services, multimodal spatio-temporal (ST) data including trajectories, transportation modes, traffic flow and social check-ins are being collected for deep learning based methods. These deep learning based methods learn ST correlations to support the downstream tasks in the fields such as smart mobility, smart city and other intelligent transportation systems. Despite their effectiveness, ST data fusion and forecasting methods face practical challenges in real-world scenarios. First, forecasting performance for ST data-insufficient area is inferior, making it necessary to transfer meta knowledge from heterogeneous area to enhance the sparse representations. Second, it is nontrivial to accurately forecast in multi-transportation-mode scenarios due to the fine-grained ST features of similar transportation modes, making it necessary to distinguish and measure the ST correlations to alleviate the influence caused by entangled ST features. At last, partial data modalities (e.g., transportation mode) are lost due to privacy or technical issues in certain scenarios, making it necessary to effectively fuse the multimodal sparse ST features and enrich the ST representations. To tackle these challenges, our research work aim to develop effective fusion and forecasting methods for multimodal ST data in smart mobility scenario. In this paper, we will introduce our recent works that investigates the challenges in terms of various real-world applications and establish the open challenges in this field for future work. © 2024 ACM.
Author Keywords intelligent transportation systems; spatial-temporal data mining; trajectory recovery; transportation mode detection; travel time estimation


Similar Articles


Id Similarity Authors Title Published
38582 View0.877Fan S.; Li J.; Lv Z.; Zhao A.Multimodal Traffic Travel Time PredictionProceedings of the International Joint Conference on Neural Networks, 2021-July (2021)
6423 View0.869Godhbani S.; Elkosantini S.; Suh W.; Lee S.M.Adl Based Framework For Multimodal Data Fusion In Traffic Jam PredictionInternational Conference on Software, Knowledge Information, Industrial Management and Applications, SKIMA, 2022-December (2022)
23645 View0.866Han X.; Li S.; Yu H.; Deng T.; Xu H.Enhanced Multimodal Prediction Via Feature Fusion And Momentum BufferingExpert Systems with Applications, 290 (2025)
53039 View0.863Hong Y.; Chen L.; Wang L.; Xie X.; Luo G.; Wang C.; Chen L.Stkopt: Automated Spatio-Temporal Knowledge Optimization For Traffic PredictionWWW 2025 - Proceedings of the ACM Web Conference (2025)
38415 View0.862Zhao W.; Zhang S.; Zhou B.; Wang B.Multi-Spatio-Temporal Fusion Graph Recurrent Network For Traffic ForecastingEngineering Applications of Artificial Intelligence, 124 (2023)
53044 View0.861Meng X.; Xie W.; Cui J.Stmgfn: Spatio-Temporal Multi-Graph Fusion Network For Traffic Flow PredictionLecture Notes in Computer Science, 15291 LNCS (2025)
29828 View0.859Dai R.; Xu S.; Gu Q.; Ji C.; Liu K.Hybrid Spatio-Temporal Graph Convolutional Network: Improving Traffic Prediction With Navigation DataProceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2020)
52834 View0.859Dai F.; Huang P.; Mo Q.; Xu X.; Bilal M.; Song H.St-Innet: Deep Spatio-Temporal Inception Networks For Traffic Flow Prediction In Smart CitiesIEEE Transactions on Intelligent Transportation Systems, 23, 10 (2022)
29827 View0.858Chen B.; Hu K.; Li Y.; Miao L.Hybrid Spatio-Temporal Graph Convolution Network For Short-Term Traffic ForecastingIEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC, 2022-October (2022)
10797 View0.855Zaman M.; Saha S.; Abdelwahed S.Assessing The Suitability Of Different Machine Learning Approaches For Smart Traffic Mobility2023 IEEE Transportation Electrification Conference and Expo, ITEC 2023 (2023)