Smart City Gnosys
Smart city article details
| Title | Fusion Of Aerial, Mms And Backpack Images And Point Clouds For Optimized 3D Mapping In Urban Areas |
|---|---|
| ID_Doc | 27458 |
| Authors | Li Z.; Wu B.; Li Y.; Chen Z. |
| Year | 2023 |
| Published | ISPRS Journal of Photogrammetry and Remote Sensing, 202 |
| DOI | http://dx.doi.org/10.1016/j.isprsjprs.2023.07.010 |
| Abstract | Photorealistic 3D models are important data sources for digital twin cities and smart city applications. These models are usually generated from data collected by aerial or ground-based platforms (e.g., mobile mapping systems (MMSs) and backpack systems) separately. Aerial and ground-based platforms capture data from overhead and ground surfaces, respectively, offering complementary information for better 3D mapping in urban areas. Particularly, backpack mapping systems have gained popularity for 3D mapping in urban areas in recent years, as they offer more flexibility to reach regions (e.g., narrow alleys and pedestrian routes) inaccessible by vehicle-based MMSs. However, integration of aerial and ground data for 3D mapping suffers from difficulties such as tie-point matching among images from different platforms with large differences in perspective, coverage, and scale. Optimal fusion of the results from different platforms is also challenging. Therefore, this paper presents a novel method for the fusion of aerial, MMS, and backpack images and point clouds for optimized 3D mapping in urban areas. A geometric-aware model for feature matching is developed based on the SuperGlue algorithm to obtain sufficient tie-points between aerial and ground images, which facilitates the integrated bundle adjustment of images to reduce their geometric inconsistencies and the subsequent dense image matching to generate 3D point clouds from different image sources. After that, a graph-based method considering both geometric and texture traits is developed for the optimal fusion of point clouds from different sources to generate 3D mesh models of better quality. Experiments conducted on a challenging dataset in Hong Kong demonstrated that the geometric-aware model could obtain sufficient accurately matched tie-points among the aerial, MMS, and backpack images, which enabled the integrated bundle adjustment of the three image datasets to generate properly aligned point clouds. Compared with the results obtained from state-of-the-art commercial software, the 3D mesh models generated from the proposed point cloud fusion method exhibited better quality in terms of completeness, consistency, and level of detail. © 2023 The Author(s) |
| Author Keywords | 3D mapping; Aerial oblique imagery; Backpack; Mobile mapping system (MMS) |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
32110  | 0.94 | Li Z.; Wu B.; Li Y. | Integration Of Aerial, Mms, And Backpack Images For Seamless 3D Mapping In Urban Areas | International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 43, B2 (2020) |
| 40178 | 0.878 | Blaser S.; Meyer J.; Nebiker S. | Open Urban And Forest Datasets From A High-Performance Mobile Mapping Backpack - A Contribution For Advancing The Creation Of Digital City Twins | International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 43, B1-2021 (2021) |
| 25473 | 0.874 | Ariff S.A.M.; Azri S.; Ujang U.; Nasir A.A.M.; Fuad N.A.; Karim H. | Exploratory Study Of 3D Point Cloud Triangulation For Smart City Modelling And Visualization | International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 44, 4/W3 (2020) |
| 52378 | 0.871 | Zhang Y.; Zou S.; Liu X. | Sparse Point Cloud Guided Digital Surface Model Generation For Aerial Images; [稀 疏 点 云 引 导 的 航 空 影 像 数 字 表 面 模 型生 成 方 法] | Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 48, 11 (2023) |
| 19681 | 0.863 | Nokkaew P.; Leksansern A.; Jindasee P.; Kamonsantiroj S.; Srisomboon K.; Sutthisangiam N. | Development Of Digital Twin Road Infrastructure For Smart City Modeling | Lecture Notes on Data Engineering and Communications Technologies, 259 (2025) |
| 36758 | 0.862 | Xie Q.; Jiang C. | Meta-Universe Enabled Digital Modeling For Urban 3D Reality Visualization | Applied Mathematics and Nonlinear Sciences, 9, 1 (2024) |
| 29696 | 0.861 | Bacher U. | Hybrid Aerial Sensor Data As Basis For A Geospatial Digital Twin | International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 43, B4-2022 (2022) |
| 46503 | 0.861 | Sun C.; Che G.; Dong X.; Zou R.; Feng L.; Ding X. | Review On Algorithm For Fusion Of Oblique Data And Radar Point Cloud | Lecture Notes in Electrical Engineering, 1033 (2024) |
| 691 | 0.86 | Ai M.; Elhabiby M.; Yang Y.; El-Sheimy N. | A Coarse-To-Fine Optimization Framework For Lidar-Based Air-Ground Cooperative Mapping | 2025 IEEE/ION Position, Location and Navigation Symposium, PLANS 2025 (2025) |
| 59331 | 0.859 | Yang B.; Dong Z.; Liang F.; Mi X. | Ubiquitous Point Cloud: Theory, Model, And Applications | Ubiquitous Point Cloud: Theory, Model, and Applications (2024) |