Smart City Gnosys

Smart city article details

Title Full-Automatic High-Precision Scene 3D Reconstruction Method With Water-Area Intelligent Complementation And Mesh Optimization For Uav Images
ID_Doc 27375
Authors Guo B.; Ge Y.; Xiao X.; Wang C.; Gong J.; Li D.
Year 2024
Published International Journal of Digital Earth, 17, 1
DOI http://dx.doi.org/10.1080/17538947.2024.2317441
Abstract Fast and high-precision urban scene 3D modeling is the foundational data infrastructure for the digital earth and smart cities. However, due to challenges such as water-area matching difficulties and issues like data redundancy and insufficient observations, existing full-automatic 3D modeling methods often result in water-area missing and many small holes in the models and insufficient local-model accuracy. To overcome these challenges, full-automatic high-precision scene 3D reconstruction method with water-area intelligent complementation on depth maps and mesh optimization is proposed. Firstly, SfM was used to calculated image poses and PatchMatch was used to generated initial depth maps. Secondly, a simplified GAN extracted water-area masks and ray tracing was used achieve high-precision auto-completed water-area depth values. Thirdly, fully connected CRF optimized water-areas and arounds in depth maps. Fourthly, high-precision 3D point clouds were obtained using depth map fusion based on clustering culling and depth least squares. Then, mesh was generated and optimized using similarity measurement and vertex gradients to obtain refined mesh. Finally, high-precision scene 3D models without water-area missing or holes were generated. The results showed that: to compare with the-state-of-art ContextCapture, the proposed method enhances model completeness by 14.3%, raises average accuracy by 14.5% and improves processing efficiency by 63.6%. © 2024 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.
Author Keywords depth map optimization; High-completeness scene 3D modeling; mesh refinement; UAV images; water-area intelligent complementation


Similar Articles


Id Similarity Authors Title Published
674 View0.851Li Y.; Qi Y.; Wang C.; Bao Y.A Cluster-Based 3D Reconstruction System For Large-Scale ScenesSensors, 23, 5 (2023)
158 View0.85Chen Z.; Lou L.3D Point Cloud Reconstruction And Segmentation For Large Scene Based On Uav Aerial ImagesProceedings of SPIE - The International Society for Optical Engineering, 12451 (2022)