Smart City Gnosys
Smart city article details
| Title | Disparity Refinement For Stereo Matching Of High-Resolution Remote Sensing Images Based On Gis Data |
|---|---|
| ID_Doc | 20535 |
| Authors | Wang X.; Jiang L.; Wang F.; You H.; Xiang Y. |
| Year | 2024 |
| Published | Remote Sensing, 16, 3 |
| DOI | http://dx.doi.org/10.3390/rs16030487 |
| Abstract | With the emergence of the Smart City concept, the rapid advancement of urban three-dimensional (3D) reconstruction becomes imperative. While current developments in the field of 3D reconstruction have enabled the generation of 3D products such as Digital Surface Models (DSM), challenges persist in accurately reconstructing shadows, handling occlusions, and addressing low-texture areas in very-high-resolution remote sensing images. These challenges often lead to difficulties in calculating satisfactory disparity maps using existing stereo matching methods, thereby reducing the accuracy of 3D reconstruction. This issue is particularly pronounced in urban scenes, which contain numerous super high-rise and densely distributed buildings, resulting in large disparity values and occluded regions in stereo image pairs, and further leading to a large number of mismatched points in the obtained disparity map. In response to these challenges, this paper proposes a method to refine the disparity in urban scenes based on open-source GIS data. First, we register the GIS data with the epipolar-rectified images since there always exists unignorable geolocation errors between them. Specifically, buildings with different heights present different offsets in GIS data registering; thus, we perform multi-modal matching for each building and merge them into the final building mask. Subsequently, a two-layer optimization process is applied to the initial disparity map based on the building mask, encompassing both global and local optimization. Finally, we perform a post-correction on the building facades to obtain the final refined disparity map that can be employed for high-precision 3D reconstruction. Experimental results on SuperView-1, GaoFen-7, and GeoEye satellite images show that the proposed method has the ability to correct the occluded and mismatched areas in the initial disparity map generated by both hand-crafted and deep-learning stereo matching methods. The DSM generated by the refined disparity reduces the average height error from 2.2 m to 1.6 m, which demonstrates superior performance compared with other disparity refinement methods. Furthermore, the proposed method is able to improve the integrity of the target structure and present steeper building facades and complete roofs, which are conducive to subsequent 3D model generation. © 2024 by the authors. |
| Author Keywords | disparity refinement; open-source GIS data; optical remote sensing images; urban scene |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
30881  | 0.881 | Dumas L.; Defonte V.; Steux Y.; Sarrazin E. | Improving Pairwise Dsm With 3Sgm: A Semantic Segmentation For Sgm Using An Automatically Refined Neural Network | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 5, 2 (2022) |
| 22660 | 0.876 | Mao Y.; Chen K.; Zhao L.; Chen W.; Tang D.; Liu W.; Wang Z.; Diao W.; Sun X.; Fu K. | Elevation Estimation-Driven Building 3-D Reconstruction From Single-View Remote Sensing Imagery | IEEE Transactions on Geoscience and Remote Sensing, 61 (2023) |
| 13602 | 0.875 | Akhavi Zadegan A.; Vivet D.; Hadachi A. | Challenges And Advancements In Image-Based 3D Reconstruction Of Large-Scale Urban Environments: A Review Of Deep Learning And Classical Methods | Frontiers in Computer Science, 7 (2025) |
| 32001 | 0.865 | Wu C.; Yu X.; Ma C.; Zhong R.; Zhou X. | Integrating Geospatial Data And Street-View Imagery To Reconstruct Large-Scale 3D Urban Building Models | Transactions in GIS, 28, 5 (2024) |
| 102 | 0.864 | Yu D.; Ji S.; Wei S.; Khoshelham K. | 3-D Building Instance Extraction From High-Resolution Remote Sensing Images And Dsm With An End-To-End Deep Neural Network | IEEE Transactions on Geoscience and Remote Sensing, 62 (2024) |
| 58458 | 0.863 | Yan Y.; Huang B.; Wang W.; Jiang X.; Xie L.; Pun M.-O.; Guo R.; Zhao Y. | Towards Vertical Urban Geometry Extraction: Occlusion-Reduced Estimation From Street View Images Using Diffusion Models | International Journal of Digital Earth, 18, 1 (2025) |
| 186 | 0.863 | Cheolhwan K.; Youngmok K.; Wonjun C.; Eunkwan L.; Hong-Gyoo S. | 3D Urban Building Reconstruction Through Neural Rendering And Uav Imagery | Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 41, 5 (2023) |
| 7699 | 0.862 | Chen Y.; Yang X.; Yang L.; Feng J. | An Automatic Approach To Extracting Large-Scale Three-Dimensional Road Networks Using Open-Source Data | Remote Sensing, 14, 22 (2022) |
| 3267 | 0.86 | Wu Y.; Xue F.; Li M.; Chen S.-H. | A Novel Building Section Skeleton For Compact 3D Reconstruction From Point Clouds: A Study Of High-Density Urban Scenes | ISPRS Journal of Photogrammetry and Remote Sensing, 209 (2024) |
| 55521 | 0.858 | Sadiqe N.E.; Jasim O.Z.; Al-Bakri M. | The Extraction Of Buildings Height Using Satellite Photogrammetric Within 3D-Geodatabase Of Smart City: Kirkuk City As A Case Study | AIP Conference Proceedings, 3219, 1 (2024) |