Smart City Gnosys

Smart city article details

Title Progressive Matching Method Of Aerial-Ground Remote Sensing Image Via Multi-Scale Context Feature Coding
ID_Doc 43380
Authors Xu C.; Xu J.; Huang T.; Zhang H.; Mei L.; Zhang X.; Duan Y.; Yang W.
Year 2023
Published International Journal of Remote Sensing, 44, 19
DOI http://dx.doi.org/10.1080/01431161.2023.2255352
Abstract The fine 3D model is the essential spatial information for the construction of a smart city. UAV aerial images with large-scale scene perception ability are common data sources for 3D modelling of cities at present. However, in some complex urban areas, a single aerial image is difficult to capture the 3D scene information because of the existence of some problems such as inaccurate edges, holes, and blurred building facade textures due to changes in perspective and area occlusion. Therefore, how to solve perspective changes and area occlusion of the aerial image quickly and efficiently has become an important problem. The ground image can be used as an important supplement to solve the problem of missing bottom and area occlusion in oblique photography modelling. Thus, this article proposes a progressive matching method via multi-scale context feature coding network to achieve robust matching of aerial-ground remote sensing images, which provides better technical support for urban modelling. The main idea consists of three parts: (1) a multi-scale context feature coding network is designed to extract feature on aerial-ground images efficiently; (2) a block-based matching strategy is proposed to pay more attention to local features of the aerial-ground images; (3) a progressive matching method is applied in block matching stage to obtain more accurate features. We used eight sets of typical data, such as aerial images captured by the drone DJI-MAVIC2 and ground images captured by handheld devices as experimental objects, and compared them with algorithms such as SIFT, D2-net, DFM and SuperGlue. Experimental results show that our proposed aerial-ground image matching method has a good performance that the average NCM has improved 2.1–8.2 times, and the average rate of correct matching has an average increase of 26% points with the average root of mean square error is only 1.48 pixels. © 2023 Informa UK Limited, trading as Taylor & Francis Group.
Author Keywords 3D model; aerial-ground remote sensing image; deep learning; feature matching; large buildings


Similar Articles


Id Similarity Authors Title Published
46893 View0.927Zhang H.; Huang T.; Xu J.; Xl C.; Yang W.Robust Matching Of Aerial-Ground Images Optimized By Multi-Layer Progressive Feature Alignment NetworkJisuanji Gongcheng/Computer Engineering, 49, 10 (2023)
52378 View0.862Zhang Y.; Zou S.; Liu X.Sparse Point Cloud Guided Digital Surface Model Generation For Aerial Images; [稀 疏 点 云 引 导 的 航 空 影 像 数 字 表 面 模 型生 成 方 法]Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 48, 11 (2023)
186 View0.858Cheolhwan K.; Youngmok K.; Wonjun C.; Eunkwan L.; Hong-Gyoo S.3D Urban Building Reconstruction Through Neural Rendering And Uav ImageryJournal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 41, 5 (2023)
20535 View0.856Wang X.; Jiang L.; Wang F.; You H.; Xiang Y.Disparity Refinement For Stereo Matching Of High-Resolution Remote Sensing Images Based On Gis DataRemote Sensing, 16, 3 (2024)
47388 View0.853Akbar A.; Liu C.; Wu H.; Jia S.; Xu Z.Scene Information Guided Aerial Photogrammetric Mission Recomposition Towards Detailed Level Building ReconstructionAdvanced Engineering Informatics, 62 (2024)
27458 View0.853Li Z.; Wu B.; Li Y.; Chen Z.Fusion Of Aerial, Mms And Backpack Images And Point Clouds For Optimized 3D Mapping In Urban AreasISPRS Journal of Photogrammetry and Remote Sensing, 202 (2023)