Smart City Gnosys

Smart city article details

Title Y-Shaped Convolutional Neural Network For 3D Roof Elements Extraction To Reconstruct Building Models From A Single Aerial Image
ID_Doc 62107
Authors Alidoost F.; Arefi H.; Hahn M.
Year 2020
Published ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 5, 2
DOI http://dx.doi.org/10.5194/isprs-annals-V-2-2020-321-2020
Abstract Fast and efficient detection and reconstruction of buildings have become essential in real-time applications such as navigation, 3D rendering, augmented reality, and 3D smart cities. In this study, a modern Deep Learning (DL)-based framework is proposed for automatic detection, localization, and height estimation of buildings, simultaneously, from a single aerial image. The proposed framework is based on a Y-shaped Convolutional Neural Network (Y-Net) which includes one encoder and two decoders. The input of the network is a single RGB image, while the outputs are predicted height information of buildings as well as the rooflines in three classes of eave, ridge, and hip lines. The extracted knowledge by the Y-Net (i.e. buildings' heights and rooflines) is utilized for 3D reconstruction of buildings based on the third Level of Detail (LoD2). The main steps of the proposed approach are data preparation, CNNs training, and 3D reconstruction. For the experimental investigations airborne data from Potsdam are used, which were provided by ISPRS. For the predicted heights, the results show an average Root Mean Square Error (RMSE) and a Normalized Median Absolute Deviation (NMAD) of about 3.8 m and 1.3 m, respectively. Moreover, the overall accuracy of the extracted rooflines is about 86%. © 2020 Copernicus GmbH. All rights reserved.
Author Keywords Building Reconstruction; Convolutional Neural Networks (CNNs); Deep Learning; Rooflines; Single Image


Similar Articles


Id Similarity Authors Title Published
17801 View0.894Usta Z.; Akın A.T.; Cömert Ç.Deep Learning Aided Web-Based Procedural Modelling Of Lod2 City ModelsEarth Science Informatics, 16, 3 (2023)
24421 View0.878Yan Y.; Huang B.Estimation Of Building Height Using A Single Street View Image Via Deep Neural NetworksISPRS Journal of Photogrammetry and Remote Sensing, 192 (2022)
18101 View0.878Teo T.-A.Deep-Learning For Lod1 Building Reconstruction From Airborne Lidar DataInternational Geoscience and Remote Sensing Symposium (IGARSS) (2019)
186 View0.876Cheolhwan K.; Youngmok K.; Wonjun C.; Eunkwan L.; Hong-Gyoo S.3D Urban Building Reconstruction Through Neural Rendering And Uav ImageryJournal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography, 41, 5 (2023)
102 View0.868Yu D.; Ji S.; Wei S.; Khoshelham K.3-D Building Instance Extraction From High-Resolution Remote Sensing Images And Dsm With An End-To-End Deep Neural NetworkIEEE Transactions on Geoscience and Remote Sensing, 62 (2024)
25925 View0.868Huang Y.; Zang Y.; Jiang Q.; Mi W.Extraction Of Building Outlines From Airborne Lidar Point Clouds Using Line-Cnn Based On Deep Network; [采用 Line-Cnn 深度学习网络的机载点云建筑轮廓线提取]Journal of Geo-Information Science, 26, 9 (2024)
4137 View0.866Yang M.; Zhao L.; Ye L.; Jiang H.; Yang Z.A Review Of Convolutional Neural Networks Related Methods For Building Extraction From Remote Sensing Images; [基于卷积神经网络的遥感影像建筑物提取方法综述]Journal of Geo-Information Science, 26, 6 (2024)
38966 View0.866Zhou Y.; Jiang W.; Wang B.Nesf-Net: Building Roof And Facade Segmentation Based On Neighborhood Relationship Awareness And Scale-Frequency Modulation Network For High-Resolution Remote Sensing ImagesISPRS Journal of Photogrammetry and Remote Sensing, 226 (2025)
748 View0.866Chen X.; Cheng Y.; Han X.; Zhao B.; Tao W.; Ozdemir E.; Pan D.A Compact Surface Reconstruction Method For Buildings Based On Convolutional Neural Network Fitting Implicit RepresentationsJournal of Computing in Civil Engineering, 39, 3 (2025)
3245 View0.865Hussain Z.K.; Congshi J.; Adrees M.; Chaudhary H.; Shafqat R.A Novel Architecture For Building Rooftop Extraction Using Remote Sensing And Deep LearningRemote Sensing Applications: Society and Environment, 38 (2025)