Smart City Gnosys

Smart city article details

Title A Multiscale And Multitask Deep Learning Framework For Automatic Building Extraction
ID_Doc 2916
Authors Yin J.; Wu F.; Qiu Y.; Li A.; Liu C.; Gong X.
Year 2022
Published Remote Sensing, 14, 19
DOI http://dx.doi.org/10.3390/rs14194744
Abstract Detecting buildings, segmenting building footprints, and extracting building edges from high-resolution remote sensing images are vital in applications such as urban planning, change detection, smart cities, and map-making and updating. The tasks of building detection, footprint segmentation, and edge extraction affect each other to a certain extent. However, most previous works have focused on one of these three tasks and have lacked a multitask learning framework that can simultaneously solve the tasks of building detection, footprint segmentation and edge extraction, making it difficult to obtain smooth and complete buildings. This study proposes a novel multiscale and multitask deep learning framework to consider the dependencies among building detection, footprint segmentation, and edge extraction while completing all three tasks. In addition, a multitask feature fusion module is introduced into the deep learning framework to increase the robustness of feature extraction. A multitask loss function is also introduced to balance the training losses among the various tasks to obtain the best training results. Finally, the proposed method is applied to open-source building datasets and large-scale high-resolution remote sensing images and compared with other advanced building extraction methods. To verify the effectiveness of multitask learning, the performance of multitask learning and single-task training is compared in ablation experiments. The experimental results show that the proposed method has certain advantages over other methods and that multitask learning can effectively improve single-task performance. © 2022 by the authors.
Author Keywords building extraction; deep learning framework; high-resolution remote sensing image; multilevel and multitask


Similar Articles


Id Similarity Authors Title Published
4137 View0.888Yang M.; Zhao L.; Ye L.; Jiang H.; Yang Z.A Review Of Convolutional Neural Networks Related Methods For Building Extraction From Remote Sensing Images; [基于卷积神经网络的遥感影像建筑物提取方法综述]Journal of Geo-Information Science, 26, 6 (2024)
13075 View0.877Han Z.; Li X.; Wang X.; Wu Z.; Liu J.Building Segmentation In Urban And Rural Areas With Mfa-Net: A Multidimensional Feature Adjustment ApproachSensors, 25, 8 (2025)
12803 View0.875Hu A.; Wu L.; Chen S.; Xu Y.; Wang H.; Xie Z.Boundary Shape-Preserving Model For Building Mapping From High-Resolution Remote Sensing ImagesIEEE Transactions on Geoscience and Remote Sensing, 61 (2023)
46437 View0.871Zou R.; Che G.; Ding X.; Dong X.; Sun C.; Feng L.Review Of Building Extraction Methods Based On High-Resolution Remote Sensing ImagesLecture Notes in Electrical Engineering, 1033 (2024)
2888 View0.87Zhang X.; Li X.; Huang J.; Li E.; Liu W.; Zhang L.A Multifeature Fusion Framework Based On D-S Theory For Automatic Building Extraction From High-Resolution Remote Sensing ImageryIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 17 (2024)
11750 View0.868Lin H.; Hao M.; Luo W.; Yu H.; Zheng N.Bearnet: A Novel Buildings Edge-Aware Refined Network For Building Extraction From High-Resolution Remote Sensing ImagesIEEE Geoscience and Remote Sensing Letters, 20 (2023)
38966 View0.867Zhou Y.; Jiang W.; Wang B.Nesf-Net: Building Roof And Facade Segmentation Based On Neighborhood Relationship Awareness And Scale-Frequency Modulation Network For High-Resolution Remote Sensing ImagesISPRS Journal of Photogrammetry and Remote Sensing, 226 (2025)
25925 View0.865Huang Y.; Zang Y.; Jiang Q.; Mi W.Extraction Of Building Outlines From Airborne Lidar Point Clouds Using Line-Cnn Based On Deep Network; [采用 Line-Cnn 深度学习网络的机载点云建筑轮廓线提取]Journal of Geo-Information Science, 26, 9 (2024)
47466 View0.863Pan X.; Xu K.; Yang S.; Liu Y.; Zhang R.; He P.Sda-Net: A Spatially Optimized Dual-Stream Network With Adaptive Global Attention For Building Extraction In Multi-Modal Remote Sensing ImagesSensors, 25, 7 (2025)
3245 View0.863Hussain Z.K.; Congshi J.; Adrees M.; Chaudhary H.; Shafqat R.A Novel Architecture For Building Rooftop Extraction Using Remote Sensing And Deep LearningRemote Sensing Applications: Society and Environment, 38 (2025)