Smart City Gnosys

Smart city article details

Title Ensemble-Based Deep Learning For Autonomous Bridge Component And Damage Segmentation Leveraging Nested Reg-Unet
ID_Doc 24126
Authors Subedi A.; Tang W.; Mondal T.G.; Wu R.-T.; Jahanshahi M.R.
Year 2023
Published Smart Structures and Systems, 31, 4
DOI http://dx.doi.org/10.12989/sss.2023.31.4.335
Abstract Bridges constantly undergo deterioration and damage, the most common ones being concrete damage and exposed rebar. Periodic inspection of bridges to identify damages can aid in their quick remediation. Likewise, identifying components can provide context for damage assessment and help gauge a bridge’s state of interaction with its surroundings. Current inspection techniques rely on manual site visits, which can be time-consuming and costly. More recently, robotic inspection assisted by autonomous data analytics based on Computer Vision (CV) and Artificial Intelligence (AI) has been viewed as a suitable alternative to manual inspection because of its efficiency and accuracy. To aid research in this avenue, this study performs a comparative assessment of different architectures, loss functions, and ensembling strategies for the autonomous segmentation of bridge components and damages. The experiments lead to several interesting discoveries. Nested Reg-UNet architecture is found to outperform five other state-of-the-art architectures in both damage and component segmentation tasks. The architecture is built by combining a Nested UNet style dense configuration with a pretrained RegNet encoder. In terms of the mean Intersection over Union (mIoU) metric, the Nested Reg-UNet architecture provides an improvement of 2.86% on the damage segmentation task and 1.66% on the component segmentation task compared to the state-of-the-art UNet architecture. Furthermore, it is demonstrated that incorporating the Lovasz-Softmax loss function to counter class imbalance can boost performance by 3.44% in the component segmentation task over the most employed alternative, weighted Cross Entropy (wCE). Finally, weighted softmax ensembling is found to be quite effective when used synchronously with the Nested Reg-UNet architecture by providing mIoU improvement of 0.74% in the component segmentation task and 1.14% in the damage segmentation task over a single-architecture baseline. Overall, the best mIoU of 92.50% for the component segmentation task and 84.19% for the damage segmentation task validate the feasibility of these techniques for autonomous bridge component and damage segmentation using RGB images. Copyright © 2023 Techno-Press, Ltd.
Author Keywords automated bridge inspection; component segmentation; damage segmentation; smart cities; structural health monitoring


Similar Articles


Id Similarity Authors Title Published
37174 View0.861Karaaslan E.; Zakaria M.; Catbas F.N.Mixed Reality-Assisted Smart Bridge Inspection For Future Smart CitiesThe Rise of Smart Cities: Advanced Structural Sensing and Monitoring Systems (2022)
38459 View0.857Zhong J.; Fan Y.; Zhao X.; Zhou Q.; Xu Y.Multi-Type Structural Damage Image Segmentation Via Dual-Stage Optimization-Based Few-Shot LearningSmart Cities, 7, 4 (2024)
5792 View0.854Li Y.; Sun Z.; Li Y.; Yang H.; Liu X.; He W.A Vision Transformer-Based Method For Predicting Seismic Damage States Of Rc Piers: Database Development And Efficient AssessmentReliability Engineering and System Safety, 263 (2025)