Smart City Gnosys
Smart city article details
| Title | Semantic Segmentation-Driven Integration Of Point Clouds From Mobile Scanning Platforms In Urban Environments |
|---|---|
| ID_Doc | 48268 |
| Authors | Koszyk J.; Jasińska A.; Pargieła K.; Malczewska A.; Grzelka K.; Bieda A.; Ambroziński Ł. |
| Year | 2024 |
| Published | Remote Sensing, 16, 18 |
| DOI | http://dx.doi.org/10.3390/rs16183434 |
| Abstract | Precise and complete 3D representations of architectural structures or industrial sites are essential for various applications, including structural monitoring or cadastre. However, acquiring these datasets can be time-consuming, particularly for large objects. Mobile scanning systems offer a solution for such cases. In the case of complex scenes, multiple scanning systems are required to obtain point clouds that can be merged into a comprehensive representation of the object. Merging individual point clouds obtained from different sensors or at different times can be difficult due to discrepancies caused by moving objects or changes in the scene over time, such as seasonal variations in vegetation. In this study, we present the integration of point clouds obtained from two mobile scanning platforms within a built-up area. We utilized a combination of a quadruped robot and an unmanned aerial vehicle (UAV). The PointNet++ network was employed to conduct a semantic segmentation task, enabling the detection of non-ground objects. The experimental tests used the Toronto 3D dataset and DALES for network training. Based on the performance, the model trained on DALES was chosen for further research. The proposed integration algorithm involved semantic segmentation of both point clouds, dividing them into square subregions, and performing subregion selection by checking the emptiness or when both subregions contained points. Parameters such as local density, centroids, coverage, and Euclidean distance were evaluated. Point cloud merging and augmentation enhanced with semantic segmentation and clustering resulted in the exclusion of points associated with these movable objects from the point clouds. The comparative analysis of the method and simple merging was performed based on file size, number of points, mean roughness, and noise estimation. The proposed method provided adequate results with the improvement of point cloud quality indicators. © 2024 by the authors. |
| Author Keywords | mobile scanning; point clouds; quadruped robot; semantic segmentation; smart city; UAV |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
48256  | 0.893 | Villinger G.; Schmitt A.; Reiterer A. | Semantic Segmentation Of Fused Mobile Mapping Data | Proceedings of SPIE - The International Society for Optical Engineering, 12999 (2024) |
| 41134 | 0.873 | Merkle D.; Reiterer A. | Overview Of 3D Point Cloud Annotation And Segmentation Techniques For Smart City Applications | Proceedings of SPIE - The International Society for Optical Engineering, 12269 (2022) |
| 8331 | 0.867 | Wang W.; Fan Y.; Li Y.; Li X.; Tang S. | An Individual Tree Segmentation Method From Mobile Mapping Point Clouds Based On Improved 3-D Morphological Analysis | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 16 (2023) |
| 13881 | 0.867 | Chen Y.; Zhang S.; Han T.; Du Y.; Zhang W.; Li J. | Chat3D: Interactive Understanding 3D Scene-Level Point Clouds By Chatting With Foundation Model For Urban Ecological Construction | ISPRS Journal of Photogrammetry and Remote Sensing, 212 (2024) |
| 43360 | 0.866 | Yang B.; Haala N.; Dong Z. | Progress And Perspectives Of Point Cloud Intelligence | Geo-Spatial Information Science, 26, 2 (2023) |
| 48325 | 0.864 | Zhang L.; Zhang K. | Semi-Supervised Semantic Segmentation Network For Point Clouds Based On 3D Shape | Applied Sciences (Switzerland), 13, 6 (2023) |
| 158 | 0.861 | Chen Z.; Lou L. | 3D Point Cloud Reconstruction And Segmentation For Large Scene Based On Uav Aerial Images | Proceedings of SPIE - The International Society for Optical Engineering, 12451 (2022) |
| 1779 | 0.859 | Zuo Z.; Li Y. | A Framework For Reconstructing Building Parametric Models With Hierarchical Relationships From Point Clouds | International Journal of Applied Earth Observation and Geoinformation, 119 (2023) |
| 17074 | 0.856 | Zaboli M.; Rastiveis H.; Hosseiny B.; Shokri D.; Sarasua W.A.; Homayouni S. | D-Net: A Density-Based Convolutional Neural Network For Mobile Lidar Point Clouds Classification In Urban Areas | Remote Sensing, 15, 9 (2023) |
| 16869 | 0.852 | Gao L.; Liu Y.; Chen X.; Liu Y.; Yan S.; Zhang M. | Cus3D: A New Comprehensive Urban-Scale Semantic-Segmentation 3D Benchmark Dataset | Remote Sensing, 16, 6 (2024) |