Smart City Gnosys

Smart city article details

Title Cus3D: A New Comprehensive Urban-Scale Semantic-Segmentation 3D Benchmark Dataset
ID_Doc 16869
Authors Gao L.; Liu Y.; Chen X.; Liu Y.; Yan S.; Zhang M.
Year 2024
Published Remote Sensing, 16, 6
DOI http://dx.doi.org/10.3390/rs16061079
Abstract With the continuous advancement of the construction of smart cities, the availability of large-scale and semantically enriched datasets is essential for enhancing the machine’s ability to understand urban scenes. Mesh data have a distinct advantage over point cloud data for large-scale scenes, as they can provide inherent geometric topology information and consume less memory space. However, existing publicly available large-scale scene mesh datasets are limited in scale and semantic richness and do not cover a wide range of urban semantic information. The development of 3D semantic segmentation algorithms depends on the availability of datasets. Moreover, existing large-scale 3D datasets lack various types of official annotation data, which hinders the widespread applicability of benchmark applications and may cause label errors during data conversion. To address these issues, we present a comprehensive urban-scale semantic segmentation benchmark dataset. It is suitable for various research pursuits on semantic segmentation methodologies. This dataset contains finely annotated point cloud and mesh data types for 3D, as well as high-resolution original 2D images with detailed 2D semantic annotations. It is constructed from a 3D reconstruction of 10,840 UVA aerial images and spans a vast area of approximately 2.85 square kilometers that covers both urban and rural scenes. The dataset is composed of 152,298,756 3D points and 289,404,088 triangles. Each 3D point, triangular mesh, and the original 2D image in the dataset are carefully labeled with one of the ten semantic categories. Six typical 3D semantic segmentation methods were compared on the CUS3D dataset, with KPConv demonstrating the highest overall performance. The mIoU is 59.72%, OA is 89.42%, and mAcc is 97.88%. Furthermore, the experimental results on the impact of color information on semantic segmentation suggest that incorporating both coordinate and color features can enhance the performance of semantic segmentation. The current limitations of the CUS3D dataset, particularly in class imbalance, will be the primary target for future dataset enhancements. © 2024 by the authors.
Author Keywords benchmark dataset; comprehensive urban-scale dataset; semantic segmentation; urban scene understanding


Similar Articles


Id Similarity Authors Title Published
60306 View0.89Zi W.; Li J.; Chen H.; Chen L.; Du C.Urbansegnet: An Urban Meshes Semantic Segmentation Network Using Diffusion Perceptron And Vertex Spatial AttentionInternational Journal of Applied Earth Observation and Geoinformation, 129 (2024)
13123 View0.881Wang R.; Huang S.; Yang H.Building3D: An Urban-Scale Dataset And Benchmarks For Learning Roof Structures From Point CloudsProceedings of the IEEE International Conference on Computer Vision (2023)
13881 View0.877Chen Y.; Zhang S.; Han T.; Du Y.; Zhang W.; Li J.Chat3D: Interactive Understanding 3D Scene-Level Point Clouds By Chatting With Foundation Model For Urban Ecological ConstructionISPRS Journal of Photogrammetry and Remote Sensing, 212 (2024)
43636 View0.871Yi H.; Liu Y.; Wang M.Psnet: Patch-Based Self-Attention Network For 3D Point Cloud Semantic SegmentationRemote Sensing, 17, 12 (2025)
41134 View0.869Merkle D.; Reiterer A.Overview Of 3D Point Cloud Annotation And Segmentation Techniques For Smart City ApplicationsProceedings of SPIE - The International Society for Optical Engineering, 12269 (2022)
48265 View0.868Arulananth T.S.; Kuppusamy P.G.; Ayyasamy R.K.; Alhashmi S.M.; Mahalakshmi M.; Vasanth K.; Chinnasamy P.Semantic Segmentation Of Urban Environments: Leveraging U-Net Deep Learning Model For Cityscape Image AnalysisPLoS ONE, 19, 4 April (2024)
18256 View0.865Li Z.; Ning X.; Lv Z.; Shi Z.; Jin H.; Wang Y.; Zhou W.Demf-Net: Dual-Branch Feature Enhancement And Multi-Scale Fusion For Semantic Segmentation Of Large-Scale Point Clouds; [Demf-Net:基于双分支增强和多尺度融合的大规模点云语义分割]Journal of Graphics, 46, 2 (2025)
13602 View0.865Akhavi Zadegan A.; Vivet D.; Hadachi A.Challenges And Advancements In Image-Based 3D Reconstruction Of Large-Scale Urban Environments: A Review Of Deep Learning And Classical MethodsFrontiers in Computer Science, 7 (2025)
18322 View0.865Luo Z.; Zeng Z.; Tang W.; Wan J.; Xie Z.; Xu Y.Dense Dual-Branch Cross Attention Network For Semantic Segmentation Of Large-Scale Point CloudsIEEE Transactions on Geoscience and Remote Sensing, 62 (2024)
1779 View0.862Zuo Z.; Li Y.A Framework For Reconstructing Building Parametric Models With Hierarchical Relationships From Point CloudsInternational Journal of Applied Earth Observation and Geoinformation, 119 (2023)