Smart City Gnosys
Smart city article details
| Title | Chat3D: Interactive Understanding 3D Scene-Level Point Clouds By Chatting With Foundation Model For Urban Ecological Construction |
|---|---|
| ID_Doc | 13881 |
| Authors | Chen Y.; Zhang S.; Han T.; Du Y.; Zhang W.; Li J. |
| Year | 2024 |
| Published | ISPRS Journal of Photogrammetry and Remote Sensing, 212 |
| DOI | http://dx.doi.org/10.1016/j.isprsjprs.2024.04.024 |
| Abstract | With the artificial intelligence technology development boom, large language models are demonstrating their potential in comprehension and creativity. Large language models such as GPT-4 and Gemini have been able to powerfully study for various professional-level exams. However, as a language model itself, its powerful comprehension can only be reflected in text sequences. Currently, although videos can be generated through the connection between 3D point clouds and large language models, there is currently no prompt project that directly interacts with one-dimensional through attribute calculation results. The point cloud data is also rich in information that can support various tasks of urban construction. For scene-level point cloud data, there has been a lot of research done on semantic segmentation, target detection, and other tasks. However, it is usually difficult to provide direct help to scene construction from the perception results. This paper presents a method for applying large language models to urban ecological construction by combining the results of 3D point cloud semantic segmentation. The objective is to integrate the prior knowledge and creative capabilities of Large Language Models (LLMs) within urban development with the outcomes derived from point cloud semantic segmentation results. This integration aims to establish an interactive point cloud intelligent analysis system, tailored for aiding decision-making processes in urban ecological civilization construction, thus presenting innovative perspectives for the advancement of smart city development. © 2024 |
| Author Keywords | Large language model interact; Point cloud understanding; Prompt engineering; Thought chain; Urban ecological construction |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
16869  | 0.877 | Gao L.; Liu Y.; Chen X.; Liu Y.; Yan S.; Zhang M. | Cus3D: A New Comprehensive Urban-Scale Semantic-Segmentation 3D Benchmark Dataset | Remote Sensing, 16, 6 (2024) |
| 13123 | 0.868 | Wang R.; Huang S.; Yang H. | Building3D: An Urban-Scale Dataset And Benchmarks For Learning Roof Structures From Point Clouds | Proceedings of the IEEE International Conference on Computer Vision (2023) |
| 48268 | 0.867 | Koszyk J.; Jasińska A.; Pargieła K.; Malczewska A.; Grzelka K.; Bieda A.; Ambroziński Ł. | Semantic Segmentation-Driven Integration Of Point Clouds From Mobile Scanning Platforms In Urban Environments | Remote Sensing, 16, 18 (2024) |
| 41134 | 0.862 | Merkle D.; Reiterer A. | Overview Of 3D Point Cloud Annotation And Segmentation Techniques For Smart City Applications | Proceedings of SPIE - The International Society for Optical Engineering, 12269 (2022) |
| 1779 | 0.861 | Zuo Z.; Li Y. | A Framework For Reconstructing Building Parametric Models With Hierarchical Relationships From Point Clouds | International Journal of Applied Earth Observation and Geoinformation, 119 (2023) |
| 34830 | 0.859 | Li Y.; Ye Z.; Huang X.; HeLi Y.; Shuang F. | Lcl_Fda: Local Context Learning And Full-Level Decoder Aggregation Network For Large-Scale Point Cloud Semantic Segmentation | Neurocomputing, 621 (2025) |
| 61547 | 0.858 | Gu K.; Lv Z.; Zhu W.; Yi Y.; Jia F.; Ma J. | Weakly Supervised Point Cloud Semantic Segmentation Based On Multidimensional Feature Fusion And Feature Representation | 2023 10th International Forum on Electrical Engineering and Automation, IFEEA 2023 (2023) |
| 42272 | 0.857 | Li J.; Liu J. | Pointdms: An Improved Deep Learning Neural Network Via Multi-Feature Aggregation For Large-Scale Point Cloud Segmentation In Smart Applications Of Urban Forestry Management | Forests, 14, 11 (2023) |
| 43360 | 0.851 | Yang B.; Haala N.; Dong Z. | Progress And Perspectives Of Point Cloud Intelligence | Geo-Spatial Information Science, 26, 2 (2023) |
| 8331 | 0.85 | Wang W.; Fan Y.; Li Y.; Li X.; Tang S. | An Individual Tree Segmentation Method From Mobile Mapping Point Clouds Based On Improved 3-D Morphological Analysis | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 16 (2023) |