Smart City Gnosys

Smart city article details

Title	A Novel Spatial Data Pipeline For Streaming Smart City Data
ID_Doc	3536
Authors	Carthen, CD; Zaremehrjardi, A; Le, VD; Cardillo, CG; Strachan, S; Tavakkoli, A; Harris, FC Jr; Dascalu, SM
Year	2024
Published	INTERNATIONAL JOURNAL OF SOFTWARE INNOVATION, 12, 1
DOI	http://dx.doi.org/10.4018/IJSI.359180
Abstract	Point cloud data from light detection and ranging (LiDAR) is often used for its spatial qualities, particularly in smart city projects involving vehicles and pedestrians. In this paper, the authors introduce a streaming and an on-demand pipeline for capturing LiDAR data from Velodyne Ultra Pucks placed along nine northern Nevada intersections known as the Living Lab within smart city project for the City of Reno. This pipeline is an iteration of a previously proposed pipeline with several feature enhancements. A streaming point cloud service was implemented to stream Point Cloud Data (PCD), LASzip (LAZ), and Google Draco. Also, two web services were built for the packet capture (PCAP) and ROS 2 bag files that enables acquisition of these formats for LiDAR data. A metadata service tracks edge device states and a GraphQL service interfaces with multiple services across the Living Lab. Draco provided the best processing time and had more options that affected the quality of the point cloud. To evaluate this pipeline, a discussion is provided, with an analysis of the point cloud formats.
Author Keywords	Big Data; Data Pipeline; Data Streaming; Data Transfer; Edge Computing; IoT; LiDAR; MQTT; ROS; Smart City

Similar Articles

Id	Similarity	Authors	Title	Published
4864	0.983	Carthen C.; Zaremehrjardi A.; Le V.; Cardillo C.; Strachan S.; Tavakkoli A.; Dascalu S.M.; Harris F.C.	A Spatial Data Pipeline For Streaming Smart City Data	2024 IEEE/ACIS 22nd International Conference on Software Engineering Research, Management and Applications, SERA 2024 - Proceedings (2024)
42928	0.872	Watanabe K.; Miyoshi T.; Yamazaki T.	Preliminary Experiment On Point Cloud Collection Through 3D Mobile Crowdsensing	Digest of Technical Papers - IEEE International Conference on Consumer Electronics (2025)
24454	0.869	Azuma K.; Akiyama K.; Shinkuma R.; Trovato G.; Nihei K.; Iwai T.	Estimation Of Spatial Features In 3-D-Sensor Network Using Multiple Lidars For Indoor Monitoring	IEEE Sensors Journal, 23, 7 (2023)
44424	0.868	Kase T.; Hasegawa K.; Watanabe K.; Miyoshi T.; Yamazaki T.	Real-Time Point Cloud Visualization For Sustainable Spatial Digital Twins	Digest of Technical Papers - IEEE International Conference on Consumer Electronics (2025)
44290	0.866	Akiyama K.; Azuma K.; Shinkuma R.; Shiomi J.	Real-Time Adaptive Data Transmission Against Various Traffic Load In Multi-Lidar Sensor Network For Indoor Monitoring	IEEE Sensors Journal, 23, 15 (2023)
59331	0.865	Yang B.; Dong Z.; Liang F.; Mi X.	Ubiquitous Point Cloud: Theory, Model, And Applications	Ubiquitous Point Cloud: Theory, Model, and Applications (2024)
41021	0.861	Mohd Ariff S.A.; Azri S.; Ujang U.; Choon T.L.	Organizing Smart City Data Based On 3D Point Cloud In Unstructured Database - An Overview	International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 48, 4/W3-2022 (2022)
3535	0.861	Carthen C.D.; Zaremehrjardi A.; Le V.; Cardillo C.; Strachan S.; Tavakkoli A.; Maketitle; Harris F.C., Jr.; Dascalu S.M.	A Novel Spatial Data Pipeline For Orchestrating Apache Nifi/Minifi	International Journal of Software Innovation, 12, 1 (2023)
1502	0.858	Shaikh S.; Matono A.; Kim K.-S.	A Distance-Window Based Real-Time Processing Of Spatial Data Streams	Proceedings - 2019 IEEE 5th International Conference on Multimedia Big Data, BigMM 2019 (2019)
41134	0.855	Merkle D.; Reiterer A.	Overview Of 3D Point Cloud Annotation And Segmentation Techniques For Smart City Applications	Proceedings of SPIE - The International Society for Optical Engineering, 12269 (2022)