Smart City Gnosys

Smart city article details

Title	Building A Data Pipeline For The Management And Processing Of Urban Data Streams
ID_Doc	12947
Authors	Badidi E.; El Neyadi N.; Al Saeedi M.; Al Kaabi F.; Maheswaran M.
Year	2018
Published	Handbook of Smart Cities: Software Services and Cyber Infrastructure
DOI	http://dx.doi.org/10.1007/978-3-319-97271-8_15
Abstract	Urban data streams (UDS) originate from various sensors and Internet of Things (IoT) devices deployed in smart cities as well as social media sources such as Twitter and Facebook. The large volumes of urban data need to be harnessed to help smart city stakeholders and applications make informed decisions on the fly. Furthermore, effective management and governance of smart city components relies on the ability to integrate and federate their data, process urban data streams locally, and use big data analytics. Data integration and interoperability is a challenging problem that smart cities are facing today. Successful data integration is crucial for improved services and governance. This chapter describes a framework that aims to serve in building a data pipeline for the acquisition and processing of urban data streams, urban data analytics, and creation of value-added services. The framework relies on latest technologies for data processing including IoT, edge computing, data integration techniques, cloud computing, and data analytics. The proposed platform will facilitate real-time event detection, notification of alerts, mining the opinions of citizens regarding the governance of their city, and building monitoring dashboards. A prototype of the platform is being implemented using the Kafka messaging platform. © Springer Nature Switzerland AG 2018.
Author Keywords	Data integration; Data interoperability; Data streams processing; Internet of things; Messaging queue; Smart cities

Similar Articles

Id	Similarity	Authors	Title	Published
23575	0.879	Raptis, TP; Cicconetti, C; Falelakis, M; Kalogiannis, G; Kanellos, T; Lobo, TP	Engineering Resource-Efficient Data Management For Smart Cities With Apache Kafka	FUTURE INTERNET, 15, 2 (2023)
4694	0.875	Gledson A.; Dhafari T.B.; Paton N.; Keane J.	A Smart City Dashboard For Combining And Analysing Multi-Source Data Streams	Proceedings - 20th International Conference on High Performance Computing and Communications, 16th International Conference on Smart City and 4th International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2018 (2019)
17247	0.872	Harris A.; Sartipi M.	Data Integration Platform For Smart And Connected Cities	SCOPE 2019 - Proceedings of the 2019 International Science of Smart City Operations and Platforms Engineering (2019)
1229	0.871	Silvestri S.; Tricomi G.; Damiano E.; Sicuranza M.; Ciampi M.	A Data Platform For The Integration Of Smart City Subsystems	Lecture Notes on Data Engineering and Communications Technologies, 232 (2025)
28752	0.87	Pandey S.K.; Khan M.T.; Qiu R.G.	Harnessing Big Data And Analytics Solutions In Support Of Smart City Services	Springer Proceedings in Business and Economics (2019)
13023	0.87	Wolf K.; Stiles J.; Miller H.J.; Dawson R.J.; Mills J.P.; Blythe P.; Morley J.	Building Enduring Smart City Data Platforms To Provide Urban Management Support: Lessons Learnt From Uk Urban Observatories And The Us Smart Columbus Operating System	Frontiers in Sustainable Cities, 7 (2025)
18707	0.869	Raptis T.P.; Cicconetti C.; Falelakis M.; Kanellos T.; Lobo T.P.	Design Guidelines For Apache Kafka Driven Data Management And Distribution In Smart Cities	ISC2 2022 - 8th IEEE International Smart Cities Conference (2022)
5903	0.868	De Camargo Magano F.; Braghetto K.R.	Abstracting Big Data Processing Tools For Smart Cities	Proceedings - 2018 IEEE 37th International Symposium on Reliable Distributed Systems Workshops, SRDSW 2018 (2019)
59006	0.868	Farmanbar, M; Rong, CM	Triangulum City Dashboard: An Interactive Data Analytic Platform For Visualizing Smart City Performance	PROCESSES, 8, 2 (2020)
57664	0.866	Moeini H.; Zeng W.; Yen I.-L.; Bastani F.	Toward Data Discovery In Dynamic Smart City Applications	Proceedings - 21st IEEE International Conference on High Performance Computing and Communications, 17th IEEE International Conference on Smart City and 5th IEEE International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2019 (2019)