Smart City Gnosys
Smart city article details
| Title | Engineering Resource-Efficient Data Management For Smart Cities With Apache Kafka |
|---|---|
| ID_Doc | 23575 |
| Authors | Raptis, TP; Cicconetti, C; Falelakis, M; Kalogiannis, G; Kanellos, T; Lobo, TP |
| Year | 2023 |
| Published | FUTURE INTERNET, 15, 2 |
| DOI | http://dx.doi.org/10.3390/fi15020043 |
| Abstract | In terms of the calibre and variety of services offered to end users, smart city management is undergoing a dramatic transformation. The parties involved in delivering pervasive applications can now solve key issues in the big data value chain, including data gathering, analysis, and processing, storage, curation, and real-world data visualisation. This trend is being driven by Industry 4.0, which calls for the servitisation of data and products across all industries, including the field of smart cities, where people, sensors, and technology work closely together. In order to implement reactive services such as situational awareness, video surveillance, and geo-localisation while constantly preserving the safety and privacy of affected persons, the data generated by omnipresent devices needs to be processed fast. This paper proposes a modular architecture to (i) leverage cutting-edge technologies for data acquisition, management, and distribution (such as Apache Kafka and Apache NiFi); (ii) develop a multi-layer engineering solution for revealing valuable and hidden societal knowledge in the context of smart cities processing multi-modal, real-time, and heterogeneous data flows; and (iii) address the key challenges in tasks involving complex data flows and offer general guidelines to solve them. In order to create an effective system for the monitoring and servitisation of smart city assets with a scalable platform that proves its usefulness in numerous smart city use cases with various needs, we deduced some guidelines from an experimental setting performed in collaboration with leading industrial technical departments. Ultimately, when deployed in production, the proposed data platform will contribute toward the goal of revealing valuable and hidden societal knowledge in the context of smart cities. |
| Author Keywords | smart cities; Apache Kafka; Apache NiFi; data management; Industry 4; 0 |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
18707  | 0.972 | Raptis T.P.; Cicconetti C.; Falelakis M.; Kanellos T.; Lobo T.P. | Design Guidelines For Apache Kafka Driven Data Management And Distribution In Smart Cities | ISC2 2022 - 8th IEEE International Smart Cities Conference (2022) |
| 34287 | 0.885 | Gupta M.; Khan M.S.; Mishra S.; Sharma P. | Iterative Approach To Implement And Deployment For Smart City And Urbanization | 5G-Enabled Technology for Smart City and Urbanization System (2024) |
| 24003 | 0.881 | MIRZA N.M.; Ali A.; Musa N.S.; Ishak M.K. | Enhancing Task Management In Apache Spark Through Energy-Efficient Data Segregation And Time-Based Scheduling | IEEE Access, 12 (2024) |
| 17684 | 0.88 | Sinaeepourfard A.; Shaik S.; Mesgaribarzi N. | Decentralized, Distributed, And Hybrid Ict Architectures: Hierarchical Multitier Big Data Driven Management For Smart, Sustainable, Scalable And Reliable Cities | 2024 IEEE Conference on Technologies for Sustainability, SusTech 2024 (2024) |
| 4390 | 0.879 | Vítor G.; Rito P.; Sargento S.; Pinto F. | A Scalable Approach For Smart City Data Platform: Support Of Real-Time Processing And Data Sharing | Computer Networks, 213 (2022) |
| 8418 | 0.879 | Chilipirea, C; Petre, AC; Groza, LM; Dobre, C; Pop, F | An Integrated Architecture For Future Studies In Data Processing For Smart Cities | MICROPROCESSORS AND MICROSYSTEMS, 52 (2017) |
| 17398 | 0.879 | Radziszewska A. | Data-Driven Approach In Knowledge-Based Smart City Management | Proceedings of the European Conference on Knowledge Management, ECKM, 2 (2023) |
| 12947 | 0.879 | Badidi E.; El Neyadi N.; Al Saeedi M.; Al Kaabi F.; Maheswaran M. | Building A Data Pipeline For The Management And Processing Of Urban Data Streams | Handbook of Smart Cities: Software Services and Cyber Infrastructure (2018) |
| 12945 | 0.878 | Cheng, B; Longo, S; Cirillo, F; Bauer, M; Kovacs, E | Building A Big Data Platform For Smart Cities: Experience And Lessons From Santander | 2015 IEEE INTERNATIONAL CONGRESS ON BIG DATA - BIGDATA CONGRESS 2015 (2015) |
| 5713 | 0.878 | Bellini P.; Bologna D.; Nesi P.; Pantaleo G. | A Unified Knowledge Model For Managing Smart City/Iot Platform Entities For Multitenant Scenarios | Smart Cities, 7, 5 (2024) |