Smart City Gnosys
Smart city article details
| Title | Promenade: A Big Data Platform For Handling City Complex Networks With Dynamic Graphs |
|---|---|
| ID_Doc | 43411 |
| Authors | Colarusso C.; De Iasio A.; Furno A.; Goglia L.; Merzoug M.A.; Zimeo E. |
| Year | 2022 |
| Published | Future Generation Computer Systems, 137 |
| DOI | http://dx.doi.org/10.1016/j.future.2022.07.008 |
| Abstract | Continuous data streams, generated by modern sensed cities, open many opportunities and perspectives in terms of developing new innovative services. To exploit this potential, flexible and scalable platforms are needed to ease the design, development, deployment, and operations of new city services. In recent years, several problem-specific platforms have been proposed in different application domains; however, to boost the evolution of smart cities, we claim the need for city-oriented platforms that can be easily customized to address different day-to-day life challenging problems. In this paper, we present the main architectural challenges and solutions proposed for the design of a novel open-source platform (named PROMENADE) characterized by: i) a data-driven graph-based modeling support to ensure high generality for addressing disparate problems related to the networked nature of many city infrastructures and systems, ii) the dynamic nature of the graph entities updated in real-time from different sources (e.g., IoT/Edge networks, data providers, etc.), and iii) high efficiency, scalability and flexibility to easily support new city services. The platform is designed around a general-purpose core that provides a set of built-in standard features such as data ingestion, storage, processing, and visualization exposed as a collection of containerized microservices. A specialization of the platform has been developed for road networks monitoring. It has been deployed in OpenShift/Kubernetes and tested using realistic datasets collected from the city of Lyon, France. The analysis addresses an important problem of big data processing pipelines: the synchronization between data ingestion and processing in order to produce an accurate result in useful time. To this end, we study different approaches for synchronization and show how the end-to-end latency is kept under control by leveraging the scalability of the platform. © 2022 The Author(s) |
| Author Keywords | Big data; Cloud-native technologies; Complex dynamic networks; Container-based microservices; DevOps; Microservices architecture; Smart cities |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
2634  | 0.894 | De Iasio A.; Futno A.; Goglia L.; Zimeo E. | A Microservices Platform For Monitoring And Analysis Of Iot Traffic Data In Smart Cities | Proceedings - 2019 IEEE International Conference on Big Data, Big Data 2019 (2019) |
| 12159 | 0.876 | Gunturi V.M.V.; Shekhar S. | Big Spatio-Temporal Network Data Analytics For Smart Cities: Research Needs | Springer Geography (2017) |
| 36281 | 0.875 | Voloch, N; Voloch-Bloch, N; Zadok, Y | Managing Large Distributed Dynamic Graphs For Smart City Network Applications | APPLIED NETWORK SCIENCE, 4, 1 (2019) |
| 28752 | 0.874 | Pandey S.K.; Khan M.T.; Qiu R.G. | Harnessing Big Data And Analytics Solutions In Support Of Smart City Services | Springer Proceedings in Business and Economics (2019) |
| 4390 | 0.874 | Vítor G.; Rito P.; Sargento S.; Pinto F. | A Scalable Approach For Smart City Data Platform: Support Of Real-Time Processing And Data Sharing | Computer Networks, 213 (2022) |
| 34287 | 0.873 | Gupta M.; Khan M.S.; Mishra S.; Sharma P. | Iterative Approach To Implement And Deployment For Smart City And Urbanization | 5G-Enabled Technology for Smart City and Urbanization System (2024) |
| 27144 | 0.871 | Ali M.; Scandurra P.; Moretti F.; Blaso L.; Leccisi M.; Leccese F. | From Big Data To Smart Data-Centric Software Architectures For City Analytics: The Case Of The Pell Smart City Platform | Proceedings - 2021 IEEE International Conference on Smart Data Services, SMDS 2021 (2021) |
| 5903 | 0.87 | De Camargo Magano F.; Braghetto K.R. | Abstracting Big Data Processing Tools For Smart Cities | Proceedings - 2018 IEEE 37th International Symposium on Reliable Distributed Systems Workshops, SRDSW 2018 (2019) |
| 12015 | 0.87 | Singh Rathore S.P.; Vishnubhai Dalabhai C.; Babubhai Patel C.K.; Sharma R.; Mathur A.; Yadav A. | Big Data Analytics For Smart Cities | Proceedings - IEEE 2024 1st International Conference on Advances in Computing, Communication and Networking, ICAC2N 2024 (2024) |
| 11997 | 0.869 | Bibri S.E. | Big Data Analytics And Context-Aware Computing: Core Enabling Technologies, Techniques, Processes, And Systems | Urban Book Series (2018) |