Smart City Gnosys
Smart city article details
| Title | Analyzing Events For Traffic Prediction On Iot Data Streams In A Smart City Scenario |
|---|---|
| ID_Doc | 9497 |
| Authors | Hota C.; Mishra S. |
| Year | 2021 |
| Published | Handbook of Big Data Analytics: Applications in ICT, security and business analytics |
| DOI | http://dx.doi.org/10.1049/PBPC037G_ch7 |
| Abstract | We propose a framework for complex event processing (CEP) coupled with predictive analytics to predict simple events and complex events on Internet of Things (IoT) data streams. The data is consumed through a REST service containing the traffic data of around 2, 000 locations in the city of Madrid, Spain. This prediction of complex events will help users in understanding the future state of road traffic and hence take meaningful decisions. For predicting events, we propose a framework that uses WSO2 Siddhi as CEP, along with InfluxDB as persistent storage. The data is consumed in the CEP with the help of a high-speed Apache Kafka messaging pipeline. This data is used to build predictive models inside the CEP that helps users to derive meaningful insights. However, in these event analytics engines, the events are created via rules that are triggered when the streaming data exceeds a certain threshold. The calculation of the “threshold” is utmost necessary as it acts as the means for the generation of simple events and complex events in an event analytics scenario. We have proposed a novel 2-fold approach for finding out the thresholds in such large datasets. We have taken the help of unsupervised learning to get the idea of thresholds. The first phase uses Node-RED and serverless computing to create the thresholds and then supply them back to the CEP for prediction. The machine learning models run on a cloud service, and the predictions or thresholds are returned back through REST services into the CEP. In the second phase, it not only creates the thresholds but also uses novel hypothesis testing techniques along with windowing mechanism on data streams to implement clustering and supply the result back into the CEP. This approach leverages on the usage of statistical techniques to understand the change in distribution of data. The changes in the data distributions trigger the retraining of the machine learning models, and the results are given back into the CEP for being used in an event generation scenario. We have also included a section in which we have incorporated a statistical analysis on the dataset used. © The Institution of Engineering and Technology 2021. |
| Author Keywords | Cloud computing; Cloud service; Clustering; Complex event processing; Data analysis; Data distributions; Data handling techniques; Event analytics engines; High-speed apache kafka messaging pipeline; Hypothesis testing techniques; Influxdb; Information networks; Internet of things; Internet of things data streams; Internet software; Iot data streams; Madrid; Node-red; Persistent storage; Predictive analytics; Rest service; Road traffic; Road traffic; Serverless computing; Smart cities; Smart city; Spain; Statistical techniques; Traffic engineering computing; Traffic engineering computing; Traffic prediction; Ubiquitous and pervasive computing; Unsupervised learning; Unsupervised learning; Windowing mechanism; Wso2 siddhi |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
27976  | 0.889 | Khazael B.; Vahidi Asl M.; Tabatabaee Malazi H. | Geospatial Complex Event Processing In Smart City Applications | Simulation Modelling Practice and Theory, 122 (2023) |
| 37274 | 0.877 | Starks F.; Goebel V.; Kristiansen S.; Plagemann T. | Mobile Distributed Complex Event Processing—Ubi Sumus? Quo Vadimus? | Lecture Notes on Data Engineering and Communications Technologies, 10 (2018) |
| 4104 | 0.873 | Mishra S.; Hota C. | A Rest Framework On Iot Streams Using Apache Spark For Smart Cities | 2019 IEEE 16th India Council International Conference, INDICON 2019 - Symposium Proceedings (2019) |
| 53190 | 0.869 | Srividhya V.R.; Kayarvizhy | Streamlined Traffic Prognosis Using Flexible Reservoir Sampling And Regression Methods | Engineering, Technology and Applied Science Research, 15, 2 (2025) |
| 42871 | 0.861 | Bhutani M.; Gulzar Y.; Reegu F.A.; Ayoub S. | Predictive Analytics For Smart City Infrastructure: Leveraging Iot And Machine Learning For Real-Time Decision-Making | Lecture Notes in Networks and Systems, 1294 LNNS (2025) |
| 15242 | 0.859 | Krishna M.H.; Manjunatha; Kumar R.; Singh N.; Kumar A.; Ftaiet A.A. | Complex Event Processing In Web Streams With Ontology-Based Abstraction Layers For Smart City Frameworks | TQCEBT 2024 - 2nd IEEE International Conference on Trends in Quantum Computing and Emerging Business Technologies 2024 (2024) |
| 3298 | 0.854 | Hiray S.R.; Ravi B. | A Novel Data Analysis Architectural Framework For Data Reduction On Edges For Smart City Healthcare | Panamerican Mathematical Journal, 33, 3 (2023) |
| 26761 | 0.853 | Okay F.Y.; Kok I.; Guzel M.; Ozdemir S. | Fog Computing-Based Complex Event Processing For Internet Of Things | Big Data-Enabled Internet of Things (2020) |
| 30379 | 0.852 | Lakshmi D.; Jeyarani J.; Suguna R.; Muneeshwari P.; Valantina G.M.; Jayaraman S. | Impact Of Iot Data Integration On Real-Time Analytics For Smart City Management | Proceedings of the 2024 10th International Conference on Communication and Signal Processing, ICCSP 2024 (2024) |