Smart City Gnosys
Smart city article details
| Title | Road Traffic Event Detection Using Twitter Data, Machine Learning, And Apache Spark |
|---|---|
| ID_Doc | 46754 |
| Authors | Alomari E.; Mehmood R.; Katib I. |
| Year | 2019 |
| Published | Proceedings - 2019 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Internet of People and Smart City Innovation, SmartWorld/UIC/ATC/SCALCOM/IOP/SCI 2019 |
| DOI | http://dx.doi.org/10.1109/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00332 |
| Abstract | Road transportation is the backbone of modern societies, yet it costs annually over a million deaths and trillions of dollars to the global economy. Social media such as Twitter have increasingly become an important source of information in many dimensions of smart societies. Automatic detection of road traffic events using Twitter data mining is one such area of a great many applications and enormous potential, albeit facing major challenges concerning the management and analysis of big data (volume, velocity, variety, and veracity). Various approaches on the subject have been proposed in recent years, but the methods and outcomes are in their infancy. This paper proposes a method for automatic detection of road traffic related events from tweets in the Saudi dialect using machine learning and big data technologies. Firstly, we build and train a classifier using three machine learning algorithms, Naïve Bayes, Support Vector Machine, and logistic regression, to filter tweets into relevant and irrelevant. Subsequently, we train other classifiers to detect multiple types of events including accident, roadwork, road closure, road damage, traffic condition, fire, weather, and social events. The results from the analysis of one million tweets show that our method is able to detect road traffic events, as well as their location and time, automatically, without any prior knowledge of the events. To the best of our knowledge, this is the first work on traffic event detection from Arabic tweets using machine learning and the Apache Spark big data platform. © 2019 IEEE. |
| Author Keywords | Apache Spark; Big data analytics; Event detection; Logistic Regressio; Machine learning; MongoDB; Naïve Bayes; Smart cities; Smart transportation; Support Vector Machine (SVM); Text mining; Twitter data analysis |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
58562  | 0.914 | Xu S.; Li S.; Wen R.; Huang W. | Traffic Event Detection Using Twitter Data Based On Association Rules | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 4, 2/W5 (2019) |
| 49778 | 0.913 | Alomari E.A.; Mehmood R. | Smart Cities, Smarter Roads: A Review Of Leveraging Cutting-Edge Technologies For Intelligent Event Detection From Social Media | International Journal of Advanced Computer Science and Applications, 14, 11 (2023) |
| 27465 | 0.898 | Alkouz B.; Al Aghbari Z. | Fusion Of Multiple Arabic Social Media Streams For Traffic Events Detection | 2022 7th International Conference on Big Data Analytics, ICBDA 2022 (2022) |
| 47341 | 0.874 | Islam M.J.; Talusan J.P.; Bhattacharjee S.; Tiausas F.; Dubey A.; Yasumoto K.; Das S.K. | Scalable Pythagorean Mean-Based Incident Detection In Smart Transportation Systems | ACM Transactions on Cyber-Physical Systems, 8, 2 (2024) |
| 36035 | 0.866 | Bawaneh M.; Simon V. | Machine Learning-Based Anomaly Detection In Smart City Traffic: Performance Comparison And Insights | International Conference on Vehicle Technology and Intelligent Transport Systems, VEHITS - Proceedings (2025) |
| 38279 | 0.861 | Chen Q.; Wang W. | Multi-Modal Neural Network For Traffic Event Detection | 2019 IEEE 2nd International Conference on Electronics and Communication Engineering, ICECE 2019 (2019) |
| 14304 | 0.861 | Teixeira E.B.; De Souza Moura P.N.; Campos C.A.V. | Classification Of Traffic Event Tweets In Portuguese Language Using Deep Learning | 2022 International Wireless Communications and Mobile Computing, IWCMC 2022 (2022) |
| 38280 | 0.86 | AlDhanhani A.; Damiani E.; Mizouni R.; Wang D.; Al-Rubaie A. | Multi-Modal Traffic Event Detection Using Shapelets | Neural Computing and Applications, 35, 2 (2023) |
| 11303 | 0.859 | Suma S.; Mehmood R.; Albeshri A. | Automatic Detection And Validation Of Smart City Events Using Hpc And Apache Spark Platforms | EAI/Springer Innovations in Communication and Computing (2020) |
| 7712 | 0.857 | Gkioka G.; Dominguez M.; Mentzas G. | An Automl-Based Approach For Automatic Traffic Incident Detection In Smart Cities | Intelligent Decision Technologies, 18, 2 (2024) |