Smart City Gnosys
Smart city article details
| Title | Machine Learning And Natural Language Processing Of Social Media Data For Event Detection In Smart Cities |
|---|---|
| ID_Doc | 35891 |
| Authors | Hodorog A.; Petri I.; Rezgui Y. |
| Year | 2022 |
| Published | Sustainable Cities and Society, 85 |
| DOI | http://dx.doi.org/10.1016/j.scs.2022.104026 |
| Abstract | Social media data analysis in a smart city context can represent an efficacious instrument to inform decision making. The manuscript strives to leverage the power of Natural Language Processing (NLP) techniques applied to Twitter messages using supervised learning to achieve real-time automated event detection in smart cities. A semantic-based taxonomy of risks is devised to discover and analyse associated events from data streams, with a view to: (i) read and process, in real-time, published texts (ii) classify each text into one representative real-world category (iii) assign a citizen satisfaction value to each event. To select the language processing models striking the best balance between accuracy and processing speed, we conducted a pre-emptive evaluation, comparing several baseline language models formerly employed by researchers for event classification. A heuristic analysis of several smart cities and community initiatives was conducted, with a view to define real-world scenarios as basis for determining correlations between two or more co-occurring event types and their associated levels of citizen satisfaction, while further considering environmental factors. Based on Multiple Regression Analysis (MRA), we established the relationships between scenario variables, obtaining a variance of 60%–90% between the dependent and independent variables. The selected combination of supervised NLP techniques leverages an accuracy of 88.5%. We found that all regression models had at least one variable below the 0.05 threshold of the f−test, therefore at least one statistically significant independent variable. These findings ultimately illustrate how citizens, taking the role of active social sensors, can yield vital data that authorities can use to make educated decisions and sustainably construct smarter cities. © 2022 The Authors |
| Author Keywords | Citizen satisfaction; Event detection; Machine learning; Natural Language Processing; Smart cities; Social media |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
11152  | 0.91 | Park D.-Y.; Ko I.-Y. | Auto-Labeling Of Sensor Data Using Social Media Messages: A Case Study For A Smart City | Proceedings of the ACM Symposium on Applied Computing (2021) |
| 18309 | 0.907 | Tyagi N.; Bhushan B. | Demystifying The Role Of Natural Language Processing (Nlp) In Smart City Applications: Background, Motivation, Recent Advances, And Future Research Directions | Wireless Personal Communications, 130, 2 (2023) |
| 6686 | 0.903 | Mirshafee M.; Barcomb A.; Tan B. | Advancing Smart Cities Through Novel Social Media Text Analysis: A Case Study Of Calgary | 2023 IEEE Symposium Series on Computational Intelligence, SSCI 2023 (2023) |
| 49778 | 0.898 | Alomari E.A.; Mehmood R. | Smart Cities, Smarter Roads: A Review Of Leveraging Cutting-Edge Technologies For Intelligent Event Detection From Social Media | International Journal of Advanced Computer Science and Applications, 14, 11 (2023) |
| 52017 | 0.896 | Doran, D; Severin, K; Gokhale, S; Dagnino, A | Social Media Enabled Human Sensing For Smart Cities | AI COMMUNICATIONS, 29, 1 (2016) |
| 11303 | 0.893 | Suma S.; Mehmood R.; Albeshri A. | Automatic Detection And Validation Of Smart City Events Using Hpc And Apache Spark Platforms | EAI/Springer Innovations in Communication and Computing (2020) |
| 59185 | 0.887 | Costa, DG; Duran-Faundez, C; Andrade, DC; Rocha, JB; Peixoto, JPJ | Twittersensing: An Event-Based Approach For Wireless Sensor Networks Optimization Exploiting Social Media In Smart City Applications | SENSORS, 18, 4 (2018) |
| 3083 | 0.886 | Emek M.S.; Parlak I.B. | A New Method Of Smart City Modeling Using Big Data Techniques | Lecture Notes in Networks and Systems, 759 LNNS (2023) |
| 54514 | 0.884 | Charalampous A.; Papadopoulos A.; Efstathiades C.; Katzis K. | Technical And Social Sensor Aggregation For Smart Environment Enhancement | IEEE AFRICON Conference, 2021-September (2021) |
| 14072 | 0.884 | Dahbi M.; Saadane R.; Mbarki S. | Citizen Sentiment Analysis In Social Media Moroccan Dialect As Case Study | Lecture Notes in Intelligent Transportation and Infrastructure, Part F1409 (2020) |