Smart City Gnosys

Smart city article details

Title Uncovering Concerns Of Citizens Through Machine Learning And Social Network Sentiment Analysis
ID_Doc 59416
Authors Kumi S.; Snow C.; Lomotey R.K.; Deters R.
Year 2024
Published IEEE Access, 12
DOI http://dx.doi.org/10.1109/ACCESS.2024.3426329
Abstract Artificial Intelligence and Machine Learning (AI/ML) as analytical tools can be applied across multiple social domains. Thus, these tools are being deployed in several ways to address societal issues and concerns for 'social good'. For instance, AI/ML has applicable use cases for crisis response, economic empowerment, educational demands, environmental challenges, equality and inclusion, health and hunger, and security and justice. In this work, we seek to explore the power and capability of AI/ML in understanding citizens' engagement, which can improve governance and smart city deployment. Specifically, we studied the views expressed by online users about the city of Saskatoon in Canada. The analyzed views have become a value chain that community leaders can use to improve the governance structure of the city. In the study, we extracted 114,390 comments from Reddit (i.e., Saskatoon subreddit posts) between January 1, 2019, and September 20, 2023, to discover topics to highlight citizens' concerns. We compare the performance of three major topic models, namely, Latent Dirichlet Allocation (LDA), Non-negative Matrix Factorization (NMF), and BERTopic with a K-means clustering algorithm in the discovery of topics from the collected Reddit comments. The BERTopic with the K-means clustering algorithm achieved the highest coherence score of approximately 0.64 in the extraction of 25 topics from the dataset. Our findings showed that BERTopic can discover coherent and diverse topics compared to LDA and NMF. We found 12 underlying themes by merging related topics. Also, we leveraged SiEBERT (a pre-trained transformer model), 4 supervised ML models, and VADER (a lexical sentiment analysis classifier) to identify the sentiments expressed in each theme. The SiEBERT model outperformed the other sentiment classifiers with an accuracy of 89% in the prediction of sentiments. The research discovered factors for smart city engagement such as Housing and Facilities, Education, Downtown Development, Tourism and Entertainment, Policing, Healthcare, Online Community, and Cost. © 2024 The Authors.
Author Keywords citizens engagement; Machine learning; smart city; social media; textual mining


Similar Articles


Id Similarity Authors Title Published
32033 View0.914Kumi S.; Lomotey R.K.; Deters R.Integrating Machine Learning And Social Sensing In Smart City Digital Twin For Citizen FeedbackProceedings - 2023 IEEE International Conference on High Performance Computing and Communications, Data Science and Systems, Smart City and Dependability in Sensor, Cloud and Big Data Systems and Application, HPCC/DSS/SmartCity/DependSys 2023 (2023)
6686 View0.885Mirshafee M.; Barcomb A.; Tan B.Advancing Smart Cities Through Novel Social Media Text Analysis: A Case Study Of Calgary2023 IEEE Symposium Series on Computational Intelligence, SSCI 2023 (2023)
43770 View0.881Zheng Z.; Sieber R.Putting Humans Back In The Loop Of Machine Learning In Canadian Smart CitiesTransactions in GIS, 26, 1 (2022)
9043 View0.878Alkhatib M.; Aleahmad A.; Barachi M.E.; Oroumchian F.; Shaalan K.Analysing The Sentiments Of Opinion Leaders In Relation To Smart Cities' Major Events2019 4th International Conference on Smart and Sustainable Technologies, SpliTech 2019 (2019)
33169 View0.878Zheng Z.; Sieber R.E.Interpreting The Smart City Through Topic ModelingUrban Book Series, Part F270 (2023)
59775 View0.877Davoodian Z.; Mohebi A.Unveiling Sentiment Insights In Smart Cities: Exploring The Role Of Social MediaProceeding of 8th International Conference on Smart Cities, Internet of Things and Applications, SCIoT 2024 (2024)
19185 View0.875Yue A.; Mao C.; Chen L.; Liu Z.; Zhang C.; Li Z.Detecting Changes In Perceptions Towards Smart City On Chinese Social Media: A Text Mining And Sentiment AnalysisBuildings, 12, 8 (2022)
35891 View0.873Hodorog A.; Petri I.; Rezgui Y.Machine Learning And Natural Language Processing Of Social Media Data For Event Detection In Smart CitiesSustainable Cities and Society, 85 (2022)
10490 View0.87Berra Z.; Arezki S.Artificial Intelligence Full Potential Yet Attained In The E-ParticipationLecture Notes in Networks and Systems, 1353 LNNS (2025)
40140 View0.868de Oliveira T.H.M.; Painho M.Open Geospatial Data Contribution Towards Sentiment Analysis Within The Human Dimension Of Smart CitiesLecture Notes in Intelligent Transportation and Infrastructure, Part F1384 (2021)