Smart City Gnosys

Smart city article details

Title	Training Environmental Sound Classification Models For Real-World Deployment In Edge Devices
ID_Doc	58701
Authors	Goulão M.; Bandeira L.; Martins B.; L. Oliveira A.
Year	2024
Published	Discover Applied Sciences, 6, 4
DOI	http://dx.doi.org/10.1007/s42452-024-05803-7
Abstract	The interest in smart city technologies has grown in recent years, and a major challenge is to develop methods that can extract useful information from data collected by sensors in the city. One possible scenario is the use of sound sensors to detect passing vehicles, sirens, and other sounds on the streets. However, classifying sounds in a street environment is a complex task due to various factors that can affect sound quality, such as weather, traffic volume, and microphone quality. This paper presents a deep learning model for multi-label sound classification that can be deployed in the real world on edge devices. We describe two key components, namely data collection and preparation, and the methodology to train the model including a pre-train using knowledge distillation. We benchmark our models on the ESC-50 dataset and show an accuracy of 85.4%, comparable to similar state-of-the-art models requiring significantly more computational resources. We also evaluated the model using data collected in the real world by early prototypes of luminaires integrating edge devices, with results showing that the approach works well for most vehicles but has significant limitations for the classes “person” and “bicycle”. Given the difference between the benchmarking and the real-world results, we claim that the quality and quantity of public and private data for this type of task is the main limitation. Finally, all results show great benefits in pretraining the model using knowledge distillation. © The Author(s) 2024.
Author Keywords	Deep convolutional neural network; Edge devices; Environmental sound classification; Smart cities

Similar Articles

Id	Similarity	Authors	Title	Published
52318	0.919	Nogueira A.F.R.; Oliveira H.S.; Machado J.J.M.; Tavares J.M.R.S.	Sound Classification And Processing Of Urban Environments: A Systematic Literature Review	Sensors, 22, 22 (2022)
24672	0.904	Lamrini M.; Chkouri M.Y.; Touhafi A.	Evaluating The Performance Of Pre-Trained Convolutional Neural Network For Audio Classification On Embedded Systems For Anomaly Detection In Smart Cities	Sensors, 23, 13 (2023)
60187	0.897	Lakshmi R.; Chaitra N.C.; Thejaswini R.; Swapna H.; Parameshachari B.D.; Kumar S.D.S.; Puttegowda K.	Urban Sound Classification With Convolutional Neural Network	2nd IEEE International Conference on Integrated Intelligence and Communication Systems, ICIICS 2024 (2024)
14305	0.893	Agarwal M.; Gill K.S.; Chattopadhyay S.; Singh M.	Classification Of Urban Sound Using Sequential Convolutional Neural Network (Cnn) Model And Its Visualisation	2024 IEEE International Conference on Information Technology, Electronics and Intelligent Communication Systems, ICITEICS 2024 (2024)
60186	0.89	Agarwal M.; Gill K.S.; Aggarwal P.; Rawat R.S.; Sunil G.	Urban Sound Classification Using Vgg19 Convolutional Neural Network (Cnn) Model And Its Visualisation	4th International Conference on Innovative Practices in Technology and Management 2024, ICIPTM 2024 (2024)
14555	0.885	Seker H.; Inik O.	Cnnsound: Convolutional Neural Networks For The Classification Of Environmental Sounds	ACM International Conference Proceeding Series (2020)
24258	0.883	Cui Q.; Zhao K.; Wang L.; Gao K.; Cao F.; Wang X.	Environmental Sound Classification Based On Knowledge Distillation	International Conference on Signal Processing Proceedings, ICSP, 2022-October (2022)
58279	0.883	Vijay M.; Ruthwik Saran K.; Reddy K.R.; Aditya Ram K.; Babu J.Y.	Towards Robust Environmental Sound Classification: A Deep Learning Approach Leveraging Time-Frequency Representations	2nd International Conference on Emerging Research in Computational Science, ICERCS 2024 (2024)
52316	0.882	Bello J.P.; Mydlarz C.; Salamon J.	Sound Analysis In Smart Cities	Computational Analysis of Sound Scenes and Events (2017)
48795	0.881	Liu Z.; Yeh W.-C.	Simplified Swarm Optimisation For Cnn Hyperparameters: A Sound Classification Approach	International Journal of Web and Grid Services, 20, 1 (2024)