Smart City Gnosys
Smart city article details
| Title | Real-Time Acoustic Detection Of Critical Incidents In Smart Cities Using Artificial Intelligence And Edge Networks |
|---|---|
| ID_Doc | 44289 |
| Authors | Saradopoulos I.; Potamitis I.; Ntalampiras S.; Rigakis I.; Manifavas C.; Konstantaras A. |
| Year | 2025 |
| Published | Sensors, 25, 8 |
| DOI | http://dx.doi.org/10.3390/s25082597 |
| Abstract | We present a system that integrates diverse technologies to achieve real-time, distributed audio surveillance. The system employs a network of microphones mounted on ESP32 platforms, which transmit compressed audio chunks via an MQTT protocol to Raspberry Pi5 devices for acoustic classification. These devices host an audio transformer model trained on the AudioSet dataset, enabling the real-time classification and timestamping of audio events with high accuracy. The output of the transformer is kept in a database of events and is subsequently converted into JSON format. The latter is further parsed into a graph structure that encapsulates the annotated soundscape, providing a rich and dynamic representation of audio environments. These graphs are subsequently traversed and analyzed using dedicated Python code and large language models (LLMs), enabling the system to answer complex queries about the nature, relationships, and context of detected audio events. We introduce a novel graph parsing method that achieves low false-alarm rates. In the task of analyzing the audio from a 1 h and 40 min long movie featuring hazardous driving practices, our approach achieved an accuracy of 0.882, precision of 0.8, recall of 1.0, and an F1 score of 0.89. By combining the robustness of distributed sensing and the precision of transformer-based audio classification, our approach that treats audio as text paves the way for advanced applications in acoustic surveillance, environmental monitoring, and beyond. © 2025 by the authors. |
| Author Keywords | acoustic surveillance; AudioSet; edge computing; IoT; transformers |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
52316  | 0.902 | Bello J.P.; Mydlarz C.; Salamon J. | Sound Analysis In Smart Cities | Computational Analysis of Sound Scenes and Events (2017) |
| 52319 | 0.897 | Sammarco M.; Stellantis T.Z.; Gantert L.; Campista M.E.M. | Sound Event Detection Via Pervasive Devices For Mobility Surveillance In Smart Cities | 2024 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2024 (2024) |
| 8076 | 0.881 | Mukhamadiyev A.; Khujayarov I.; Nabieva D.; Cho J. | An Ensemble Of Convolutional Neural Networks For Sound Event Detection | Mathematics, 13, 9 (2025) |
| 7009 | 0.878 | Errico D.; Re M.; Colombo V.; Cardarilli G.C.; Martina M.; Roch M.R. | Ai-Based Sound Event Detection On Iot Nodes: Requirements Evaluation | Lecture Notes in Electrical Engineering, 1036 LNEE (2023) |
| 3614 | 0.871 | Mohmmad S.; Sanampudi S.K. | A Parametric Survey On Polyphonic Sound Event Detection And Localization | Multimedia Tools and Applications, 84, 20 (2025) |
| 6985 | 0.871 | Holub J.; Svatos J. | Ai-Based Acoustic Surveillance System For Smart Cities | 8th IEEE International Forum on Research and Technologies for Society and Industry Innovation, RTSI 2024 - Proceeding (2024) |
| 47334 | 0.87 | Paissan F.; Ancilotto A.; Brutti A.; Farella E. | Scalable Neural Architectures For End-To-End Environmental Sound Classification | ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2022-May (2022) |
| 40858 | 0.869 | Brutti A.; Paissan F.; Ancilotto A.; Farella E. | Optimizing Phinet Architectures For The Detection Of Urban Sounds On Low-End Devices | European Signal Processing Conference, 2022-August (2022) |
| 60187 | 0.868 | Lakshmi R.; Chaitra N.C.; Thejaswini R.; Swapna H.; Parameshachari B.D.; Kumar S.D.S.; Puttegowda K. | Urban Sound Classification With Convolutional Neural Network | 2nd IEEE International Conference on Integrated Intelligence and Communication Systems, ICIICS 2024 (2024) |
| 52318 | 0.868 | Nogueira A.F.R.; Oliveira H.S.; Machado J.J.M.; Tavares J.M.R.S. | Sound Classification And Processing Of Urban Environments: A Systematic Literature Review | Sensors, 22, 22 (2022) |