Smart City Gnosys
Smart city article details
| Title | Vision Transformer Attention With Multi-Reservoir Echo State Network For Anomaly Recognition |
|---|---|
| ID_Doc | 61219 |
| Authors | Ullah W.; Hussain T.; Baik S.W. |
| Year | 2023 |
| Published | Information Processing and Management, 60, 3 |
| DOI | http://dx.doi.org/10.1016/j.ipm.2023.103289 |
| Abstract | Anomalous event recognition requires an instant response to reduce the loss of human life and property; however, existing automated systems show limited performance due to considerations related to the temporal domain of the videos and ignore the significant role of spatial information. Furthermore, although current surveillance systems can detect anomalous events, they require human intervention to recognise their nature and to select appropriate countermeasures, as there are no fully automatic surveillance techniques that can simultaneously detect and interpret anomalous events. Therefore, we present a framework called Vision Transformer Anomaly Recognition (ViT-ARN) that can detect and interpret anomalies in smart city surveillance videos. The framework consists of two stages: the first involves online anomaly detection, for which a customised, lightweight, one-class deep neural network is developed to detect anomalies in a surveillance environment, while in the second stage, the detected anomaly is further classified into the corresponding class. The size of our anomaly detection model is compressed using a filter pruning strategy based on a geometric median, with the aim of easy adaptability for resource-constrained devices. Anomaly classification is based on vision transformer features and is followed by a bottleneck attention mechanism to enhance the representation. The refined features are passed to a multi-reservoir echo state network for a detailed analysis of real-world anomalies such as vandalism and road accidents. A total of 858 and 1600 videos from two datasets are used to train the proposed model, and extensive experiments on the LAD-2000 and UCF-Crime datasets comprising 290 and 400 testing videos reveal that our framework can recognise anomalies more effectively, outperforming other state-of-the-art approaches with increases in accuracy of 10.14% and 3% on the LAD-2000 and UCF-Crime datasets, respectively. © 2023 |
| Author Keywords | Anomaly detection and recognition; Artificial intelligence; Attention mechanism; ESN; Spatio-temporal; Surveillance system; Weakly supervised learning |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
48481  | 0.916 | Ullah W.; Min Ullah F.U.; Ahmad Khan Z.; Wook Baik S. | Sequential Attention Mechanism For Weakly Supervised Video Anomaly Detection | Expert Systems with Applications, 230 (2023) |
| 32356 | 0.91 | Ullah W.; Hussain T.; Khan Z.A.; Haroon U.; Baik S.W. | Intelligent Dual Stream Cnn And Echo State Network For Anomaly Detection | Knowledge-Based Systems, 253 (2022) |
| 3569 | 0.906 | Zhao Y.; Man K.L.; Smith J.; Guan S.-U. | A Novel Two-Stream Structure For Video Anomaly Detection In Smart City Management | Journal of Supercomputing, 78, 3 (2022) |
| 9107 | 0.905 | Raja R.; Sharma P.C.; Mahmood M.R.; Saini D.K. | Analysis Of Anomaly Detection In Surveillance Video: Recent Trends And Future Vision | Multimedia Tools and Applications, 82, 8 (2023) |
| 44339 | 0.9 | Samaila Y.A.; Sebastian P.; Shuaibu A.N.; Azhar Ali S.S.; Muhammad S.A.; Yahya M.S.; Shuaibu I.; Sani I.M. | Real-Time Deep Anomaly Detection: An Overview Of Benchmark Datasets And Performance Metrics | Transportation Research Procedia, 84 (2025) |
| 22251 | 0.897 | Saleem G.; Bajwa U.I.; Raza R.H.; Alqahtani F.H.; Tolba A.; Xia F. | Efficient Anomaly Recognition Using Surveillance Videos | PeerJ Computer Science, 8 (2022) |
| 937 | 0.894 | Nayak R.; Pati U.C.; Das S.K. | A Comprehensive Review On Deep Learning-Based Methods For Video Anomaly Detection | Image and Vision Computing, 106 (2021) |
| 999 | 0.892 | Baala A.; Mostafa H.; Mohssine B. | A Comprehensive Systematic Review Of Deep Learning Techniques For Anomaly Detection In Urban Video Surveillance | 2025 5th International Conference on Innovative Research in Applied Science, Engineering and Technology, IRASET 2025 (2025) |
| 21183 | 0.89 | Patrikar D.; Parate M.; Dhengre N. | Dual-Stage Attention Mechanism For Robust Video Anomaly Detection And Localization | Signal, Image and Video Processing, 19, 9 (2025) |
| 9633 | 0.89 | Bento F.R.O.; Vassallo R.F.; Samatelo J.L.A. | Anomaly Detection On Public Streets Using Spatial Features And A Bidirectional Sequential Classifier | Journal of Control, Automation and Electrical Systems, 33, 1 (2022) |