Smart City Gnosys
Smart city article details
| Title | A Novel Unsupervised Video Anomaly Detection Framework Based On Optical Flow Reconstruction And Erased Frame Prediction |
|---|---|
| ID_Doc | 3576 |
| Authors | Huang H.; Zhao B.; Gao F.; Chen P.; Wang J.; Hussain A. |
| Year | 2023 |
| Published | Sensors, 23, 10 |
| DOI | http://dx.doi.org/10.3390/s23104828 |
| Abstract | Reconstruction-based and prediction-based approaches are widely used for video anomaly detection (VAD) in smart city surveillance applications. However, neither of these approaches can effectively utilize the rich contextual information that exists in videos, which makes it difficult to accurately perceive anomalous activities. In this paper, we exploit the idea of a training model based on the “Cloze Test” strategy in natural language processing (NLP) and introduce a novel unsupervised learning framework to encode both motion and appearance information at an object level. Specifically, to store the normal modes of video activity reconstructions, we first design an optical stream memory network with skip connections. Secondly, we build a space–time cube (STC) for use as the basic processing unit of the model and erase a patch in the STC to form the frame to be reconstructed. This enables a so-called ”incomplete event (IE)” to be completed. On this basis, a conditional autoencoder is utilized to capture the high correspondence between optical flow and STC. The model predicts erased patches in IEs based on the context of the front and back frames. Finally, we employ a generating adversarial network (GAN)-based training method to improve the performance of VAD. By distinguishing the predicted erased optical flow and erased video frame, the anomaly detection results are shown to be more reliable with our proposed method which can help reconstruct the original video in IE. Comparative experiments conducted on the benchmark UCSD Ped2, CUHK Avenue, and ShanghaiTech datasets demonstrate AUROC scores reaching 97.7%, 89.7%, and 75.8%, respectively. © 2023 by the authors. |
| Author Keywords | incomplete event; optical flow; video anomaly detection |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
3569  | 0.884 | Zhao Y.; Man K.L.; Smith J.; Guan S.-U. | A Novel Two-Stream Structure For Video Anomaly Detection In Smart City Management | Journal of Supercomputing, 78, 3 (2022) |
| 6735 | 0.869 | Song X.; Liu P.; Li S.; Xu S.; Wang K. | Adversarial Erasure Network Based On Multi-Instance Learning For Weakly Supervised Video Anomaly Detection | Neurocomputing, 636 (2025) |
| 48481 | 0.865 | Ullah W.; Min Ullah F.U.; Ahmad Khan Z.; Wook Baik S. | Sequential Attention Mechanism For Weakly Supervised Video Anomaly Detection | Expert Systems with Applications, 230 (2023) |
| 38655 | 0.864 | Li B.; Ge H.; Liu Y.; Tang G. | Multiscale Recovery Diffusion Model With Unsupervised Learning For Video Anomaly Detection System | IEEE Transactions on Industrial Informatics, 21, 3 (2025) |
| 61219 | 0.86 | Ullah W.; Hussain T.; Baik S.W. | Vision Transformer Attention With Multi-Reservoir Echo State Network For Anomaly Recognition | Information Processing and Management, 60, 3 (2023) |
| 937 | 0.858 | Nayak R.; Pati U.C.; Das S.K. | A Comprehensive Review On Deep Learning-Based Methods For Video Anomaly Detection | Image and Vision Computing, 106 (2021) |
| 39047 | 0.858 | Liu J.; Liu Y.; Lin J.; Li J.; Cao L.; Sun P.; Hu B.; Song L.; Boukerche A.; Leung V.C.M. | Networking Systems For Video Anomaly Detection: A Tutorial And Survey | ACM Computing Surveys, 57, 10 (2025) |
| 4575 | 0.857 | Khaire P.; Kumar P. | A Semi-Supervised Deep Learning Based Video Anomaly Detection Framework Using Rgb-D For Surveillance Of Real-World Critical Environments | Forensic Science International: Digital Investigation, 40 (2022) |
| 999 | 0.855 | Baala A.; Mostafa H.; Mohssine B. | A Comprehensive Systematic Review Of Deep Learning Techniques For Anomaly Detection In Urban Video Surveillance | 2025 5th International Conference on Innovative Research in Applied Science, Engineering and Technology, IRASET 2025 (2025) |
| 29734 | 0.855 | Khanam M.H.; Roopa R. | Hybrid Deep Learning Models For Anomaly Detection In Cctv Video Surveillance | 4th International Conference on Sentiment Analysis and Deep Learning, ICSADL 2025 - Proceedings (2025) |