Smart City Gnosys

Smart city article details

Title Camera-Based Crime Behavior Detection And Classification
ID_Doc 13255
Authors Gao J.; Shi J.; Balla P.; Sheshgiri A.; Zhang B.; Yu H.; Yang Y.
Year 2024
Published Smart Cities, 7, 3
DOI http://dx.doi.org/10.3390/smartcities7030050
Abstract Increasing numbers of public and private locations now have surveillance cameras installed to make those areas more secure. Even though many organizations still hire someone to monitor the cameras, the person hired is more likely to miss some unexpected events in the video feeds because of human error. Several researchers have worked on surveillance data and have presented a number of approaches for automatically detecting aberrant events. To keep track of all the video data that accumulate, a supervisor is often required. To analyze the video data automatically, we recommend using neural networks to identify the crimes happening in the real world. Through our approach, it will be easier for police agencies to discover and assess criminal activity more quickly using our method, which will reduce the burden on their staff. In this paper, we aim to provide anomaly detection using surveillance videos as input specifically for the crimes of arson, burglary, stealing, and vandalism. It will provide an efficient and adaptable crime-detection system if integrated across the smart city infrastructure. In our project, we trained multiple accurate deep learning models for object detection and crime classification for arson, burglary and vandalism. For arson, the videos were trained using YOLOv5. Similarly for burglary and vandalism, we trained using YOLOv7 and YOLOv6, respectively. When the models were compared, YOLOv7 performed better with the highest mAP of 87. In this, we could not compare the model’s performance based on crime type because all the datasets for each crime type varied. So, for arson YOLOv5 performed well with 80% mAP and for vandalism, YOLOv6 performed well with 86% mAP. This paper designed an automatic identification of crime types based on camera or surveillance video in the absence of a monitoring person, and alerts registered users about crimes such as arson, burglary, and vandalism through an SMS service. To detect the object of the crime in the video, we trained five different machine learning models: Improved YOLOv5 for arson, Faster RCNN and YOLOv7 for burglary, and SSD MobileNet and YOLOv6 for vandalism. Other than improved models, we innovated by building ensemble models of all three crime types. The main aim of the project is to provide security to the society without human involvement and make affordable surveillance cameras to detect and classify crimes. In addition, we implemented the Web system design using the built package in Python, which is Gradio. This helps the registered user of the Twilio communication tool to receive alert messages when any suspicious activity happens around their communities. © 2024 by the authors.
Author Keywords arson; burglary; crime; crime classification; deep learning; Gradio; object detection; Twilio; vandalism


Similar Articles


Id Similarity Authors Title Published
44344 View0.876Zingoni A.; Alcalde-Llergo J.M.; Morciano G.; Melloni D.; Yeguas-Bolívar E.; Fantasia N.; Mascia G.; Sperandio M.Real-Time Detection Of Criminal Actions In The Everyday Life, From Camera-Equipped Streetlamps2024 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering, MetroXRAINE 2024 - Proceedings (2024)
9107 View0.862Raja R.; Sharma P.C.; Mahmood M.R.; Saini D.K.Analysis Of Anomaly Detection In Surveillance Video: Recent Trends And Future VisionMultimedia Tools and Applications, 82, 8 (2023)
937 View0.859Nayak R.; Pati U.C.; Das S.K.A Comprehensive Review On Deep Learning-Based Methods For Video Anomaly DetectionImage and Vision Computing, 106 (2021)
61134 View0.859Khan H.; Yuan X.; Qingge L.; Roy K.Violence Detection From Industrial Surveillance Videos Using Deep LearningIEEE Access, 13 (2025)
62125 View0.857Song F.; Li P.Yolov5-Ms: Real-Time Multi-Surveillance Pedestrian Target Detection Model For Smart CitiesBiomimetics, 8, 6 (2023)
950 View0.855Ullah F.U.M.; Obaidat M.S.; Ullah A.; Muhammad K.; Hijji M.; Baik S.W.A Comprehensive Review On Vision-Based Violence Detection In Surveillance VideosACM Computing Surveys, 55, 10 (2023)
8959 View0.852Mumtaz N.; Ejaz N.; Habib S.; Mohsin S.M.; Tiwari P.; Band S.S.; Kumar N.An Overview Of Violence Detection Techniques: Current Challenges And Future DirectionsArtificial Intelligence Review, 56, 5 (2023)
35059 View0.851Sivasubramanian K.; Balasundaram Sathiya Devi V.; Bala Murugan M.S.; Rajagopal M.K.Leveraging Deep Learning For Improving Real Time Stolen Vehicle Tracking In Smart CitiesACM International Conference Proceeding Series (2023)
44339 View0.851Samaila Y.A.; Sebastian P.; Shuaibu A.N.; Azhar Ali S.S.; Muhammad S.A.; Yahya M.S.; Shuaibu I.; Sani I.M.Real-Time Deep Anomaly Detection: An Overview Of Benchmark Datasets And Performance MetricsTransportation Research Procedia, 84 (2025)
974 View0.85Choudhry N.; Abawajy J.; Huda S.; Rao I.A Comprehensive Survey Of Machine Learning Methods For Surveillance Videos Anomaly DetectionIEEE Access, 11 (2023)