Smart City Gnosys

Smart city article details

Title Contextual Detection Of Pedestrians And Vehicles In Orthophotography By Fusion Of Deep Learning Algorithms
ID_Doc 15954
Authors Ansarnia M.S.; Tisserand E.; Berviller Y.; Schweitzer P.; Zidane M.A.
Year 2022
Published Sensors, 22, 4
DOI http://dx.doi.org/10.3390/s22041381
Abstract In the context of smart cities, monitoring pedestrian and vehicle movements is essential to recognize abnormal events and prevent accidents. The proposed method in this work focuses on analyzing video streams captured from a vertically installed camera, and performing contextual road user detection. The final detection is based on the fusion of the outputs of three different convolutional neural networks. We are simultaneously interested in detecting road users, their motion, and their location respecting the static environment. We use YOLOv4 for object detection, FC-HarDNet for background semantic segmentation, and FlowNet 2.0 for motion detection. FC-HarDNet and YOLOv4 were retrained with our orthophotographs dataset. The last step involves a data fusion module. The presented results show that the method allows one to detect road users, identify the surfaces on which they move, quantify their apparent velocity, and estimate their actual velocity. © 2022 by the authors. Licensee MDPI, Basel, Switzerland.
Author Keywords Deep learning; FC-HarDNet; FlowNet 2.0; Optical flow; Orthophotography; Semantic segmentation; YOLO


Similar Articles


Id Similarity Authors Title Published
45511 View0.872Zhao R.; Hao J.; Huo H.Research On Multi-Modal Pedestrian Detection And Tracking Algorithm Based On Deep LearningFuture Internet, 16, 6 (2024)
23647 View0.869Bhonde T.; Temare H.; Dadwhal Y.S.Enhanced Object Detection Using Yolov8: Identifying Vehicles And Pedestrians In Urban Environments2024 IEEE Pune Section International Conference, PuneCon 2024 (2024)
62125 View0.862Song F.; Li P.Yolov5-Ms: Real-Time Multi-Surveillance Pedestrian Target Detection Model For Smart CitiesBiomimetics, 8, 6 (2023)
39607 View0.858Du L.Object Detectors In Autonomous Vehicles: Analysis Of Deep Learning TechniquesInternational Journal of Advanced Computer Science and Applications, 14, 10 (2023)
41546 View0.858Kim D.H.; Moon J.Pedrisknet: Classifying Pedestrian Situations In Surveillance Videos For Pedestrian Safety Monitoring In Smart CitiesProceedings - IEEE International Conference on Advanced Video and Signal-Based Surveillance, AVSS, 2024 (2024)
154 View0.857Lima J.P.; Roberto R.; Figueiredo L.; Simões F.; Thomas D.; Uchiyama H.; Teichrieb V.3D Pedestrian Localization Using Multiple Cameras: A Generalizable ApproachMachine Vision and Applications, 33, 4 (2022)
43782 View0.851Tahir N.U.A.; Long Z.; Zhang Z.; Asim M.; ELAffendi M.Pvswin-Yolov8S: Uav-Based Pedestrian And Vehicle Detection For Traffic Management In Smart Cities Using Improved Yolov8Drones, 8, 3 (2024)