Smart City Gnosys
Smart city article details
| Title | 3D Pedestrian Localization Using Multiple Cameras: A Generalizable Approach |
|---|---|
| ID_Doc | 154 |
| Authors | Lima J.P.; Roberto R.; Figueiredo L.; Simões F.; Thomas D.; Uchiyama H.; Teichrieb V. |
| Year | 2022 |
| Published | Machine Vision and Applications, 33, 4 |
| DOI | http://dx.doi.org/10.1007/s00138-022-01323-9 |
| Abstract | Pedestrian detection is a critical problem in many areas, such as smart cities, surveillance, monitoring, autonomous driving, and robotics. AI-based methods have made tremendous progress in the field in the last few years, but good performance is limited to data that match the training datasets. We present a multi-camera 3D pedestrian detection method that does not need to be trained using data from the target scene. The core idea of our approach consists in formulating consistency in multiple views as a graph clique cover problem. We estimate pedestrian ground location on the image plane using a novel method based on human body poses and person’s bounding boxes from an off-the-shelf monocular detector. We then project these locations onto the ground plane and fuse them with a new formulation of a clique cover problem from graph theory. We propose a new vertex ordering strategy to define fusion priority based on both detection distance and vertex degree. We also propose an optional step for exploiting pedestrian appearance during fusion by using a domain-generalizable person re-identification model. Finally, we compute the final 3D ground coordinates of each detected pedestrian with a method based on keypoint triangulation. We evaluated the proposed approach on the challenging WILDTRACK and MultiviewX datasets. Our proposed method significantly outperformed state of the art in terms of generalizability. It obtained a MODA that was approximately 15% and 2% better than the best existing generalizable detection technique on WILDTRACK and MultiviewX, respectively. © 2022, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature. |
| Author Keywords | 3D location; Generalizable; Multi-camera; Pedestrian detection |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
34758  | 0.867 | Wang Y.; Zhang L.; Wang X.; Ding K.; Yan J. | Large-Scale Multi-Camera Person Trajectory Tracking Based On Low Sampling Rate Of Camera | Proceedings of the International Conference on Big Data Computing and Communications, BIGCOM, 2024 (2024) |
| 15954 | 0.857 | Ansarnia M.S.; Tisserand E.; Berviller Y.; Schweitzer P.; Zidane M.A. | Contextual Detection Of Pedestrians And Vehicles In Orthophotography By Fusion Of Deep Learning Algorithms | Sensors, 22, 4 (2022) |
| 62125 | 0.854 | Song F.; Li P. | Yolov5-Ms: Real-Time Multi-Surveillance Pedestrian Target Detection Model For Smart Cities | Biomimetics, 8, 6 (2023) |
| 45511 | 0.854 | Zhao R.; Hao J.; Huo H. | Research On Multi-Modal Pedestrian Detection And Tracking Algorithm Based On Deep Learning | Future Internet, 16, 6 (2024) |
| 58500 | 0.851 | Elias P.; Macko M.; Sedmidubsky J.; Zezula P. | Tracking Subjects And Detecting Relationships In Crowded City Videos | Multimedia Tools and Applications, 83, 5 (2024) |
| 61124 | 0.85 | Liu H.; Lu H.; Data K.; Gruteser M. | Vifi-Loc: Multi-Modal Pedestrian Localization Using Gan With Camera-Phone Correspondences | ACM International Conference Proceeding Series (2023) |