Smart City Gnosys

Smart city article details

Title	Streetaware: A High-Resolution Synchronized Multimodal Urban Scene Dataset
ID_Doc	53206
Authors	Piadyk Y.; Rulff J.; Brewer E.; Hosseini M.; Ozbay K.; Sankaradas M.; Chakradhar S.; Silva C.
Year	2023
Published	Sensors, 23, 7
DOI	http://dx.doi.org/10.3390/s23073710
Abstract	Access to high-quality data is an important barrier in the digital analysis of urban settings, including applications within computer vision and urban design. Diverse forms of data collected from sensors in areas of high activity in the urban environment, particularly at street intersections, are valuable resources for researchers interpreting the dynamics between vehicles, pedestrians, and the built environment. In this paper, we present a high-resolution audio, video, and LiDAR dataset of three urban intersections in Brooklyn, New York, totaling almost 8 unique hours. The data were collected with custom Reconfigurable Environmental Intelligence Platform (REIP) sensors that were designed with the ability to accurately synchronize multiple video and audio inputs. The resulting data are novel in that they are inclusively multimodal, multi-angular, high-resolution, and synchronized. We demonstrate four ways the data could be utilized — (1) to discover and locate occluded objects using multiple sensors and modalities, (2) to associate audio events with their respective visual representations using both video and audio modes, (3) to track the amount of each type of object in a scene over time, and (4) to measure pedestrian speed using multiple synchronized camera views. In addition to these use cases, our data are available for other researchers to carry out analyses related to applying machine learning to understanding the urban environment (in which existing datasets may be inadequate), such as pedestrian-vehicle interaction modeling and pedestrian attribute recognition. Such analyses can help inform decisions made in the context of urban sensing and smart cities, including accessibility-aware urban design and Vision Zero initiatives. © 2023 by the authors.
Author Keywords	computer vision; data synchronization; street-level imagery; urban intelligence; urban multimedia data; urban sensing

Similar Articles

Id	Similarity	Authors	Title	Published
38291	0.888	Patil K.; Gatagat D.; Rumane O.; Pashankar S.; chumchu P.	Multi-Object Urban Dataset: A Resource For Detecting Pedestrians, Traffic And Motorbikes	Data in Brief, 57 (2024)
35150	0.878	Li T.; Cullom J.; Stern R.	Leveraging Video Data To Better Understand Driver-Pedestrian Interactions In A Smart City Environment	DICPS 2021 - Proceedings of the ACM 1st Workshop on Data-Driven and Intelligent Cyber-Physical Systems, Part of CPS-IoT Week 2021 (2021)
50553	0.871	Duan Z.; Yang Z.; Samoilenko R.; Oza D.S.; Jagadeesan A.; Sun M.; Ye H.; Xiong Z.; Zussman G.; Kostic Z.	Smart City Traffic Intersection: Impact Of Video Quality And Scene Complexity On Precision And Inference	2021 IEEE 23rd International Conference on High Performance Computing and Communications, 7th International Conference on Data Science and Systems, 19th International Conference on Smart City and 7th International Conference on Dependability in Sensor, Cloud and Big Data Systems and Applications, HPCC-DSS-SmartCity-DependSys 2021 (2022)
40178	0.87	Blaser S.; Meyer J.; Nebiker S.	Open Urban And Forest Datasets From A High-Performance Mobile Mapping Backpack - A Contribution For Advancing The Creation Of Digital City Twins	International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 43, B1-2021 (2021)
61285	0.862	Wu M.; Jia Q.; Yang A.; Zhong Z.; Ma M.; Chen L.; Jing N.	Visual Route Recognition In Urban Spaces: A Scalable Approach Using Open Street View Data	IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 18 (2025)
44405	0.86	Ghasemi M.; Kleisarchaki S.; Calmant T.; Lu J.; Ojha S.; Kostic Z.; Gurgen L.; Zussman G.; Ghaderi J.	Real-Time Multi-Camera Analytics For Traffic Information Extraction And Visualization	2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2023 (2023)
60171	0.859	Pargoo N.S.; Ghasemi M.; Xia S.; Turkcan M.K.; Ehsan T.; Zang C.; Sun Y.; Ghaderi J.; Zussman G.; Kostic Z.; Ortiz J.	Urban Sensing For Human-Centered Systems: A Modular Edge Framework For Real-Time Interaction	HumanSys 2025 - Proceedings of the 2025 3rd International Workshop on Human-Centered Sensing, Modeling, and Intelligent Systems, 2025 Cyber-Physical Systems and Internet-of-Things Week, CPS-IoT Week 2025 Workshops (2025)
16287	0.857	Yang S.; Bailey E.; Yang Z.; Ostrometzky J.; Zussman G.; Seskar I.; Kostic Z.	Cosmos Smart Intersection: Edge Compute And Communications For Bird'S Eye Object Tracking	2020 IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2020 (2020)
54231	0.856	Herzog F.; Chen J.; Teepe T.; Gilg J.; Hormann S.; Rigoll G.	Synthehicle: Multi-Vehicle Multi-Camera Tracking In Virtual Cities	Proceedings - 2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops, WACVW 2023 (2023)
24680	0.856	Guo X.; Hu Y.; Zhang Y.; Yi S.; Tu W.	Evaluating The Quality Of High-Frequency Pedestrian Commuting Streets: A Data-Driven Approach In Shenzhen	Smart Cities, 8, 3 (2025)