Smart City Gnosys

Smart city article details

Title Near-Optimal Vehicular Crowdsensing Task Allocation Empowered By Deep Reinforcement Learning; [基于深度强化学习的智联网汽车感知任务分配]
ID_Doc 38914
Authors Xiang C.-C.; Li Y.-Y.; Feng L.; Chen C.; Guo S.-T.; Yang P.-L.
Year 2022
Published Jisuanji Xuebao/Chinese Journal of Computers, 45, 5
DOI http://dx.doi.org/10.11897/SP.J.1016.2022.00918
Abstract With the rapid development of intelligent vehicular technologies, such as Self-driving systems and Advanced Driver Assistance systems, off-the-shelf intelligent vehicles are equipped with more and more sensors, including GPS, camera, Lidar, etc., thus possessing powerful capabilities of computation and communication along with large-scale storage capacity. As an important kind of the intelligent vehicle, the Mobility-On-Demand(MOD) vehicles (such as Uber, DiDi, and connected taxis) have large-scale, fine-grained coverage in cities along with non-negligible amounts of spare time. Hence, utilizing their available sensors provides promising opportunities in achieving large-scale, fine-grained, and low-cost vehicular crowdsensing for smart cities. As a result, this paper focuses on these MOD vehicles and studies how to optimally allocate the vehicular crowdsensing tasks for the MOD vehicles. It chiefly involves two main challenges: (1)Both the distributions of the MOD vehicles and the sensing tasks have spatial-temporal differences. Also, the pick-up earnings of MOD vehicles vary with the location and time. Hence, it renders the sensing cost highly dynamic in both temporal and spatial dimensions. Even worse, such sensing cost is hard to model because of its highly dynamic nature. (2)The optimal sensing task allocation is a NP-hard problem, which has exponential time complexity. Furthermore, owing to the high mobility of the vehicles, it requires real-time task allocation in vehicular crowdsensing. To address these challenges, we propose a deep reinforcement learning-empowered near-optimal task allocation method for vehicular crowdsensing. We utilize deep reinforcement learning to extract the highly dynamic sensing cost of vehicles, which is fed back to optimally allocate the sensing tasks for each MOD vehicle. Specifically, targeting the first challenge, we deploy the Encoder-Decoder Recurrent Neural Network based on dual attentions (including the spatial attention and the temporal attention) to extract the spatial-temporal correlations of pick-up earnings, which are then used to learn the sensing cost according to the driving cost model. Furthermore, through the equivalent problem transformation, we prove that the task allocation problem has a submodular objective function and a q-dependent constraint. Hence, based on the sub-modularity theory, we propose a near-optimal task allocation algorithm, jointly considering the total utility and marginal utility. It is proved to achieve a 1/ 2+cmax/cmin -approximation ratio in polynomial time, where cmax and cmin represent the maximal and minimal values of the sensing costs for all the vehicles, respectively. Finally, we exploit two large-scale datasets to evaluate the performance of the proposed method. One dataset is about 12493 MOD vehicles in Chongqing City, China, while the other is about 113 million vehicle trips in New York City, America. The results demonstrate that our method averagely improves the prediction accuracy of pick-up earnings and the allocation utility of sensing tasks by 25.1% and 37.7%, respectively, compared with seven baselines. Moreover, we implement a prototype system for on-road illegal parking detection, i.e., leveraging the smartphone sensor (such as camera and GPS) of massive MOD vehicles to detect the on-road illegal parking events when driving on roads. Based on this system, we validate the proposed method is feasible and significant in practical applications. © 2022, Science Press. All right reserved.
Author Keywords Deep reinforcement learning; Recurrent neural network; Sensing task allocation; Sub-modularity; Vehicular crowdsensing


Similar Articles


Id Similarity Authors Title Published
16329 View0.89Huo J.; Wang L.; Wen X.; Gesbert D.; Lu Z.Cost-Efficient Vehicular Crowdsensing Based On Implicit Relation Aware Graph Attention NetworksIEEE Transactions on Industrial Informatics, 20, 3 (2024)
31074 View0.872Xu, SS; Chen, XL; Pi, XD; Joe-Wong, C; Zhang, P; Noh, HYIncentivizing Large-Scale Vehicular Crowdsensing System For Smart City ApplicationsSENSORS AND SMART STRUCTURES TECHNOLOGIES FOR CIVIL, MECHANICAL, AND AEROSPACE SYSTEMS 2019, 10970 (2019)
54441 View0.871Zeng J.; Gou F.; Wu J.Task Offloading Scheme Combining Deep Reinforcement Learning And Convolutional Neural Networks For Vehicle Trajectory Prediction In Smart CitiesComputer Communications, 208 (2023)
32466 View0.87Wu Y.; Fang X.; Min G.; Chen H.; Luo C.Intelligent Offloading Balance For Vehicular Edge Computing And NetworksIEEE Transactions on Intelligent Transportation Systems, 26, 5 (2025)
43045 View0.868Shakir A.T.; Masini B.M.; Khudhair N.R.; Nordin R.; Amphawan A.Priority-Aware Multi-Agent Deep Reinforcement Learning For Resource Scheduling In C-V2X Mode 4 CommunicationIEEE Access (2025)
13345 View0.867Rao B.; Zhang X.; Zhu T.; You Y.; Li Y.; Duan J.; Zhou Z.; Chen X.Can You Do Both? Balancing Order Serving And Crowdsensing For Ride-Hailing VehiclesIEEE International Workshop on Quality of Service, IWQoS (2024)
37265 View0.866Dai Z.; Wang H.; Liu C.H.; Han R.; Tang J.; Wang G.Mobile Crowdsensing For Data Freshness: A Deep Reinforcement Learning ApproachProceedings - IEEE INFOCOM, 2021-May (2021)
54442 View0.861Zhao X.; Liu M.; Li M.Task Offloading Strategy And Scheduling Optimization For Internet Of Vehicles Based On Deep Reinforcement LearningAd Hoc Networks, 147 (2023)
10605 View0.859Chen X.; Xu S.; Fu H.; Joe-Wong C.; Zhang L.; Noh H.Y.; Zhang P.Asc: Actuation System For City-Wide Crowdsensing With Ride-Sharing Vehicular PlatformSCOPE 2019 - Proceedings of the 2019 International Science of Smart City Operations and Platforms Engineering (2019)
2820 View0.856Taha M.B.; Talhi C.; Ould-Slimane H.; Alrabaee S.; Choo K.-K.R.A Multi-Objective Approach Based On Differential Evolution And Deep Learning Algorithms For VanetsIEEE Transactions on Vehicular Technology, 72, 3 (2023)