Smart City Gnosys
Smart city article details
| Title | A Deep Reinforcement Learning Scheme For Spectrum Sensing And Resource Allocation In Its |
|---|---|
| ID_Doc | 1390 |
| Authors | Wei H.; Peng Y.; Yue M.; Long J.; AL-Hazemi F.; Mirza M.M. |
| Year | 2023 |
| Published | Mathematics, 11, 16 |
| DOI | http://dx.doi.org/10.3390/math11163437 |
| Abstract | In recent years, the Internet of Vehicles (IoV) has been found to be of huge potential value in the promotion of the development of intelligent transportation systems (ITSs) and smart cities. However, the traditional scheme in IoV has difficulty in dealing with an uncertain environment, while reinforcement learning has the advantage of being able to deal with an uncertain environment. Spectrum resource allocation in IoV faces the uncertain environment in most cases. Therefore, this paper investigates the spectrum resource allocation problem by deep reinforcement learning after using spectrum sensing technology in the ITS, including the vehicle-to-infrastructure (V2I) link and the vehicle-to-vehicle (V2V) link. The spectrum resource allocation is modeled as a reinforcement learning-based multi-agent problem which is solved by using the soft actor critic (SAC) algorithm. Considered an agent, each V2V link interacts with the vehicle environment and makes a joint action. After that, each agent receives different observations as well as the same reward, and updates networks through the experiences from the memory. Therefore, during a certain time, each V2V link can optimize its spectrum allocation scheme to maximize the V2I capacity as well as increase the V2V payload delivery transmission rate. However, the number of SAC networks increases linearly as the number of V2V links increases, which means that the networks may have a problem in terms of convergence when there are an excessive number of V2V links. Consequently, a new algorithm, namely parameter sharing soft actor critic (PSSAC), is proposed to reduce the complexity for which the model is easier to converge. The simulation results show that both SAC and PSSAC can improve the V2I capacity and increase the V2V payload transmission success probability within a certain time. Specifically, these novel schemes have a 10 percent performance improvement compared with the existing scheme in the vehicular environment. Additionally, PSSAC has a lower complexity. © 2023 by the authors. |
| Author Keywords | deep reinforcement learning; spectrum resource allocation; vehicle to infrastructure; vehicle to vehicle |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
4083  | 0.896 | Hong S.; Kim J.; Kim G.; Cho S. | A Research Trends Of Reinforcement Learning Algorithms For C-V2X Network Resource Allocation | International Conference on Ubiquitous and Future Networks, ICUFN (2024) |
| 43045 | 0.883 | Shakir A.T.; Masini B.M.; Khudhair N.R.; Nordin R.; Amphawan A. | Priority-Aware Multi-Agent Deep Reinforcement Learning For Resource Scheduling In C-V2X Mode 4 Communication | IEEE Access (2025) |
| 34403 | 0.883 | Liu Z.; Han Y.; Fan J.; Zhang L.; Lin Y. | Joint Optimization Of Spectrum And Energy Efficiency Considering The C-V2X Security: A Deep Reinforcement Learning Approach | IEEE International Conference on Industrial Informatics (INDIN), 2020-July (2020) |
| 21411 | 0.872 | Li F.; Sun Z.; Lam K.-Y.; Sun L.; Shen B.; Peng B. | Dynamic Spectrum Optimization For Internet-Of-Vehicles With Deep-Learning-Based Mobility Prediction | Wireless Personal Communications, 137, 1 (2024) |
| 32466 | 0.855 | Wu Y.; Fang X.; Min G.; Chen H.; Luo C. | Intelligent Offloading Balance For Vehicular Edge Computing And Networks | IEEE Transactions on Intelligent Transportation Systems, 26, 5 (2025) |
| 17056 | 0.854 | Zhang X.; Xing H.; Zang W.; Jin Z.; Shen Y. | Cybertwin-Driven Multi-Intelligent Reflecting Surfaces Aided Vehicular Edge Computing Leveraged By Deep Reinforcement Learning | IEEE Vehicular Technology Conference, 2022-September (2022) |
| 11738 | 0.854 | Ye J.; Ge X. | Beam Management Optimization For V2V Communications Based On Deep Reinforcement Learning | Scientific Reports, 13, 1 (2023) |
| 16160 | 0.851 | Sharma S.; Singh B. | Cooperative Reinforcement Learning Based Adaptive Resource Allocation In V2V Communication | 2019 6th International Conference on Signal Processing and Integrated Networks, SPIN 2019 (2019) |
| 21064 | 0.851 | Nguyen H.T.T.; Nguyen M.T.; Do H.T.; Hua H.T.; Nguyen C.V. | Drl-Based Intelligent Resource Allocation For Diverse Qos In 5G And Toward 6G Vehicular Networks: A Comprehensive Survey | Wireless Communications and Mobile Computing, 2021 (2021) |