Smart City Gnosys

Smart city article details

Title	Securing Uav-To-Vehicle Communications: A Curiosity-Driven Deep Q-Learning Network (C-Dqn) Approach
ID_Doc	47814
Authors	Fu F.; Jiao Q.; Yu F.R.; Zhang Z.; Du J.
Year	2021
Published	2021 IEEE International Conference on Communications Workshops, ICC Workshops 2021 - Proceedings
DOI	http://dx.doi.org/10.1109/ICCWorkshops50388.2021.9473714
Abstract	Unmanned aerial vehicle (UAV) will open up new application fields in smart city-based intelligent transportation systems (ITSs), e.g., traffic management, disaster rescue, police patrol, etc. However, the broadcast and line-of-sight nature of air-to-ground wireless channels give rise to a new challenge to the information security of UAV-to-vehicle (U2V) communications. This paper considers U2V communications subject to multi-eavesdroppers on the ground in urban scenarios. We aim to maximize the secrecy rates in physical layer security perspective while considering both the energy consumption and flight zone limitation, by jointly optimizing the UAV's trajectory, the transmit power of the UAV, and the jamming power sent by the roadside unit (RSU). This joint optimization problem is modeled as a Markov decision process (MDP), considering time-varying characteristics of the wireless channels. A curiosity-driven deep reinforcement learning (DRL) algorithm is subsequently utilized to solve the above MDP, in which the agent is reinforced by an extrinsic reward supplied by the environment and an intrinsic reward defined as the prediction error of the consequence after executing its actions. Extensive simulation results show that compared to the DRL without intrinsic rewards, the proposed scheme can have excellent performance in terms of the average reward, learning efficiency, and generalization to other scenarios. © 2021 IEEE.
Author Keywords	curiosity-driven DQN; physical layer security; resource allocation; trajectory design; UAV

Similar Articles

Id	Similarity	Authors	Title	Published
59291	0.889	Liu S.; Sun G.; Teng S.; Li J.; Zhang C.; Wang J.; Du H.; Liu Y.	Uav-Enabled Collaborative Secure Data Transmission Via Hybrid-Action Multi-Agent Deep Reinforcement Learning	Proceedings - IEEE Global Communications Conference, GLOBECOM (2024)
18022	0.866	Chen L.; Liu K.; Yang P.; Xiong Z.; An P.; Quek T.Q.S.; Zhang Z.	Deep Point Reinforcement Learning Approach For Sustainable Communications By Uav And Moving Interaction Station	IEEE Transactions on Vehicular Technology (2025)
16152	0.86	Kim J.; Park S.; Jung S.; Cordeiro C.	Cooperative Multi-Uav Positioning For Aerial Internet Service Management: A Multi-Agent Deep Reinforcement Learning Approach	IEEE Transactions on Network and Service Management, 21, 4 (2024)
58717	0.857	Tao X.; Hafid A.S.	Trajectory Design In Uav-Aided Mobile Crowdsensing: A Deep Reinforcement Learning Approach	IEEE International Conference on Communications (2021)
1129	0.856	Liu X.; Wang Y.; Gao H.; Ngai E.C.H.; Zhang B.; Wang C.; Wang W.	A Coverage-Aware Task Allocation Method For Uav-Assisted Mobile Crowd Sensing	IEEE Transactions on Vehicular Technology, 73, 7 (2024)
5700	0.856	Oubbati O.S.; Alotaibi J.; Alromithy F.; Atiquzzaman M.; Altimania M.R.	A Uav-Ugv Cooperative System: Patrolling And Energy Management For Urban Monitoring	IEEE Transactions on Vehicular Technology (2025)
1087	0.854	Parvaresh N.; Kantarci B.	A Continuous Actor-Critic Deep Q-Learning-Enabled Deployment Of Uav Base Stations: Toward 6G Small Cells In The Skies Of Smart Cities	IEEE Open Journal of the Communications Society, 4 (2023)
44892	0.853	Ul Abideen Tariq Z.; Baccour E.; Erbad A.; Hamdi M.	Reinforcement Learning-Based Anti-Jamming Solution For Aerial Ris-Aided Dense Dynamic Multi-User Environments	20th International Wireless Communications and Mobile Computing Conference, IWCMC 2024 (2024)
2337	0.853	Xi M.; Dai H.; He J.; Li W.; Wen J.; Xiao S.; Yang J.	A Lightweight Reinforcement-Learning-Based Real-Time Path-Planning Method For Unmanned Aerial Vehicles	IEEE Internet of Things Journal, 11, 12 (2024)
9695	0.853	Chen S.; Wei K.; Pei T.; Long S.	Aoi-Guaranteed Uav Crowdsensing: A Ugv-Assisted Deep Reinforcement Learning Approach	Ad Hoc Networks, 173 (2025)