Smart City Gnosys
Smart city article details
| Title | An Improved Multi-Actor Hybrid Attention Critic Algorithm For Cooperative Navigation In Urban Low-Altitude Logistics Environments |
|---|---|
| ID_Doc | 8277 |
| Authors | Li C.; Feng Q.; Ding C.; Ye Z. |
| Year | 2025 |
| Published | Computers, Materials and Continua, 84, 2 |
| DOI | http://dx.doi.org/10.32604/cmc.2025.063703 |
| Abstract | The increasing adoption of unmanned aerial vehicles (UAVs) in urban low-altitude logistics systems, particularly for time-sensitive applications like parcel delivery and supply distribution, necessitates sophisticated coordination mechanisms to optimize operational efficiency. However, the limited capability of UAVs to extract state-action information in complex environments poses significant challenges to achieving effective cooperation in dynamic and uncertain scenarios. To address this, we presents an Improved Multi-Agent Hybrid Attention Critic (IMAHAC) framework that advances multi-agent deep reinforcement learning (MADRL) through two key innovations. Firstly, a Temporal Difference Error and Time-based Prioritized Experience Replay (TT-PER) mechanism that dynamically adjusts sample weights based on temporal relevance and prediction error magnitude, effectively reducing the interference from obsolete collaborative experiences while maintaining training stability. Secondly, a hybrid attention mechanism is developed, integrating a sensor fusion layer—which aggregates features from multi-sensor data to enhance decision-making—and a dissimilarity layer that evaluates the similarity between key-value pairs and query values. By combining this hybrid attention mechanism with the Multi-Actor Attention Critic (MAAC) framework, our approach strengthens UAVs’ capability to extract critical state-action features in diverse environments. Comprehensive simulations in urban air mobility scenarios demonstrate IMAHAC’s superiority over conventional MADRL baselines and MAAC, achieving higher cumulative rewards, fewer collisions, and enhanced cooperative capabilities. This work provides both algorithmic advancements and empirical validation for developing robust autonomous aerial systems in smart city infrastructures. Copyright © 2025 The Authors. |
| Author Keywords | attention mechanism; multiagent deep reinforcement learning; Unmanned aerial vehicles |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
38095  | 0.872 | Dhuheir M.; Erbad A.; Hamdaoui B.; Belhaouari S.B.; Guizani M.; Vu T.X. | Multi-Agent Meta Reinforcement Learning For Reliable And Low-Latency Distributed Inference In Resource-Constrained Uav Swarms | IEEE Access, 13 (2025) |
| 9695 | 0.865 | Chen S.; Wei K.; Pei T.; Long S. | Aoi-Guaranteed Uav Crowdsensing: A Ugv-Assisted Deep Reinforcement Learning Approach | Ad Hoc Networks, 173 (2025) |
| 2337 | 0.864 | Xi M.; Dai H.; He J.; Li W.; Wen J.; Xiao S.; Yang J. | A Lightweight Reinforcement-Learning-Based Real-Time Path-Planning Method For Unmanned Aerial Vehicles | IEEE Internet of Things Journal, 11, 12 (2024) |
| 25354 | 0.86 | Javaid S.; Khan M.A.; Fahim H.; He B.; Saeed N. | Explainable Ai And Monocular Vision For Enhanced Uav Navigation In Smart Cities: Prospects And Challenges | Frontiers in Sustainable Cities, 7 (2025) |
| 1129 | 0.854 | Liu X.; Wang Y.; Gao H.; Ngai E.C.H.; Zhang B.; Wang C.; Wang W. | A Coverage-Aware Task Allocation Method For Uav-Assisted Mobile Crowd Sensing | IEEE Transactions on Vehicular Technology, 73, 7 (2024) |
| 16151 | 0.853 | Zhang H.; Tang H.; Ding W.; Zhang X.-P. | Cooperative Multi-Type Multi-Agent Deep Reinforcement Learning For Resource Management In Space-Air-Ground Integrated Networks | UbiComp/ISWC 2023 Adjunct - Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2023 ACM International Symposium on Wearable Computing (2023) |
| 7863 | 0.852 | Lee C.-Y.; Khanum A.; Wang N.-C.; Karuparthi B.S.K.; Yang C.-S. | An Efficient Lane Following Navigation Strategy With Fusion Attention For Autonomous Drones In Urban Areas | IEEE Transactions on Vehicular Technology, 73, 3 (2023) |
| 16152 | 0.85 | Kim J.; Park S.; Jung S.; Cordeiro C. | Cooperative Multi-Uav Positioning For Aerial Internet Service Management: A Multi-Agent Deep Reinforcement Learning Approach | IEEE Transactions on Network and Service Management, 21, 4 (2024) |