Smart City Gnosys
Smart city article details
| Title | Federated Multiagent Actor-Critic Learning For Age Sensitive Mobile-Edge Computing |
|---|---|
| ID_Doc | 26379 |
| Authors | Zhu Z.; Wan S.; Fan P.; Letaief K.B. |
| Year | 2022 |
| Published | IEEE Internet of Things Journal, 9, 2 |
| DOI | http://dx.doi.org/10.1109/JIOT.2021.3078514 |
| Abstract | As an emerging technique, mobile-edge computing (MEC) introduces a new scheme for various distributed communication-computing systems, such as industrial Internet of Things (IoT), vehicular communication, smart city, etc. In this work, we mainly focus on the timeliness of the MEC systems where the freshness of the data and computation tasks is significant. First, we formulate a kind of age-sensitive MEC models and define the average Age-of-Information (AoI) minimization problems of interests. Then, a novel mixed-policy-based multimodal deep reinforcement learning (RL) framework, called heterogeneous multiagent actor-critic (H-MAAC), is proposed as a paradigm for joint collaboration in the investigated MEC systems, where edge devices and center controller learn the interactive strategies through their own observations. To improve the system performance, we develop the corresponding online algorithm by introducing the edge federated learning mode into the multiagent cooperation whose advantages on learning convergence can be guaranteed theoretically. To the best of our knowledge, it is the first joint MEC collaboration algorithm that combines the edge federated mode with the multiagent actor-critic RL. Furthermore, we evaluate the proposed approach and compare it with popular RL-based methods. As a result, the proposed algorithm not only outperforms the baselines on average system age, but also promotes the stability of training process. Besides, the simulation outcomes provide several insights for collaboration designs over MEC systems. © 2014 IEEE. |
| Author Keywords | Federated learning (FL); joint collaboration; mixed policies; mobile-edge computing (MEC); multiagent deep reinforcement learning (RL); multimodal learning |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
7745  | 0.896 | Zhu Z.; Wan S.; Fan P.; Letaief K.B. | An Edge Federated Marl Approach For Timeliness Maintenance In Mec Collaboration | 2021 IEEE International Conference on Communications Workshops, ICC Workshops 2021 - Proceedings (2021) |
| 38090 | 0.885 | Jiao T.; Feng X.; Guo C.; Wang D.; Song J. | Multi-Agent Deep Reinforcement Learning For Efficient Computation Offloading In Mobile Edge Computing | Computers, Materials and Continua, 76, 3 (2023) |
| 40838 | 0.876 | Liu L.; Xu Z. | Optimizing Lightweight Neural Networks For Efficient Mobile Edge Computing | Scientific Reports, 15, 1 (2025) |
| 34353 | 0.869 | Chen Z.; Xiong B.; Chen X.; Min G.; Li J. | Joint Computation Offloading And Resource Allocation In Multi-Edge Smart Communities With Personalized Federated Deep Reinforcement Learning | IEEE Transactions on Mobile Computing, 23, 12 (2024) |
| 26323 | 0.856 | Chen X.; Liu G. | Federated Deep Reinforcement Learning-Based Task Offloading And Resource Allocation For Smart Cities In A Mobile Edge Network | Sensors, 22, 13 (2022) |
| 38241 | 0.85 | Wu B.; Ma L.; Ji Y.; Cong J.; Xu M.; Zhao J.; Yang Y. | Multi-Layer Guided Reinforcement Learning Task Offloading Based On Softmax Policy In Smart Cities | Computer Communications, 235 (2025) |