Smart City Gnosys

Smart city article details

Title Towards Communication-Efficient Federated Learning Through Particle Swarm Optimization And Knowledge Distillation
ID_Doc 58065
Authors Zaman S.; Talukder S.; Hossain M.Z.; Puppala S.M.T.; Imteaj A.
Year 2024
Published Proceedings - 2024 IEEE 48th Annual Computers, Software, and Applications Conference, COMPSAC 2024
DOI http://dx.doi.org/10.1109/COMPSAC61105.2024.00075
Abstract The widespread popularity of Federated Learning (FL) has led researchers to delve into its various facets, primarily focusing on personalization, fair resource allocation, privacy, and global optimization, with less attention puts towards the crucial aspect of ensuring efficient and cost-optimized communication between the FL server and its agents. A major challenge in achieving successful model training and inference on distributed edge devices lies in optimizing communication costs amid resource constraints, such as limited bandwidth, and selecting efficient agents. In resource-limited FL scenarios, where agents often rely on unstable networks, the transmission of large model weights can substantially degrade model accuracy and increase communication latency between the FL server and agents. Addressing this challenge, we propose a novel strategy that integrates a knowledge distillation technique with a Particle Swarm Optimization (PSO)-based FL method. This approach focuses on transmitting model scores instead of weights, significantly reducing communication overhead and enhancing model accuracy in unstable environments. Our method, with potential applications in smart city services and industrial IoT, marks a significant step forward in reducing network communication costs and mitigating accuracy loss, thereby optimizing the communication efficiency between the FL server and its agents. © 2024 IEEE.
Author Keywords convergence; edge computation; Federated Learning; heterogeneity; knowledge distillation; local model; resource-limitations


Similar Articles


Id Similarity Authors Title Published
41395 View0.935Qolomany B.; Ahmad K.; Al-Fuqaha A.; Qadir J.Particle Swarm Optimized Federated Learning For Industrial Iot And Smart City ServicesProceedings - IEEE Global Communications Conference, GLOBECOM (2020)
26347 View0.88Alla K.R.; Thangarasu G.Federated Learning For Iot Devices In Smart Cities: A Particle Swarm Optimation-Based Approach2023 2nd International Conference on Smart Technologies for Smart Nation, SmartTechCon 2023 (2023)
43973 View0.87Qu X.; Wang J.; Xiao J.Quantization And Knowledge Distillation For Efficient Federated Learning On Edge DevicesProceedings - 2020 IEEE 22nd International Conference on High Performance Computing and Communications, IEEE 18th International Conference on Smart City and IEEE 6th International Conference on Data Science and Systems, HPCC-SmartCity-DSS 2020 (2020)
54221 View0.867Yang H.; Liu H.; Yuan X.; Wu K.; Ni W.; Zhang J.A.; Liu R.P.Synergizing Intelligence And Privacy: A Review Of Integrating Internet Of Things, Large Language Models, And Federated Learning In Advanced Networked SystemsApplied Sciences (Switzerland), 15, 12 (2025)
26346 View0.867Nguyen D.C.; Ding M.; Pathirana P.N.; Seneviratne A.; Li J.; Vincent Poor H.Federated Learning For Internet Of Things: A Comprehensive SurveyIEEE Communications Surveys and Tutorials, 23, 3 (2021)
26334 View0.862Sirohi D.; Kumar N.; Rana P.S.; Tanwar S.; Iqbal R.; Hijjii M.Federated Learning For 6G-Enabled Secure Communication Systems: A Comprehensive SurveyArtificial Intelligence Review, 56, 10 (2023)
40082 View0.861Zhang S.; Duan J.; Liu H.Online Task Assignment For Federated Learning In Smart CityProceedings of SPIE - The International Society for Optical Engineering, 12249 (2022)
26356 View0.861Valente R.; Senna C.; Rito P.; Sargento S.Federated Learning Framework To Decentralize Mobility Forecasting In Smart CitiesProceedings of IEEE/IFIP Network Operations and Management Symposium 2023, NOMS 2023 (2023)
26360 View0.857Hosseini Mirmahaleh S.Y.; Rahmani A.M.Federated Learning In Smart CitiesModel Optimization Methods for Efficient and Edge AI: Federated Learning Architectures, Frameworks and Applications (2024)
26359 View0.856Gandhi M.; Singh S.K.; Ravikumar R.N.; Vaghela K.Federated Learning In Secure Smart City Sensing: Challenges And OpportunitiesEdge of Intelligence: Exploring the Frontiers of AI at the Edge (2025)