Smart City Gnosys

Smart city article details

Title	Load Balancing And Resource Allocation In Smart Cities Using Reinforcement Learning
ID_Doc	35418
Authors	Alorbani A.; Bauer M.
Year	2021
Published	2021 IEEE International Smart Cities Conference, ISC2 2021
DOI	http://dx.doi.org/10.1109/ISC253183.2021.9562941
Abstract	Technology is being adopted by many municipalities to improve their services and operations through so-called "smart city applications". Development of these smart city applications are increasingly looking to leverage edge and cloud computing to support these initiatives. This approach brings a number of challenges, including the allocation of tasks to that process data from sensors to computing systems, dealing with the data that may be time sensitive, handling frequently starting and finishing tasks, dynamically changing resource utilization of computing elements, etc. This paper focuses on the challenge of allocating tasks to resources to try to ensure balanced loads on processing elements in dynamic environments. A reinforcement learning approach is introduced to address this problem. The reinforcement learning agent uses a novel Multi-Observation Single-State model based on observed features from multiple sources at a single step. A model of a smart city computational infrastructure is introduced and is used to define our reinforcement learning algorithm for task allocation. We illustrate the agent behavior through simulations.
Author Keywords	cloud; edge computing; IoT; reinforcement learning; smart city; task allocation

Similar Articles

Id	Similarity	Authors	Title	Published
39777	0.899	Mattia G.P.; Beraldi R.	On Real-Time Scheduling In Fog Computing: A Reinforcement Learning Algorithm With Application To Smart Cities	2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2022 (2022)
15454	0.896	Peng K.; Liu P.; Xu X.; Zhou X.	Computing Offloading Of Multi-Dependent Tasks In Smart Cities; [面向智慧城市的多依赖任务计算迁移研究]	Yingyong Kexue Xuebao/Journal of Applied Sciences, 41, 3 (2023)
40037	0.878	Proietti Mattia G.; Beraldi R.	Online Decentralized Scheduling In Fog Computing For Smart Cities Based On Reinforcement Learning	IEEE Transactions on Cognitive Communications and Networking, 10, 4 (2024)
50634	0.874	Ahmadi K.; Allan V.H.	Smart City: Application Of Multi-Agent Reinforcement Learning Systems In Adaptive Traffic Management	2021 IEEE International Smart Cities Conference, ISC2 2021 (2021)
10151	0.874	Othmen S.; Mansouri W.; Khdhir R.	Applying Artificial Intelligence Techniques For Resource Management In The Internet Of Things (Iot)	International Journal of Electrical and Computer Engineering Systems, 16, 2 (2025)
2288	0.873	Sahoo S.; Sahoo K.S.; Sahoo B.; Gandomi A.H.	A Learning Automata Based Edge Resource Allocation Approach For Iot-Enabled Smart Cities	Digital Communications and Networks, 10, 5 (2024)
7714	0.865	Ludolfinger U.; Martens M.	An Autonomous Energy Management Concept For Sustainable Smart Cities	2023 IEEE European Technology and Engineering Management Summit, E-TEMS 2023 - Conference Proceedings (2023)
38338	0.865	Mustafa A.S.; Yussof S.; Asyikin Mohamed Radzi N.	Multi-Objective Simulated Annealing For Efficient Task Allocation In Uav-Assisted Edge Computing For Smart City Traffic Management	IEEE Access, 13 (2025)
60278	0.864	Bansal M.; Chana I.; Clarke S.	Urbanenqosplace: A Deep Reinforcement Learning Model For Service Placement Of Real-Time Smart City Iot Applications	IEEE Transactions on Services Computing, 16, 4 (2023)
38114	0.863	Neelamegam G.; Venkatesan R.; Ramya S.R.; Ramya R.S.; Akshya J.; Sundarrajan M.; Choudhry M.D.	Multi-Agent Systems For Autonomous Iot Network Management Using Distributed Reinforcement Learning	Proceedings of 2025 3rd International Conference on Intelligent Systems, Advanced Computing, and Communication, ISACC 2025 (2025)