| Abstract |
A recent technology trend known as the Internet of Things (IoT) involves using devices like smartphones, smart TVs, medical and healthcare equipment, and home appliances to generate data. This paper introduces a novel framework, Reinforcement Learning with Black Widow Optimization (RL-BWO), to enhance IoT service recommendations through responsiveness to evolving service requests and optimized resource usage. Unlike prior hybrid approaches that rely on static recommendation strategies or single-pass learning, RL-BWO uniquely integrates incremental Reinforcement Learning (RL) with evolutionary optimization, enabling continuous policy refinement in dynamic environments. The framework features a multi-batch data partitioning mechanism, and a service-request interactive simulator based on Markov Decision Processes (MDP) to support real-time adaptation. The Black Widow Optimization (BWO) algorithm is used to fine-tune service selection through fitness-based ranking, ensuring high-quality recommendations under resource constraints. Experimental results in a smart city simulation show that RL-BWO improves the solved request rate by up to 12.8%, reduces latency by 17%, and enhances reliability by 9.6% compared to leading methods such as Genetic Algorithm–Simulated Annealing–Particle Swarm Optimization (GASAPSO), Time Correlation Coefficient with Cuckoo Search–K-means (TCCF), and Artificial Bee Colony with Genetic Algorithm (ABCGA). These results demonstrate RL-BWO’s superior scalability, accuracy, and responsiveness, making it a robust solution for large-scale, real-time IoT service recommendation. © 2004-2012 IEEE. |
