Smart City Gnosys

Smart city article details

Title Deep Learning Framework Using Transformer Networks For Multi Building Energy Consumption Prediction In Smart Cities
ID_Doc 17892
Authors Moveh S.; Merchán-Cruz E.A.; Abuhussain M.; Dodo Y.A.; Alhumaid S.; Alhamami A.H.
Year 2025
Published Energies, 18, 6
DOI http://dx.doi.org/10.3390/en18061468
Abstract The increasing complexity of urban building energy systems necessitates advanced prediction methods for efficient energy management. Urban buildings account for approximately 40% of global energy consumption, making accurate prediction crucial for sustainability goals. This research develops a novel transformer-based deep learning framework for multi-building energy consumption forecasting. Despite recent advances in energy prediction techniques, existing models struggle with multi-building scenarios due to limited ability to capture cross-building correlations, inadequate integration of diverse data streams, and poor scalability when deployed at urban scale—gaps this research specifically addresses. The study implemented a modified transformer architecture with hierarchical attention mechanisms, processing data from 100 commercial buildings across three climate zones over three years (2020–2023). The framework incorporated weather parameters, occupancy patterns, and historical energy consumption data through multi-head attention layers, employing a 4000-step warm-up period and adaptive regularization techniques. The evaluation included a comparison with the baseline models (ARIMA, LSTM, GRU) and robustness testing. The framework achieved a 23.7% improvement in prediction accuracy compared to traditional methods, with a mean absolute percentage error of 3.2%. Performance remained stable across building types, with office complexes showing the highest accuracy (MAPE = 2.8%) and healthcare facilities showing acceptable variance (MAPE = 3.5%). The model-maintained prediction stability under severe data perturbations while demonstrating near-linear computational scaling. The transformer-based approach significantly enhances building energy prediction capabilities, enabling more effective demand-side management strategies, though future research should address long-term adaptability. © 2025 by the authors.
Author Keywords building energy prediction; deep learning; smart cities; transformer networks; urban computing


Similar Articles


Id Similarity Authors Title Published
7417 View0.916Sunder R.; R S.; Paul V.; Punia S.K.; Konduri B.; Nabilal K.V.; Lilhore U.K.; Lohani T.K.; Ghith E.; Tlija M.An Advanced Hybrid Deep Learning Model For Accurate Energy Load Prediction In Smart BuildingEnergy Exploration and Exploitation, 42, 6 (2024)
54322 View0.91Ardabili S.; Abdolalizadeh L.; Mako C.; Torok B.; Mosavi A.Systematic Review Of Deep Learning And Machine Learning For Building EnergyFrontiers in Energy Research, 10 (2022)
26837 View0.909Helli S.S.; Tanberk S.; Demir O.Forecasting Energy Consumption Using Deep Learning In Smart CitiesProceedings - 2022 International Conference on Artificial Intelligence of Things, ICAIoT 2022 (2022)
57240 View0.905Shafiq M.; Bhavani N.P.G.; Venkata Naga Ramesh J.; Veeresha R.K.; Talasila V.; Sulaiman Alfurhood B.Thermal Modeling And Machine Learning For Optimizing Heat Transfer In Smart City Infrastructure Balancing Energy Efficiency And Climate ImpactThermal Science and Engineering Progress, 54 (2024)
23280 View0.903Huang J.; Algahtani M.; Kaewunruen S.Energy Forecasting In A Public Building: A Benchmarking Analysis On Long Short-Term Memory (Lstm), Support Vector Regression (Svr), And Extreme Gradient Boosting (Xgboost) NetworksApplied Sciences (Switzerland), 12, 19 (2022)
12172 View0.902So D.; Oh J.; Jeon I.; Moon J.; Lee M.; Rho S.Bigta-Net: A Hybrid Deep Learning-Based Electrical Energy Forecasting Model For Building Energy Management SystemsSystems, 11, 9 (2023)
11151 View0.9Yang F.; Mao Q.Auto-Evaluation Model For The Prediction Of Building Energy Consumption That Combines Modified Kalman Filtering And Long Short-Term MemorySustainability (Switzerland), 15, 22 (2023)
4027 View0.893Carrera B.; Kim K.A Regression Framework For Energy Consumption In Smart Cities With Encoder-Decoder Recurrent Neural NetworksEnergies, 16, 22 (2023)
17962 View0.89Aljohani A.Deep Learning-Based Optimization Of Energy Utilization In Iot-Enabled Smart Cities: A Pathway To Sustainable DevelopmentEnergy Reports, 12 (2024)
9337 View0.889Abid Y.M.; Jalil M.A.; Abd S.K.; Sabah H.A.; Bakri B.I.; Jaleel Maktoof M.A.; Mohammed A.; Adile M.; Mustafa Ahmed M.S.; Mohammed M.A.; Alzubaidi L.H.Analysis Of The Energy Efficiency Of Smart City Buildings Based On Deep Learning Algorithms Using AiInternational Conference on Smart Systems for Electrical, Electronics, Communication and Computer Engineering, ICSSEEC 2024 - Proceedings (2024)