Smart City Gnosys

Smart city article details

Title Forecasting Smart Meter Energy Usage Using Distributed Systems And Machine Learning
ID_Doc 26858
Authors Dong C.; Du L.; Ji F.; Song Z.; Zheng Y.; Howard A.; Intrevado P.; Woodbridge D.
Year 2019
Published Proceedings - 20th International Conference on High Performance Computing and Communications, 16th International Conference on Smart City and 4th International Conference on Data Science and Systems, HPCC/SmartCity/DSS 2018
DOI http://dx.doi.org/10.1109/HPCC/SmartCity/DSS.2018.00216
Abstract In this research, we explore the technical and computational merits of a machine learning algorithm on a large data set, employing distributed systems. Using 167 million (10 GB) energy consumption observations collected by smart meters from residential consumers in London, England, we predict future residential energy consumption using a Random Forest machine learning algorithm. Distributed systems such as AWS S3 and EMR, MongoDB and Apache Spark are used. Computational times and predictive accuracy are evaluated. We conclude that there are significant computational advantages to using distributed systems when applying machine learning algorithms on large-scale data. We also observe that distributed systems can be computationally burdensome when the amount of data being processed is below a threshold at which it can leverage the computational efficiencies provided by distributed systems. © 2018 IEEE.
Author Keywords Data processing; Distributed computing; Distributed databases; Machine learning; Smart grids


Similar Articles


Id Similarity Authors Title Published
48668 View0.888Aurangzeb K.Short Term Power Load Forecasting Using Machine Learning Models For Energy Management In A Smart Community2019 International Conference on Computer and Information Sciences, ICCIS 2019 (2019)
9463 View0.884Singh T.; Solanki A.; Sharma S.K.Analytical Study Of Machine Learning Techniques On The Smart Home Energy ConsumptionAIP Conference Proceedings, 2938, 1 (2023)
17271 View0.88Christantonis K.; Tjortjis C.Data Mining For Smart Cities: Predicting Electricity Consumption By Classification10th International Conference on Information, Intelligence, Systems and Applications, IISA 2019 (2019)
54287 View0.878Zhakiyev N.; Omirgaliyev R.; Bapiyev I.; Baisakalova N.; Tankeyev S.System For Water And Electricity Consumption Prediction In Smart Cities Using MlSIST 2023 - 2023 IEEE International Conference on Smart Information Systems and Technologies, Proceedings (2023)
35996 View0.877Haque A.; Malik A.Machine Learning In Renewable Energy Systems For Smart CitiesSmart Cities: Power Electronics, Renewable Energy, and Internet of Things (2024)
36056 View0.874Tiwari S.; Jain A.; Ahmed N.M.O.S.; Charu; Alkwai L.M.; Dafhalla A.K.Y.; Hamad S.A.S.Machine Learning-Based Model For Prediction Of Power Consumption In Smart Grid- Smart Way Towards Smart CityExpert Systems, 39, 5 (2022)
45985 View0.874Alomoush W.; Khan T.A.; Nadeem M.; Janjua J.I.; Saeed A.; Athar A.Residential Power Load Prediction In Smart Cities Using Machine Learning Approaches2022 International Conference on Business Analytics for Technology and Security, ICBATS 2022 (2022)
47255 View0.872Wu Z.; Chu W.Sampling Strategy Analysis Of Machine Learning Models For Energy Consumption Prediction2021 9th IEEE International Conference on Smart Energy Grid Engineering, SEGE 2021 (2021)
32444 View0.872Nijim M.; Kanumuri V.; Albetaineh H.; Goyal A.Intelligent Monitoring And Management Of Smart Buildings Using Machine Learning: Optimizing User Behavior And Energy EfficiencyProceedings - 2023 Congress in Computer Science, Computer Engineering, and Applied Computing, CSCE 2023 (2023)
35921 View0.871Tang Z.; Xie H.; Du C.; Liu Y.; Khalaf O.I.; Allimuthu U.K.Machine Learning Assisted Energy Optimization In Smart Grid For Smart City ApplicationsJournal of Interconnection Networks, 22 (2022)