Smart City Gnosys

Smart city article details

Title	Data Quality Evaluation, Outlier Detection And Missing Data Imputation Methods For Iot In Smart Cities
ID_Doc	17323
Authors	Van Zoest V.; Liu X.; Ngai E.
Year	2021
Published	Studies in Computational Intelligence, 971
DOI	http://dx.doi.org/10.1007/978-3-030-72065-0_1
Abstract	Low-cost IoT devices allow data collection in smart cities at a high spatio-temporal resolution. Data quality evaluation is needed to investigate the pre-processing steps required to use these data. Besides data pre-processing, outlier detection techniques are required to detect anomalies in the spatio-temporal IoT dataset. We distinguish between erroneous outliers and events based on spatio-temporal autocorrelation patterns, as well as correlations with other dynamic processes in the environment. We consider missing data imputation to fill gaps caused by sensor failures, maintenance, pre-processing and outlier detection. In this study, we use the temporal covariance structure within the data to impute missing data. We apply the methods for outlier detection and missing data imputation to an IoT testbed for air quality monitoring in the city of Eindhoven, the Netherlands. The methods can be applied in a more general sense to other continuous environmental variables which show a similarly strong spatio-temporal autocorrelation structure. © 2021, The Author(s), under exclusive license to Springer Nature Switzerland AG.
Author Keywords	Air quality; Data quality; Missing data imputation; Outlier detection; Smart city

Similar Articles

Id	Similarity	Authors	Title	Published
30974	0.917	AlSalehy A.S.; Bailey M.	Improving Time Series Data Quality: Identifying Outliers And Handling Missing Values In A Multilocation Gas And Weather Dataset	Smart Cities, 8, 3 (2025)
58019	0.897	Tahiri Alaoui M.L.; Belhiah M.; Ziti S.	Towards An Optimization Model For Outlier Detection In Iot-Enabled Smart Cities	Lecture Notes in Networks and Systems, 712 LNNS (2023)
15167	0.889	Zafeirelli S.; Kavroudakis D.	Comparison Of Outlier Detection Approaches In A Smart Cities Sensor Data Context	International Journal on Smart Sensing and Intelligent Systems, 17, 1 (2024)
25527	0.886	Mosallam B.E.; Ahmed S.H.	Exploring Effective Outlier Detection In Iot: A Systematic Survey Of Techniques And Applications	1st International Conference of Intelligent Methods, Systems and Applications, IMSA 2023, 2023-January (2023)
9617	0.882	Bachechi C.; Rollo F.; Po L.; Quattrini F.	Anomaly Detection In Multivariate Spatial Time Series: A Ready-To-Use Implementation	International Conference on Web Information Systems and Technologies, WEBIST - Proceedings, 2021-October (2021)
37126	0.875	Srinivas L.N.B.; Jayavel K.	Missing Data Estimation And Imputation Algorithm For Wireless Sensor Network Applications	2022 International Conference on Computer Communication and Informatics, ICCCI 2022 (2022)
37127	0.874	Eid M.M.; Eldahshan K.; Abouali A.H.	Missing Data In Smart Cities: An Imputation Algorithm Based On Sine/Cosine Optimization Algorithm	2024 International Conference on Computer and Applications, ICCA 2024 (2024)
17322	0.868	Julio H. Buelvas P.; Fernando E. Avila B.; Natalia Gaviria G.; Danny A. Munera R.	Data Quality Estimation In A Smart City'S Air Quality Monitoring Iot Application	2021 2nd Sustainable Cities Latin America Conference, SCLA 2021 (2021)
48295	0.865	Rollo F.; Bachechi C.; Po L.	Semi Real-Time Data Cleaning Of Spatially Correlated Data In Traffic Sensor Networks	International Conference on Web Information Systems and Technologies, WEBIST - Proceedings, 2022-October (2022)
4151	0.864	Ferrer-Cid P.; Barcelo-Ordinas J.M.; Garcia-Vidal J.	A Review Of Graph-Powered Data Quality Applications For Iot Monitoring Sensor Networks	Journal of Network and Computer Applications, 236 (2025)