Smart City Gnosys
Smart city article details
| Title | A Lean Simulation Framework For Stress Testing Iot Cloud Systems |
|---|---|
| ID_Doc | 2287 |
| Authors | Li J.; Moeini B.; Nejati S.; Sabetzadeh M.; McCallen M. |
| Year | 2024 |
| Published | IEEE Transactions on Software Engineering, 50, 7 |
| DOI | http://dx.doi.org/10.1109/TSE.2024.3402157 |
| Abstract | The Internet of Things (IoT) connects a plethora of smart devices globally across various applications like smart cities, autonomous vehicles, and health monitoring. Simulation plays a key role in the testing of IoT systems, noting that field testing of a complete IoT product may be infeasible or prohibitively expensive. This paper addresses a specific yet important need in simulation-based testing for IoT: Stress testing of cloud systems that are increasingly employed in IoT applications. Existing stress testing solutions for IoT demand significant computational resources, making them ill-suited and costly. We propose a lean simulation framework designed for IoT cloud stress testing. The framework enables efficient simulation of a large array of IoT and edge devices that communicate with the cloud. To facilitate simulation construction for practitioners, we develop a domain-specific language (DSL), named IoTECS, for generating simulators from model-based specifications. We provide the syntax and semantics of IoTECS and implement IoTECS using Xtext and Xtend. We assess simulators generated from IoTECS specifications for stress testing two real-world systems: a cloud-based IoT monitoring system developed by our industry partner and an IoT-connected vehicle system. Our empirical results indicate that simulators created using IoTECS: (1) achieve best performance when configured with Docker containerization; (2) effectively assess the service capacity of our case-study systems, and (3) outperform industrial stress-testing baseline tools, JMeter and Locust, by a factor of 3.5 in terms of the number of IoT and edge devices they can simulate using identical hardware resources. To gain initial insights about the usefulness of IoTECS in practice, we interviewed two engineers from our industry partner who have firsthand experience with IoTECS. Feedback from these interviews suggests that IoTECS is effective in stress testing IoT cloud systems, saving significant time and effort. © 2024 IEEE. |
| Author Keywords | IoT cloud; model-driven engineering; Simulation-based testing; stress testing; Xtext |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
1558  | 0.884 | Li J.; Nejati S.; Sabetzadeh M.; McCallen M. | A Domain-Specific Language For Simulation-Based Testing Of Iot Edge-To-Cloud Solutions | Proceedings - 25th ACM/IEEE International Conference on Model Driven Engineering Languages and Systems, MODELS 2022 (2022) |
| 14363 | 0.858 | Yoo J.; Hwang J.; Lee J.; Yoo S.; Song J. | Clocis: Cloud-Based Conformance Testing Framework For Iot Devices In The Future Internet | Electronics (Switzerland), 12, 24 (2023) |
| 18501 | 0.853 | Bhadula S.; Adnan M.M.; Kumar R.; Kaliyaperumal G.; Rao B.D.; Boob N.S. | Design And Evaluation Of Iot Prototypes: Leveraging Test-Beds For Performance Assessment And Innovation | 2024 IEEE 4th International Conference on ICT in Business Industry and Government, ICTBIG 2024 (2024) |
| 36498 | 0.852 | Olianas D.; Leotta M.; Ricca F. | Matter: A Tool For Generating End-To-End Iot Test Scripts | Software Quality Journal, 30, 2 (2022) |
| 34853 | 0.85 | Demirbas A.F.; Gurer O.; Yurdasan Z.; Akcapinar A.; Rodoplu V. | Lean: A Multi-Cell Smart City Simulator For The Massive Internet Of Things Medium Access Control Layer | Proceedings - 2021 Innovations in Intelligent Systems and Applications Conference, ASYU 2021 (2021) |