Smart City Gnosys
Smart city article details
| Title | Big Stream Processing Systems: An Experimental Evaluation |
|---|---|
| ID_Doc | 12160 |
| Authors | Shahverdi E.; Awad A.; Sakr S. |
| Year | 2019 |
| Published | Proceedings - 2019 IEEE 35th International Conference on Data Engineering Workshops, ICDEW 2019 |
| DOI | http://dx.doi.org/10.1109/ICDEW.2019.00-35 |
| Abstract | As the world gets more instrumented and connected, we are witnessing a flood of digital data generated from various hardware (e.g., sensors) or software in the format of flowing streams of data. Real-time processing for such massive amounts of streaming data is a crucial requirement in several application domains including financial markets, surveillance systems, manufacturing, smart cities, and scalable monitoring infrastructure. In the last few years, several big stream processing engines have been introduced to tackle this challenge. In this article, we present an extensive experimental study of five popular systems in this domain, namely, Apache Storm, Apache Flink, Apache Spark, Kafka Streams and Hazelcast Jet. We report and analyze the performance characteristics of these systems. In addition, we report a set of insights and important lessons that we have learned from conducting our experiments. © 2019 IEEE. |
| Author Keywords | Benchmarking; Big Stream Processing |
Similar Articles
| Id | Similarity | Authors | Title | Published |
|---|---|---|---|---|
42642  | 0.9 | Baban P. | Pre-Processing And Data Validation In Iot Data Streams | DEBS 2020 - Proceedings of the 14th ACM International Conference on Distributed and Event-Based Systems (2020) |
| 24778 | 0.89 | Nasiri, H; Nasehi, S; Goudarzi, M | Evaluation Of Distributed Stream Processing Frameworks For Iot Applications In Smart Cities | JOURNAL OF BIG DATA, 6, 1 (2019) |
| 44454 | 0.865 | Rajasekar P.; Bhosale R.S.; Indhumathi C.; Sandeep K.V.; Prasanthi Kumari N.; Rajendiran M. | Real-Time Stream Processing In Iot Environments | Proceedings of 9th International Conference on Science, Technology, Engineering and Mathematics: The Role of Emerging Technologies in Digital Transformation, ICONSTEM 2024 (2024) |