A survey on the evolution of stream processing systems

Journal Article (2023)
Author(s)

Marios Fragkoulis (Delivery Hero, TU Delft - Web Information Systems)

Paris Carbone (KTH Royal Institute of Technology, Research Institutes of Sweden RISE)

Vasiliki Kalavri (Boston University)

A. Katsifodimos (TU Delft - Web Information Systems)

Research Group
Web Information Systems
Copyright
© 2023 M. Fragkoulis, Paris Carbone, Vasiliki Kalavri, A Katsifodimos
DOI related publication
https://doi.org/10.1007/s00778-023-00819-8
More Info
expand_more
Publication Year
2023
Language
English
Copyright
© 2023 M. Fragkoulis, Paris Carbone, Vasiliki Kalavri, A Katsifodimos
Research Group
Web Information Systems
Issue number
2
Volume number
33 (2024)
Pages (from-to)
507-541
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Stream processing has been an active research field for more than 20 years, but it is now witnessing its prime time due to recent successful efforts by the research community and numerous worldwide open-source communities. This survey provides a comprehensive overview of fundamental aspects of stream processing systems and their evolution in the functional areas of out-of-order data management, state management, fault tolerance, high availability, load management, elasticity, and reconfiguration. We review noteworthy past research findings, outline the similarities and differences between the first (’00–’10) and second (’11–’23) generation of stream processing systems, and discuss future trends and open problems.