A survey on the evolution of stream processing systems

Journal article (2023)

Authors

M. Fragkoulis Web Information Systems - EEMCS , Delivery Hero
Paris Carbone Research Institutes of Sweden RISE, KTH Royal Institute of Technology
Vasiliki Kalavri Boston University
A Katsifodimos Web Information Systems - EEMCS
Research Group
Web Information Systems (EEMCS) (TU Delft)
Copyright: © 2023 M. Fragkoulis, Paris Carbone, Vasiliki Kalavri, A Katsifodimos
DOI: https://doi.org/10.1007/s00778-023-00819-8
Stream processing Fault-tolerance Cloud applications Streaming analytics
More Info
expand_more

Published Date

2023

Language

English

Faculty

Electrical Engineering, Mathematics and Computer Science

Department

Software Technology

Research Group

Web Information Systems

Abstract

Stream processing has been an active research field for more than 20 years, but it is now witnessing its prime time due to recent successful efforts by the research community and numerous worldwide open-source communities. This survey provides a comprehensive overview of fundamental aspects of stream processing systems and their evolution in the functional areas of out-of-order data management, state management, fault tolerance, high availability, load management, elasticity, and reconfiguration. We review noteworthy past research findings, outline the similarities and differences between the first (’00–’10) and second (’11–’23) generation of stream processing systems, and discuss future trends and open problems.