Print Email Facebook Twitter Towards Evaluating Stream Processing Autoscalers Title Towards Evaluating Stream Processing Autoscalers Author Siachamis, G. (TU Delft Web Information Systems) Kanis, Job (Student TU Delft) Koper, Wybe (Student TU Delft) Psarakis, K. (TU Delft Web Information Systems) Fragkoulis, M. (TU Delft Web Information Systems; Delivery Hero SE) van Deursen, A. (TU Delft Software Technology) Katsifodimos, A (TU Delft Web Information Systems) Department Software Technology Date 2023 Abstract In this work, we evaluate autoscaling solutions for stream processing engines. Although autoscaling has become a mainstream subject of research in the last decade, the database research community has yet to evaluate different autoscaling techniques under a proper benchmarking setting and evaluation framework. As a result, every newly proposed autoscaling solution only performs a shallow performance evaluation and comparison against existing solutions. In this paper, we evaluate autoscaling solutions by employing two streaming queries and a dynamic workload that follows a cosinus pattern. Our experiments reveal that current autoscaling techniques fail to account for generated lag due to rescaling or underprovisioning and cannot efficiently handle practical scenarios of intensely dynamic workloads. Subject autoscalingstream processing To reference this document use: http://resolver.tudelft.nl/uuid:c777dcac-fe53-463a-beed-25729ba27f8b DOI https://doi.org/10.1109/ICDEW58674.2023.00021 Publisher IEEE Embargo date 2023-12-14 ISBN 9798350322446 Source Proceedings - 2023 IEEE 39th International Conference on Data Engineering Workshops, ICDEW 2023 Event 39th IEEE International Conference on Data Engineering Workshops, ICDEW 2023, 2023-04-03 → 2023-04-07, Anaheim, United States Series Proceedings - 2023 IEEE 39th International Conference on Data Engineering Workshops, ICDEW 2023 Bibliographical note Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. Part of collection Institutional Repository Document type conference paper Rights © 2023 G. Siachamis, Job Kanis, Wybe Koper, K. Psarakis, M. Fragkoulis, A. van Deursen, A Katsifodimos Files PDF Towards_Evaluating_Stream ... calers.pdf 1.03 MB Close viewer /islandora/object/uuid:c777dcac-fe53-463a-beed-25729ba27f8b/datastream/OBJ/view