The Design and Analysis of an Elastic Scheduling System for Distributed Graph Processing

The Design and Analysis of an Elastic Scheduling System for Distributed Graph Processing

Au, Sietse (TU Delft Electrical Engineering, Mathematics and Computer Science)

Iosup, A. (mentor)

Delft University of Technology

Computer Engineering | Distributed Systems

2022-08-16

Graphs are versatile enough to model many problems, and we see them used for
solving a large spectrum of challenges in various disciplines. As the size of graph
data grew over the years, to satisfy the requirement to process large data sets on
time, distributed graph-processing systems were implemented.
However, these systems were built with a static deployment in mind, only allowing the systems to run on a pre-defined set of machines. Manual optimizations
and tweaks to deployment configurations lead to a waste of resources as well as an
increase in operational costs.
In this thesis, we explore the introduction of elastic deployment in distributed
graph-processing systems. We design and implement a distributed graph-processing
system and a framework for assessing elasticity and performing real-world experimentation.

http://resolver.tudelft.nl/uuid:1035ddee-0825-4542-908a-34974fba7032

Student theses

master thesis

© 2022 Sietse Au