A workload model for MapReduce

Master thesis (2012)

Authors

Contributors

A. Iosup (mentor)
D.H.J. Epema (mentor)
Programme
Computer Science (EEMCS) (TU Delft)
Copyright: ©2012 De Ruiter, T.A.
More Info
expand_more

Published Date

11-06-2012

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Programme

Computer Science

Abstract

MapReduce is a parallel programming model used by Cloud service providers for data mining. To be able to enhance existing and to develop new MapReduce sys- tems, we need to evaluate the performance of these systems. To this end we intro- duce in this work the Cloud Workloads Archive Toolbox. This toolbox facilitates the analysis of MapReduce workload traces, generation of realistic synthetic work- loads, and the evaluation of MapReduce systems in simulation. We present an overview and analysis of real world MapReduce workload traces, we propose a model for MapReduce workloads, we describe the development of the toolbox, and we present an experiment in which we use our toolbox to evaluate two MapReduce schedulers.

Files

Thesis.pdf
(pdf | 1.89 Mb)