Data Lineage Editor

Bachelor thesis (2019)

Authors

N.Q. Belzer Electrical Engineering, Mathematics and Computer Science
B.A. Bernstein Electrical Engineering, Mathematics and Computer Science
J.C.M. Geurtz Electrical Engineering, Mathematics and Computer Science
R. Hijdra Electrical Engineering, Mathematics and Computer Science
P.M. Lammerts Electrical Engineering, Mathematics and Computer Science
J.A.H. Wermelink Electrical Engineering, Mathematics and Computer Science

Contributors

C. Lofi Web Information Systems - EEMCS (coach)
O.W. Visser Computer Science & Engineering-Teaching Team - EEMCS (supervisor 1)
Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright: © 2019 Nick Belzer, Buster Bernstein, Jasper Geurtz, Rens Hijdra, Philippe Lammerts, Henk-Jan Wermelink
More Info
expand_more

Published Date

02-07-2019

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Abstract

Governments require companies to be able to explain where their data is coming from and going to. Our client helps these companies by creating maps of their data landscapes. This is the concept of data lineage. There are various issues that arise in the workflow of figuring out and building data lineage diagrams. Our contributions here are providing a model for what data lineage diagram instances are, and an interactive web application that can be used to visualize and edit these diagrams in an intuitive way. One of the core challenges of this project has been to combine the client's business perspective with our knowledge of computer science. Starting with our research by figuring out the client's use cases, analysing them for their feasibility within the constraints of the project. The team used both Scrum and an agile approach to develop a product that matches the client's expectations and needs throughout the project. The product was tested by adhering to the five metrics defined by the Consortium for IT Software Quality. The final product contains the desired functionality and allows building data lineage diagrams using company data from the client through external APIs. The client is eager to use the product and has provided additional opportunities for the team to work further on the product.