Print Email Facebook Twitter KPI by proxy Title KPI by proxy Author van den Hoek, Martijn (TU Delft Electrical Engineering, Mathematics and Computer Science) Contributor Proksch, S. (mentor) van Deursen, A. (graduation committee) Kula, E. (graduation committee) Cavalcante Siebert, L. (graduation committee) Degree granting institution Delft University of Technology Programme Computer Science Date 2021-08-20 Abstract Metrics are widely used in the software engineering industry and can serve as Key Performance Indicators (KPIs), which are used by management to make informed decisions and understand the performance of the organisation. Many companies measure themselves against industry-standard metrics, in addition to their own set of metrics. This thesis aims to investigate the relationship between these industry-standard metrics and the metrics that are additionally collected. Instead of focusing on the performance of a single organisation, the DORA report focuses on the comparison of organisations. It measures the Software Delivery and Operational (SDO) performance of organisations by four key and industry-standard metrics representing two aspects, stability and throughput, of a software product. The use of one metric as a proxy for another metric or a thematic group of metrics is a common phenomenon. However, there rarely is evidence supporting the assumption that the proxy reflects the intended metric or represents the full thematic group. This thesis performs a single case study within ING, a large and highly digital bank in the Netherlands. It investigates the KPIs that are collected by the bank and analyses the relationships between those KPIs and the four metrics from the DORA report. It establishes a list of 27 KPIs that are in use by ING and shows that there are no correlations between the DORA metrics as collected within the bank and that these metrics show very little correlation with the metrics that ING collects additionally. Furthermore, it is established that nearly all metrics contain a bias at the organisational level and that these biases have a significant impact on the correlation between metrics. Subject KPIproxyDORAmetricDevOps To reference this document use: http://resolver.tudelft.nl/uuid:78393e53-bf86-41dd-8611-ad75c28265d6 Part of collection Student theses Document type master thesis Rights © 2021 Martijn van den Hoek Files PDF MSc_thesis_Martijn_van_de ... k_2021.pdf 1.47 MB Close viewer /islandora/object/uuid:78393e53-bf86-41dd-8611-ad75c28265d6/datastream/OBJ/view