Methods to identify outliers in repetitions of UV/Vis spectra

Abstract (2016)

Authors

M.J. Lepot Sanitary Engineering - CEG
Alma Mašić Eawag - Swiss Federal Institute of Aquatic Science and Technology
Jean Baptiste Aubin Université de Lyon
F.H.L.R. Clemens Sanitary Engineering - CEG , Deltares
Research Group
Sanitary Engineering (CEG) (TU Delft)
Detection PCA Spectra Outlier DDT UV/Vis
More Info
expand_more

Published Date

2016

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Civil Engineering & Geosciences

Department

Water Management

Research Group

Sanitary Engineering

Abstract

UV/Vis spectrophotometers have been used to monitor water quality since the early 2000s. Calibration of these devices requires sampling campaigns to elaborate relations between recorded spectra and measured concentrations. Recent sensor improvements allow recordings of a spectrum in as little as 15 seconds, making it possible to record several spectra for the same sample. Spectrum repetitions provide new opportunities to detect outliers – a task that is difficult in non-repetitive spectra recordings. A well-executed outlier detection can e.g. result in a more accurate calibration of the spectrophotometer or an improved construction of a regression model. In this work, two methods are presented and tested to detect outliers in repetitions of spectral data: one based on data depth theory (DDT) and one on principal component analysis (PCA). Results show that the two methods are generally consistent in identifying outliers, with only small differences between the methods.