Malleable Kernel Interpolation for Scalable Structured Gaussian Process

Master Thesis (2023)
Author(s)

Hanyuan Ban (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Contributor(s)

Raj T. Rajan – Mentor (TU Delft - Signal Processing Systems)

Francesco Fioranelli – Graduation committee member (TU Delft - Microwave Sensing, Signals & Systems)

Bianca Giovanardi – Graduation committee member (TU Delft - Aerospace Structures & Computational Mechanics)

Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright
© 2023 Hanyuan Ban
More Info
expand_more
Publication Year
2023
Language
English
Copyright
© 2023 Hanyuan Ban
Graduation Date
07-11-2023
Awarding Institution
Delft University of Technology
Programme
Electrical Engineering
Faculty
Electrical Engineering, Mathematics and Computer Science
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Gaussian process regression (GPR), a potent non-parametric data modeling tool, has gained attention but is hindered by its high com- putational load. State-of-the-art low-rank approximations like struc- tured kernel interpolation (SKI)-based methods offer efficiency, yet lack a strategy for determining the number of grid points, a pivotal factor impacting accuracy and efficiency. In this thesis, we tackle this challenge.
We explore existing low-rank approximations that facilitates the computation, dissecting their strengths and limitations, particularly SKI-based methods. Subsequently, we introduce a novel approxima- tion framework, MKISSGP, which dynamically adjusts grid points us- ing a new hyperparameter of the model: density, according to changes in the kernel hyperparameters in each training iteration.
MKISSGP exhibited consistent error levels in the reconstruction of the kernel matrix, irrespective of changes in hyperparameters. This robust performance forms the bedrock for achieving accurate approx- imations of kernel matrix-related terms. When employing our rec- ommended density value (i.e., 2.7), MKISSGP achieved a comparable level of precision to that of precise GPR, while requiring only 52% of the time compared to the current state-of-the-art method.

Files

Hanyuan_Ban_5519829_Master_The... (pdf)
(pdf | 2.69 Mb)
- Embargo expired in 07-05-2024
License info not available