The impact of different methods of gradient descent on the spectral bias of physics-informed neural networks
A.F. van den Arend Schmidt (TU Delft - Electrical Engineering, Mathematics and Computer Science)
J. Sun – Mentor (TU Delft - Pattern Recognition and Bioinformatics)
Alexander Heinlein – Mentor (TU Delft - Numerical Analysis)
T. Wang – Mentor
Hayley Hung – Graduation committee member (TU Delft - Pattern Recognition and Bioinformatics)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Physics-Informed Neural Networks (PINNs) are intended to solve complex problems that obey physical rules or laws but have noisy or little data. These problems are encountered in a wide range of fields including for instance bioengineering, fluid mechanics, meta-material design and high-dimensional partial differential equations (PDEs). Whilst PINNs show promising results, they often fail to converge in the presence of higher frequency components; a problem known as the spectral bias. Multiple studies have explored ways to overcome or minimize spectral bias specifically for PINNs. This paper builds on previous studies by investigating the impact of different gradient descent methods on the spectral bias.