A Spatiotemporal Deep Neural Network Useful for Defect Identification and Reconstruction of Artworks Using Infrared Thermography

Journal Article (2022)
Author(s)

Morteza Moradi (TU Delft - Structural Integrity & Composites)

R. Ghorbani (TU Delft - Pattern Recognition and Bioinformatics)

Stefano Sfarra (University of L'Aquila)

David M. J. Tax (TU Delft - Pattern Recognition and Bioinformatics)

Dimitrios Zarouchas (TU Delft - Structural Integrity & Composites)

Research Group
Structural Integrity & Composites
Copyright
© 2022 M. Moradi, R. Ghorbani, Stefano Sfarra, D.M.J. Tax, D. Zarouchas
DOI related publication
https://doi.org/10.3390/s22239361
More Info
expand_more
Publication Year
2022
Language
English
Copyright
© 2022 M. Moradi, R. Ghorbani, Stefano Sfarra, D.M.J. Tax, D. Zarouchas
Research Group
Structural Integrity & Composites
Issue number
23
Volume number
22
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Assessment of cultural heritage assets is now extremely important all around the world. Non-destructive inspection is essential for preserving the integrity of artworks while avoiding the loss of any precious materials that make them up. The use of Infrared Thermography is an interesting concept since surface and subsurface faults can be discovered by utilizing the 3D diffusion inside the object caused by external heat. The primary goal of this research is to detect defects in artworks, which is one of the most important tasks in the restoration of mural paintings. To this end, machine learning and deep learning techniques are effective tools that should be employed properly in accordance with the experiment’s nature and the collected data. Considering both the temporal and spatial perspectives of step-heating thermography, a spatiotemporal deep neural network is developed for defect identification in a mock-up reproducing an artwork. The results are then compared with those of other conventional algorithms, demonstrating that the proposed approach outperforms the others.