Training and Testing Texture Similarity Metrics for Structurally Lossless Compression

Journal Article (2024)
Author(s)

Kaixuan Zhang (Northwestern University)

Zhaochen Shi (Northwestern University)

Jana Zujovic (Northwestern University)

Huib De Ridder (TU Delft - Industrial Design Engineering)

Rene Van Egmond (TU Delft - Industrial Design Engineering)

David L. Neuhoff (University of Michigan)

Thrasyvoulos N. Pappas (TU Delft - Industrial Design Engineering)

Research Group
Human Technology Relations
DOI related publication
https://doi.org/10.1109/TIP.2024.3364507 Final published version
More Info
expand_more
Publication Year
2024
Language
English
Research Group
Human Technology Relations
Bibliographical Note
Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Journal title
IEEE Transactions on Image Processing
Volume number
33
Pages (from-to)
1614-1626
Page Views
361
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

We present a systematic approach for training and testing structural texture similarity metrics (STSIMs) so that they can be used to exploit texture redundancy for structurally lossless image compression. The training and testing is based on a set of image distortions that reflect the characteristics of the perturbations present in natural texture images. We conduct empirical studies to determine the perceived similarity scale across all pairs of original and distorted textures. We then introduce a data-driven approach for training the Mahalanobis formulation of STSIM based on the resulting annotated texture pairs. Experimental results demonstrate that training results in significant improvements in metric performance. We also show that the performance of the trained STSIM metrics is competitive with state of the art metrics based on convolutional neural networks, at substantially lower computational cost.

Files

Training_and_Testing_Texture_S... (pdf)
(pdf | 16.5 Mb)
- Embargo expired in 15-08-2024
License info not available