Enhancing Point-of-Care Ultrasound Image Quality Using a Conditional GAN and Paired Data
H.G.A. van der Pol (TU Delft - Mechanical Engineering)
Freija Geldof – Mentor (Nederlands Kanker Instituut - Antoni van Leeuwenhoek ziekenhuis)
Behdad Dashtbozorg – Mentor (Nederlands Kanker Instituut - Antoni van Leeuwenhoek ziekenhuis)
Jos A. van der Hage – Mentor (Leiden University Medical Center)
Jifke Veenland – Graduation committee member (Erasmus MC)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Introduction. Point-of-care ultrasound (POCUS) devices are gaining popu-larity due to their portability and affordability, making ultrasound technology more accessible in various medical settings. However, these benefits of cost and portability come with a trade-off in imaging quality. Aim. This thesis aims to enhance the image quality of POCUS devices using deep learning and a novel paired dataset of POCUS and high-end ultrasound images. Method. First, an accurately paired dataset was created, comprising ex vivo and abdominal phantom images from both POCUS and high-end ultrasound systems. This was achieved by building an automated acquisition setup to en-sure consistent capture locations, along with comprehensive image alignment and registration steps. Second, a deep learning network was developed to en-hance POCUS image quality. A conditional Generative Adversarial Network (cGAN) with a U-Net generator, pretrained on simulation data, was trained and evaluated using this paired dataset. Results. A paired dataset of 1064 images was collected. The proposed cGAN achieved significant improvements in image quality over low-quality input im-ages, increasing the Structural Similarity Index Measure (SSIM) from 0.286 ± 0.062 to 0.540 ± 0.082 and Peak Signal-to-Noise Ratio (PSNR) from 19.155 ± 1.948 dB to 22.406 ± 2.189 dB. It also reduced the Natural Image Quality Eval-uator (NIQE) from 7.948 ± 1.772 to 4.436 ± 0.528 and Perception-based Image Quality Evaluator (PIQE) from 31.116 ± 5.911 to 19.991 ± 5.722, where lower scores indicate higher quality. Additionally, qualitative assessment showed that end-users preferred the enhanced images over the original low-quality images. Conclusions. This thesis presents the first accurately paired dataset of POCUS and high-end ultrasound images. Additionally, the developed cGAN success-fully enhanced the quality of POCUS images, surpassing the results reported in similar studies. This work demonstrates the potential for reliable quality enhancement methods for POCUS while preserving its cost and portability benefits, ultimately increasing its value and impact in the medical field.