Corneal guttae, which are the abnormal growth of extracellular matrix in the corneal endothelium, are observed in specular images as black droplets that occlude the endothelial cells. To estimate the corneal parameters (endothelial cell density [ECD], coefficient of variation [CV], and hexagonality [HEX]), we propose a new deep learning method that includes a novel attention mechanism (named fNLA), which helps to infer the cell edges in the occluded areas. The approach first derives the cell edges, then infers the well-detected cells, and finally employs a postprocessing method to fix mistakes. This results in a binary segmentation from which the corneal parameters are estimated. We analyzed 1203 images (500 contained guttae) obtained with a Topcon SP-1P microscope. To generate the ground truth, we performed manual segmentation in all images. Several networks were evaluated (UNet, ResUNeXt, DenseUNets, UNet++, etc.) and we found that DenseUNets with fNLA provided the lowest error: a mean absolute error of 23.16 [cells/mm²] in ECD, 1.28 [%] in CV, and 3.13 [%] in HEX. Compared with Topcon’s built-in software, our error was 3–6 times smaller. Overall, our approach handled notably well the cells affected by guttae, detecting cell edges partially occluded by small guttae and discarding large areas covered by extensive guttae.

@en

The corneal endothelium, a non-regenerative layer of cells controlling the state of corneal hydration, is the most critical tissue of the cornea. Quantifying its health status is not only important to diagnose and treat certain corneal diseases but also relevant to the execution and evaluation of many eye surgeries. By means of specular microscopy, the endothelium can be visualized and evaluated in vivo, in a non-invasive manner. The estimation of the corneal endothelium parameters, particularly cell density, provides a valuable input for disease diagnosis, prognosis, and monitoring. Manual estimation, which requires cell segmentation, is time consuming and tedious. In this thesis, we have presented and evaluated several automatic techniques for the segmentation and quantification of the corneal endothelium. The final method was evaluated in two clinical studies: one regarding the transplantation of the cornea (41 patients, 1 year follow-up, 383 images), and another regarding the implantation of the glaucoma drainage device Baerveldt (204 patients, 2 year follow-up, 7975 images). Our method detected more than twice the number of cells than the microscope built-in software (Topcon SP-1P), and our estimation error of the corneal parameters was less than one third of Topcon’s error. Overall, our proposed fully-automatic method provided such a high accuracy that the distinctive patterns in the corneal parameters throughout the months were clearly observable and equal to the manual annotations. @en

Purpose: To present a fully automatic method to estimate the corneal endothelium parameters from specular microscopy images and to use it to study a one-year follow-up after ultrathin Descemet stripping automated endothelial keratoplasty. Methods: We analyzed 383 post ultrathin Descemet stripping automated endothelial keratoplasty images from 41 eyes acquired with a Topcon SP-1P specular microscope at 1, 3, 6, and 12 months after surgery. The estimated parameters were endothelial cell density (ECD), coefficient of variation (CV), and hexagonality (HEX). Manual segmentation was performed in all images. Results: Our method provided an estimate for ECD, CV, and HEX in 98.4% of the images, whereas Topcon’s software had a success rate of 71.5% for ECD/CV and 30.5% for HEX. For the images with estimates, the percentage error in our method was 2.5% for ECD, 5.7% for CV, and 5.7% for HEX, whereas Topcon’s software provided an error of 7.5% for ECD, 17.5% for CV, and 18.3% for HEX. Our method was significantly better than Topcon’s (P < 0.0001) and was not statistically significantly different from the manual assessments (P > 0.05). At month 12, the subjects presented an average ECD = 1377 ± 483 [cells/mm² ], CV = 26.1 ± 5.7 [%], and HEX = 58.1 ± 7.1 [%]. Conclusions: The proposed method obtains reliable and accurate estimations even in challenging specular images of pathologic corneas. Translational Relevance: CV and HEX, not currently used in the clinic owing to a lack of reliability in automatic methods, are useful biomarkers to analyze the postoperative healing process. Our accurate estimations allow now for their clinical use.

@en

Background Corneal endothelium (CE) images provide valuable clinical information regarding the health state of the cornea. Computation of the clinical morphometric parameters requires the segmentation of endothelial cell images. Current techniques to image the endothelium in vivo deliver low quality images, which makes automatic segmentation a complicated task. Here, we present two convolutional neural networks (CNN) to segment CE images: a global fully convolutional approach based on U-net, and a local sliding-window network (SW-net). We propose to use probabilistic labels instead of binary, we evaluate a preprocessing method to enhance the contrast of images, and we introduce a postprocessing method based on Fourier analysis and watershed to convert the CNN output images into the final cell segmentation. Both methods are applied to 50 images acquired with an SP-1P Topcon specular microscope. Estimates are compared against a manual delineation made by a trained observer. Results U-net (AUC=0.9938) yields slightly sharper, clearer images than SW-net (AUC=0.9921). After postprocessing, U-net obtains a DICE=0.981 and a MHD=0.22 (modified Hausdorff distance), whereas SW-net yields a DICE=0.978 and a MHD=0.30. U-net generates a wrong cell segmentation in only 0.48% of the cells, versus 0.92% for the SW-net. U-net achieves statistically significant better precision and accuracy than both, Topcon and SW-net, for the estimates of three clinical parameters: cell density (ECD), polymegethism (CV), and pleomorphism (HEX). The mean relative error in U-net for the parameters is 0.4% in ECD, 2.8% in CV, and 1.3% in HEX. The computation time to segment an image and estimate the parameters is barely a few seconds. Conclusions Both methods presented here provide a statistically significant improvement over the state of the art. U-net has reached the smallest error rate. We suggest a segmentation refinement based on our previous work to further improve the performance.@en

In images of the corneal endothelium (CE) acquired by specular microscopy, endothelial cells are commonly only visible in a part of the image due to varying contrast, mainly caused by challenging imaging conditions as a result of a strongly curved endothelium. In order to estimate the morphometric parameters of the corneal endothelium, the analyses need to be restricted to trustworthy regions - the region of interest (ROI) - where individual cells are discernible. We developed an automatic method to find the ROI by Dense U-nets, a densely connected network of convolutional layers. We tested the method on a heterogeneous dataset of 140 images, which contains a large number of blurred, noisy, and/or out of focus images, where the selection of the ROI for automatic biomarker extraction is vital. By using edge images as input, which can be estimated after retraining the same network, Dense U-net detected the trustworthy areas with an accuracy of 98.94% and an area under the ROC curve (AUC) of 0.998, without being affected by the class imbalance (9:1 in our dataset). After applying the estimated ROI to the edge images, the mean absolute percentage error (MAPE) in the estimated endothelial parameters was 0.80% for ECD, 3.60% for CV, and 2.55% for HEX.@en

The morphometric parameters of the corneal endothelium – cell density (ECD), cell size variation (CV), and hexagonality (HEX) – provide clinically relevant information about the cornea. To estimate these parameters, the endothelium is commonly imaged with a non-contact specular microscope and cell segmentation is performed to these images. In previous work, we have developed several methods that, combined, can perform an automated estimation of the parameters: the inference of the cell edges, the detection of the region of interest (ROI), a post-processing method that combines both images (edges and ROI), and a refinement method that removes false edges. In this work, we first explore the possibility of using a CNN-based regressor to directly infer the parameters from the edge images, simplifying the framework. We use a dataset of 738 images coming from a study related to the implantation of a Baerveldt glaucoma device and a standard clinical care regarding DSAEK corneal transplantation, both from the Rotterdam Eye Hospital and both containing images of unhealthy endotheliums. This large dataset allows us to build a large training set that makes this approach feasible. We achieved a mean absolute percentage error (MAPE) of 4.32% for ECD, 7.07% for CV, and 11.74% for HEX. These results, while promising, do not outperform our previous work. In a second experiment, we explore the use of the CNN-based regressor to improve the post-processing method of our previous approach in order to adapt it to the specifics of each image. Our results showed no clear benefit and proved that our previous post-processing is already highly reliable and robust.@en

Corneal endothelium images obtained by in vivo specular microscopy provide important information to assess the health status of the cornea. Estimation of clinical parameters, such as cell density, polymegethism, and pleomorphism, requires accurate cell segmentation. State-of-the-art techniques to automatically segment the endothelium are error-prone when applied to images with low contrast and/or large variation in cell size. Here, we propose an automatic method to segment the endothelium. Starting with an oversegmented image comprised of superpixels obtained from a stochastic watershed segmentation, the proposed method uses intensity and shape information of the superpixels to identify and merge those that constitute a cell, using Support Vector Machines. We evaluated the automatic segmentation on a dataset of in vivo specular microscopy images (Topcon SP-1P), obtaining 95.8merged cells and 2.0the parameter estimation against the results of the vendor&#x2019;s builtin software, obtaining a statistically significant better precision in all parameters and a similar or better accuracy. The parameter estimation was also evaluated on three other datasets from different imaging modalities (confocal microscopy, phasecontrast microscopy, and fluorescence confocal microscopy) and tissue types (ex vivo corneal endothelium and retinal pigment epithelium). In comparison with the estimates of the datasets&#x2019; authors, we achieved statistically significant better accuracy and precision in all parameters except pleomorphism, where a similar accuracy and precision were obtained.

@en

Clinical parameters related to the corneal endothelium can only be estimated by segmenting endothelial cell images. Specular microscopy is the current standard technique to image the endothelium, but its low SNR make the segmentation a complicated task. Recently, we proposed a method to segment such images by starting with an oversegmented image and merging the superpixels that constitute a cell. Here, we show how our merging method provides better results than optimizing the segmentation itself. Furthermore, our method can provide accurate results despite the degree of the initial oversegmentation, resulting into a precision and recall of 0.91 for the optimal oversegmentation.@en