Objective: Only few studies have investigated quantitative magnetic resonance imaging (MRI) T₂ mapping of knee cartilage in population-based cohorts. Our objective was to evaluate the association between T₂ relaxation times of different cartilage segments and the presence of knee MRI-based osteoarthritis (OA) and patient characteristics in a large population-based cohort. Design: In this cross-sectional study, we included 673 females (mean age: 59.8 years; standard deviation: 3.7) scanned with 1.5T-MRI from a sub-cohort of the Rotterdam Study. T₂ relaxation times were calculated in six femoral and tibial cartilage regions of interest. Associations between T₂ relaxation times, MRI Osteoarthritis Knee Score (MOAKS)-based tibiofemoral OA, and Knee injury and Osteoarthritis Outcome Score (KOOS)-based symptom status were evaluated using multivariate fixed effects regression analyses. Results: A total of 1332 knees were included, of which 237 (17.7%) had MRI-based OA. Patients with OA had higher T₂ relaxation times across all cartilage segments, and T₂ values positively correlated with BMI (r = 0.17–0.46), the strongest correlations being in the lateral compartment. Weak associations were found between T₂ relaxation times and age. After adjustments, T₂ values in the lateral weight-bearing femur (OR: 0.67; 95%CI: 0.56–0.79), lateral tibia (OR: 1.11; 95%CI: 1.00–1.24), lateral posterior femur (OR: 1.48; 95%CI: 1.28–1.72), and medial posterior femur (OR: 1.14; 95%CI: 1.01–1.30), were associated with the presence of OA. T₂ relaxation times were not associated with the KOOS-based symptom status. Conclusion: In this population-based cohort, T₂ values were associated with BMI. Additionally, T₂ values in the lateral cartilage subregions were associated with MRI-based OA.

Rationale and Objectives: Distinguishing malignant from benign liver lesions based on magnetic resonance imaging (MRI) is an important but often challenging task, especially in noncirrhotic livers. We developed and externally validated a radiomics model to quantitatively assess T2-weighted MRI to distinguish the most common malignant and benign primary solid liver lesions in noncirrhotic livers. Materials and Methods: Data sets were retrospectively collected from three tertiary referral centers (A, B, and C) between 2002 and 2018. Patients with malignant (hepatocellular carcinoma and intrahepatic cholangiocarcinoma) and benign (hepatocellular adenoma and focal nodular hyperplasia) lesions were included. A radiomics model based on T2-weighted MRI was developed in data set A using a combination of machine learning approaches. The model was internally evaluated on data set A through cross-validation, externally validated on data sets B and C, and compared to visual scoring of two experienced abdominal radiologists on data set C. Results: The overall data set included 486 patients (A: 187, B: 98, and C: 201). The radiomics model had a mean area under the curve (AUC) of 0.78 upon internal validation on data set A and a similar AUC in external validation (B: 0.74 and C: 0.76). In data set C, the two radiologists showed moderate agreement (Cohen's κ: 0.61) and achieved AUCs of 0.86 and 0.82. Conclusion: Our T2-weighted MRI radiomics model shows potential for distinguishing malignant from benign primary solid liver lesions. External validation indicated that the model is generalizable despite substantial MRI acquisition protocol differences. Pending further optimization and generalization, this model may aid radiologists in improving the diagnostic workup of patients with liver lesions.

Computer-aided methods have shown added value for diagnosing and predicting brain disorders and can thus support decision making in clinical care and treatment planning. This chapter will provide insight into the type of methods, their working, their input data –such as cognitive tests, imaging, and genetic data– and the types of output they provide. We will focus on specific use cases for diagnosis, i.e., estimating the current “condition” of the patient, such as early detection and diagnosis of dementia, differential diagnosis of brain tumors, and decision making in stroke. Regarding prediction, i.e., estimation of the future “condition” of the patient, we will zoom in on use cases such as predicting the disease course in multiple sclerosis and predicting patient outcomes after treatment in brain cancer. Furthermore, based on these use cases, we will assess the current state-of-the-art methodology and highlight current efforts on benchmarking of these methods and the importance of open science therein. Finally, we assess the current clinical impact of computer-aided methods and discuss the required next steps to increase clinical impact.

BACKGROUND: Accurate characterization of glioma is crucial for clinical decision making. A delineation of the tumor is also desirable in the initial decision stages but is time-consuming. Previously, deep learning methods have been developed that can either non-invasively predict the genetic or histological features of glioma, or that can automatically delineate the tumor, but not both tasks at the same time. Here, we present our method that can predict the molecular subtype and grade, while simultaneously providing a delineation of the tumor. METHODS: We developed a single multi-task convolutional neural network that uses the full 3D, structural, preoperative MRI scans to predict the IDH mutation status, the 1p/19q co-deletion status, and the grade of a tumor, while simultaneously segmenting the tumor. We trained our method using a patient cohort containing 1508 glioma patients from 16 institutes. We tested our method on an independent dataset of 240 patients from 13 different institutes. RESULTS: In the independent test set, we achieved an IDH-AUC of 0.90, an 1p/19q co-deletion AUC of 0.85, and a grade AUC of 0.81 (grade II/III/IV). For the tumor delineation, we achieved a mean whole tumor Dice score of 0.84. CONCLUSIONS: We developed a method that non-invasively predicts multiple, clinically relevant features of glioma. Evaluation in an independent dataset shows that the method achieves a high performance and that it generalizes well to the broader clinical population. This first-of-its-kind method opens the door to more generalizable, instead of hyper-specialized, AI methods.

Treatment planning of gastrointestinal stromal tumors (GISTs) includes distinguishing GISTs from other intra-abdominal tumors and GISTs’ molecular analysis. The aim of this study was to evaluate radiomics for distinguishing GISTs from other intra-abdominal tumors, and in GISTs, predict the c-KIT, PDGFRA, BRAF mutational status, and mitotic index (MI). Patients diagnosed at the Erasmus MC between 2004 and 2017, with GIST or non-GIST intra-abdominal tumors and a contrast-enhanced venous-phase CT, were retrospectively included. Tumors were segmented, from which 564 image features were extracted. Prediction models were constructed using a combination of machine learning approaches. The evaluation was performed in a 100 × random-split cross-validation. Model performance was compared to that of three radiologists. One hundred twenty-five GISTs and 122 non-GISTs were included. The GIST vs. non-GIST radiomics model had a mean area under the curve (AUC) of 0.77. Three radiologists had an AUC of 0.69, 0.76, and 0.84, respectively. The radiomics model had an AUC of 0.52 for c-KIT, 0.56 for c-KIT exon 11, and 0.52 for the MI. The numbers of PDGFRA, BRAF, and other c-KIT mutations were too low for analysis. Our radiomics model was able to distinguish GISTs from non-GISTs with a performance similar to three radiologists, but less observer dependent. Therefore, it may aid in the early diagnosis of GIST, facilitating rapid referral to specialized treatment centers. As the model was not able to predict any genetic or molecular features, it cannot aid in treatment planning yet.

Patients with BRAF mutated (BRAF-mt) metastatic melanoma benefit significantly from treatment with BRAF inhibitors. Currently, the BRAF status is determined on archival tumor tissue or on fresh tumor tissue from an invasive biopsy. The aim of this study was to evaluate whether radiomics can predict the BRAF status in a non-invasive manner. Patients with melanoma lung metastases, known BRAF status, and a pretreatment computed tomography scan were included. After semi-automatic annotation of the lung lesions (maximum two per patient), 540 radiomics features were extracted. A chest radiologist scored all segmented lung lesions according to the Lung Image Database Consortium (LIDC) criteria. Univariate analysis was performed to assess the predictive value of each feature for BRAF mutation status. A combination of various machine learning methods was used to develop BRAF decision models based on the radiomics features and LIDC criteria. A total of 169 lung lesions from 103 patients (51 BRAF-mt; 52 BRAF wild type) were included. There were no features with a significant discriminative value in the univariate analysis. Models based on radiomics features and LIDC criteria both performed as poorly as guessing. Hence, the BRAF mutation status in melanoma lung metastases cannot be predicted using radiomics features or visually scored LIDC criteria.

Retinal vascular diseases are a leading cause for blindness and partial sight certifications. By applying adaptive optics (AO) to conventional imaging modalities, the microstructures of the retinal vasculature can be observed with high spatial resolution, hence offering a unique opportunity for the exploration of the human microcirculation. The objective of this systematic review is to describe the current state of retinal vascular biomarkers imaged by AO flood illumination ophthalmoscopy (FIO) and AO scanning laser ophthalmoscopy (SLO). A literature research was conducted in the PubMed and Scopus databases on July 9, 2020. From 217 screened studies, 42 were eligible for this review. All studies underwent a quality check regarding their content. A meta-analysis was performed for the biomarkers reported for the same pathology in at least three studies using the same modality. The most frequently studied vascular biomarkers were the inner diameter (ID), outer diameter (OD), parietal thickness (PT), wall cross-sectional area (WCSA), and wall-to-lumen ratio (WLR). The applicability of AO vascular biomarkers has been mostly explored in systemic hypertension using AO FIO and in diabetes using AO SLO. The result of the meta-analysis for hypertensive patients showed that WLR, PT, and ID were significantly different when compared to healthy controls, while WCSA was not (P < 0.001, P = 0.002, P < 0.001, and P = 0.070, respectively). The presented review shows that, although a substantial number of retinal vascular biomarkers have been explored in AO en face imaging, further clinical research and standardization of procedures is needed to validate such biomarkers for the longitudinal monitoring of arterial hypertension and other diseases.

This work validates the generalizability of MRI-based classification of Alzheimer's disease (AD) patients and controls (CN) to an external data set and to the task of prediction of conversion to AD in individuals with mild cognitive impairment (MCI). We used a conventional support vector machine (SVM) and a deep convolutional neural network (CNN) approach based on structural MRI scans that underwent either minimal pre-processing or more extensive pre-processing into modulated gray matter (GM) maps. Classifiers were optimized and evaluated using cross-validation in the Alzheimer's Disease Neuroimaging Initiative (ADNI; 334 AD, 520 CN). Trained classifiers were subsequently applied to predict conversion to AD in ADNI MCI patients (231 converters, 628 non-converters) and in the independent Health-RI Parelsnoer Neurodegenerative Diseases Biobank data set. From this multi-center study representing a tertiary memory clinic population, we included 199 AD patients, 139 participants with subjective cognitive decline, 48 MCI patients converting to dementia, and 91 MCI patients who did not convert to dementia. AD-CN classification based on modulated GM maps resulted in a similar area-under-the-curve (AUC) for SVM (0.940; 95%CI: 0.924–0.955) and CNN (0.933; 95%CI: 0.918–0.948). Application to conversion prediction in MCI yielded significantly higher performance for SVM (AUC = 0.756; 95%CI: 0.720-0.788) than for CNN (AUC = 0.742; 95%CI: 0.709-0.776) (p<0.01 for McNemar's test). In external validation, performance was slightly decreased. For AD-CN, it again gave similar AUCs for SVM (0.896; 95%CI: 0.855–0.932) and CNN (0.876; 95%CI: 0.836–0.913). For prediction in MCI, performances decreased for both SVM (AUC = 0.665; 95%CI: 0.576-0.760) and CNN (AUC = 0.702; 95%CI: 0.624-0.786). Both with SVM and CNN, classification based on modulated GM maps significantly outperformed classification based on minimally processed images (p=0.01). Deep and conventional classifiers performed equally well for AD classification and their performance decreased only slightly when applied to the external cohort. We expect that this work on external validation contributes towards translation of machine learning to clinical practice.

An automated method for registering B-mode ultrasound (US) and magnetic resonance imaging (MRI) of the carotid arteries is proposed. The registration uses geometric features, namely, lumen centerlines and lumen segmentations, which are extracted fully automatically from the images after manual annotation of three seed points in US and MRI. The registration procedure starts with alignment of the lumen centerlines using a point-based registration algorithm. The resulting rigid transformation is used to initialize a rigid and subsequent non-rigid registration procedure that jointly aligns centerlines and segmentations by minimizing a weighted sum of the Euclidean distance between centerlines and the dissimilarity between segmentations. The method was evaluated in 28 carotid arteries from eight patients and six healthy volunteers. First, the automated US lumen segmentation method was validated and optimized in a cross-validation experiment. Next, the effect of the weighting parameter of the proposed registration dissimilarity metric and the control point spacing in the non-rigid registration was evaluated. Finally, the proposed registration method was evaluated in comparison to an existing intensity-and-point-based method, a registration using only the centerlines and a registration using manual US lumen segmentations. Registration accuracy was measured in terms of the mean surface distance between manual US segmentations and the registered MRI segmentations. The average mean surface distance was 0.78 ± 0.34 mm for all subjects, 0.65 ± 0.09 mm for healthy volunteers and 0.87 ± 0.42 mm for patients. The results for the complete set were significantly better (Wilcoxon test, p <0.01) than the results for the intensity-and-point-based method and the centerline-based registration method. We conclude that the proposed method can robustly and accurately register US and MR images of the carotid artery, allowing multimodal analysis of the carotid plaque to improve plaque assessment.

Background and aims In a large stroke-free population, we sought to identify cardiovascular risk factors and carotid plaque components associated with carotid plaque burden, lumen volume and stenosis. Methods The carotid arteries of 1562 stroke-free participants from The Rotterdam Study were imaged on a 1.5-Tesla MRI scanner. Inner and outer wall of the carotid arteries were automatically segmented and lumen volume (mm³), wall volume (outer wall–inner wall) and plaque burden (wall volume/outer wall volume) (%) were quantified. Plaque components were visually determined and luminal stenosis was assessed. We analyzed associations of cardiovascular risk factors and carotid plaque components with plaque burden and lumen volumes using regression analysis. Results We investigated 2821 carotid plaques and found that women had larger plaque burden (50.7 ± 7.8% vs. 49.2 ± 7.7%, p <0.0001) and smaller lumen volumes (933 ± 286 mm³ vs. 1078 ± 334 mm³, p <0.0001) than men. In women, age, HDL-cholesterol and systolic blood pressure, and in men, total cholesterol, non-HDL cholesterol and statin use were independently associated with higher plaque burden and lumen volume. Furthermore, smoking and diabetes were associated with lumen volume in men (respectively p = 0.04 and p = 0.002). Intraplaque hemorrhage (IPH) and lipid were related to a larger plaque burden (OR 1.30 [1.05–1.60] and OR 1.28[1.06–1.55]). Finally, within the highest quartile of plaque burden, IPH was strongly associated with luminal stenosis independent of age, sex, plaque burden and composition (Beta = 15.2; [11.8–18.6]). Conclusions Several cardiovascular risk factors and plaque components, in particular IPH, are associated with higher plaque burden. Carotid IPH is strongly associated with an increased luminal stenosis.