Rheumatic Digital Twin

Proposed Machine Learning–Based Multimodal Framework to Inform Clinical Decision-Making

Review (2026)
Author(s)

Daniyal Selani (Leiden University Medical Center, TU Delft - Electrical Engineering, Mathematics and Computer Science)

Rachel Knevel (Leiden University Medical Center)

Marcel Reinders (TU Delft - Electrical Engineering, Mathematics and Computer Science, Leiden University Medical Center)

Erik B. van den Akker (TU Delft - Electrical Engineering, Mathematics and Computer Science, Leiden University Medical Center)

Research Group
Pattern Recognition and Bioinformatics
DOI related publication
https://doi.org/10.2196/86763 Final published version
More Info
expand_more
Publication Year
2026
Language
English
Research Group
Pattern Recognition and Bioinformatics
Journal title
Journal of Medical Internet Research
Volume number
28
Article number
e86763
Downloads counter
15
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Rheumatic diseases are chronic, immune-mediated conditions characterized by significant heterogeneity in presentation and disease course. However, current clinical approaches often rely on snapshot-based assessments that fail to capture the complex longitudinal evolution of these conditions. To address these limitations and support the implementation of precision medicine, we present the design for the Rheumatic Digital Twin, a novel, modular conceptual framework intended to integrate heterogeneous multimodal data, ranging from electronic health records and clinical notes to imaging and omics, into a dynamic, computational representation of the patient journey. Our theoretical architecture addresses challenges related to data silos and variable availability of data modalities through a multistage approach that envisions the use of domain-specific foundation models to independently process distinct data modalities. To effectively model the temporal progression inherent in chronic diseases, the proposed design utilizes Transformer architectures, leveraging self-attention mechanisms to treat patient events, such as lab results or medication changes, as sequential data tokens. We describe how these unimodal representations would subsequently be fused via joint embedding techniques to construct a shared, multimodal representational space. Envisioned to function analogously to a recommender system, the Rheumatic Digital Twin framework is modeled to map patients into a latent space where proximity reflects clinical and biological similarity. By identifying “nearest neighbors,” historical patients with comparable trajectories, the system aims to enable in silico cohorting, theoretically allowing clinicians to forecast key clinical events, predict treatment responses, and identify likely disease courses based on the outcomes of similar peers.