Stability of Cell-Specific Gene Regulatory Networks Inferred by ScReNI

Why Out-of-Bag Accuracy Falls Short and Edge Weight Variance Shows Promise

Bachelor Thesis (2026)
Author(s)

E. Cîmpean (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Contributor(s)

M.J.T. Reinders – Graduation committee member (TU Delft - Electrical Engineering, Mathematics and Computer Science)

S.E. Verwer – Graduation committee member (TU Delft - Electrical Engineering, Mathematics and Computer Science)

T. Verlaan – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)

I.B. Pronk – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Faculty
Electrical Engineering, Mathematics and Computer Science
More Info
expand_more
Publication Year
2026
Language
English
Graduation Date
21-06-2026
Awarding Institution
Delft University of Technology
Project
CSE3000 Research Project
Programme
Computer Science and Engineering
Faculty
Electrical Engineering, Mathematics and Computer Science
Downloads counter
7
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Gene regulatory networks (GRNs) inferred at single-cell resolution offer insight into regulatory mechanisms underlying complex diseases such as Alzheimer's disease, but the reliability of the GRNs produced by methods such as ScReNI is not fully explored. This work investigates the stability and reliability of GRNs inferred by a Python reimplementation of ScReNI applied to the Seattle Alzheimer's Disease Brain Cell Atlas (SEA-AD) and a mouse retinal dataset. Three experiments were conducted. First, gene-level prediction accuracy, measured via random forest out-of-bag (OOB) R2, was found to vary across genes and to be driven primarily by expression level rather than network position. Second, two main candidate cell-level reliability metrics were evaluated against precision and recall: OOB Rshowed no significant association with precision once network density and expression were statistically controlled for, whereas edge weight variance across repeated inference runs retained significant correlation with both, making it the more promising candidate metric identified. Third, comparing the GRNs of cells with high versus low edge weight variance within cell types revealed that such networks share similar topological structure but diverge substantially in edge weight magnitude. These findings indicate that out-of-bag accuracy alone is an insufficient proxy for GRN reliability, and that edge weight variance, while more informative, does not yet provide a fully cell-type-consistent reliability metric, motivating further work on alternative approaches to quantifying single-cell GRN stability.

Files

Research_Project_Paper.pdf
(pdf | 0.755 Mb)
License info not available