MS

M. Sabbaqi

info

Please Note

6 records found

Graph Kalman Filtering and Model Inference via Model-based Deep Learning

Journal article (2026) - M. Sabbaqi, R. Taormina, E. Isufi
Inference tasks involving time series over graphs are of importance in applications such as urban water networks, economics, and networked neuroscience. Addressing these tasks typically relies on identifying a computationally affordable model that jointly captures the graph-temporal patterns of the data. In this work, we propose a graph-aware state space model for graph time series, where both the latent state and the observation equation are parametric graph-induced models. More specifically, we consider the state equation to follow a stochastic partial differential equation driven by noise over the edges accounting not only for potential uncertainties thereof, but also for increasing the degrees of freedom in a tractable manner. The graph structure conditioning of the noise dispersion allows the state variable to deviate from the stochastic process in certain neighborhoods. The observation model is a sampled and graphfiltered version of the state capturing multi-hop neighboring influence. The goal is to learn the parameters in both state and observation models from the partially observed data for downstream tasks such as prediction and imputation. The model is inferred first through a maximum likelihood approach that provides theoretical tractability but is limited in expressivity and scalability. To improve on the latter, we use the state space formulation to build a principled deep learning architecture that jointly learns the parameters and tracks the state in an endto- end manner in the spirit of Kalman neural networks. The proposed models are evaluated on controlled and four real-world scenarios, showing the effectiveness of the proposed approach when the model lacks training data. Finally, we conduct a case study on water networks, where the proposed model is used to predict the water levels in the network when the data is extremely scarce. ...

A Principled and Robust Approach to Learning from Relational Time Series

Doctoral thesis (2026) - M. Sabbaqi, A. Hanjalic, E. Isufi, R. Taormina
Learning representations from relational time series is a fundamental problem in many applications involving social networks, finance, and urban water systems, among others. In these domains, a wide variety of tasks require modeling relational time series for imputating missing ratings in a social network, forecasting of stock prices in a financial market, and anomaly detection in urban water systems. Such data upholds complex relatio-temporal dependencies that introduce multiple challenges per se. Data efficiency, robustness to structural perturbations, scalability to large-scale networks, interpretability, and transferability are some main challenges pertaining to the full scale deployment of machine learning solutions in this setting. However, the underlying fundamental challenge is to jointly model the temporal patterns and the relational dependencies simultaneously underpinning the aforementioned issues. This dissertation aims to study machine learning models for relational time series for this setup.... ...
Conference paper (2024) - Rohan Money, Mohammad Sabbaqi, Joshin Krishnan, Baltasar Beferull-Lozano, Elvin Isufi
In this paper, we propose a topology-aware Kalman filter for hidden dynamics over simplicial complex. Specifically, we consider that the hidden dynamics of a system can be expressed as a simplicial process that respects the structure of the underlying network. And these dynamics are observed through an observation matrix, which can be represented using simplicial convolution filters. This combination allows us to model effectively a broader spectrum of network dynamics than graph-based alternatives, such as edge flow evolution. Additionally, we propose a parametric, structure-aware noise covariance model for the system dynamics. We alternate between estimating the process state using the Kalman filter and updating the parameters through maximum likelihood estimation. The efficacy of the proposed approach is demonstrated through experiments on both real-world and synthetic datasets. ...
Conference paper (2024) - Mohammad Sabbaqi, Elvin Isufi
Inference of time varying data over graphs is of importance in real-world applications such as urban water networks, economics, and brain recordings. It typically relies on identifying a computationally affordable joint spatiotemporal method that can leverage the patterns in the data. While this per se is a challenging task, it becomes even more so when the network comes with uncertainties, which, if not accounted for, can lead to unpredictable consequences. To target this setting, we model graph uncertainties as Gaussian noise on the edges and design a stochastic partial differential equation (SPDE) based on it. We use this SPDE as a state equation to model the time varying signal evolution and extend it further to a state-space model where the observations are graph-filtered versions of the state. This allows us to have a joint spatiotemporal expressive kernel that can be estimated online via Kalman filtering and which parameters can also be estimated online via maximum likelihood principles, ultimately, reducing the computational cost. We corroborate the proposed approach on numerical experiments, showing a superior performance to approaches ignoring either the uncertainty or considering a separable spatiotemporal kernel. ...

Architecture and Theoretical Analysis

Journal article (2023) - Mohammad Sabbaqi, Elvin Isufi
Devising and analysing learning models for spatiotemporal network data is of importance for tasks including forecasting, anomaly detection, and multi-agent coordination, among others. Graph Convolutional Neural Networks (GCNNs) are an established approach to learn from time-invariant network data. The graph convolution operation offers a principled approach to aggregate information and offers mathematical analysis by exploring tools from graph signal processing. This analysis provides insights into the equivariance properties of GCNNs; spectral behaviour of the learned filters; and the stability to graph perturbations, which arise from support perturbations or uncertainties. However, extending the convolutional learning and respective analysis to the spatiotemporal domain is challenging because spatiotemporal data have more intrinsic dependencies. Hence, a higher flexibility to capture jointly the spatial and temporal dependencies is required to learn meaningful higher-order representations. Here, we leverage product graphs to represent the spatiotemporal dependencies in the data and introduce Graph-Time Convolutional Neural Networks (GTCNNs) as a principled architecture. We also introduce a parametric product graph to learn the spatiotemporal coupling. The convolution principle further allows a similar mathematical tractability as for GCNNs. In particular, the stability result shows GTCNNs are stable to spatial perturbations. owever, there is an implicit trade-off between discriminability and robustness; i.e., the more complex the model, the less stable. Extensive numerical results on benchmark datasets corroborate our findings and show the GTCNN compares favorably with state-of-the-art solutions. We anticipate the GTCNN to be a starting point for more sophisticated models that achieve good performance but are also fundamentally grounded. ...
Conference paper (2023) - Mohammad Sabbaqi, Elvin Isufi
Reconstructing missing values and removing noise from network-based multivariate time series requires developing graph-time regularizers capable of capturing their spatiotemporal behavior. However, current approaches based on joint spatiotemporal smoothness, diffusion, or variations thereof may not be effective for time series with discontinuities across the graph or time. To address this challenge, we propose a joint graph-time trend filter operating over a product graph representing spatiotemporal relations. Additionally, we develop a graph-time unrolled neural network to learn the prior from the data, which is based on the alternating direction method of multipliers iterations of the graph-time trend filter and on graph-time convolutional filters. Numerical tests with two synthetic and four real datasets corroborate the effectiveness of both approaches, highlight their inherent trade-offs, and show they compare well with state-of-the-art alternatives. ...