B. De Schutter
Please Note
291 records found
1
This paper investigates the growth rate and fixed points of periodic max-min-plus-scaling (MMPS) systems with a period greater than one. First, we analyze the average growth rate of the periodic MMPS system by introducing an extended periodic form for the MMPS system. Then we propose a tree search algorithm to calculate the average growth rate of the periodic MMPS system with shorter execution time as compared to similar existing algorithms for MMPS systems.
Dispersion modeling is crucial for marine environmental modeling and management. However, operational applications require a practical balance between model accuracy and computational efficiency. To address this challenge, we develop and validate a generalized cell-based model (CBM) framework for contaminant dispersion. The framework enhances physical realism through a novel three-dimensional (3D) transport model and a formulation for chemical reactions. Additionally, a new discretization-based approach is proposed to robustly relate the CBM’s diffusion coefficient to its partial differential equation counterpart, improving performance in scenarios with sharp gradients of the concentration level. The proposed framework’s favorable trade-off between accuracy and efficiency is demonstrated in a comparative simulation study, where the 3D CBM reduces computation time from 14.72 s to 0.06 s compared to finite-element methods (FEM), with a relative Root Mean Square Error (RMSE) of 7.67%. To demonstrate its practical applicability, the proposed framework is validated using ocean current and nitrate concentration data from the Copernicus Marine Environment Monitoring Service. After identifying a key model parameter from the data, the model’s forward predictions accurately reproduce the observed nitrate concentration patterns, confirming its suitability for operational scenarios.
This paper presents a deep learning framework for analyzing on-board vibration response signals in infrastructure health monitoring. The proposed WaveletInception–BiGRU network uses a Learnable Wavelet Packet Transform (LWPT) for early spectral feature extraction, followed by one-dimensional Inception-Residual Network (1D Inception-ResNet) modules for multi-scale, high-level feature learning. Bidirectional Gated Recurrent Unit (BiGRU) modules then integrate temporal dependencies and incorporate operational conditions, such as the measurement speed. This approach enables effective analysis of vibration signals recorded at varying speeds, eliminating the need for explicit signal preprocessing. The sequential estimation head further leverages bidirectional temporal information to produce an accurate, localized assessment of infrastructure health. Ultimately, the framework generates high-resolution health profiles spatially mapped to the physical layout of the infrastructure. Case studies involving track stiffness regression and transition zone classification using real-world measurements demonstrate that the proposed framework significantly outperforms state-of-the-art methods, underscoring its potential for accurate, localized, and automated on-board infrastructure health monitoring.
Efficient energy management is essential for sustainable microgrid operation amid increasing renewable energy integration. In this paper, an imitation learning-based framework to approximate mixed-integer Economic Model Predictive Control (EMPC) is proposed for microgrid energy management, considering fuel generators, renewable energy resources, a unified energy storage unit, and curtailable loads. Within the proposed framework, a neural network is trained to imitate EMPC control actions from offline trajectories, thereby enabling fast real-time decision making without solving online mixed-integer optimization problems, which often exhibit highly variable solution times across instances and do not scale well to large problem sizes; in particular, worst-case solving times can be excessively large and therefore unsuitable for real-time deployment. In contrast, the learned policy provides predictable and consistently low computation times. For robustness and generalization, the learning process incorporates noise injection during training to mitigate distribution shift and explicitly accounts for forecast uncertainty in renewable generation and demand. Furthermore, a constraint-tightening approach combined with a projection layer built on control barrier functions is proposed to ensure recursive feasibility and constraint satisfaction for the learned controller. Simulation results demonstrate that the learned policy achieves economic performance comparable to EMPC, while reducing computation time by approximately one order of magnitude relative to the optimization-based EMPC.
A unified framework for multi-agent formation with a non-repetitive leader
Adaptive control and iterative learning control
Formation Tracking (FT) control is aimed at handling cooperative tasks in Multi-Agent Systems (MASs) to achieve desired performance. In these tasks, the leader's input is generally non-zero and unknown to all followers, i.e., its trajectory can be arbitrary and non-repetitive. In this paper, the additive property of linear systems is exploited to develop a unified framework for FT tasks of MASs, consisting of Adaptive Observer-based Control (AOC) and Iterative Learning Control (ILC). An AOC controller is employed to guarantee a fixed-shape formation between the leader and followers during the whole process, which reserves the initial condition for ILC. And ILC is used to improve the FT performance of certain repetitive tasks (followers rotating around the leader) over the trials. This gives rise to a fully distributed algorithm working for a directed communication graph containing a spanning tree without requiring any eigenvalue information from the Laplacian matrix of the graph, which enables its application to MASs with a large number of agents. Comparison is made via a numerical simulation to show that the proposed combined AOC-ILC algorithm has less FT error than pure AOC (without ILC), which validates the feasibility and efficacy of this algorithm.
Certainty-Equivalence Model Predictive Control
Stability, Performance, and Beyond
Handling model mismatch is a common challenge in model predictive control (MPC). While robust MPC is effective, its conservatism often makes it less desirable. Certainty-equivalence MPC (CE-MPC), which uses a nominal model, offers an appealing alternative due to its design simplicity and low computational costs. This paper investigates CE-MPC for uncertain nonlinear systems with multiplicative parametric uncertainty and input constraints that are inactive at the steady state. The primary contributions are two-fold. First, a novel perturbation analysis of the MPC value function is provided, without assuming the Lipschitz continuity of the stage cost, better tailoring the widely used quadratic cost and having broader applicability in value function approximation, learning-based MPC, and performance-driven MPC design. Second, the stability and performance analysis of CE-MPC are provided, quantifying the suboptimality of CE-MPC compared to the infinite-horizon optimal controller with perfect model knowledge. The results provide insights in how the prediction horizon and model mismatch jointly affect stability and the worst-case performance. Furthermore, the general results are specialized to linear quadratic control, and a competitive ratio bound is derived, serving as the first competitive-ratio bound for MPC of uncertain linear systems with input constraints and multiplicative uncertainty.
Max-min-plus-scaling (MMPS) systems extend max-plus and max-min-plus models by incorporating a scaling operation, making them suitable for modeling discrete-event systems involving timing, synchronization, and resource constraints. This paper focuses on implicit MMPS systems, where the current state depends on itself, which complicates analysis because solutions may not exist or may be non-unique. We investigate conditions under which such systems are solvable. We prove that the implicit MMPS system is solvable if the corresponding implicit interconnection graph does not contain any circuits. When there exist a circuit, we develop necessary and sufficient conditions for the system to be solvable. The paper also discusses solvable regions and proposes an iterative method for computing system states. We demonstrate all the theoretical results with a numerical example.
PieceWise Affine (PWA) approximations for nonlinear functions have been extensively used for tractable, computationally efficient control of nonlinear systems. However, reaching a desired approximation accuracy without prior information about the behavior of the nonlinear systems remains a challenge in the function approximation and control literature. As the name suggests, PWA approximation aims at approximating a nonlinear function or system by dividing the domain into multiple subregions where the nonlinear function or dynamics is approximated locally by an affine function also called local mode. Without prior knowledge of the form of the nonlinearity, the required number of modes, the locations of the subregions, and the local approximations need to be optimized simultaneously, which becomes highly complex for large-scale systems with multi-dimensional nonlinear functions. This paper introduces a novel approach for PWA approximation of multi-dimensional nonlinear systems, utilizing a hinging hyperplane formalism for cut-based partitioning of the domain. The complexity of the PWA approximation is iteratively increased until reaching the desired accuracy level. Further, the tractable cut definitions allow for different forms of subregions, as well as the ability to impose continuity constraints on the PWA approximation. The methodology is explained via multiple examples and its performance is compared to two existing approaches through case studies, showcasing its efficacy.
This paper presents a novel distributed model predictive control (MPC) formulation without terminal cost and a corresponding distributed synthesis approach for distributed linear discrete-time systems with coupled constraints. The proposed control scheme introduces an explicit stability condition as an additional constraint based on relaxed dynamic programming. As a result, contrary to other related approaches, system stability with the developed controller does not rely on designing a terminal cost. A distributed synthesis approach is then introduced to handle the stability constraint locally within each local agent. To solve the underlying optimization problem for distributed MPC, a violation-free distributed optimization approach is developed, using constraint tightening to ensure feasibility throughout iterations. A numerical example demonstrates that the proposed distributed MPC approach ensures closed-loop stability for each feasible control sequence, with each agent computing its control input in parallel.
State-Action Control Barrier Functions
Imposing Safety on Learning-Based Control With Low Online Computational Costs
Learning-based control with safety guarantees usually requires real-time safety certification and modifications of possibly unsafe learning-based policies. The control barrier function (CBF) method uses a safety filter (SF) containing a constrained optimization problem to produce safe policies. However, finding a valid CBF for a general nonlinear system requires a complex function parameterization, which in general makes the policy optimization problem difficult to solve in real time. For nonlinear systems with nonlinear state constraints, this paper proposes the novel concept of state-action CBFs (SACBFs), which do not only characterize the safety at each state but also evaluate the control inputs taken at each state. SACBFs, in contrast to CBFs, enable a flexible parameterization, resulting in a SF that involves a convex quadratic optimization problem, which significantly alleviates the online computational burden. We propose a learning-based approach to synthesize SACBFs. The effect of learning errors on the effectiveness of SACBFs is addressed by constraint tightening and introducing a new concept called contractive-set CBFs. This ensures formal safety guarantees for the learned CBFs and control policies. Simulation results on an inverted pendulum with elastic walls validate the proposed CBFs in terms of constraint satisfaction and CPU time.
Partitioning techniques for non-centralized predictive control
A systematic review and novel theoretical insights
The partitioning problem is of central relevance for designing and implementing non-centralized Model Predictive Control (MPC) strategies for large-scale systems. These control approaches include decentralized MPC, distributed MPC, hierarchical MPC, and coalitional MPC. Partitioning a system for the application of non-centralized MPC consists of finding the best definition of the subsystems, and their allocation into groups for the definition of local controllers, to maximize the relevant performance indicators. The present survey proposes a novel systematization of the partitioning approaches in the literature in five main classes: optimization-based, algorithmic, community-detection-based, game-theoretic-oriented, and heuristic approaches. A unified graph-theoretical formalism, a mathematical re-formulation of the problem in terms of mixed-integer programming, the novel concepts of predictive partitioning and multi-topological representations, and a methodological formulation of quality metrics are developed to support the classification and further developments of the field. We analyze the different classes of partitioning techniques, and we present an overview of their strengths and limitations, which include a technical discussion about the different approaches. Representative case studies are discussed to illustrate the application of partitioning techniques for non-centralized MPC in various sectors, including power systems, water networks, wind farms, chemical processes, transportation systems, communication networks, industrial automation, smart buildings, and cyber–physical systems. An outlook of future challenges completes the survey.
This work analyzes how the trade-off between the modeling error, the terminal value function error, and the prediction horizon affects the performance of a nominal receding-horizon linear quadratic (LQ) controller. By developing a novel perturbation result of the Riccati difference equation, a novel performance upper bound is obtained and suggests that for many cases, the prediction horizon can be either 1 or +∞ to improve the control performance, depending on the relative difference between the modeling error and the terminal value function error. The result also shows that when an infinite horizon is desired, a finite prediction horizon that is larger than the controllability index can be sufficient for achieving a near-optimal performance, revealing a close relation between the prediction horizon and controllability. The obtained suboptimality performance upper bound is applied to provide novel sample complexity and regret guarantees for nominal receding-horizon LQ controllers in a learning-based setting. We show that an adaptive prediction horizon that increases as a logarithmic function of time is beneficial for regret minimization.
The European Economic Area Electricity Network Benchmark (EEA-ENB) is a multi-area power system representing the European network of transmission systems for electricity to facilitate the application of distributed control techniques. In the EEA-ENB, we consider the Load Frequency Control (LFC) problem in the presence of Renewable Energy Sources (RESs), and Energy Storage Systems (ESSs). RESs are known to cause instability in power networks due to their inertialess and intermittent characteristics, while ESSs are introduced as a resource to mitigate the problem. In the EEA-ENB, particular attention is dedicated to Distributed Model Predictive Control (DMPC), whose application is often limited to small and homogeneous test cases due to the lack of standardized large-scale scenarios for testing, and due to the large computation time required to obtain a centralized MPC action for performance comparison with DMPC strategies under consideration. The second problem is exacerbated when the scale of the system grows. To address these challenges and to provide a real-world-based and control-independent benchmark, the EEA-ENB has been developed. The benchmark includes a centralized MPC strategy providing performance and computation time metrics to compare distributed control within a repeatable and realistic simulation environment.
In the backdrop of an increasingly pressing need for effective urban and highway transportation systems, this work explores the synergy between model-based and learning-based strategies to enhance traffic flow management by use of an innovative approach to the problem of ramp metering control that embeds Reinforcement Learning (RL) techniques within the Model Predictive Control (MPC) framework. The control problem is formulated as an RL task by crafting a suitable stage cost function that is representative of the traffic conditions, variability in the control action, and violations of the constraint on the maximum number of vehicles in queue. An MPC-based RL approach, which leverages the MPC optimal problem as a function approximation for the RL algorithm, is proposed to learn to efficiently control an on-ramp and satisfy its constraints despite uncertainties in the system model and variable demands. Simulations are performed on a benchmark small-scale highway network to compare the proposed methodology against other state-of-the-art control approaches. Results show that, starting from an MPC controller that has an imprecise model and is poorly tuned, the proposed methodology is able to effectively learn to improve the control policy such that congestion in the network is reduced and constraints are satisfied, yielding an improved performance that is superior to the other controllers.
In practice, achieving a balance between accuracy, stability, and computational efficiency in modeling contaminant dispersion in marine environments remains challenging due to complex physical dynamics and numerical constraints. To address these challenges, an enhanced cell-based model (CBM) is developed and applied to simulate pollutant transport in the ocean. The CBM discretizes the spatial domain into uniform cells, resulting in a naturally parallelizable structure, and characterizes the transport process by incorporating both water flow-driven convection and diffusion effects. Moreover, two approaches are proposed for estimating the diffusion coefficient, and their performance is compared to a first-order upwind scheme finite-difference method (FDM) solution. Finally, the CBM is comprehensively compared with both the FDM and the finite-element method (FEM) solvers under varying spatial and temporal resolutions. Simulation results show that the CBM is less affected by the Courant-Friedrichs-Lewy (CFL) conditions and demonstrates stable convergence where the FDM fails or requires stricter settings. In addition, the CBM offers a favorable trade-off between accuracy and computational efficiency under coarse configurations. These results indicate that the CBM provides a reliable foundation for dynamic modeling and integration with learning-based frameworks in marine environment simulations.
Marine litter pollution is a major environmental threat due to the widespread presence of plastics and their detrimental impact on marine life and human health. There is a need for autonomous systems with computer vision to help clean the oceans. This study compares the latest state-of-the-art You Only Look Once (YOLO) models YOLOv9 - YOLOv12 in an underwater object detection setting in terms of accuracy, computational speed, and architecture complexity. We specifically focus on the smallest versions of these architectures, due to the real-time constraints of the setting. Multiple underwater datasets are combined to obtain a wide representation of underwater conditions and marine objects. The findings provide valuable insights into selecting and optimizing object detection architectures for underwater litter detection, contributing to monitoring marine ecosystems and addressing marine pollution. This work can be used as a building ground for further improving underwater object detection systems.
Greenhouse climate control is concerned with maximizing performance in terms of crop yield and resource efficiency. One promising approach is model predictive control (MPC), which leverages a model of the system to optimize the control inputs, while enforcing physical constraints. However, prediction models for greenhouse systems are inherently inaccurate due to the complexity of the real system and the uncertainty in predicted weather profiles. For model-based control approaches such as MPC, this can degrade performance and lead to constraint violations. Existing approaches address uncertainty in the prediction model with robust or stochastic MPC methodology; however, these necessarily reduce crop yield due to conservatism and often bear higher computational loads. In contrast, learning-based control approaches, such as reinforcement learning (RL), can handle uncertainty naturally by leveraging data to improve performance. This work proposes an MPC-based RL control framework to optimize the climate control performance in the presence of prediction uncertainty. The approach employs a parametrized MPC scheme that learns directly from data, in an online fashion, the parametrization of the constraints, prediction model, and optimization cost that minimizes constraint violations and maximizes climate control performance. Simulations show that the approach can learn an MPC controller that significantly outperforms the current state-of-the-art in terms of constraint violations and efficient crop growth.
Implementing model predictive control (MPC) in practice faces many subtle but prevalent problems, including modeling errors, solver errors, and actuator faults. In essence, the real control input applied to the system always deviates from the ideal one based on a perfect controller, resulting in an imperfect controller. In this letter, we provide a general analysis to quantify the suboptimality of MPC for Lipschitz-continuous nonlinear systems due to imperfect control inputs in terms of dynamic regret. Based on a general assumption about how the imperfect controller may improve over time, sublinear regret upper bounds are established for cases where the closed-loop system under the ideal controller is Lipschitz-contractive (i.e., its Lipschitz constant is smaller than one). In addition, we also discuss how the regret scales when the closed-loop system under the oracle controller is not Lipschitz-contractive. The results provide insights into designing suitable MPC strategies, especially for learning-based MPC.