Circular Image

P. Palensky

info

Please Note

315 records found

Evolving day-ahead predictions into intraday reality

Journal article (2027) - Kutay Bölat, Peter Palensky, Simon H. Tindemans
Accurate intraday forecasts are essential for power system operations, complementing day-ahead forecasts that gradually lose relevance as new information becomes available. This paper introduces a Bayesian updating mechanism that converts fully probabilistic day-ahead forecasts into intraday forecasts without retraining or re-inference. The approach conditions the Gaussian mixture output of a conditional variational autoencoder-based forecaster on observed measurements, yielding an updated distribution for the remaining horizon that preserves its probabilistic structure. This enables consistent point, quantile, and ensemble forecasts while remaining computationally efficient and suitable for real-time applications. Experiments on household electricity consumption and photovoltaic generation datasets demonstrate that the proposed method improves forecast accuracy up to 25% across likelihood-, sample-, quantile-, and point-based metrics. The largest gains occur in time steps with strong temporal correlation to observed data, and the use of pattern dictionary-based covariance structures further enhances performance. The results highlight a theoretically grounded framework for intraday forecasting in modern power systems. ...
Journal article (2027) - Ali Rajaei, Peter Palensky, Jochen L. Cremer
Network topology optimization (NTO) via busbar splitting can mitigate transmission grid congestion and reduce redispatch costs. However, solving this mixed-integer nonlinear problem for large-scale systems in near-real-time is currently intractable with existing solvers. Machine learning (ML) approaches have emerged as a promising alternative, but they have limited generalization to unseen topologies, varying operating conditions, and different systems, which limits their practical applicability. This paper formulates NTO for congestion management considering linearized AC power flow, and proposes a graph neural network (GNN)-accelerated approach. We develop a heterogeneous edge-aware message passing GNN to predict effective nodes for busbar splitting actions as candidate NTO solutions. The proposed GNN captures local flow patterns, improves generalization to unseen topology changes, and enhances transferability across systems. Case studies show up to 104 × speed-up, delivering AC-feasible solutions within one minute and a 2.3% optimality gap on the GOC 2000-bus system. These results demonstrate a significant step toward near-real-time NTO for large-scale systems with topology and cross-system generalization. ...
Electric Vehicles (EVs) offer substantial flexibility for grid services, yet large-scale, uncoordinated charging can threaten voltage stability in distribution networks. Existing Reinforcement Learning (RL) approaches for smart charging often disregard physical grid constraints or have degraded performance for complex, large-scale tasks, limiting their scalability and real-world applicability. This paper introduces a physics-informed (PI) RL algorithm that integrates a differentiable power flow model and voltage-based reward design into the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm, enabling RL to better scale to a large number of EVs and deliver real-time voltage support while meeting EV user demands. The resulting PI-TD3 algorithm achieves faster convergence, improved sample efficiency, and reliable voltage magnitude regulation under uncertain and overloaded conditions. Benchmarks on the IEEE 34-bus and 123-bus networks show that the proposed PI-TD3 outperforms both model-free RL and optimization-based baselines in grid constraint management, user satisfaction, and economic metrics, even as the system scales to hundreds of EVs. These advances enable robust, scalable, and practical EV charging strategies that enhance grid resilience and support the operation of distribution networks. ...
Journal article (2026) - Cesar Diaz-Londono, Stavros Orfanoudakis, P.P. Vergara Barrios, P. Palensky, Fredy Ruiz, Giambattista Gruosso
Integrating electric vehicles (EVs) into the power grid can revolutionize energy management strategies, offering both challenges and opportunities for creating a more sustainable and resilient grid. In this context, model predictive control (MPC) emerges as a powerful tool for addressing the complexities of Grid-to-Vehicle (G2V) and Vehicle-to-Grid (V2G) enabled demand response management. By leveraging advanced optimization techniques, MPC algorithms can anticipate future grid conditions and dynamically adjust EV charging and discharging schedules. However, no standard tools exist to evaluate novel energy management strategies based on MPC approaches. This work focuses on harnessing the potential of MPC in G2V and V2G applications by providing open-source algorithms that allow the maximization of EV flexibility and support demand response initiatives while mitigating the impact on EV battery health. Through extensive simulation and analysis, we demonstrate the efficacy of our approach in maximizing the benefits of G2V and V2G while assessing the impact on the longevity and reliability of EV batteries. Specifically, the proposed methods enable the optimization of EV charging and discharging schedules in real-time, taking into account fluctuating energy prices, grid constraints, and EV user preferences. ...
Journal article (2026) - Alfan Presekal, Ioannis Semertzis, Himanshu Goyel, Peter Palensky, Alexandru Stefanov
Cyber attacks on power grids are imminent and potentially have a severe impact, as evidenced by the cyber attacks in Ukraine in 2015, 2016, and 2022. In response to this challenge, machine learning-based Intrusion Detection Systems (IDS) have become more prevalent as a potential mitigation owing to their alignment with the latest advances in artificial intelligence. However, existing anomaly detection methods for power grid Operational Technology (OT) are often inadequate, as they primarily focus on detecting power grid physical anomalies at the later attack stages and suffer from the scarcity of available data for supervised machine learning. To address these limitations, we propose a novel semi-supervised IDS specifically for digital substations of the power system. The proposed detection method identifies the distinctive distance similarity of digital substation OT communication traffic using a Convolutional Neural Network and Chebyshev distance of packet payloads, and Kolmogorov-Smirnov of packets’ interarrival time using Fast Fourier Transform amplitude. Subsequently, these traffic features are combined into a vector and classified using a novel hybrid semi-supervised Self-Organizing Map (SOM) and Density-Based Spatial Clustering of Applications with Noise (DBSCAN). Results indicate that the proposed method can identify zero-day attacks and achieve accuracy and F1 above 95%. ...
Conference paper (2026) - S. Orfanoudakis, B. Elders, P. Palensky, P.P. Vergara Barrios
Rapidly expanding Electric Vehicle (EV) adoption necessitates robust, large-scale charging strategies to meet global decarbonization targets. Traditional methods, such as heuristics and mathematical programming-based approaches, struggle to scale effectively and adapt to EV dispatch’s complexity, uncertainty, and variability. Reinforcement Learning (RL) offers a promising alternative due to its ability to handle complex optimization problems, process substantial real-time data, and learn continuously without explicit retraining for every scenario. This study proposes a novel end-to-end RL framework that leverages the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm, enhanced by Graph Neural Networks (GNN), to capture spatial interactions among charging nodes. A key contribution is integrating a safety layer designed to ensure grid stability, preserve EV charging requirements, and enforce power limits. The RL agent was trained and evaluated using real EV charging sessions, offering a realistic assessment of its performance. The results indicate that the proposed method can efficiently coordinate large fleets of EVs, ensuring stable power grid operation and fair distribution of charging resources. ...
Digital substations, which replace traditional analog infrastructure, are essential to power grid operation but are facing growing vulnerability to cyber attacks. Existing anomaly detection in substation communication requires labeled datasets for supervised training and fails to incorporate temporal characteristics, which cannot detect unknown persistent attacks. Setting arbitrary thresholds for outlier detection leads to high false positives and low detection rates. This paper addresses cyber security challenges related to IEC 61850 Generic Object Oriented Substation Event (GOOSE) protocol within digital substations. We propose a novel unsupervised Transformer-based Distribution Fitting Anomaly Detection (TF-DiFAD) method for time series GOOSE frames with a robust thresholding technique. Deep packet inspection is used to extract features from GOOSE frames, which are processed through the proposed TF-DiFAD model. TF-DiFAD combines the deep learning transformer model with statistical distribution fitting techniques to accurately detect anomalous GOOSE frames. Specifically, reconstruction errors are generated using a state-of-the-art transformer model. A novel model-agnostic solution is applied for setting anomaly thresholds and calculating anomaly probabilities. The Kolmogorov-Smirnov test is employed to select the best-fitting distribution for these errors. TF-DiFAD is benchmarked against other state-of-the-art models using two distinct test datasets, demonstrating superior performance. The results indicate that TF-DiFAD detects anomalies with Receiver Operating Characteristics Area Under Curve (ROC AUC) scores of 96.84% and 95.73% respectively for both datasets. ...
With the growing integration of Modular Multilevel Converters (MMCs) in Multi-Terminal Direct Current (MTDC) transmission systems, there is a growing need for control strategies that balance economic efficiency with robust dynamic performance. This paper presents an enhanced Optimal Power Flow (OPF)-based framework for hybrid AC-MTDC systems, incorporating a novel droop control strategy that jointly coordinates DC-voltage and AC-frequency regulation. By embedding frequency control loops into the MMCs, the method enables system-wide coordination that enhances power sharing and improves resilience under disturbances. The proposed strategy dynamically adjusts converter operating points to minimize generation costs and DC-voltage deviations, balancing economic objectives with system stability. A modified Nordic test system integrated with a four-terminal MTDC grid is used to validate the approach. Optimization is performed using Julia, while the system's dynamic performance is evaluated through electromagnetic transient simulations with the EMTP software. Case studies across multiple scenarios demonstrate that the proposed droop control achieves markedly improved frequency and voltage robustness over active power control, while incurring lower generation costs than the adaptive droop benchmark. The results highlight the ability of the proposed strategy to deliver cost-effective operation without compromising performance, offering a promising solution for the coordinated control of future hybrid AC-DC transmission networks. ...
Conference paper (2026) - A. Presekal, V. Rajkumar, H. Goyel, N. Cibin, P. Palensky, J. Godefrooi, A. Ştefanov
The increasing digitalization of power grids has introduced cyber security vulnerabilities. One of the vulnerabilities is related to the IEC 61850 Generic Object Oriented Substation Event (GOOSE) protocol for time-critical communication between Intelligent Electronic Devices (IEDs). This protocol lacks built-in message integrity and authentication mechanisms, making it susceptible to cyber attacks, e.g., spoofing. To address these vulnerabilities, IEC 62351-6:2020 recommends the usage of a Hash-based Message Authentication Code (HMAC). However, implementing this security measure in existing brownfield digital substations is challenging due to the lack of compatible commercial devices and is economically expensive. Therefore, this research proposes and evaluates a cost-effective cyber security enhancement using commodity hardware, e.g., Raspberry Pi, to implement HMAC-based message authentication for ensuring GOOSE message integrity and authentication in brownfield digital substations with respect to stringent time requirements for the operation of protective relays. The proposed solution ensures message integrity and authentication while maintaining compliance with standard requirements. Validation is performed using real commercial IEDs in a real-time Hardware-in-the-Loop (HIL) architecture, demonstrating that the solution meets substation time requirements. This approach provides a feasible and immediate cyber security enhancement for brownfield digital substations without requiring significant infrastructure changes. ...
Journal article (2026) - Zhisheng Xiong, Bo Zeng, Peter Palensky, Pedro P. Vergara
To develop an optimal operational scheme for distribution networks capable of addressing asymmetric uncertainties associated with renewable energy and load demands, this paper presents a confidence level-based information gap decision theory (CL-IGDT) framework. Building on IGDT, the proposed framework utilizes the confidence level to capture the asymmetric characteristics of uncertainties and maximize the risk-averse capability of the solution in a probabilistic manner. To facilitate such probabilistic consideration, the imprecise Dirichlet model is employed to construct the ambiguity sets of uncertainties. Consequently, a two-stage robust optimal operation model for distribution networks using CL-IGDT is developed. An iterative method is proposed to solve the model and determine the upper and lower bounds of the objective function. Case study demonstrates that the proposed approach yields a more robust and statistically optimized solution with required accuracy compared to existing methods, contributing to a reduction in first-stage cost by 0.84%, second-stage average cost by 6.7%, and significantly increasing the reliability of the solution by 8%. ...
Journal article (2026) - Dong Liu, Sander Timmerman, Yu Xiang, Ensieh Hosseini, Peter Palensky, Pedro P. Vergara
To correct outdated and incomplete topologies in low-voltage distribution networks (LVDNs) using only voltage magnitude measurements, a data-driven approach is developed by integrating machine learning algorithms with correlation analysis. Similar to existing data-driven topology identification and correction methods, the proposed approach exploits smart meter data to infer topology information. However, unlike many conventional approaches that require repeated preprocessing, multiple data sources, or separate procedures for different topology elements, it provides a unified framework that consistently uses the same up-to-date voltage magnitude dataset across all processing stages. Specifically, switch states are identified via supervised learning, while user–feeder connections and customer phase labels are refined using a modified hierarchical clustering algorithm. To address the similarity among smart meter data induced by distributed photovoltaic (PV) systems, a time-based data selection strategy is incorporated into the correlation analysis. The feasibility and robustness of the proposed approach are validated using modified real-world LVDNs and multiple incomplete smart meter datasets collected from customers in the Netherlands. The results demonstrate that the proposed approach can effectively mitigate the impact of PV-induced similarity on phase identification and improve topology correction performance. Although the approach is designed for topology correction rather than full topology reconstruction, the corrected topology improves network observability and supports distribution system operators in load balancing and PV integration. ...
Cyber attacks targeting Intelligent Electronic Devices (IEDs) in digital substations can disrupt power system operation, causing equipment damage, instability, cascading failures, and even a blackout. Cyber–Physical Power System (CPPS) datasets are critically needed to develop novel methods for the detection and prevention of cyber attacks on digital substations. In this paper, a novel CPPS dataset is proposed for cyber security of digital substations, including real-time power system measurements, i.e., electromagnetic transient three-phase voltages and currents, communication network traffic, and virtual IED resource metrics. Various scenarios are simulated on an IEC 61850-compliant testbed consisting of Real-Time Digital Simulator (RTDS) and physical and virtual IEDs in hardware-in-the-loop configuration. The dataset contains different operating conditions and cyber attack scenarios, i.e., normal operation, single-phase-to-ground fault, network reconnaissance, resource exhaustion, and IEC 61850 Generic Object-Oriented Substation Event (GOOSE) and Sampled Values (SV) injection attacks. This work aims to provide the research community with a comprehensive and high-fidelity dataset to be used for the design and testing of novel methodologies to increase the cyber security of power grids. ...
Journal article (2026) - Weijie Xia, Gao Peng, Chenguang Wang, Peter Palensky, Eric Pauwels, Pedro P. Vergara
Electricity Consumption Profiles (ECPs) are crucial for operating and planning power distribution systems, especially with the increasing number of low-carbon technologies such as solar panels and electric vehicles. Traditional ECP modeling methods typically assume the availability of sufficient ECP data. However, in practice, the accessibility of ECP data is limited due to privacy issues or the absence of metering devices. Few-shot learning (FSL) has emerged as a promising solution for ECP modeling in data-scarce scenarios. Nevertheless, standard FSL methods, such as those used for images, are unsuitable for ECP modeling because (1) these methods usually assume several source domains with sufficient data and several target domains. However, in the context of ECP modeling, there may be thousands of source domains, e.g., households with a moderate amount of data, and thousands of target domains, e.g., households that ECP are required to be modeled. (2) Standard FSL methods usually involve cumbersome knowledge transfer mechanisms, such as pre-training and fine-tuning. To address these limitations, this paper proposes a novel FSL framework that integrates Transformers with Gaussian Mixture Models (GMMs) for ECP modeling. The proposed approach is fine-tuning-free, computationally efficient, and robust even with extremely limited data. Results show that our method can accurately restore the complex ECP distribution with a minimal amount of ECP data (e.g., only 1.6% of the complete domain dataset) and outperforms state-of-the-art time series modeling methods in the context of ECP modeling. ...
We introduce a physics-informed neural network for power flow (PINN4PF) that effectively captures the nonlinear dynamics of large-scale modern power systems. The proposed neural network (NN) architecture consists of two important advancements in the training pipeline: (A) a double-head feed-forward NN that aligns with power flow (PF), including an activation function that adjusts to the net active and reactive power injections patterns, and (B) a physics-based loss function that partially incorporates power system topology information through a novel hidden function. The effectiveness of the proposed architecture is illustrated through 4-bus, 15-bus, 290-bus, and 2224-bus test systems and is evaluated against two baselines: a linear regression model (LR) and a black-box NN (MLP). The comparison is based on (i) generalization ability, (ii) robustness, (iii) impact of training dataset size on generalization ability, (iv) accuracy in approximating derived PF quantities (specifically line current, line active power, and line reactive power), and (v) scalability. Results demonstrate that PINN4PF outperforms both baselines across all test systems by up to two orders of magnitude, not only in terms of direct criteria, e.g., generalization ability, but also in terms of derived physical quantities. ...
Journal article (2026) - Dong Liu, Juan S. Giraldo, Peter Palensky, Pedro P. Vergara
Centralized reinforcement learning-based voltage regulation in distribution networks is becoming increasingly difficult due to the growing penetration of distributed energy resources, high computational burden, repeated power flow calculations, and increasing privacy concerns. This paper proposes a physics-informed fully distributed reinforcement learning framework that enables autonomous voltage regulation using only local smart meter data. A Thevenin-equivalent-based local voltage estimation model and a hybrid correction mechanism are developed to support accurate local decision-making without synchronized global measurements or centralized power flow solvers. A lightweight coordination mechanism is further introduced to refine the actions of independently trained local agents. Case studies show that the proposed framework reduces voltage violations by approximately 80%, achieves performance close to that of power flow-based training environments, and achieves a training speedup of about 6×[jls-end-space/]. The results also indicate that the relaxation factors in the reward function and the coordination scaler are critical to voltage regulation efficiency, whereas the discount factor has a smaller impact. These findings demonstrate the practicality of the proposed framework for privacy-aware fully distributed voltage regulation. ...
Electric-vehicle smart charging requires quick decision-making under uncertainty while enforcing strict electricity grid and user requirements. Mathematical optimization becomes too slow at scale, while online reinforcement learning struggles with sparse rewards and safety. This paper proposes GNN-DT, a topology-aware Decision Transformer that combines graph neural network embeddings with sequence modeling to learn charging policies from offline trajectories. The method operates over variable numbers of vehicles and chargers without retraining. Evaluated on realistic smart charging scenarios, GNN-DT achieves near-optimal performance, reaching rewards within 5 percent of an oracle solver while using up to 10× fewer training trajectories than baseline methods. It consistently outperforms online and offline reinforcement learning approaches and generalizes to unseen fleet sizes and network topologies. Inference runs in milliseconds, making the approach suitable for real-time deployment in large-scale charging systems. ...
As the Netherlands moves toward climate neutrality by 2050, the national power system will rely heavily on variable renewable energy sources (VRES) such as offshore wind and solar photovoltaics. While previous studies have examined steady-state implications of overplanting and grid reinforcement, less attention has been given to assessing the effectiveness of flexibility resources during longer time periods. This paper presents an operational assessment of the 2050 Dutch transmission system using full-day optimal power flow simulations for typical summer and winter conditions.The synthetic model of the transmission system is developed in DIgSILENT PowerFactory and includes distributed and centralized supply, batteries, electrolyzers, and demand response mechanisms. Using the Mean-Variance Mapping Optimization (MVMO) algorithm with 15-minute resolution, system operation is optimized to minimize active power losses while respecting voltage and thermal limits. The results show that flexibility resources are essential to ensure demand coverage and reduce transmission congestion, especially during periods of high VRES generation. In winter, the centralized nature of offshore wind leads to regional overloads and higher losses, while summer benefits from decentralized PV generation and more balanced load matching. Batteries and hydrogen units show distinct operational patterns, emphasizing the importance of their strategic placement. These findings support the design of control strategies and infrastructure planning for high-VRES transmission systems. ...
Conference paper (2025) - K. Bölat, T. Alskaif, P. Palensky, S. H. Tindemans
operators are required to monitor and analyze these systems, raising the challenge of integration and management of large, spatially distributed time-series data that are both high-dimensional and affected by missing values. In this work, a probabilistic entity embedding-based clustering framework is proposed to address these problems. This method encodes each PV system’s characteristic power generation patterns and uncertainty as a probability distribution, then groups systems by their statistical distances and agglomerative clustering. Applied to a multi-year residential PV dataset, it produces concise, uncertainty-aware cluster profiles that outperform a physics-based baseline in representativeness and robustness, and support reliable missing-value imputation. A systematic hyperparameter study further offers practical guidance for balancing model performance and robustness. ...
Journal article (2025) - Dong Liu, Juan S. Giraldo, Peter Palensky, Pedro P. Vergara
With the increasing availability of smart meter (SM) data and the frequent lack of accurate network topology information, model-free power flow (PF) calculation has gained traction, often leveraging artificial neural networks (ANNs). However, training such models typically requires large volumes of SM data, raising significant privacy concerns for households in distribution networks. To address this challenge, we propose a privacy-preserving PF calculation framework that incorporates two local privacy-enhancing mechanisms: a Local Randomisation Strategy (LRS) and a Zero-Knowledge Proof (ZKP)-based data collection strategy. The LRS provides irreversible transformation of power data, ensuring strong privacy protection while preserving data utility. In parallel, the ZKP-based strategy enables secure and trustworthy voltage data collection, allowing smart meters to interact with distribution system operators without disclosing actual voltage magnitudes. To address performance degradation caused by seasonal variations in load profiles, we further integrate an incremental learning strategy into the online application. Extensive evaluations across three datasets demonstrate that the proposed framework can efficiently collect one month of SM data within one hour while maintaining most voltage magnitude estimation errors lower than 0.01 p.u. under varying measurement noise and seasonal conditions. ...
Journal article (2025) - Jasper Stoter, Xinyu Tang, Milos Cvetkovic, Peter Palensky, Henk Polinder, Çağatay Iris, Frederik Schulte
Rising energy expenses, the shift towards renewable sources, and grid congestion considerably affect the operations of container terminals. To tackle these challenges, it is necessary to implement energy-aware integrated operational planning which considers related uncertainties. This work proposes a two-stage stochastic mixed integer programming model to optimize container terminal operations planning and demand-responsive energy management. To this end, energy consumption is shifted whenever operationally possible and economically beneficial. We solve the proposed model by developing a dedicated progressive hedging algorithm. Operations considered in this model include vessel scheduling at berths, temperature control of refrigerated containers, and allocation of handling capacity of quay cranes, yard cranes, and automated guided vehicles to serve each vessel. Various scenarios for vessel arrival times and electricity prices are explored representing the uncertainty of energy demand and supply, respectively, based on a case study of the Altenwerder container terminal in Hamburg. Our results suggest potential cost savings of 5.9 per cent on average with a single energy price based on a long-term contract and 13.2 per cent when applying varying real-time electricity prices based on wholesale market rates. These findings underscore the substantial potential of demand response strategies for (electrified) container terminal operations. ...