Electric-vehicle smart charging requires quick decision-making under uncertainty while enforcing strict electricity grid and user requirements. Mathematical optimization becomes too slow at scale, while online reinforcement learning struggles with sparse rewards and safety. This paper proposes GNN-DT, a topology-aware Decision Transformer that combines graph neural network embeddings with sequence modeling to learn charging policies from offline trajectories. The method operates over variable numbers of vehicles and chargers without retraining. Evaluated on realistic smart charging scenarios, GNN-DT achieves near-optimal performance, reaching rewards within 5 percent of an oracle solver while using up to 10× fewer training trajectories than baseline methods. It consistently outperforms online and offline reinforcement learning approaches and generalizes to unseen fleet sizes and network topologies. Inference runs in milliseconds, making the approach suitable for real-time deployment in large-scale charging systems.

Digital substations, which replace traditional analog infrastructure, are essential to power grid operation but are facing growing vulnerability to cyber attacks. Existing anomaly detection in substation communication requires labeled datasets for supervised training and fails to incorporate temporal characteristics, which cannot detect unknown persistent attacks. Setting arbitrary thresholds for outlier detection leads to high false positives and low detection rates. This paper addresses cyber security challenges related to IEC 61850 Generic Object Oriented Substation Event (GOOSE) protocol within digital substations. We propose a novel unsupervised Transformer-based Distribution Fitting Anomaly Detection (TF-DiFAD) method for time series GOOSE frames with a robust thresholding technique. Deep packet inspection is used to extract features from GOOSE frames, which are processed through the proposed TF-DiFAD model. TF-DiFAD combines the deep learning transformer model with statistical distribution fitting techniques to accurately detect anomalous GOOSE frames. Specifically, reconstruction errors are generated using a state-of-the-art transformer model. A novel model-agnostic solution is applied for setting anomaly thresholds and calculating anomaly probabilities. The Kolmogorov-Smirnov test is employed to select the best-fitting distribution for these errors. TF-DiFAD is benchmarked against other state-of-the-art models using two distinct test datasets, demonstrating superior performance. The results indicate that TF-DiFAD detects anomalies with Receiver Operating Characteristics Area Under Curve (ROC AUC) scores of 96.84% and 95.73% respectively for both datasets.

Integrating electric vehicles (EVs) into the power grid can revolutionize energy management strategies, offering both challenges and opportunities for creating a more sustainable and resilient grid. In this context, model predictive control (MPC) emerges as a powerful tool for addressing the complexities of Grid-to-Vehicle (G2V) and Vehicle-to-Grid (V2G) enabled demand response management. By leveraging advanced optimization techniques, MPC algorithms can anticipate future grid conditions and dynamically adjust EV charging and discharging schedules. However, no standard tools exist to evaluate novel energy management strategies based on MPC approaches. This work focuses on harnessing the potential of MPC in G2V and V2G applications by providing open-source algorithms that allow the maximization of EV flexibility and support demand response initiatives while mitigating the impact on EV battery health. Through extensive simulation and analysis, we demonstrate the efficacy of our approach in maximizing the benefits of G2V and V2G while assessing the impact on the longevity and reliability of EV batteries. Specifically, the proposed methods enable the optimization of EV charging and discharging schedules in real-time, taking into account fluctuating energy prices, grid constraints, and EV user preferences.

Electricity Consumption Profiles (ECPs) are crucial for operating and planning power distribution systems, especially with the increasing number of low-carbon technologies such as solar panels and electric vehicles. Traditional ECP modeling methods typically assume the availability of sufficient ECP data. However, in practice, the accessibility of ECP data is limited due to privacy issues or the absence of metering devices. Few-shot learning (FSL) has emerged as a promising solution for ECP modeling in data-scarce scenarios. Nevertheless, standard FSL methods, such as those used for images, are unsuitable for ECP modeling because (1) these methods usually assume several source domains with sufficient data and several target domains. However, in the context of ECP modeling, there may be thousands of source domains, e.g., households with a moderate amount of data, and thousands of target domains, e.g., households that ECP are required to be modeled. (2) Standard FSL methods usually involve cumbersome knowledge transfer mechanisms, such as pre-training and fine-tuning. To address these limitations, this paper proposes a novel FSL framework that integrates Transformers with Gaussian Mixture Models (GMMs) for ECP modeling. The proposed approach is fine-tuning-free, computationally efficient, and robust even with extremely limited data. Results show that our method can accurately restore the complex ECP distribution with a minimal amount of ECP data (e.g., only 1.6% of the complete domain dataset) and outperforms state-of-the-art time series modeling methods in the context of ECP modeling.

Centralized reinforcement learning-based voltage regulation in distribution networks is becoming increasingly difficult due to the growing penetration of distributed energy resources, high computational burden, repeated power flow calculations, and increasing privacy concerns. This paper proposes a physics-informed fully distributed reinforcement learning framework that enables autonomous voltage regulation using only local smart meter data. A Thevenin-equivalent-based local voltage estimation model and a hybrid correction mechanism are developed to support accurate local decision-making without synchronized global measurements or centralized power flow solvers. A lightweight coordination mechanism is further introduced to refine the actions of independently trained local agents. Case studies show that the proposed framework reduces voltage violations by approximately 80%, achieves performance close to that of power flow-based training environments, and achieves a training speedup of about 6×[jls-end-space/]. The results also indicate that the relaxation factors in the reward function and the coordination scaler are critical to voltage regulation efficiency, whereas the discount factor has a smaller impact. These findings demonstrate the practicality of the proposed framework for privacy-aware fully distributed voltage regulation.

Rapidly expanding Electric Vehicle (EV) adoption necessitates robust, large-scale charging strategies to meet global decarbonization targets. Traditional methods, such as heuristics and mathematical programming-based approaches, struggle to scale effectively and adapt to EV dispatch’s complexity, uncertainty, and variability. Reinforcement Learning (RL) offers a promising alternative due to its ability to handle complex optimization problems, process substantial real-time data, and learn continuously without explicit retraining for every scenario. This study proposes a novel end-to-end RL framework that leverages the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm, enhanced by Graph Neural Networks (GNN), to capture spatial interactions among charging nodes. A key contribution is integrating a safety layer designed to ensure grid stability, preserve EV charging requirements, and enforce power limits. The RL agent was trained and evaluated using real EV charging sessions, offering a realistic assessment of its performance. The results indicate that the proposed method can efficiently coordinate large fleets of EVs, ensuring stable power grid operation and fair distribution of charging resources.

To develop an optimal operational scheme for distribution networks capable of addressing asymmetric uncertainties associated with renewable energy and load demands, this paper presents a confidence level-based information gap decision theory (CL-IGDT) framework. Building on IGDT, the proposed framework utilizes the confidence level to capture the asymmetric characteristics of uncertainties and maximize the risk-averse capability of the solution in a probabilistic manner. To facilitate such probabilistic consideration, the imprecise Dirichlet model is employed to construct the ambiguity sets of uncertainties. Consequently, a two-stage robust optimal operation model for distribution networks using CL-IGDT is developed. An iterative method is proposed to solve the model and determine the upper and lower bounds of the objective function. Case study demonstrates that the proposed approach yields a more robust and statistically optimized solution with required accuracy compared to existing methods, contributing to a reduction in first-stage cost by 0.84%, second-stage average cost by 6.7%, and significantly increasing the reliability of the solution by 8%.

We introduce a physics-informed neural network for power flow (PINN4PF) that effectively captures the nonlinear dynamics of large-scale modern power systems. The proposed neural network (NN) architecture consists of two important advancements in the training pipeline: (A) a double-head feed-forward NN that aligns with power flow (PF), including an activation function that adjusts to the net active and reactive power injections patterns, and (B) a physics-based loss function that partially incorporates power system topology information through a novel hidden function. The effectiveness of the proposed architecture is illustrated through 4-bus, 15-bus, 290-bus, and 2224-bus test systems and is evaluated against two baselines: a linear regression model (LR) and a black-box NN (MLP). The comparison is based on (i) generalization ability, (ii) robustness, (iii) impact of training dataset size on generalization ability, (iv) accuracy in approximating derived PF quantities (specifically line current, line active power, and line reactive power), and (v) scalability. Results demonstrate that PINN4PF outperforms both baselines across all test systems by up to two orders of magnitude, not only in terms of direct criteria, e.g., generalization ability, but also in terms of derived physical quantities.

With the growing integration of Modular Multilevel Converters (MMCs) in Multi-Terminal Direct Current (MTDC) transmission systems, there is a growing need for control strategies that balance economic efficiency with robust dynamic performance. This paper presents an enhanced Optimal Power Flow (OPF)-based framework for hybrid AC-MTDC systems, incorporating a novel droop control strategy that jointly coordinates DC-voltage and AC-frequency regulation. By embedding frequency control loops into the MMCs, the method enables system-wide coordination that enhances power sharing and improves resilience under disturbances. The proposed strategy dynamically adjusts converter operating points to minimize generation costs and DC-voltage deviations, balancing economic objectives with system stability. A modified Nordic test system integrated with a four-terminal MTDC grid is used to validate the approach. Optimization is performed using Julia, while the system's dynamic performance is evaluated through electromagnetic transient simulations with the EMTP software. Case studies across multiple scenarios demonstrate that the proposed droop control achieves markedly improved frequency and voltage robustness over active power control, while incurring lower generation costs than the adaptive droop benchmark. The results highlight the ability of the proposed strategy to deliver cost-effective operation without compromising performance, offering a promising solution for the coordinated control of future hybrid AC-DC transmission networks.

Electric Vehicles (EVs) offer substantial flexibility for grid services, yet large-scale, uncoordinated charging can threaten voltage stability in distribution networks. Existing Reinforcement Learning (RL) approaches for smart charging often disregard physical grid constraints or have degraded performance for complex, large-scale tasks, limiting their scalability and real-world applicability. This paper introduces a physics-informed (PI) RL algorithm that integrates a differentiable power flow model and voltage-based reward design into the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm, enabling RL to better scale to a large number of EVs and deliver real-time voltage support while meeting EV user demands. The resulting PI-TD3 algorithm achieves faster convergence, improved sample efficiency, and reliable voltage magnitude regulation under uncertain and overloaded conditions. Benchmarks on the IEEE 34-bus and 123-bus networks show that the proposed PI-TD3 outperforms both model-free RL and optimization-based baselines in grid constraint management, user satisfaction, and economic metrics, even as the system scales to hundreds of EVs. These advances enable robust, scalable, and practical EV charging strategies that enhance grid resilience and support the operation of distribution networks.

The modular multilevel converter (MMC) uses many power electronic components in the high voltage direct current (HVDC) application. One of the major concerns in half-bridge MMC is the fault in the converter submodules. It raises the question of whether the reliability and high-quality performance of the MMC can be increased significantly as the active device controls the power flow between the AC- and DC-sides. During the SM fault within the MMC leg, the unbalance is introduced in-side the MMC converter. The unbalanced voltage within the leg of the MMC will continuously introduce an AC-current component on the DC-side of the converter. Thus, the hybrid proportional-internal (PI) control and proportional-resonant control (PR) is introduced in controlling the power flow within the internal MMC to eliminate the AC-current component and ensure pure DC-current in the internal MMC. This study investigates the internal power flow control of a three-phase rectifier MMC with symmetric and asymmetric SM fault conditions. Compared with conventional control methods, the proposed control can tolerate SM faults and eliminate the AC-current component within the converter, increasing the converter's performance. Simulation results are included and discussed to verify the proposed control.

Achieving carbon neutrality in industrial ports demands a radical transformation of current energy systems. This paper presents a model-based optimization approach for the operation of a multi-energy cluster, considering a hypothetical evolution of a multi-energy industrial cluster in the Netherlands. The aim is to establish a new system operation strategy that supports the transition towards a carbon-neutral energy system. The synthetic model of the used multi-energy cluster integrates five energy carriers - electricity, natural gas, hydrogen, ammonia, and heat - using an energy hub approach to enable sector coupling and enhance flexibility. Physics-based modeling of electrical power flows is included to ensure technical feasibility in the power system. The model minimizes total cluster's cost while ensuring reliable energy supply. The optimization is implemented in Python by using the PyPSA toolbox and mixed-integer linear programming. A full-year, hourly-resolution simulation under three weather scenarios reveals optimal system operation strategies. Numerical results highlight the benefits of multi-energy cluster operation for managing renewable variability and identify ammonia as a key flexibility provider, supporting hydrogen and electricity systems through conversion and storage. The strategy emphasizes cross-sector economic optimization, dynamic dispatch, and enhanced flexibility, offering practical insights for decarbonizing industrial ports and informing future energy investment planning.

Rising energy expenses, the shift towards renewable sources, and grid congestion considerably affect the operations of container terminals. To tackle these challenges, it is necessary to implement energy-aware integrated operational planning which considers related uncertainties. This work proposes a two-stage stochastic mixed integer programming model to optimize container terminal operations planning and demand-responsive energy management. To this end, energy consumption is shifted whenever operationally possible and economically beneficial. We solve the proposed model by developing a dedicated progressive hedging algorithm. Operations considered in this model include vessel scheduling at berths, temperature control of refrigerated containers, and allocation of handling capacity of quay cranes, yard cranes, and automated guided vehicles to serve each vessel. Various scenarios for vessel arrival times and electricity prices are explored representing the uncertainty of energy demand and supply, respectively, based on a case study of the Altenwerder container terminal in Hamburg. Our results suggest potential cost savings of 5.9 per cent on average with a single energy price based on a long-term contract and 13.2 per cent when applying varying real-time electricity prices based on wholesale market rates. These findings underscore the substantial potential of demand response strategies for (electrified) container terminal operations.

As the adoption of electric vehicles (EVs) accelerates, addressing the challenges of large-scale, city-wide optimization becomes critical in ensuring efficient use of charging infrastructure and maintaining electrical grid stability. This study introduces EV-GNN, a novel graph-based solution that addresses scalability challenges and captures uncertainties in EV behavior from a Charging Point Operator’s (CPO) perspective. We prove that EV-GNN enhances classic Reinforcement Learning (RL) algorithms’ scalability and sample efficiency by combining an end-to-end Graph Neural Network (GNN) architecture with RL and employing a branch pruning technique. We further demonstrate that the proposed architecture’s flexibility allows it to be combined with most state-of-the-art deep RL algorithms to solve a wide range of problems, including those with continuous, multi-discrete, and discrete action spaces. Extensive experimental evaluations show that EV-GNN significantly outperforms state-of-the-art RL algorithms in scalability and generalization across diverse EV charging scenarios, delivering notable improvements in both small- and large-scale problems.