The increasing penetration of Electric Vehicles (EVs) and renewable energy sources is placing significant stress on existing power grid infrastructure. This work investigates the application of vehicle-to-grid (V2G)-enabled smart charging in workplace environments from the perspective of EV aggregators, using real-world charging data from Dutch business parking lots. To address the limitations of conventional deep Reinforcement Learning (RL) methods in enforcing operational constraints, we propose a Safe RL method using the Constrained Variational Policy Optimization (CVPO) algorithm, specifically designed to reduce constraint violations and enhance reliability. Empirical results show that CVPO outperforms classic RL baselines and rule-based policies, closely approximating the performance of an optimal offline benchmark while exhibiting strong generalization to unseen scenarios. ... Read more