J. Zatarain Salazar
Please Note
20 records found
1
MORL4Water
A Modular Multi-Objective Reinforcement Learning Toolkit for Water Resource Management
Evolutionary Multi-Objective Direct Policy Search (EMODPS) is a prominent framework for designing control policies in multi-purpose environmental systems, combining direct policy search with multi-objective evolutionary algorithms (MOEAs) to identify Pareto approximate control policies. While EMODPS is effective, the choice of functions within its global approximator networks remains underexplored, despite their potential to significantly influence both solution quality and MOEA performance. This study conducts a rigorous assessment of a suite of Radial Basis Functions (RBFs) as candidates for these networks. We critically evaluate their ability to map system states to control actions, and assess their influence on Pareto efficient control policies. We apply this analysis to two contrasting case studies: the Conowingo Reservoir System, which balances competing water demands including hydropower, environmental flows, urban supply, power plant cooling, and recreation; and The Shallow Lake Problem, where a city navigates the trade-off between environmental and economic objectives when releasing anthropogenic phosphorus. Our findings reveal that the choice of RBF functions substantially impacts model outcomes. In complex scenarios like multi-objective reservoir control, this choice is critical, while in simpler contexts, such as the Shallow Lake Problem, the influence is less pronounced, though distinctive differences emerge in the characteristics of the prescribed control strategies.
Despite progress in multiobjective evolutionary algorithms (MOEAs) research, their efficacy in real-world scenarios remains unclear. This article introduces a diagnostic benchmarking framework to evaluate MOEAs, comprising (1) flexible MOEA construction software, (2) performance evaluation metrics and (3) real-world applications for benchmarking, reflecting diverse mathematical challenges. Utilizing this framework, NSGA-II, NSGA-III, RVEA, MOEA/D and Borg MOEA were evaluated across four applications with three to ten objectives. Collectively, the four applications capture challenges such as stochastic objectives, severe constraints, nonlinearity and complex Pareto frontiers. The study demonstrates how MOEAs that have shown strong performance on standard test problems can struggle on real-world applications. The benchmarking framework and results have value for enhancing the design and use of MOEAs in real-world applications. Further, the results highlight the need to improve the adaptability and ease-of-use of MOEAs given the often ill-defined nature of real-world problem-solving.
Integrated Assessment Models (IAMs) vary widely in complexity and underlying assumptions. There have been considerable efforts to increase the complexity of IAMs for improved representation of socioeconomic and environmental outcomes. However, less attention has been given to the foundational assumptions of these models and their distributional consequences. These assumptions are fraught with deep and normative uncertainty and can significantly impact IAM projections. If these assumptions are not explicit, IAMs can perpetuate existing mistakes and exacerbate inequalities due to their black-box nature. This paper introduces a novel IAM called JUSTICE (Justice Universality Spatial Temporal Integrated Climate Economy) to explore the influence on distributive justice outcomes due to underlying modelling assumptions across model components and functions: the economy and climate components, and the damage and social welfare functions. JUSTICE is a simple IAM inspired by the long-established RICE and is designed to be a surrogate for more complex IAMs for eliciting normative insights. As illustrated in Figure 1, JUSTICE contains two distinct economic and climate sub-models, three damage functions, and four social welfare functions (SWFs), each based on fundamentally different assumptions. This modular structure enables JUSTICE to uncover assumptions with nontrivial normative and distributional consequences. Also, the simplicity of JUSTICE makes it suitable for assessing the consequences of these modelling assumptions under deep and normative uncertainty using MS-MORDM and EMODPS frameworks, promoting a more equitable approach to decision-making. Using JUSTICE, we investigate the effects of three SWFs—Utilitarianism, Egalitarianism, and Prioritarianism—on global temperature rise, with two levels of aggregation. We also explore the sensitivity of distributional outcomes for two different climate models. Our findings reveal that different assumptions lead to significantly distinct optimal abatement pathways, underscoring the importance of explicating assumptions and exploring their uncertainties to facilitate deliberation and identify common ground among policymakers with diverse perspectives.
In this study, we operationalized theoretical justice theories in terms of moral principles into functions and parameters for use with traditional water resources optimization models and frameworks. These moral principles include Utilitarianism (which evaluates measures according to their effect on welfare), Sufficientarianism (which makes sure that each individual gets a sufficient threshold), Prioritarianism (which guarantees extra weight to worse-off individuals), and envy-freeness (which requires that each individual prefers his share to the share of others).
The result of the study as applied in the case study of the Susquehanna basin, USA, displays undertanding and outlooks of various perspectives of fairness on integrated water resources management among competing stakeholders and needs. Such perspectives are presented together with traditional resource efficiency and/or conservation oriented optimization techniques and methods to highlight synergy and trade-offs in integrated water resources management. We think that the methods and approaches presented here will advance the scientific discussion on the operationalization of justice/equity/fairness in real-world modeling and management of integrated water resources. ...
In this study, we operationalized theoretical justice theories in terms of moral principles into functions and parameters for use with traditional water resources optimization models and frameworks. These moral principles include Utilitarianism (which evaluates measures according to their effect on welfare), Sufficientarianism (which makes sure that each individual gets a sufficient threshold), Prioritarianism (which guarantees extra weight to worse-off individuals), and envy-freeness (which requires that each individual prefers his share to the share of others).
The result of the study as applied in the case study of the Susquehanna basin, USA, displays undertanding and outlooks of various perspectives of fairness on integrated water resources management among competing stakeholders and needs. Such perspectives are presented together with traditional resource efficiency and/or conservation oriented optimization techniques and methods to highlight synergy and trade-offs in integrated water resources management. We think that the methods and approaches presented here will advance the scientific discussion on the operationalization of justice/equity/fairness in real-world modeling and management of integrated water resources.