Tree-based ensemble methods for sensitivity analysis of environmental models

A performance comparison with Sobol and Morris techniques

Journal Article (2018)
Author(s)

Marc Jaxa-Rozen (TU Delft - Policy Analysis)

Jan H. Kwakkel (TU Delft - Policy Analysis)

Research Group
Policy Analysis
Copyright
© 2018 M. Jaxa-Rozen, J.H. Kwakkel
DOI related publication
https://doi.org/10.1016/j.envsoft.2018.06.011
More Info
expand_more
Publication Year
2018
Language
English
Copyright
© 2018 M. Jaxa-Rozen, J.H. Kwakkel
Research Group
Policy Analysis
Volume number
107
Pages (from-to)
245-266
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Complex environmental models typically require global sensitivity analysis (GSA) to account for non-linearities and parametric interactions. However, variance-based GSA is highly computationally expensive. While different screening methods can estimate GSA results, these techniques typically impose restrictions on sampling methods and input types. As an alternative, this work evaluates two decision tree-based methods to approximate GSA results: random forests, and Extra-Trees. These techniques are applicable with common sampling methods, and continuous or categorical inputs. The tree-based methods are compared to reference Sobol GSA and Morris screening techniques, for three cases: an Ishigami-Homma function, a H1N1 pandemic model, and the CDICE integrated assessment model. The Extra-Trees algorithm performs favorably compared to Morris elementary effects, accurately approximating the relative importance of Sobol total effect indices. Furthermore, Extra-Trees can estimate variable interaction importances using a pairwise permutation measure. As such, this approach could offer a user-friendly option for screening in models with inputs of mixed types.

Files

Tree_based_ensemble_methods_fi... (pdf)
(pdf | 2.46 Mb)
- Embargo expired in 23-06-2020