The proliferation of agent-based models (ABMs) in recent decades has motivated model practitioners to improve the transparency, replicability, and trust in results derived from ABMs. The complexity of ABMs has risen in stride with advances in computing power and resources, resulting in larger models with complex interactions and learning and whose outputs are often high-dimensional and require sophisticated analytical approaches. Similarly, the increasing use of data and dynamics in ABMs has further enhanced the complexity of their outputs. In this article, we offer an overview of the state-of-the-art approaches in analyzing and reporting ABM outputs highlighting challenges and outstanding issues. In particular, we examine issues surrounding variance stability (in connection with determination of appropriate number of runs and hypothesis testing), sensitivity analysis, spatio-temporal analysis, visualization, and effective communication of all these to non-technical audiences, such as various stakeholders.@en

Often, socio-environmental agent-based models (ABMs) are driven by a host of parameters, and their outputs are similarly multidimensional or vastly high-dimensional. While this complex data and its inter-relationships may be rendered tractable, the task is far from trivial. In this paper, we study the multidimensional outcome space of the socio-environmental, land-use RHEA ABM (Risks and Hedonics in an Empirical Agent-based Land Market), specifically the inter-distances among the outcome measures, and their reducibility using several well-known dimension reduction techniques, variants of multidimensional scalings. In testing the efficacy of several reduction algorithms, we temporally characterize the model's reducibility while exposing changes in behavior across a wide parameter space that can signal sudden or gradual shifts and possible critical transitions. Our findings reveal that the ABM's signature reducibility trends exhibit idiosyncrasies and unexpected non-linearity as well as discontinuities. These non-linearities and discontinuities are indicative of both gradual and sudden shifts, signaling potential propensity to internal perturbations induced by parameter settings. Additionally, we related the outcome space via their inter-distances to the multidimensional input parameter space, effectively assessing outcome “reducibility to model controls”. This analysis reveals that the model's sensitivity to parameters is not only temporally dependent, but also can be partitioned by them, some of which suppress variability in this reduction to model controls, raising questions regarding the extent and structure of endogeneity that yields the distinct temporal trends in the relationship between inputs and outputs and their connections to outcome reducibility.@en