CHIME: Causal Human-In-the-Loop Model Explanations

CHIME: Causal Human-In-the-Loop Model Explanations

Biswas, Shreyan (TU Delft Electrical Engineering, Mathematics and Computer Science)

Yang, J. (mentor)
Houben, G.J.P.M. (graduation committee)

Delft University of Technology

Computer Science

2022-08-31

Explaining the behaviour of Artificial Intelligence models has become a necessity. Their opaqueness and fragility are not tolerable in high-stakes domains especially.
Although considerable progress is being made in the field of Explainable Artificial Intelligence, scholars have demonstrated limits and flaws of existing approaches: explanations requiring further interpretation, non-standardised explanatory format, and overall fragility.
In light of this fragmentation, we turn to the field of philosophy of science to understand what constitutes a good explanation, that is, a generalisation that covers both the actual outcome and, possibly multiple, counterfactual outcomes.
Inspired by this, we propose CHIME: a human-in-the-loop, post-hoc approach focused on creating such explanations by establishing the causal features in the input.
We first elicit people's cognitive abilities to understand what parts of the input the model might be attending to. Then, through Causal Discovery we uncover the underlying causal graph relating the different concepts. Finally, with such a causal structure, we compute the causal effects different concepts have on a model's outcome.
We evaluate the Fidelity, Coherence, and Accuracy of the explanations obtained with CHIME with respect to two state-of-the-art Computer Vision models trained on real-world image data sets. We found evidence that the explanations reflect the causal concepts tied to a model's prediction, both from the perspective of causal strength and accuracy.

Human Computer Interaction
Explainable AI
Causal Inference
Human in the loop

http://resolver.tudelft.nl/uuid:21e8d264-4268-483a-ab8e-094f6cbea45b

Student theses

master thesis

© 2022 Shreyan Biswas