“It Is a Moving Process”
Understanding the Evolution of Explainability Needs of Clinicians in Pulmonary Medicine
L. Corti (TU Delft - Web Information Systems)
Rembrandt Oltmans (Student TU Delft)
Jiwon Jung (Erasmus MC, TU Delft - DesIgning Value in Ecosystems)
A.M.A. Balayn (TU Delft - Organisation & Governance, TU Delft - Web Information Systems)
Marlies S. Wijsenbeek (Erasmus MC)
J. Yang (TU Delft - Web Information Systems)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Clinicians increasingly pay attention to Artificial Intelligence (AI) to improve the quality and timeliness of their services. There are converging opinions on the need for Explainable AI (XAI) in healthcare. However, prior work considers explanations as stationary entities with no account for the temporal dynamics of patient care. In this work, we involve 16 Idiopathic Pulmonary Fibrosis (IPF) clinicians from a European university medical centre and investigate their evolving uses and purposes for explainability throughout patient care. By applying a patient journey map for IPF, we elucidate clinicians' informational needs, how human agency and patient-specific conditions can influence the interaction with XAI systems, and the content, delivery, and relevance of explanations over time. We discuss implications for integrating XAI in clinical contexts and more broadly how explainability is defined and evaluated. Furthermore, we reflect on the role of medical education in addressing epistemic challenges related to AI literacy.
help_outline