The Role of Digital Literacy in Maintaining Autonomy in AI Decision-Support
Balancing the Burdens
S.N.R. Buijsman (TU Delft - Ethics & Philosophy of Technology)
S.E. Carter (TU Delft - Web Information Systems)
Juan Pablo Bermudez (University of Southampton)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Integrating AI systems into workflows risks undermining the competence of the people supported by them, specifically due to a loss of meta-cognitive competence. We discuss a recent suggestion to mitigate this through better uncertainty quantification. While this is certainly a step in the right direction, there is a question whether users are sufficiently supported to engage in critical reflection with literacy and tools alone. We therefore suggest that socio-technical system design focused on the role of AI systems is crucial to preserving autonomy, even when supported by uncertainty quantification.