Human Control and Discretion in AI-driven Decision-making in Government

Human Control and Discretion in AI-driven Decision-making in Government

Mitrou, Lilian (University of the Aegean)
Janssen, M.F.W.H.A. (TU Delft Information and Communication Technology)
Loukis, Euripidis (University of the Aegean)

Loukis, Euripidis (editor)

2021

Traditionally public decision-makers have been given discretion in many of the decisions they have to make in how to comply with legislation and policies. In this way, the context and specific circumstances can be taken into account when making decisions. This enables more acceptable solutions, but at the same time, discretion might result in treating individuals differently. With the advance of AI-based decisions, the role of the decision-makers is changing. The automation might result in fully automated decisions, humans-in-the-loop or AI might only be used as recommender systems in which humans have the discretion to deviate from the suggested decision. The predictability of and the accountability of the decisions might vary in these circumstances, although humans always remain accountable. Hence, there is a need for human-control and the decision-makers should be given sufficient authority to control the system and deal with undesired outcomes. In this direction this paper analyzes the degree of discretion and human control needed in AI-driven decision-making in government. Our analysis is based on the legal requirements set/posed to the administration, by the extensive legal frameworks that have been created for its operation, concerning the rule of law, the fairness-non-discrimination, the justifiability and accountability, and the certainty/predictability.

http://resolver.tudelft.nl/uuid:46d143ef-c86b-4a77-9f96-a8b7ac727eec

https://doi.org/10.1145/3494193.3494195

Association for Computing Machinery (ACM)

2022-07-12

978-1-4503-9011-8

Proceedings of the 14th International Conference on Theory and Practice of Electronic Governance, ICEGOV 2021

14th International Conference on Theory and Practice of Electronic Governance, ICEGOV 2021, 2021-10-06 → 2021-10-08, Virtual, Online, Greece

ACM International Conference Proceeding Series

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Institutional Repository

conference paper

© 2021 Lilian Mitrou, M.F.W.H.A. Janssen, Euripidis Loukis