Diagnosing and Addressing Emergent Harms in the Design Process of Public AI and Algorithmic Systems

Diagnosing and Addressing Emergent Harms in the Design Process of Public AI and Algorithmic Systems

Nouws, S.J.J. (TU Delft Information and Communication Technology)
Martinez de Rituerto de Troya, I. (TU Delft Information and Communication Technology)
Dobbe, R.I.J. (TU Delft Information and Communication Technology)
Janssen, M.F.W.H.A. (TU Delft Engineering, Systems and Services)

Cid, David Duenas (editor)

Engineering, Systems and Services

2023

Algorithmic and data-driven systems are increasingly used in the public sector to improve the efficiency of existing services or to provide new services through the newfound capacity to process vast volumes of data. Unfortunately, certain instances also have negative consequences for citizens, in the form of discriminatory outcomes, arbitrary decisions, lack of recourse, and more. These have serious impacts on citizens ranging from material to psychological harms. These harms partly emerge from choices and interactions in the design process. Existing critical and reflective frameworks for technology design do not address several aspects that are important to the design of systems in the public sector, namely protection of citizens in the face of potential algorithmic harms, the design of institutions to ensure system safety, and an understanding of how power relations affect the design, development, and deployment of these systems. The goal of this workshop is to develop these three perspectives and take the next step towards reflective design processes within public organisations. The workshop will be divided into two parts. In the first half we will elaborate the conceptual foundations of these perspectives in a series of short talks. Workshop participants will learn new ways of protecting against algorithmic harms in sociotechnical systems through understanding what institutions can support system safety, and how power relations influence the design process. In the second half, participants will get a chance to apply these lenses by analysing a real world case, and reflect on the challenges in applying conceptual frameworks to practice.

Artificial Intelligence
data science
design process
institutional design
power analysis
public sector
system safety

http://resolver.tudelft.nl/uuid:616f2ec2-20c0-475c-b7eb-1d3ba7d76580

https://doi.org/10.1145/3598469.3598557

Association for Computing Machinery (ACM)

9798400708374

Proceedings of the 24th Annual International Conference on Digital Government Research - Together in the Unstable World: Digital Government and Solidarity, DGO 2023

24th Annual International Conference on Digital Government Research - Together in the Unstable World: Digital Government and Solidarity, DGO 2023, 2023-07-11 → 2023-07-14, Gdansk, Poland

ACM International Conference Proceeding Series

Institutional Repository

conference paper

© 2023 S.J.J. Nouws, I. Martinez de Rituerto de Troya, R.I.J. Dobbe, M.F.W.H.A. Janssen