Hard choices in artificial intelligence

Dobbe, R.I.J.; Krendl Gilbert, Thomas; Mintz, Yonatan

doi:10.1016/j.artint.2021.103555

Hard choices in artificial intelligence

Title

Hard choices in artificial intelligence

Author

Dobbe, R.I.J. (TU Delft Information and Communication Technology)
Krendl Gilbert, Thomas (University of California)
Mintz, Yonatan (University of Wisconsin-Madison)

Date

2021

Abstract

As AI systems are integrated into high stakes social domains, researchers now examine how to design and operate them in a safe and ethical manner. However, the criteria for identifying and diagnosing safety risks in complex social contexts remain unclear and contested. In this paper, we examine the vagueness in debates about the safety and ethical behavior of AI systems. We show how this vagueness cannot be resolved through mathematical formalism alone, instead requiring deliberation about the politics of development as well as the context of deployment. Drawing from a new sociotechnical lexicon, we redefine vagueness in terms of distinct design challenges at key stages in AI system development. The resulting framework of Hard Choices in Artificial Intelligence (HCAI) empowers developers by 1) identifying points of overlap between design decisions and major sociotechnical challenges; 2) motivating the creation of stakeholder feedback channels so that safety issues can be exhaustively addressed. As such, HCAI contributes to a timely debate about the status of AI development in democratic societies, arguing that deliberation should be the goal of AI Safety, not just the procedure by which it is ensured.

Subject

AI ethics
AI governance
AI regulation
AI safety
Philosophy of artificial intelligence
Sociotechnical systems

To reference this document use:

http://resolver.tudelft.nl/uuid:8434d889-0a42-4432-a9d3-aeead7cd8aff

DOI

https://doi.org/10.1016/j.artint.2021.103555

ISSN

0004-3702

Source

Artificial Intelligence, 300

Part of collection

Institutional Repository