AI, Control and Unintended Consequences

AI, Control and Unintended Consequences: The Need for Meta-Values

van de Poel, I.R. (TU Delft Ethics & Philosophy of Technology)

Fritzsche, Albrecht (editor)
Santa-María, Andrés (editor)

2023

Due to their self-learning and evolutionary character, AI (Artificial Intelligence) systems are more prone to unintended consequences and more difficult to control than traditional sociotechnical systems. To deal with this, machine ethicists have proposed to build moral (reasoning) capacities into AI systems by designing artificial moral agents. I argue that this may well lead to more, rather than less, unintended consequences and may decrease, rather than increase, human control over such systems. Instead, I suggest, we should bring AI systems under meaningful human control by formulating a number of meta-values for their evolution. Amongst others, this requires responsible experimentation with AI systems, which may neither guarantee full control nor the prevention of all undesirable consequences, but nevertheless ensures that AI systems, and their evolution, do not get out of control.

http://resolver.tudelft.nl/uuid:dad3cb07-0902-47e3-8b4c-e5db08b24c35

https://doi.org/10.1007/978-3-031-25233-4_9

Springer

2023-10-29

978-3-031-25232-7

Rethinking Technology and Engineering: Dialogues Across Disciplines and Geographies

Philosophy of Engineering and Technology, 1879-7202, 45

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Institutional Repository

book chapter

© 2023 I.R. van de Poel