Circular Image

R.I.J. Dobbe

info

Please Note

34 records found

A Scoping Review of AIES & FAccT Articles

Journal article (2026) - Siddharth Mehrotra, Jin Huang, Xuelong Fu, Roel Dobbe, Clara I. Sánchez, Maarten De Rijke
Background: Trustworthy AI serves as a foundational pillar for two major AI ethics conferences: AIES and FAccT. Current research often adopts techno-centric approaches, focusing primarily on technical attributes such as accuracy, reliability, robustness, and fairness, while overlooking the sociotechnical dimensions critical to understanding AI trustworthiness in real-world contexts. Objectives: This scoping review aims to examine how the AIES and FAccT communities conceptualize, measure, and validate AI trustworthiness, identifying major gaps and opportunities for advancing a holistic understanding of trustworthy AI systems. Methods: We conduct a scoping review of the AIES and FAccT conference proceedings to date, systematically analyzing how trustworthiness is defined, operationalized, and applied across different research domains. Our analysis focuses on conceptualization approaches, measurement methods, verification and validation techniques, application areas, and underlying values. Results: While significant progress has been made in defining technical attributes such as transparency, accountability, and robustness, our findings reveal critical gaps. Current research often predominantly emphasizes technical precision at the expense of social and ethical considerations. The sociotechnical nature of AI systems remains less explored and trustworthiness emerges as a contested concept shaped by those with the power to define it. Conclusions: An interdisciplinary approach combining technical rigor with social, cultural, and institutional considerations is essential for advancing trustworthy AI. We propose actionable measures for the AI ethics community to adopt holistic frameworks that genuinely address the complex interplay between AI systems and society, ultimately promoting responsible technological development that benefits all stakeholders. ...

A literature review on how algorithmic design influences energy justice in electrical distribution grids

Journal article (2026) - Eva de Winkel, Zofia Lukszo, Mark Neerincx, Roel Dobbe
Recent energy justice scholarship has argued for the need to reflect more explicitly on the normative assumptions that underpin claims to justice in energy systems. While such reflections increasingly inform energy policy, less attention has been paid to how these assumptions shape the design of algorithmic systems central to energy system planning and operations. This paper explores how normative assumptions in the design of algorithmic systems used to request flexibility from electricity consumers and producers to manage grid congestion may influence distributive justice outcomes. By systematically reviewing the scientific literature presenting such systems, we define two categories of assumptions: (1) scope assumptions , which set the boundaries of the justice analysis by determining which burdens and benefits, scale, subjects, and timeframe are considered relevant; and (2) design assumptions , which specify how these considerations are translated into the structure of algorithmic systems, such as allocation principles, technical problem framing, data availability and evaluation metrics. We find that the particular assumptions adopted within each category determine the distributive outcomes of these algorithmic systems. Recognizing their normative character, we propose that scope assumptions should be informed by context-specific risks of injustice identified by policymakers, while engineers should reflect on and validate their design assumptions in relation to these risks. ...
Journal article (2026) - Atay Kozlovski, Edina Harbinja, Roel Dobbe
Advances in generative AI have given rise to a growing industry centred on interactive representations of deceased individuals. Within this emerging “digital afterlife industry”, interactive deadbots (IDBs) are presented as hyper-realistic avatars that use a person’s likeness, voice, and personal data to simulate conversational interactions with them. Rapidly moving from a niche experiment to a mainstream phenomenon, IDBs are poised to reshape the ethical, social, legal, and governance landscapes surrounding death, mourning, and digital legacy. This paper examines the disruptive nature of IDB technology through a multidisciplinary lens, using the concept of indeterminacy as its guiding analytical framework and a novel way to conceptualise the unstable field. Rather than advancing a unified understanding of indeterminacy, we introduce a structured analytical map and provisional taxonomy that distinguishes technological, social, philosophical, legal, and regulatory manifestations of indeterminacy in IDBs. By offering a tentative and necessarily selective map of this fluid and nascent field, we explore how indeterminacy and IDBs intersect. The paper examines how IDBs amplify existing forms of indeterminacy and how indeterminacy itself shapes the development and use of these systems across five domains: technological, social, philosophical, legal, and regulatory. ...
Evolutionary therapy (ET) applies principles of evolutionary biology to steer tumour dynamics and forestall or delay treatment resistance, typically guided by data-driven mathematical models. Our aim is to assess whether ET protocols, and specifically Zhang et al.’s protocol proposed for metastatic castrate-resistant prostate cancer, can be theoretically effective for fast-growing metastatic cancers such as stage IV non-small-cell lung cancer (NSCLC). Using longitudinal tumour-burden data from NSCLC patients treated with erlotinib, we systematically evaluate 26 two-population differential-equation models based on classical tumour-growth dynamics, with varying assumptions about density- and frequency-dependent interactions, pharmacokinetics, and treatment-induced death. Previous work by Yin et al. on the same dataset employed an exponential model that omitted density- and frequency-dependent interactions; although it provided a good fit to tumour-burden data, its structure would theoretically lead to poorer outcomes under ET protocols. In contrast, our analysis identifies the minimal model structure required to reproduce the resistance-driven regrowth observed in NSCLC, with the Gompertzian model featuring log-kill dynamics and both density- and frequency-dependent interactions providing the best fit. In this model, Zhang et al.’s protocol prolonged median time-to-progression to 42.3 months compared with 24.8 months under maximum tolerated dose. These results indicate that ET is theoretically a viable treatment strategy for NSCLC. This study offers a practical framework for assessing ET feasibility using clinical data and supports future clinical translation of ET in NSCLC. ...

Evaluating disparities in grid capacity between households with and without rooftop solar

Journal article (2026) - Eva de Winkel, Flin Verdaasdonk, Zofia Lukszo, Werner van Westering, Mark Neerincx, Roel Dobbe
“Fairness-aware” algorithms are increasingly used to allocate grid capacity in electrical power systems, yet they often overlook existing disparities between household groups, such as those arising from unequal rooftop solar adoption. Through simulations on a stylized low-voltage grid using electricity data from the Netherlands, we apply demographic parity, a group fairness metric, to compare differences in grid access and costs between households with and without rooftop solar. Three objectives are analyzed: minimal intervention, proportional fairness, and min-max fairness. The results indicate that (1) “fairness-aware” allocation does not eliminate group disparities, (2) voltage violations influence the distribution of burdens and benefits, (3) lower curtailment compensation can reduce disparities between households, and (4) common fairness evaluation metrics do not capture these group disparities. This study advances the discussion on fairness in power systems computation by encouraging further research on how to avoid reinforcing existing disparities. ...
We focus on explainability as a desideratum for automated decision-making systems, rather than only models. Although the explainable artificial intelligence (XAI) paradigm offers an impressive variety of solutions to increase the transparency of automated decisions, XAI contributions rarely account for the complete systems—social and institutional environments—where models operate. Our work focuses on one such system in the domain of social welfare, which increasingly turns to automated decision-making to carry out targeted digital surveillance. Specifically, we present a case study of a black-box machine learning model previously used in a major Dutch city to support its officials in the task of detecting fraud. Employing analyses established in the field of system safety, we identify five types of hazards that could have occurred after the introduction of the model. For each of them, we reason about the potential value of XAI interventions as hazard mitigation strategies. The case study illustrates how the deployment of models may impact processes that exist far upstream and downstream from their decision logic, making explainability and/or interpretability insufficient to guarantee the systems’ safe operation. In many cases, XAI techniques may only be able to reasonably address a small fraction of hazards related to the use of algorithms; several major hazards that we identify would have still posed risks if the system had relied on an interpretable model. Thus, we empirically demonstrate that the values, which lie at the heart of XAI research, such as responsibility, safety, or transparency, ultimately necessitate a broader outlook on automated decision-making systems. ...

Sociotechnical limits of AI alignment and safety through Reinforcement Learning from Human Feedback

Journal article (2025) - Adam Dahlgren Lindström, Leila Methnani, Lea Krause, Petter Ericson, Íñigo Martínez de Rituerto de Troya, Dimitri Coelho Mollo, Roel Dobbe
This paper critically evaluates the attempts to align Artificial Intelligence (AI) systems, especially Large Language Models (LLMs), with human values and intentions through Reinforcement Learning from Feedback methods, involving either human feedback (RLHF) or AI feedback (RLAIF). Specifically, we show the shortcomings of the broadly pursued alignment goals of honesty, harmlessness, and helpfulness. Through a multidisciplinary sociotechnical critique, we examine both the theoretical underpinnings and practical implementations of RLHF techniques, revealing significant limitations in their approach to capturing the complexities of human ethics, and contributing to AI safety. We highlight tensions inherent in the goals of RLHF, as captured in the HHH principle (helpful, harmless and honest). In addition, we discuss ethically-relevant issues that tend to be neglected in discussions about alignment and RLHF, among which the trade-offs between user-friendliness and deception, flexibility and interpretability, and system safety. We offer an alternative vision for AI safety and ethics which positions RLHF approaches within a broader context of comprehensive design across institutions, processes and technological systems, and suggest the establishment of AI safety as a sociotechnical discipline that is open to the normative and political dimensions of artificial intelligence. ...

Combining Actor Analysis and System Safety Analysis

Journal article (2025) - Wybe Segeren, Haiko van der Voort, Roel Dobbe
This paper considers the methodological challenge of mapping systemic risks and harms emerging from the use of algorithms and artificial intelligence in social welfare systems. Recent tragedies in social welfare put focus on the role of algorithmic systems in the execution of social security policies, motivating new governance and regulatory measures. While many efforts have tried to address risks at the level of the technology, individual process or organization, algorithmic risks in social welfare are inherently sociotechnical. Addressing these risks involves various actors, bringing in additional normative and political complexity. In this study, we apply two methods known for their ability to address parts of the complexity. Actor analysis is used to analyse the multi-actor aspect and associated normative dimensions, and a system safety analysis is used to map and analyze the sociotechnical nature and mechanisms of algorithmic risks. We motivate why and how these methods are combined and reflect on their synergy and challenges. The study is situated in the establishment of a Dutch algorithm watchdog, and focuses on the case of Dutch social security. As such, this study is a first of its kind to apply system safety to algorithms in the social welfare domain, and provides methodological contributions by using actor analysis to better scope and inform the multi-actor and cross-organizational nature of the safety analysis. ...

Perceptions of injustice emerging from grid congestion in the Netherlands

Journal article (2025) - Eva de Winkel, Zofia Lukszo, Mark Neerincx, Roel Dobbe
As renewable energy and electrification expand rapidly, many electrical distribution grids experience grid congestion. This situation leads to long waiting lists for parties seeking a new grid connection or aiming to expand their existing grid connection. In addition to traditional grid enforcements, distribution system operators are developing ways to manage congestion by steering electricity supply and demand. As grid congestion limits the previously abundant resource of grid capacity, the challenge of how to fairly distribute this now-scarce resource raises new questions about nondiscrimination and broader notions of justice. This study, grounded in energy justice, explores the distributive and procedural injustices people experience with increasing grid congestion. Our research focuses on The Netherlands, where more than 10,000 parties await new grid connections. Through 16 semi-structured interviews with people either affected by or involved in mitigating grid congestion, our thematic analysis reveals three key categories: (1) injustices arising from legacy policies, legislation, and social norms; (2) injustices due to unclear regulations, inconsistent policies, and policy gaps; and (3) injustices related to changing relationships between DSOs and affected parties. These findings highlight that grid congestion is fundamentally sociotechnical; while congestion is both constrained and addressed by technical factors, institutional and social factors such as legacy policies, social norms and communication, significantly influence perceptions of injustice. Our findings call for a comprehensive integration of justice principles within the institutional (e.g. regulation, policy, markets, social norms), technical (e.g. grid infrastructure, IT systems), and social (e.g. community engagement, communication) components of grid infrastructure. ...
Journal article (2025) - Nanpeng Yu, Shaorong Zhang, Ning Lu, Emily Ma, Zhaohao Ding, Di Cao, Junbo Zhao, Yuanqi Gao, Jingtao Qin, Patricia Hidalgo-Gonzalez, Roel Dobbe, Yang Liu, Anamika Dubey, Yubo Wang, John Dirkman, Haiwang Zhong
This paper reviews the burgeoning field of data-driven algorithms and their application in solving increasingly complex decision-making, optimization, and control problems within active distribution networks. By summarizing a wide array of use cases, including network reconfiguration and restoration, crew dispatch, Volt-Var control, dispatch of distributed energy resources, and optimal power flow, we underscore the versatility and potential of data-driven approaches to improve active distribution system operations. The categorization of these algorithms into four main groups-mathematical optimization, end-to-end learning, learning-assisted optimization, and physics-informed learning-provides a structured overview of the current state of research in this domain. Additionally, we delve into enhanced algorithmic strategies such as non-centralized methods, robust and stochastic methods, and online learning, which represent significant advancements in addressing the unique challenges of active distribution systems. The discussion extends to the critical role of datasets and test systems in fostering an open and collaborative research environment, essential for the validation and benchmarking of novel data-driven solutions. In conclusion, we outline the primary challenges that must be navigated to bridge the gap between theoretical research and practical implementation, alongside the opportunities that lie ahead. These insights aim to pave the way for the development of more resilient, efficient, and adaptive active distribution networks, leveraging the full spectrum of data-driven algorithmic innovations. ...

EGOV-CeDEM-ePart 2025 conference

Conference paper (2025) - Sara Hofmann, Lieselot Danneels, Roel Dobbe, Anna Sophie Novak, Peter Parycek, Gerhard Schwabe, Vera Spitzer, Jolien Ubacht
Conference paper (2025) - Íñigo De Troya, Jacqueline Kernahan, Neelke Doorn, Virginia Dignum, Roel Dobbe
A sociotechnical systems lens on AI is often used to bring attention to the human factors and societal impacts that are often neglected through technical abstraction. However, abstraction is also a general principle of sociotechnical systems, where functional objectives (e.g. fair hiring decisions) are operationalised into low-level implementations (e.g. fair algorithms, recourse, legal basis). The trouble with abstraction arises when critical contextual factors are erroneously neglected, leading to an impoverished representation of the problem space. De-contextualisation can render the resulting solutions problematic when they are re-contextualised back into the site of use, where misabstractions may produce safety hazards, harms, moral wrongs, and context frictions. Despite growing recognition that context matters for how sociotechnical systems operate in practice, the normative implications of abstraction are still understudied. In this paper, we propose misabstraction as an analytic framework for thinking about the perils and challenges of sociotechnical abstraction. We use the framework to analyse the requirements specification outlined in the procurement tender of a recommender system for public employment services and show how misabstractions cascade through the sociotechnical stack, producing ripple effects that implicate hidden and neglected contextual factors across multiple frames (e.g. institutional, organisational, operational, and algorithmic). Misabstraction can help policymakers, system designers, critical scholars, and civil society alike to attend to the political conditions that shape design, and their implications for understanding and addressing systemic risk in sociotechnical AI systems. ...

Adjusting Goals to Manage Functional Limitations of AI Tools in Healthcare

Conference paper (2025) - Jacqueline Kernahan, Richard Bartels, Mark de Reuver, Daniel Oberski, Roel Dobbe
Artificial intelligence based tools are being developed for decision support in healthcare, however, they are frequently found to lack the required functionality to achieve the clinical goals for which they were built. This results in wasted time, money and resources for hospitals attempting to implement and operate such tools. To determine how functionality issues can be resolved prior to tool implementation, it is necessary to understand why such tools are being designed and then built. Our research focuses on clinical decision support tools with functionality issues arising from target variable invalidity. In this paper, we analyze published articles which present clinical decision support tool designs related to clinical goals. These tools use machine learning models trained on electronic health record data. We find that design decisions driven by data availability can introduce construct invalidity in clinical decision support tool designs, leading to an inability of the tool to address the clinical goal. We observe that alternative goals to the main clinical goal are used to justify continued development. We show that functional limitations of the tool related to the clinical goal can be obscured by imprecise terminology in the model’s stated functionality. Finally, we highlight the need for reconsidered approaches to dataset creation, defining success criteria, and the reporting and transparency of research outcomes as they relate to clinical goals. ...
Journal article (2025) - Kailas Shankar Honasoge, Tania L.S. Vincent, Gordon G. McNickle, Roel Dobbe, Kateřina Staňková, Joel S. Brown, Joseph Apaloo
In mathematical models of eco-evolutionary dynamics with a quantitative trait, two species with different strategies can coexist only if they are separated by a valley or peak of the adaptive landscape. A community is ecologically and evolutionarily stable if each species’ trait sits on global, equal fitness peaks, forming a saturated ESS community. However, the adaptive landscape may allow communities with fewer (undersaturated) or more (hypersaturated) species than the ESS. Non-ESS communities at ecological equilibrium exhibit invasion windows of strategies that can successfully invade. Hypersaturated communities can arise through mutual invasibility where each non-ESS species’ strategy lies in another’s invasion window. Hypersaturation in ESS communities with more than 1 species remains poorly understood. We use the G-function approach to model niche coevolution and Darwinian dynamics in a Lotka–Volterra competition model. We confirm that up to 2 species can coexist in a hypersaturated community with a single-species ESS if the strategy is scalar-valued, or 3 species if the strategy is bivariate. We conjecture that at most n·s+1 species can form a hypersaturated community, where n is the number of ESS species at the strategy’s dimension s. For a scalar-valued 2-species ESS, 4 species coexist by “straddling” the would-be ESS traits. When our model has a 5-species ESS, we can get 7 or 8, but not 9 or 10, species coexisting in the hypersaturated community. In a bivariate model with a single-species ESS, an infinite number of 3-species hypersaturated communities can exist. We offer conjectures and discuss their relevance to ecosystems that may be non-ESS due to invasive species, climate change, and human-altered landscapes. ...
Journal article (2025) - Jolien Ubacht, Manuel Pedro Rodríguez Bolívar, Panos Panagiotopoulos, Peter Parycek, Gabriela Viale Pereira, Gerhard Schwabe, Anthony Simonofski, Efthimios Tambouris, Vera Spitzer, Maurus Engbers, Simone Nicosanti, Lieselot Danneels, Roel Dobbe, Sara Hofmann, Marijn Janssen, Ida Lindgren, Euripidis Loukis, Francesco Mureddu, Anna Sophie Novak
Purpose (stating the main purposes and research question): Anthropogenic resource use contributes to pollution, violent conflict over scarce resources, loss of biodiversity, and diminished quality of life for humans. Moreover, the “safe” amount of carbon dioxide—350 parts per million—has been exceeded. The health care industry is responsible for 4–5% of total world emissions,[i] which is similar to the global food sector.[ii] Health care carbon emissions come from health care infrastructures, supply chains and health care delivery. Increasingly, health care delivery is reliant on technologies which require the use of artificial intelligence to provide supportive care, such as triage algorithms, electronic patient records, and robotics.[iii] While these technological innovations have advanced health care significantly, they also contribute to the negative effects on the environment, among others, through carbon emissions. The environmental impacts of artificial intelligence (AI) in health care—in particular—are understudied. This research seeks to fill this gap. Methods: Our team ran an exploratory search in Scopus and PubMed to identify studies that integrate environmental sustainability, artificial intelligence, and health. Results: Our research initially yielded 735 studies. 77 of these studies focused on an environmental concern of a health technology or AI-application in a health care setting, but most of the articles in this subset addressed lowering energy consumption of a specific technology, such as a sensor or monitoring technology. Conclusions: While there have been studies looking at AI in health care; sustainability in AI; and sustainability in health care, little attention has been paid to the interface between all three. [i] Karliner, J., Slotterback, S., Boyd, R., Ashby, B., & Steele, K. 2019. Health Care’s Climate Footprint: How the Health Sector Contributes to the Global Climate Crisis and Opportunities for Action Healthcare Without HarmARUP; September. [ii] Pichler, P. P., Jaccard, I. S., Weisz, U., & Weisz, H. 2019 International Comparison of Health Care Carbon Footprints, Environmental Research Letters 14, no. 6: 064004. [iii] Khaliq, Abdul, Ali Waqas, Qasim Ali Nisar, Shahbaz Haider, and Zunaina Asghar. 2022. Application of AI and robotics in hospitality sector: A resource gain and resource loss perspective. Technology in Society 68: 101807. ...
Book chapter (2024) - S.J.J. Nouws, R.I.J. Dobbe
This chapter proposes an analytical lens to comprehensively address the role of Artificial Intelligence (AI) applications in mediating arbitrary exercise of power in public administration and the citizen harms that result from such conduct. It provides a timely and urgent account to fill gaps in conventional Rule of Law thought. AI systems are socio-technical by nature and, therefore, differ from the text-driven social constructs that the legal professions dealing with Rule of Law issues concentrate on. Put to work in public administration contexts with consequential decision-making, technical artefacts can contribute to a variety of hazardous situations that provide opportunities for arbitrary conduct. A comprehensive lens to understand and address the role of technology in Rule of Law violations has largely been missing in literature. We propose to combine a socio-legal perspective on the Rule of Law with central insights from system safety—a safety engineering tradition with a strong scientific as well as real-world practice—that considers safety from a technological, systemic, and institutional perspective. The combination results in a lexicon and analytical approach that enables public organisations to identify possibilities for arbitrary conduct in public AI systems. Following on the analysis, interventions can be designed to prevent, mitigate, or correct system hazards and, thereby, protect citizens against arbitrary exercise of power. ...
This paper introduces systems theory and system safety concepts to ongoing academic debates about the safety of Machine Learning (ML) systems in the public sector. In particular, we analyze the risk factors of ML systems and their respective institutional context, which impact the ability to control such systems. We use interview data to abductively show what risk factors of such systems are present in public professionals' perceptions and what factors are expected based on systems theory but are missing. Based on the hypothesis that ML systems are best addressed with a systems theory lens, we argue that the missing factors deserve greater attention in ongoing efforts to address ML systems safety. These factors include the explication of safety goals and constraints, the inclusion of systemic factors in system design, the development of safety control structures, and the tendency of ML systems to migrate towards higher risk. Our observations support the hypothesis that ML systems can be best regarded through a systems theory lens. Therefore, we conclude that system safety concepts can be useful aids for policymakers who aim to improve ML system safety. ...

Speculative design explorations for sustainable digital futures

Conference paper (2024) - Mathijs Bodelier, Maria Luce Lupetti, Roel Dobbe, Lise Magnier
Information technologies promise to make products and services more efficient and sustainable, yet the ICT industry has a substantial ecological footprint that is only expected to grow. This calls for actions beyond improving product efficiency. To this end, we explore whether demand for data can be moderated by encouraging ‘sufficient’ usage. We combine behaviour change theories with a critical design approach and conduct a Research through Design exploration of online consumption speculating about possible directions for reducing data use. Partnering with an internet service provider, we designed and tested with end users a set of three provotypes embodying data-sufficient design directions. We reflect on the results to argue that across the entire system of stakeholders, there is insufficient awareness of the environmental impact of data technologies. Further, we conclude by highlighting that contrary to the belief that interventions aimed at reducing consumption harm user experience, our results show that moderating data intake might actually even improve it. ...

Toward Sociotechnical AI: Mapping Vulnerabilities for Machine Learning in Context (Minds and Machines, (2024), 34, 2, (12), 10.1007/s11023-024-09668-y)

Journal article (2024) - Roel Dobbe, Anouk Wolters
In this article, the following errors have been missed in the corrections stage and the same has been corrected with the correction article. Data Availability section was inadvertently published and it has been removed from the article. The reference Wolters, A. (2022). Guiding the specification of sociotechnical Machine Learning systems: Addressing vulnerabilities and challenges in Machine Learning practice (Unpublished master’s thesis). Massachusetts Institute of Technology is updated to Wolters, A. (2022). Guiding the specification of sociotechnical Machine Learning systems: Addressing vulnerabilities and challenges in Machine Learning practice (Published master’s thesis). Delft University of Technology. Missing equal contribution text and Acknowledgments were included in the original article. ...