Generative AI enables automated, effective manipulation at scale. Despite the growing general ethical discussion around generative AI, the specific manipulation risks remain inadequately investigated. This article outlines essential inquiries encompassing conceptual, empirical, and design dimensions of manipulation, pivotal for comprehending and curbing manipulation risks. By highlighting these questions, the article underscores the necessity of an appropriate conceptualisation of manipulation to ensure the responsible development of Generative AI technologies.

Franke, in Philosophy & Technology, 37(1), 1–6, (2024), connects the recent debate about manipulative algorithmic transparency with the concerns about problematic pursuits of positive liberty. I argue that the indifference view of manipulative transparency is not aligned with positive liberty, contrary to Franke’s claim, and even if it is, it is not aligned with the risk that many have attributed to pursuits of positive liberty. Moreover, I suggest that Franke’s worry may generalise beyond the manipulative transparency debate to AI ethics in general.

A series of recent papers raises worries about the manipulative potential of algorithmic transparency (to wit, making visible the factors that influence an algorithm’s output). But while the concern is apt and relevant, it is based on a fraught understanding of manipulation. Therefore, this paper draws attention to the ‘indifference view’ of manipulation, which explains better than the ‘vulnerability view’ why algorithmic transparency has manipulative potential. The paper also raises pertinent research questions for future studies of manipulation in the context of algorithmic transparency.

This chapter provides a theoretical lens on conceptual disruption. It offers a typology of conceptual disruption, discusses its relation to conceptual engineering, and sketches a programmatic view of the implications of conceptual disruption for the ethics of technology. We begin by distinguishing between three different kinds of conceptual disruptions: conceptual gaps, conceptual overlaps, and conceptual misalignments. Subsequently, we distinguish between different mechanisms of conceptual disruption, and two modes of conceptual change. We point out that disruptions may be induced by technology, but can also be triggered by intercultural exchanges. Conceptual disruptions frequently yield conceptual uncertainty and may call for conceptual and ethical inquiry. We argue that a useful approach to address conceptual disruptions is to engage in conceptual engineering. We outline what conceptual engineering involves and argue that discussions on conceptual disruption and conceptual engineering can benefit from closer integration. In closing, we discuss the relevance of studying conceptual disruption for technology ethics, and point to the promise of this line of research to innovate practical philosophy at large.

We examine whether Thomsonian constitutivism, a metaethical view that analyses value in terms of ‘goodness-fixing kinds,’ i.e. kinds that themselves set the standards for being a good instance of the respective kind, offers a satisfactory explanation of value change and disagreement. While value disagreement has long been considered an important explanandum, we introduce value change as a closely related but distinct phenomenon of metaethical interest. We argue that constitutivism fails to explain both phenomena because of its commitment to goodness-fixing kinds. Constitutivism explains away disagreement and at best explains the emergence of new values, not genuine change. Therefore, Thomsonian constitutivism is not a good fix for realist problems with explaining value disagreement, and value change.

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user friendly design, microtargeting, default settings, gamification, and real time profiling. The authors in this volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? •Does online manipulation threaten autonomy, freedom, and meaning in life and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? This volume brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. The Philosophy of Online Manipulation will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation.

This chapter defends the view that manipulated behaviour is explained by an injustice. Injustices that explain manipulated behaviour need not involve agential features such as intentionality. Therefore, technology can manipulate us, even if technological artefacts like robots, intelligent software agents, or other ‘mere tools’ lack agential features such as intentionality. The chapter thus sketches a comprehensive account of manipulated behaviour related to but distinct from existing accounts of manipulative behaviour. It then builds on that account to defend the possibility that we are being manipulated by technology.

In the last few decades, several philosophers have written on the topic of moral revolutions, distinguishing them from other kinds of society-level moral change. This article surveys recent accounts of moral revolutions in moral philosophy. Different authors use quite different criteria to pick out moral revolutions. Features treated as relevant include radicality, depth or fundamentality, pervasiveness, novelty and particular causes. We also characterize the factors that have been proposed to cause moral revolutions, including anomalies in existing moral codes, changing honour codes, art, economic conditions and individuals or groups. Finally, we discuss what accounts of moral revolutions have in common, how they differ and how moral revolutions are distinguished from other kinds of moral change, such as drift and reform.

This chapter provides an overview of the key debates and concepts relevant to online manipulation. First, it introduces and critically discusses three preliminary methodological questions concerning the method used to study manipulation (online), the normative charge of the concept, and the level and type of intentionality required to manipulate. Second, it critically discusses the most prominent philosophical approaches to the study of manipulation, distinguishing process-, outcome- and norm-based views of manipulation. Third, it introduces the notion of an “aggravating factor”, which is a factor that can make online manipulation more effective, its effects worse or morally wrong, or makes it harder for individuals to avoid or contest manipulative practices and technologies. Under this header, we will discuss personalization, opacity, flow, lack of user control, and an organization’s moral compass.

This chapter introduces the themes and questions addressed in this volume on the philosophy of online manipulation. It lays out the reasons for considering that online manipulation is an intellectually interesting and practically problematic phenomenon and raises the questions of whether online manipulation differs from other types of manipulation. It then introduces briefly the 19 chapters in the volume.

The power of technology to transform religions, science, and political institutions has often been presented as nothing short of revolutionary. Does technology have a similarly transformative influence on societies’ morality? Scholars have not rigorously investigated the role of technology in moral revolutions, even though existing research on technomoral change suggests that this role may be considerable. In this paper, we explore what the role of technology in moral revolutions, understood as processes of radical group-level moral change, amounts to. We do so by investigating four historical episodes of radical moral change in which technology plays a noteworthy role. Our case-studies illustrate the plurality of mechanisms involved in technomoral revolutions, but also suggest general patterns of technomoral change, such as technology’s capacity to stabilize and destabilize moral systems, and to make morally salient phenomena visible or invisible. We find several leads to expand and refine conceptual tools for analysing moral change, specifically by crystallizing the notions of ‘technomoral niche construction’ and ‘moral payoff mechanisms’. Coming to terms with the role of technology in radical moral change, we argue, enriches our understanding of moral revolutions, and alerts us to the depths of which technology can change our societies in wanted and unwanted ways.

Several anti-debunkers have argued that evolutionary explanations of our moral beliefs fail to meet a necessary condition on undermining defeat called modal security. They conclude that evolution, therefore, does not debunk our moral beliefs. This article shows that modal security is false if knowledge is virtuous achievement. New information can undermine a given belief without providing reason to doubt that that belief is sensitive or safe. This leads to a novel conception of undermining defeat, and it shows that successful debunking of moral realism is possible.

The standard way to test alternative descriptive theories of moral judgment is by asking subjects to evaluate (amongst others) sacrificial dilemmas, where acting classifies as a utilitarian moral judgment and not acting classifies as a deontological moral judgment. Previous research uncovered many situational factors that alter subject’s moral judgments without affecting which type of action utilitarianism or deontology would recommend. This literature review provides a systematic analysis of the experimental literature on the influence of situational factors on moral judgments in sacrificial dilemmas. It analyses 53 articles in detail and reports mean effect sizes, as well as operationalizations, for 36 situational factors that significantly influence moral judgment. Moreover, the review discusses how the impact of situational factors relates to a dual process theory of moral judgment. It supports the view that utilitarian judgments are driven by controlled cognitive processes and shows that the drivers of deontological judgments depend on valence.

Most non-robust-realist metaethical theories, such as expressivism, constructivism, and non-robust forms of realism, claim to retain a sense of objectivity in ethics. A persistent issue for these theories is to identify an objective criterion for moral truth that meets their objectivist aspiration. Objectivist aspirations are often probed by confronting non-realists with abject normative positions, such as those of rational racists, which are licensed by the framework of the respective non-realist theory but nevertheless strike us a wrong. In such cases, non-realist theories face a dilemma. Either they allow that anything goes and thereby forgo their objectivist aspirations or they disallow abject normative positions. In the latter case, however, they have nothing to turn to but subjective criteria ultimately related to one’s personal outlook. This is unacceptably smug. I argue that pragmatism in the spirit of Charles S. Peirce partially solves this dilemma. True belief would withstand experience and argument were we to inquire as far as we fruitfully could on the matter. I elucidate this notion and argue that pragmatist construal of moral truth provides a substantive, objective criterion to determine the truth value of moral claims, without recourse to subjective criteria. This puts pragmatism ahead of rival non-realist theories.

Moral disagreement is often thought to be of great metaethical significance for moral realists. I explore what remains of that significance when we look at moral disagreement through the lens of a combination of two influential and independently plausible hypotheses about moral language. The Morality-As-Cooperation (MAC) hypothesis says that our capacity for and use of moral language is an adaptation to increase mutualistic cooperation. The Concepts-As-Tools (CAT) hypothesis says that we often engage in disputes about language use and that many apparent moral disagreements are linguistic disagreements in disguise. The combined MAC-CAT view that I explore suggests that we frequently engage in linguistic disputes to find optimal means for mutualistic cooperation. I show that this perspective weakens sceptical claims based on moral disagreements, that is offers a novel way for moral realists to explain the apparent genuineness of moral disagreements without the need to accept theses borrowed from non-cognitivism.

Pandemics like COVID-19 confront us with decisions about life and death that come with great uncertainty, factual as well as moral. How should policy makers deal with such uncertainty? We suggest that rather than to deliberate until they have found the right course of action, they better do moral experiments that generate relevant experiences to enable more reliable moral evaluations and rational decisions.

Ever-increasing numbers of human interactions with intelligent software agents, online and offline, and their increasing ability to influence humans have prompted a surge in attention toward the concept of (online) manipulation. Several scholars have argued that manipulative influence is always hidden. But manipulation is sometimes overt, and when this is acknowledged the distinction between manipulation and other forms of social influence becomes problematic. Therefore, we need a better conceptualisation of manipulation that allows it to be overt and yet clearly distinct from related concepts of social influence. I argue that manipulation is careless influence, show how this account helps to alleviate the shortcomings of the hidden influence view of manipulation, and derive implications for digital ethics.

We propose a fundamental challenge to the feasibility of moral progress: most extant theories of progress, we will argue, assume an unrealistic level of cognitive control people must have over their moral judgments for moral progress to occur. Moral progress depends at least in part on the possibility of individual people improving their moral cognition to eliminate the pernicious influence of various epistemically defective biases and other distorting factors. Since the degree of control people can exert over their moral cognition tends to be significantly overestimated, the prospects of moral progress face a formidable problem, the force of which has thus far been underappreciated. In the paper, we will provide both conceptual and empirical arguments for this thesis, and explain its most important implications.