Ever-increasing numbers of human interactions with intelligent software agents, online and offline, and their increasing ability to influence humans have prompted a surge in attention toward the concept of (online) manipulation. Several scholars have argued that manipulative influence is always hidden. But manipulation is sometimes overt, and when this is acknowledged the distinction between manipulation and other forms of social influence becomes problematic. Therefore, we need a better conceptualisation of manipulation that allows it to be overt and yet clearly distinct (...) from related concepts of social influence. I argue that manipulation is careless influence, show how this account helps to alleviate the shortcomings of the hidden influence view of manipulation, and derive implications for digital ethics. (shrink)

Generative AI enables automated, effective manipulation at scale. Despite the growing general ethical discussion around generative AI, the specific manipulation risks remain inadequately investigated. This article outlines essential inquiries encompassing conceptual, empirical, and design dimensions of manipulation, pivotal for comprehending and curbing manipulation risks. By highlighting these questions, the article underscores the necessity of an appropriate conceptualisation of manipulation to ensure the responsible development of Generative AI technologies.

Andreas Schmidt and Neil Levy have recently defended nudging against the objection that nudges fail to treat nudgees as rational agents. Schmidt rejects two theses that have been taken to support the objection: that nudges harness irrational processes in the nudgee, and that they subvert the nudgee’s rationality. Levy rejects a third thesis that may support the objection: that nudges fail to give reasons. I argue that these defences can be extrapolated from nudges to some nonconsensual neurointerventions; if Schmidt’s and (...) Levy’s defences succeed, then some nonconsensual neurointerventions neither harness irrationality, nor subvert rationality, nor fail to give reasons. This, I claim, poses a challenge both to opponents of nonconsensual neurointerventions, and to defenders of nudging. (shrink)

A series of recent papers raises worries about the manipulative potential of algorithmic transparency (to wit, making visible the factors that influence an algorithm’s output). But while the concern is apt and relevant, it is based on a fraught understanding of manipulation. Therefore, this paper draws attention to the ‘indifference view’ of manipulation, which explains better than the ‘vulnerability view’ why algorithmic transparency has manipulative potential. The paper also raises pertinent research questions for future studies of manipulation in the context (...) of algorithmic transparency. (shrink)

Eyewitness testimony is a powerful form of evidence, and this is especially true in the United States criminal legal system. At the same time, eyewitness misidentification is the greatest contributing factor to wrongful convictions proven by DNA testing. In this paper, I offer a close examination of this tension between the enormous epistemic weight that eyewitness testimony is afforded in the United States criminal legal system and the fact that there are important questions about its reliability as a source of (...) evidence. In Sections 1 and 2, I argue that lineups and interrogations often function by way of extracting testimony from an eyewitness through practices that are manipulative, deceptive, or coercive. I then show, in Section 3, that when testimony that is extracted in these ways is given an unwarranted excess of credibility, the eyewitness in question is the victim of what I call agential testimonial injustice. I conclude that since much of the testimony of eyewitnesses is both extracted and given an excess of credibility, there is a fairly widespread form of epistemic injustice being inflicted upon testifiers in the United States criminal legal system. This calls for reforms along both dimensions—lineups and interrogations should go through a witness's epistemic agency, rather than bypassing, exploiting, or undermining it, and the weight of the resulting testimony should be viewed in the broader context of its significant fallibility. (shrink)

ABSTRACTThis paper introduces the category of ‘non-deceptive manipulation that causes false beliefs’, analyzes how it narrows the traditional scope of ‘deception’, and draws moral implications.

Mobile health applications (‘health apps’) that promise the user to help her with some aspect of her health are very popular: for-profit apps such as MyFitnessPal, Fitbit, or Headspace have tens of millions of users each. For-profit health apps are designed and run as optimization systems. One would expect that these health apps aim to optimize the health of the user, but in reality they aim to optimize user engagement and, in effect, conversion. This is problematic, I argue, because digital (...) health environments that aim to optimize user engagement risk being manipulative. To develop this argument, I first provide a brief analysis of the underlying business models and the resulting designs of the digital environments provided by popular for-profit health apps. In a second step, I present a concept of manipulation that can help analyze digital environments such as health apps. In the last part of the article, I use my concept of manipulation to analyze the manipulative potential of for-profit health apps. Although for-profit health can certainly empower their users, the conditions for empowerment also largely overlap with the conditions for manipulation. As a result, we should be cautious when embracing the empowerment discourse surrounding health apps. An additional aim of this article is to contribute to the rapidly growing literature on digital choice architectures and the ethics of influencing behavior through such choice architectures. I take health apps to be a paradigmatic example of digital choice architectures that give rise to ethical questions, so my analysis of the manipulative potential of health apps can also inform the larger literature on digital choice architectures. (shrink)

In this article, we argue that rational persuasion can be a _pro tanto_ wrong and that online platforms possess features that are especially conducive to this wrong. We begin by setting out an account of rational persuasion. This consists of four jointly sufficient conditions for rational persuasion and is intended to capture the core, uncontroversial cases of such persuasion. We then discuss a series of wrong-making features which are present in methods of influence commonly thought of as _pro tanto_ wrong, (...) such as manipulation and paternalism. It is next shown that these wrong-making features are also present in a range of cases that are, by the jointly sufficient conditions already established, rational persuasion, and so some forms of rational persuasion are _pro tanto_ wrong, including in some ways that have not previously been remarked upon. Finally, we demonstrate that online settings possess a number of features that are especially conducive to wrongful rational persuasion. (shrink)

This article argues that manipulation is negligent influence. Manipulation is negligent in the sense that manipulators do not chose their method of influence because for its potential to reveal reasons to their victims. Thus, manipulation is a lack of care, or negligence, exclusively understood exclusively in terms of how one influences. That makes the proposed account superior to the most influential alternative, which analyses manipulation disjunctively as violation of several distinct types of norms. The implication is a paradigm shift in (...) understanding manipulation in terms of what manipulators intend to do toward a focus on what they fail to do or intend. (shrink)

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user-friendly design, micro-targeting, default-settings, gamification, and real-time profiling. The authors in this (...) volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? • Does online manipulation threaten autonomy, freedom, and meaning in life, and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? The Philosophy of Online Manipulation brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. It will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation. (shrink)

Nudging works through dispositions to decide with specific heuristics, and has three component parts. A nudge is a feature of an environment that enables such a disposition; a person is nudged when such a disposition is triggered; and a person performs a nudged action when such a disposition manifests in action. This analysis clarifies an autonomy-based worry about nudging as used in public policy or for private profit: that a person’s ability to reason well is undermined when she is nudged. (...) Reasoning well is a component of self-guidance, which is an aspect of autonomy and so something there is reason to promote, preserve, or respect. However, a person can reason well when she is nudged: Many of these heuristics are good rules to reason with, and she can be flexible with respect to them when she takes there to be a better way to reason. Along the way, this paper uncovers several design specifications for responsible nudging, and discusses open empirical questions. However, nudging’s being compatible with reasoning well crystallizes a distinct worry about manipulation: that nudge designers can rely on nudged people guiding themselves toward the designers’ own ends. Manipulation of this sort exploits one aspect of autonomy (namely, self-guidance) to undermine autonomy in other respects. (shrink)

The permissibility of nudging in public policy is often assessed in terms of the conditions of transparency, rationality, and easy resistibility. This debate has produced important resources for any ethical inquiry into nudging, but it has also failed to focus sufficiently on a different yet very important question, namely: when do nudges undermine a patient’s voluntary consent to a medical procedure? In this paper, I take on this further question and, more precisely, I ask to which extent the three conditions (...) of transparency, rationality, and easy resistibility can be applied to the assessment of voluntary consent too. After presenting two examples, designed to put pressure on these three conditions, I show that, suitably modified, the three conditions can remain significant in the assessment of voluntary consent as well. However, the needed modifications are very substantial and result in a rather complicated view. To propose a tidier solution, I argue that nudging undermines voluntary consent if and only if it cannot be ‘interpersonally justified’ to the patient. I use the three modified conditions to motivate the idea of interpersonal justification and also to further specify the principles it involves. My resulting view is especially attractive because it builds on already existing insights from the debate on nudging, updates those insights with an eye to medical consent, and finally unites them in an elegant and simple framework. (shrink)

The paper focuses on the nature and moral status of manipulation. I analyse a popular account of manipulation by Robert Noggle and assess a challenge that has been posed by Moti Gorin. I argue that Noggle’s theory can fend off the challenge. The analysis is instructive in that it enables one to look more closely at the nature of manipulation. I argue, contrary to some proposed accounts, that manipulation essentially involves deception about the manipulator’s intentions. Secondly, since manipulation contains an (...) element of deception, it is, I maintain, prima facie immoral. Finally, I analyse and explain away several examples of allegedly morally non-problematic manipulation. (shrink)

Advances in science and technology have added to our insights into the vulnerabilities of human agency as well as to the methods of exploiting them. This has raised the stakes for efforts to clarify the concept and ethics of manipulation. Among these efforts, Robert Noggle’s influencer-centered account of manipulation has been most significant. He defines manipulative acts as those whereby an agent intentionally influences a recipient’s attitudes so that they do not conform as closely as they otherwise would to the (...) pertinent norms and ideals endorsed by the influencer. This provides a relatively simple and in many ways clear definition of manipulation. It sidesteps thorny debates about autonomy, freedom, or practical rationality. It also promises to reveal a conceptual parallel between manipulating and lying, and thus to explain why manipulation is pro tanto wrong. In one respect, however, the account remains ambiguous: It remains unclear whether, and to what extent, it requires that influencers’ beliefs about what is ideal for their recipients to be grounded in some effort on the part of the influencer to identify with or take on the role of her recipient. This paper explains this ambiguity. It argues that influencer-centrism cannot remain indifferent to the validity of an agent’s beliefs about the ideal state of the recipient and provide an identification requirement that would render the whole account plausible and sufficiently determinate. (shrink)

Journal of Philosophy of Education, EarlyView.

Many philosophical accounts of manipulation are blind to the extent to which actual people fall short of the rational ideal, while prominent accounts in political science are under-inclusive. We offer necessary and sufficient conditions – Suitable Reason and Testimonial Honesty – distinguishing manipulative from non-manipulative influence; develop a ‘hypothetical disclosure test’ to measure the degree of manipulation; and provide further criteria to assess and compare the morality of manipulation across cases. We discuss multiple examples drawn from politics and from public (...) policy with particular attention to recent debates about the ethics and politics of nudge. (shrink)

In this paper I defend a pairing of the “Epistemic Criterion” and of the “Momentousness Criterion” from a critique in Clayton and Stevens’s advocacy of the “Acceptability Requirement.” I argue that where it is valuable for people to set their own ends, they can only fully meaningfully do this in light of facts and free of misinformation. It is the duty of educators to put them in this position; it is then students' prerogative to fail to live meaningfully. While children (...) have no duty to perfect themselves, they do have a right to invent themselves, but they cannot do this is ignorance: if their life is meaningless because they chose as well as they could without being informed, then they could not truly consent to the life they undertook, and did not have a realistic chance at a meaningful life. (shrink)

Technology scholars and journalists have recently called attention to digital platforms’ and devices’ ability to influence users based on their present moods, stress level, hunger, and other transient features. For them, such influence based on users’ present status – what the chapter calls “real-time profiling” – is not only a clear form of wrongful manipulation but also online manipulation’s future. The chapter aims to explain what makes real-time profiling wrong (when wrong) and discusses problems associated with its regulation. After explaining (...) what real-time profiling consists in and showing that it can be presumed to be a form of manipulation, the chapter argues that real-time profiling is wrong both because the profiler psychologically hijacks profiled subjects and because it works as a gateway to further wrongs. Towards the end, the chapter discusses some implications of the proposed account for the legal regulation of online manipulative technologies like real-time profiling. It is argued that existing legal frameworks are not fine-grained enough to deal with the wrongs associated with real-time profiling and related forms of online manipulation. (shrink)

An important question regarding the use of neurointerventions in criminal justice systems relates to the ethics of offering neurointerventions in exchange for a sentence reduction or as a condition of parole – what has been termed the _neurocorrective offer_. In this paper, we suggest that neurocorrective offers may sometimes involve manipulative pressure. That is, in some cases these offers will involve a pressure to comply with the manipulators’ (i.e., the state’s) bidding that does not rise to the level of coercion, (...) but which cannot be considered an instance of persuasion. We then suggest that offenders may fall victim to this pressure due to general facts about human psychology and their situational vulnerability. We end the paper by identifying three reasons for thinking it prima facie morally wrong for the state to make neurocorrective offers involving manipulative pressure even if such offers do not undermine offenders’ consent to the offer. Specifically, we suggest that such offers are plausibly pro tanto harmful to some offenders and that they sometimes disrespect their autonomy and rationality. (shrink)

Gamification is the use of elements and techniques from video game design in non-game contexts. Amid the rapid growth of this practice, normative questions have been under-explored. The primary goal of this article is to develop a normatively sophisticated and descriptively rich account for appropriately addressing major ethical considerations associated with gamification. The framework suggests that practitioners and designers should be precautious about, primarily, but not limited to, whether or not their use of gamification practices: takes unfair advantage of workers (...) ; infringes any involved workers’ or customers’ autonomy ; intentionally or unintentionally harms workers and other involved parties; or has a negative effect on the moral character of involved parties. (shrink)

Why is it wrong to punish criminals who have been entrapped by the state? The paper begins by presenting some criticisms of existing answers to this question. First, they fail to put the target, or victim, of entrapment at the centre of the moral explanation. Second, they fail to account for the intuitive relation between the reasons not to entrap and the reasons not to punish. Third, they struggle to account for the existence of agent-neutral reasons not to punish entrapped (...) offenders. Lastly, they are ill-equipped to explain why entrapment seems problematic also outside the legal context. In response, the paper develops a novel account of entrapment: the Manipulation Account. According to this, entrapment always involves a particular kind of manipulation (manipulation-by-hidden-intentions) which morally taints punishment. In short, I suggest that both the initial entrapment and the subsequent punishment involve wrongful manipulation. Lastly, the paper presents some untraditional, but ultimately welcoming, implications of the account. (shrink)

Many Christian theologians believe in the existence of cases of divine hardening and divine election, where God either actively contributes to human evil or preordains it. God seems to act like a manipulator, who first covertly incites or determines people’s evil actions and then condemns those actions and punishes the wrongdoers. I raise three questions regarding such cases: (1) how can humans be responsible for wrongdoings that are determined by God via either direct involvement or predestination; (2) is God justified (...) in using covert manipulation to achieve his goals; (3) how can God judge human evil, if God predestines them or actively incites humans to commit evils? The article outlines two cases of supposed divine manipulation, discusses the general nature of manipulation and then examines each question outlined above. The argument is that the problems surrounding divine manipulation present significant challenges to especially those Christian theists that subscribe to divine determinism. (shrink)

Philosophers working on the morality of harm have paid surprisingly little attention to the problem of manipulation. The aim of this paper is to remedy this lacuna by exploring how liability to defensive harm is affected by the fact that someone posing an unjust threat has been manipulated into doing so. In addressing this problem, the challenge is to answer the following question: Why should it be the case that being misled into posing an unjust threat by manipulation makes a (...) difference to one’s liability, as compared to being misled into doing so by natural events or by someone’s honest attempt to persuade us? To answer this question, I first outline an account of manipulation and then use it to defend what I shall call the “Pre-emption Principle.”. (shrink)

We influence each other constantly and in diverse ways. At times ethically, as when we convince others via arguments founded in good reason. At times problematically, as when we coerce others to ac...