This chapter defends the view that manipulated behaviour is explained by an injustice. Injustices that explain manipulated behaviour need not involve agential features such as intentionality. Therefore, technology can manipulate us, even if technological artefacts like robots, intelligent software agents, or other ‘mere tools’ lack agential features such as intentionality. The chapter thus sketches a comprehensive account of manipulated behaviour related to but distinct from existing accounts of manipulative behaviour. It then builds on that account to defend the possibility that (...) we are being manipulated by technology. (shrink)

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user-friendly design, micro-targeting, default-settings, gamification, and real-time profiling. The authors in this (...) volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? • Does online manipulation threaten autonomy, freedom, and meaning in life, and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? The Philosophy of Online Manipulation brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. It will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation. (shrink)

This article argues that manipulation is negligent influence. Manipulation is negligent in the sense that manipulators do not chose their method of influence because for its potential to reveal reasons to their victims. Thus, manipulation is a lack of care, or negligence, exclusively understood exclusively in terms of how one influences. That makes the proposed account superior to the most influential alternative, which analyses manipulation disjunctively as violation of several distinct types of norms. The implication is a paradigm shift in (...) understanding manipulation in terms of what manipulators intend to do toward a focus on what they fail to do or intend. (shrink)

The standard way to test alternative descriptive theories of moral judgment is by asking subjects to evaluate (amongst others) sacrificial dilemmas, where acting classifies as a utilitarian moral judgment and not acting classifies as a deontological moral judgment. Previous research uncovered many situational factors that alter subject’s moral judgments without affecting which type of action utilitarianism or deontology would recommend. This literature review provides a systematic analysis of the experimental literature on the influence of situational factors on moral judgments in (...) sacrificial dilemmas. It analyses 53 articles in detail and reports mean effect sizes, as well as operationalizations, for 36 situational factors that significantly influence moral judgment. Moreover, the review discusses how the impact of situational factors relates to a dual process theory of moral judgment. It supports the view that utilitarian judgments are driven by controlled cognitive processes and shows that the drivers of deontological judgments depend on valence. (shrink)

Ever-increasing numbers of human interactions with intelligent software agents, online and offline, and their increasing ability to influence humans have prompted a surge in attention toward the concept of (online) manipulation. Several scholars have argued that manipulative influence is always hidden. But manipulation is sometimes overt, and when this is acknowledged the distinction between manipulation and other forms of social influence becomes problematic. Therefore, we need a better conceptualisation of manipulation that allows it to be overt and yet clearly distinct (...) from related concepts of social influence. I argue that manipulation is careless influence, show how this account helps to alleviate the shortcomings of the hidden influence view of manipulation, and derive implications for digital ethics. (shrink)

In this paper, I introduce a “promises and perils” framework for understanding the “soft” impacts of emerging technology, and argue for a eudaimonic conception of well-being. This eudaimonic conception of well-being, however, presupposes that we have something like stable character traits. I therefore defend this view from the “situationist challenge” and show that instead of viewing this challenge as a threat to well-being, we can incorporate it into how we think about living well with technology. Human beings are susceptible to (...) situational influences and are often unaware of the ways that their social and technological environment influence not only their ability to do well, but even their ability to know whether they are doing well. Any theory that attempts to describe what it means for us to be doing well, then, needs to take these contextual features into account and bake them into a theory of human flourishing. By paying careful attention to these contextual factors, we can design systems that promote human flourishing. (shrink)

Generative AI enables automated, effective manipulation at scale. Despite the growing general ethical discussion around generative AI, the specific manipulation risks remain inadequately investigated. This article outlines essential inquiries encompassing conceptual, empirical, and design dimensions of manipulation, pivotal for comprehending and curbing manipulation risks. By highlighting these questions, the article underscores the necessity of an appropriate conceptualisation of manipulation to ensure the responsible development of Generative AI technologies.

Artificial Intelligence (AI) is increasingly adopted in society, creating numerous opportunities but at the same time posing ethical challenges. Many of these are familiar, such as issues of fairness, responsibility and privacy, but are presented in a new and challenging guise due to our limited ability to steer and predict the outputs of AI systems. This chapter first introduces these ethical challenges, stressing that overviews of values are a good starting point but frequently fail to suffice due to the context (...) sensitivity of ethical challenges. Frequently, additional (ethical) values emerge for specific applications, as e.g. challenges with fraud detection are very different from those around language technologies. Second, methods to tackle these challenges are discussed. Main ethical theories (virtue ethics, consequentialism, and deontology) are shown to provide a starting point, but often lack the details needed for actionable AI Ethics. Instead, mid-level philosophical theories coupled to design-approaches such as Design for Values, together with interdisciplinary working methods, offer the best way forwards. The chapter aims to show how these approaches can lead to an ethics of AI that is actionable and that can be proactively integrated in the design of AI systems. (shrink)

Recommender Systems (RecSys) have been around since the early days of the Internet, helping users navigate the vast ocean of information and the increasingly available options that have been available for us ever since. The range of tasks for which one could use a RecSys is expanding as the technical capabilities grow, with the disruption of Machine Learning representing a tipping point in this domain, as in many others. However, the increase of the technical capabilities of AI-powered RecSys did not (...) come with a thorough consideration of their ethical implications and, despite being a well-established technical domain, the potential impacts of RecSys on their users are still under-assessed. This paper aims at filling this gap in regards to one of the main impacts of RecSys: personal autonomy. We first describe how technology can affect human values and a suitable methodology to identify these effects and mitigate potential harms: Value Sensitive Design (VSD). We use VSD to carry out a conceptual investigation of personal autonomy in the context of a generic RecSys and draw on a nuanced account of procedural autonomy to focus on two components: competence and authenticity. We provide the results of our inquiry as a value hierarchy and apply it to the design of a speculative RecSys as an example. (shrink)

Feasting on a plethora of social media platforms, news aggregators, and online marketplaces, recommender systems (RSs) are spreading pervasively throughout our daily online activities. Over the years, a host of ethical issues have been associated with the diffusion of RSs and the tracking and monitoring of users’ data. Here, we focus on the impact RSs may have on personal autonomy as the most elusive among the often-cited sources of grievance and public outcry. On the grounds of a philosophically nuanced notion (...) of autonomy, we illustrate three specific reasons why RSs may limit or compromise it: the threat of manipulation and deception associated with RSs; the RSs’ power to reshape users’ personal identity; the impact of RSs on knowledge and critical thinking. In our view, however, notwithstanding these legitimate concerns, RSs may effectively help users to navigate an otherwise overwhelming landscape. Our perspective, therefore, is not to be intended as a bulwark to protect the _status quo_ but as an invitation to carefully weigh these aspects in the design of ethically oriented RSs. (shrink)

Much discussion of the ethics of algorithms has focused on harms to autonomy—especially harms stemming from manipulation. Nonetheless, although manipulation can often be harmful, we suggest that in certain contexts it may not impair autonomy. To fully assess the impact of algorithm design on autonomy, we argue for a need to move beyond a focus on manipulation towards a multidimensional account of autonomy itself. Drawing on the autonomy literature and recent data ethics, we propose a novel account which takes autonomy (...) to supervene on three distinct but related elements: agency, authenticity and individual control over decision-making. By distinguishing autonomy from control, the account can explain the variable effects of manipulation on user autonomy within algorithm-driven systems. In particular, it can explain why improving user control may improve autonomy in some contexts, while in other contexts—such as in some kinds of newsfeeds—certain algorithm designs that instead _reduce_ user control may nevertheless improve autonomy. As a result, the account can accommodate the sometimes convoluted interplay between control, autonomy, manipulation, and commercial versus prosocial design goals. (shrink)