Generative AI enables automated, effective manipulation at scale. Despite the growing general ethical discussion around generative AI, the specific manipulation risks remain inadequately investigated. This article outlines essential inquiries encompassing conceptual, empirical, and design dimensions of manipulation, pivotal for comprehending and curbing manipulation risks. By highlighting these questions, the article underscores the necessity of an appropriate conceptualisation of manipulation to ensure the responsible development of Generative AI technologies.

Much discussion of the ethics of algorithms has focused on harms to autonomy—especially harms stemming from manipulation. Nonetheless, although manipulation can often be harmful, we suggest that in certain contexts it may not impair autonomy. To fully assess the impact of algorithm design on autonomy, we argue for a need to move beyond a focus on manipulation towards a multidimensional account of autonomy itself. Drawing on the autonomy literature and recent data ethics, we propose a novel account which takes autonomy (...) to supervene on three distinct but related elements: agency, authenticity and individual control over decision-making. By distinguishing autonomy from control, the account can explain the variable effects of manipulation on user autonomy within algorithm-driven systems. In particular, it can explain why improving user control may improve autonomy in some contexts, while in other contexts—such as in some kinds of newsfeeds—certain algorithm designs that instead _reduce_ user control may nevertheless improve autonomy. As a result, the account can accommodate the sometimes convoluted interplay between control, autonomy, manipulation, and commercial versus prosocial design goals. (shrink)

Franke, in Philosophy & Technology, 37(1), 1–6, (2024), connects the recent debate about manipulative algorithmic transparency with the concerns about problematic pursuits of positive liberty. I argue that the indifference view of manipulative transparency is not aligned with positive liberty, contrary to Franke’s claim, and even if it is, it is not aligned with the risk that many have attributed to pursuits of positive liberty. Moreover, I suggest that Franke’s worry may generalise beyond the manipulative transparency debate to AI ethics (...) in general. (shrink)